2024-03-22T07:07:04.774 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-22T07:07:04.774 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi --verbose --description upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031 -- /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/orig.config.yaml 2024-03-22T07:07:04.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-22T07:07:04.901 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031 branch: squid description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7616031' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 768f6cd6e95d0c7a626042719c230df59bdba9d3 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3446 sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 sleep_before_teardown: 0 subset: 21/32 suite: upgrade suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_768f6cd6e95d0c7a626042719c230df59bdba9d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 768f6cd6e95d0c7a626042719c230df59bdba9d3 targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcqXMhTls3FT7xL+yVpzauANSZZY/lcNSZAjz1U2bpDW8extONAzceZP03Ao8jn/35Hv62Aumdg4/tGMcdplMA= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDeaxG++idYksphzV1KC9E74pqZDFOxehKK7e1lTaMu1GMl2yeuSCKKISGejv5KZ1SbpXnP7HWhDxcnYUH791Yg= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/upgrade/cephfs/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-22_02:08:13 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-03-22T07:07:04.902 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_768f6cd6e95d0c7a626042719c230df59bdba9d3/qa; will attempt to use it 2024-03-22T07:07:04.902 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_768f6cd6e95d0c7a626042719c230df59bdba9d3/qa/tasks 2024-03-22T07:07:04.902 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-22T07:07:04.904 INFO:teuthology.task.internal:Checking packages... 2024-03-22T07:07:04.929 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'db0330b1e4e2470d52b750e251e55a522b4f7d69' 2024-03-22T07:07:04.929 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:07:04.929 INFO:teuthology.packaging:ref: None 2024-03-22T07:07:04.929 INFO:teuthology.packaging:tag: None 2024-03-22T07:07:04.929 INFO:teuthology.packaging:branch: squid 2024-03-22T07:07:04.929 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:07:04.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-03-22T07:07:05.091 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1667.gdb0330b1 2024-03-22T07:07:05.095 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-22T07:07:05.101 INFO:teuthology.task.internal:no buildpackages task found 2024-03-22T07:07:05.101 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-22T07:07:05.131 INFO:teuthology.task.internal:Saving configuration 2024-03-22T07:07:05.150 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-22T07:07:05.163 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-22T07:07:05.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-22 07:01:58.938183', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcqXMhTls3FT7xL+yVpzauANSZZY/lcNSZAjz1U2bpDW8extONAzceZP03Ao8jn/35Hv62Aumdg4/tGMcdplMA='} 2024-03-22T07:07:05.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-22 07:01:58.939817', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDeaxG++idYksphzV1KC9E74pqZDFOxehKK7e1lTaMu1GMl2yeuSCKKISGejv5KZ1SbpXnP7HWhDxcnYUH791Yg='} 2024-03-22T07:07:05.214 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-22T07:07:05.220 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-03-22T07:07:05.220 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-03-22T07:07:05.220 INFO:teuthology.run_tasks:Running task console_log... 2024-03-22T07:07:05.308 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc3c156e0d0>, signals=[15]) 2024-03-22T07:07:05.309 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-22T07:07:05.315 INFO:teuthology.task.internal:Opening connections... 2024-03-22T07:07:05.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:07:05.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:07:05.403 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-03-22T07:07:05.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:07:05.494 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-22T07:07:05.500 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-03-22T07:07:05.517 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-03-22T07:07:05.518 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-03-22T07:07:05.574 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-22T07:07:05.575 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-22T07:07:05.575 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-03-22T07:07:05.597 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-03-22T07:07:05.615 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-03-22T07:07:05.615 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-22T07:07:05.670 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-22T07:07:05.671 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-22T07:07:05.671 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-22T07:07:05.671 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-22T07:07:05.671 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-22T07:07:05.689 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-22T07:07:05.698 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-22T07:07:05.721 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-22T07:07:05.721 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-03-22T07:07:05.724 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-03-22T07:07:05.740 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-22T07:07:05.745 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-22T07:07:05.745 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-03-22T07:07:05.780 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-03-22T07:07:05.902 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-22T07:07:05.952 INFO:teuthology.run_tasks:Running task kernel... 2024-03-22T07:07:05.966 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-22T07:07:05.967 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-22T07:07:05.967 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-22T07:07:05.967 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-22T07:07:05.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:07:05.984 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-03-22T07:07:05.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:07:05.985 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-03-22T07:07:06.040 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-361.el9.x86_64 2024-03-22T07:07:06.040 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-361.el9.x86_64 2024-03-22T07:07:06.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-03-22T07:07:06.041 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-361.el9.x86_64 2024-03-22T07:07:06.042 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-361.el9.x86_64 2024-03-22T07:07:06.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-03-22T07:07:08.253 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-22T07:07:08.317 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-22T07:07:09.775 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2024-03-22T07:07:09.895 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2024-03-22T07:07:10.508 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.0 MB 00:00 2024-03-22T07:07:12.375 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-22T07:07:16.542 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.1 MB 00:00 2024-03-22T07:07:18.193 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-03-22T07:07:20.081 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-22T07:07:24.659 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 570 kB/s | 8.0 MB 00:14 2024-03-22T07:07:25.078 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-03-22T07:07:26.895 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-03-22T07:07:27.151 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-22T07:07:27.151 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-22T07:07:27.249 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:07:27.256 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:07:27.256 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-03-22T07:07:27.256 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:07:27.256 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:07:27.256 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-03-22T07:07:27.257 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:07:27.258 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 76 M 2024-03-22T07:07:27.258 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 123 M 2024-03-22T07:07:27.258 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:07:27.654 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 365 kB/s | 44 kB 00:00 2024-03-22T07:07:30.154 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 5.7 MB/s | 15 MB 00:02 2024-03-22T07:07:30.902 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-03-22T07:07:32.304 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): kernel-modules-core-5.14.0-430.el9.x86_6 5.9 MB/s | 27 MB 00:04 2024-03-22T07:07:32.362 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-03-22T07:07:34.121 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 5.1 MB/s | 33 MB 00:06 2024-03-22T07:07:34.121 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:07:34.121 INFO:teuthology.orchestra.run.smithi195.stdout:Total 11 MB/s | 76 MB 00:06 2024-03-22T07:07:34.448 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:01 2024-03-22T07:07:34.786 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:07:35.161 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:07:35.161 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:07:36.158 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:07:36.158 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:07:38.601 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:07:39.209 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-22T07:07:39.296 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-22T07:07:39.303 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-22T07:07:41.402 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-22T07:07:41.402 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-22T07:07:41.513 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-22T07:07:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 76 M 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 123 M 2024-03-22T07:07:41.523 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:07:41.740 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 287 kB/s | 44 kB 00:00 2024-03-22T07:07:42.067 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-22T07:07:42.122 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 28 MB/s | 15 MB 00:00 2024-03-22T07:07:42.198 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-22T07:07:42.756 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 29 MB/s | 33 MB 00:01 2024-03-22T07:07:43.214 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-core-5.14.0-430.el9.x86_6 19 MB/s | 27 MB 00:01 2024-03-22T07:07:43.214 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:07:43.214 INFO:teuthology.orchestra.run.smithi134.stdout:Total 45 MB/s | 76 MB 00:01 2024-03-22T07:07:43.882 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:07:44.219 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:07:44.219 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:07:45.233 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:07:45.234 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:07:46.910 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-22T07:07:47.016 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:07:47.698 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:07:48.300 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-22T07:07:48.380 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-22T07:07:51.105 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-22T07:07:51.242 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-22T07:07:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:07:56.114 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-22T07:07:56.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:00.904 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:20.922 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:20.923 INFO:teuthology.orchestra.run.smithi195.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-22T07:08:20.923 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:08:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:21.314 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:21.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-22T07:08:21.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-22T07:08:21.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:08:21.752 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:08:22.052 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-03-22T07:08:22.152 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-22T07:08:22.152 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-22T07:08:22.152 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-22T07:08:22.153 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-22T07:08:22.153 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-22T07:08:22.153 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-03-22T07:08:22.153 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-03-22T07:08:22.153 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-03-22T07:08:22.232 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-22T07:08:22.233 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-22T07:08:22.233 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-03-22T07:08:22.273 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-03-22T07:08:22.273 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-03-22T07:08:22.273 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 68.el9 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8264254 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2024-03-22T07:08:22.274 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:08:22.275 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-03-22T07:08:22.276 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-22T07:08:22.276 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 5.14.0-430.el9.x86_64 2024-03-22T07:08:22.277 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-22T07:08:22.906 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-03-22T07:08:24.344 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-22T07:08:24.364 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-03-22T07:08:24.367 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-03-22T07:08:24.381 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.GrKdECed7l 2024-03-22T07:08:24.382 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GrKdECed7l 2024-03-22T07:08:24.450 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.GrKdECed7l 2024-03-22T07:08:24.593 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.GrKdECed7l is 6KB 2024-03-22T07:08:24.642 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.GrKdECed7l 2024-03-22T07:08:24.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-03-22T07:08:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-22T07:08:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-22T07:08:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-22T07:08:24.720 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-22T07:08:24.722 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-22T07:08:24.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-03-22T07:08:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:30.425 INFO:teuthology.orchestra.run.smithi134.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-22T07:08:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:08:30.469 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:30.790 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:30.790 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-22T07:08:30.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-22T07:08:30.791 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-22T07:08:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-22T07:08:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:08:31.167 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:08:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-22T07:08:31.167 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-22T07:08:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-22T07:08:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-22T07:08:31.168 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:08:31.168 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:08:31.509 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-03-22T07:08:31.614 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-22T07:08:31.614 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-22T07:08:31.614 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-22T07:08:31.614 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-22T07:08:31.615 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-22T07:08:31.615 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-03-22T07:08:31.615 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-03-22T07:08:31.615 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-03-22T07:08:31.694 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-22T07:08:31.694 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-22T07:08:31.694 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 68.el9 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8264254 2024-03-22T07:08:31.729 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-22T07:08:31.730 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-03-22T07:08:31.731 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:08:31.731 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-03-22T07:08:31.731 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-22T07:08:31.731 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-430.el9.x86_64 2024-03-22T07:08:31.732 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-22T07:08:32.346 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-03-22T07:08:33.797 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-22T07:08:33.833 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-03-22T07:08:33.835 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-03-22T07:08:33.849 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.tz2eitv0Vc 2024-03-22T07:08:33.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tz2eitv0Vc 2024-03-22T07:08:33.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.tz2eitv0Vc 2024-03-22T07:08:34.068 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.tz2eitv0Vc is 6KB 2024-03-22T07:08:34.117 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.tz2eitv0Vc 2024-03-22T07:08:34.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-03-22T07:08:34.196 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-22T07:08:34.196 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-22T07:08:34.196 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-22T07:08:34.196 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-22T07:08:34.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-22T07:08:34.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-03-22T07:08:54.900 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-03-22T07:08:54.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-22T07:08:54.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:09:04.358 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-03-22T07:09:04.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-22T07:09:04.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:09:22.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-22T07:09:31.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-22T07:09:31.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:09:54.923 DEBUG:teuthology.orchestra.remote:timed out 2024-03-22T07:10:03.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-22T07:10:03.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:10:07.516 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-22T07:10:07.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-22T07:10:07.948 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-430.el9.x86_64"... 2024-03-22T07:10:07.948 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-03-22T07:10:07.962 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-430.el9.x86_64 2024-03-22T07:10:07.963 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-22T07:10:07.963 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-22T07:10:07.963 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-22T07:10:08.963 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-03-22T07:10:08.964 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-22T07:10:09.026 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-03-22T07:10:09.066 DEBUG:teuthology.parallel:result is None 2024-03-22T07:10:31.853 DEBUG:teuthology.orchestra.remote:timed out 2024-03-22T07:10:43.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-22T07:10:43.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:10:44.177 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-03-22T07:10:44.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-22T07:10:44.569 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-430.el9.x86_64"... 2024-03-22T07:10:44.569 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-03-22T07:10:44.585 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-430.el9.x86_64 2024-03-22T07:10:44.585 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-22T07:10:44.585 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-22T07:10:44.585 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-22T07:10:45.586 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-03-22T07:10:45.587 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-22T07:10:45.666 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-03-22T07:10:45.710 DEBUG:teuthology.parallel:result is None 2024-03-22T07:10:45.711 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-22T07:10:45.718 INFO:teuthology.task.internal:Creating test directory... 2024-03-22T07:10:45.718 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-22T07:10:45.720 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-22T07:10:45.739 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-22T07:10:45.761 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-22T07:10:45.794 INFO:teuthology.task.internal:Creating archive directory... 2024-03-22T07:10:45.795 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-22T07:10:45.797 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-22T07:10:46.045 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-22T07:10:46.052 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-22T07:10:46.052 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-22T07:10:46.054 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-22T07:10:46.092 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-22T07:10:46.095 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-22T07:10:46.106 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-22T07:10:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-22T07:10:46.111 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-22T07:10:46.120 INFO:teuthology.task.internal:Configuring sudo... 2024-03-22T07:10:46.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-22T07:10:46.150 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-22T07:10:46.183 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-22T07:10:46.191 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-22T07:10:46.192 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-22T07:10:46.219 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-22T07:10:46.239 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-22T07:10:46.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-22T07:10:46.365 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-22T07:10:46.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-22T07:10:46.488 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:10:46.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-22T07:10:46.555 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-22T07:10:46.599 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-22T07:10:46.659 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-22T07:10:46.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-22T07:10:46.787 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:10:46.787 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-22T07:10:46.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-03-22T07:10:46.859 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-03-22T07:10:46.897 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-22T07:10:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-22T07:10:47.331 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-22T07:10:47.341 INFO:teuthology.task.internal:Starting timer... 2024-03-22T07:10:47.341 INFO:teuthology.run_tasks:Running task pcp... 2024-03-22T07:10:47.383 INFO:teuthology.run_tasks:Running task selinux... 2024-03-22T07:10:47.413 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-22T07:10:47.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-03-22T07:10:47.481 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-03-22T07:10:47.483 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-03-22T07:10:47.560 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-03-22T07:10:47.562 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-22T07:10:47.562 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-03-22T07:10:47.586 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-03-22T07:10:47.586 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-03-22T07:10:47.613 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-03-22T07:10:47.613 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-03-22T07:10:47.613 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-22T07:10:47.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:10:47.654 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-22T07:10:47.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:10:47.683 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-22T07:10:47.683 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-03-22T07:10:47.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-03-22T07:10:47.765 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-22T07:10:47.775 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-22T07:10:47.790 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-22T07:10:47.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-22T07:15:00.943 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-03-22T07:15:00.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-22T07:15:00.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:15:01.038 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-03-22T07:15:01.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-22T07:15:01.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-22T07:15:01.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-22T07:15:01.204 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-22T07:15:01.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-22T07:15:01.285 INFO:teuthology.run_tasks:Running task clock... 2024-03-22T07:15:01.296 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-22T07:15:01.296 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-22T07:15:01.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-22T07:15:01.300 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-22T07:15:01.300 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-22T07:15:01.330 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-22T07:15:01.347 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-22T07:15:01.356 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-22T07:15:01.373 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-22T07:15:01.377 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-03-22T07:15:01.391 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-03-22T07:15:01.403 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-03-22T07:15:01.408 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-22T07:15:01.417 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-03-22T07:15:01.424 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-22T07:15:01.434 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-22T07:15:01.450 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-22T07:15:01.477 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-03-22T07:15:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-22T07:15:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-03-22T07:15:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.481 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.482 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.503 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-03-22T07:15:01.507 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-22T07:15:01.507 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-03-22T07:15:01.507 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.507 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.507 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.507 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:15:01.508 INFO:teuthology.run_tasks:Running task install... 2024-03-22T07:15:01.516 DEBUG:teuthology.task.install:project ceph 2024-03-22T07:15:01.517 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'db0330b1e4e2470d52b750e251e55a522b4f7d69'}} 2024-03-22T07:15:01.517 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'db0330b1e4e2470d52b750e251e55a522b4f7d69'} 2024-03-22T07:15:01.517 INFO:teuthology.task.install:Using flavor: default 2024-03-22T07:15:01.524 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-22T07:15:01.524 INFO:teuthology.task.install:extra packages: [] 2024-03-22T07:15:01.524 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'db0330b1e4e2470d52b750e251e55a522b4f7d69', 'tag': None, 'wait_for_package': False} 2024-03-22T07:15:01.525 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:15:01.525 INFO:teuthology.packaging:ref: None 2024-03-22T07:15:01.525 INFO:teuthology.packaging:tag: None 2024-03-22T07:15:01.525 INFO:teuthology.packaging:branch: quincy 2024-03-22T07:15:01.525 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:15:01.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-03-22T07:15:01.528 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'db0330b1e4e2470d52b750e251e55a522b4f7d69', 'tag': None, 'wait_for_package': False} 2024-03-22T07:15:01.528 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:15:01.528 INFO:teuthology.packaging:ref: None 2024-03-22T07:15:01.529 INFO:teuthology.packaging:tag: None 2024-03-22T07:15:01.529 INFO:teuthology.packaging:branch: quincy 2024-03-22T07:15:01.529 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:15:01.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-03-22T07:15:01.892 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/ 2024-03-22T07:15:01.892 INFO:teuthology.task.install.rpm:Package version is 17.2.7-726.g9c4e0c34 2024-03-22T07:15:01.900 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/ 2024-03-22T07:15:01.900 INFO:teuthology.task.install.rpm:Package version is 17.2.7-726.g9c4e0c34 2024-03-22T07:15:02.013 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-22T07:15:02.013 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:15:02.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-22T07:15:02.015 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-22T07:15:02.016 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:15:02.016 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-22T07:15:02.043 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-22T07:15:02.043 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:15:02.043 INFO:teuthology.packaging:ref: None 2024-03-22T07:15:02.043 INFO:teuthology.packaging:tag: None 2024-03-22T07:15:02.043 INFO:teuthology.packaging:branch: quincy 2024-03-22T07:15:02.043 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:15:02.044 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-22T07:15:02.046 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-22T07:15:02.046 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:15:02.046 INFO:teuthology.packaging:ref: None 2024-03-22T07:15:02.046 INFO:teuthology.packaging:tag: None 2024-03-22T07:15:02.046 INFO:teuthology.packaging:branch: quincy 2024-03-22T07:15:02.046 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:15:02.046 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-22T07:15:02.112 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-22T07:15:02.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-22T07:15:02.191 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-22T07:15:02.198 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-22T07:15:02.257 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-03-22T07:15:02.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-03-22T07:15:02.265 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-03-22T07:15:02.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-03-22T07:15:02.506 INFO:teuthology.orchestra.run.smithi134.stdout:74 files removed 2024-03-22T07:15:02.512 INFO:teuthology.orchestra.run.smithi195.stdout:74 files removed 2024-03-22T07:15:02.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-03-22T07:15:02.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw 2024-03-22T07:15:03.160 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 234 kB/s | 77 kB 00:00 2024-03-22T07:15:03.323 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 160 kB/s | 77 kB 00:00 2024-03-22T07:15:03.527 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 29 kB/s | 9.2 kB 00:00 2024-03-22T07:15:03.682 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2024-03-22T07:15:03.878 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 5.7 kB/s | 1.8 kB 00:00 2024-03-22T07:15:04.082 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 4.9 kB/s | 1.8 kB 00:00 2024-03-22T07:15:04.281 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-22T07:15:04.476 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 19 MB/s | 6.7 MB 00:00 2024-03-22T07:15:05.756 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-03-22T07:15:06.062 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 4.5 MB/s | 2.0 MB 00:00 2024-03-22T07:15:06.863 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-03-22T07:15:08.531 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-03-22T07:15:12.458 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.1 MB 00:00 2024-03-22T07:15:14.675 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-03-22T07:15:15.569 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 896 kB/s | 8.0 MB 00:09 2024-03-22T07:15:15.618 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-03-22T07:15:20.501 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-22T07:15:22.937 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 14 M 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-03-22T07:15:22.940 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 3.1 M 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 2.9 M 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 5.0 M 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 23 M 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 25 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 636 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 457 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 4.9 M 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-22T07:15:22.941 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 45 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 117 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 156 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 320 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 293 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 99 k 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout:Install 22 Packages 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-03-22T07:15:22.942 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:22.943 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 58 M 2024-03-22T07:15:22.943 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:15:24.136 INFO:teuthology.orchestra.run.smithi134.stdout:(1/24): ceph-radosgw-17.2.7-726.g9c4e0c34.el9.x 14 MB/s | 14 MB 00:01 2024-03-22T07:15:24.186 INFO:teuthology.orchestra.run.smithi134.stdout:(2/24): ceph-selinux-17.2.7-726.g9c4e0c34.el9.x 503 kB/s | 25 kB 00:00 2024-03-22T07:15:24.295 INFO:teuthology.orchestra.run.smithi134.stdout:(3/24): ceph-base-17.2.7-726.g9c4e0c34.el9.x86_ 4.2 MB/s | 5.0 MB 00:01 2024-03-22T07:15:24.320 INFO:teuthology.orchestra.run.smithi134.stdout:(4/24): libcephfs2-17.2.7-726.g9c4e0c34.el9.x86 4.7 MB/s | 636 kB 00:00 2024-03-22T07:15:24.362 INFO:teuthology.orchestra.run.smithi134.stdout:(5/24): libradosstriper1-17.2.7-726.g9c4e0c34.e 6.7 MB/s | 457 kB 00:00 2024-03-22T07:15:24.462 INFO:teuthology.orchestra.run.smithi134.stdout:(6/24): python3-ceph-argparse-17.2.7-726.g9c4e0 451 kB/s | 45 kB 00:00 2024-03-22T07:15:24.605 INFO:teuthology.orchestra.run.smithi134.stdout:(7/24): librgw2-17.2.7-726.g9c4e0c34.el9.x86_64 17 MB/s | 4.9 MB 00:00 2024-03-22T07:15:24.629 INFO:teuthology.orchestra.run.smithi134.stdout:(8/24): python3-ceph-common-17.2.7-726.g9c4e0c3 704 kB/s | 117 kB 00:00 2024-03-22T07:15:24.655 INFO:teuthology.orchestra.run.smithi134.stdout:(9/24): python3-cephfs-17.2.7-726.g9c4e0c34.el9 3.1 MB/s | 156 kB 00:00 2024-03-22T07:15:24.705 INFO:teuthology.orchestra.run.smithi134.stdout:(10/24): python3-rbd-17.2.7-726.g9c4e0c34.el9.x 5.7 MB/s | 293 kB 00:00 2024-03-22T07:15:24.739 INFO:teuthology.orchestra.run.smithi134.stdout:(11/24): python3-rados-17.2.7-726.g9c4e0c34.el9 2.9 MB/s | 320 kB 00:00 2024-03-22T07:15:24.764 INFO:teuthology.orchestra.run.smithi134.stdout:(12/24): python3-rgw-17.2.7-726.g9c4e0c34.el9.x 1.7 MB/s | 99 kB 00:00 2024-03-22T07:15:24.898 INFO:teuthology.orchestra.run.smithi134.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 406 kB/s | 44 kB 00:00 2024-03-22T07:15:24.923 INFO:teuthology.orchestra.run.smithi134.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 866 kB/s | 159 kB 00:00 2024-03-22T07:15:24.982 INFO:teuthology.orchestra.run.smithi134.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-03-22T07:15:25.007 INFO:teuthology.orchestra.run.smithi134.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-22T07:15:25.032 INFO:teuthology.orchestra.run.smithi134.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 821 kB/s | 41 kB 00:00 2024-03-22T07:15:25.274 INFO:teuthology.orchestra.run.smithi134.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 201 kB/s | 49 kB 00:00 2024-03-22T07:15:25.358 INFO:teuthology.orchestra.run.smithi134.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 810 kB/s | 67 kB 00:00 2024-03-22T07:15:25.383 INFO:teuthology.orchestra.run.smithi134.stdout:(20/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 821 kB/s | 309 kB 00:00 2024-03-22T07:15:25.575 INFO:teuthology.orchestra.run.smithi134.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-03-22T07:15:25.950 INFO:teuthology.orchestra.run.smithi134.stdout:(22/24): librbd1-17.2.7-726.g9c4e0c34.el9.x86_6 7.8 MB/s | 2.9 MB 00:00 2024-03-22T07:15:26.001 INFO:teuthology.orchestra.run.smithi134.stdout:(23/24): librados2-17.2.7-726.g9c4e0c34.el9.x86 5.0 MB/s | 3.1 MB 00:00 2024-03-22T07:15:26.201 INFO:teuthology.orchestra.run.smithi134.stdout:(24/24): ceph-common-17.2.7-726.g9c4e0c34.el9.x 7.3 MB/s | 23 MB 00:03 2024-03-22T07:15:26.207 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:15:26.207 INFO:teuthology.orchestra.run.smithi134.stdout:Total 18 MB/s | 58 MB 00:03 2024-03-22T07:15:26.208 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:15:26.237 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:15:26.238 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:15:26.699 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:15:26.699 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:15:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:15:28.232 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-03-22T07:15:28.286 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/26 2024-03-22T07:15:28.378 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/26 2024-03-22T07:15:28.457 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 3/26 2024-03-22T07:15:28.504 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/26 2024-03-22T07:15:28.601 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/26 2024-03-22T07:15:28.654 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-03-22T07:15:28.684 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-03-22T07:15:29.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-03-22T07:15:29.149 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 8/26 2024-03-22T07:15:29.212 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 8/26 2024-03-22T07:15:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-03-22T07:15:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:17.2.7-726.g9c4e0c34.el9.x 10/26 2024-03-22T07:15:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 11/26 2024-03-22T07:15:29.384 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 12/26 2024-03-22T07:15:29.410 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 13/26 2024-03-22T07:15:29.477 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 13/26 2024-03-22T07:15:29.515 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-03-22T07:15:29.560 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-03-22T07:15:29.593 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-03-22T07:15:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-03-22T07:15:29.923 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 18/26 2024-03-22T07:15:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 18/26 2024-03-22T07:15:30.077 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 19/26 2024-03-22T07:15:30.100 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86 20/26 2024-03-22T07:15:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 21/26 2024-03-22T07:15:32.589 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 21/26 2024-03-22T07:15:33.121 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 21/26 2024-03-22T07:15:33.159 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 22/26 2024-03-22T07:15:33.232 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 22/26 2024-03-22T07:15:33.232 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-22T07:15:33.232 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-22T07:15:33.232 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:33.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 23/26 2024-03-22T07:15:42.828 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 23/26 2024-03-22T07:15:42.828 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-03-22T07:15:42.828 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-03-22T07:15:42.828 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-03-22T07:15:42.828 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-03-22T07:15:42.829 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-03-22T07:15:42.829 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-03-22T07:15:42.829 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-03-22T07:15:42.829 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:44.123 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 24/26 2024-03-22T07:15:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 24/26 2024-03-22T07:15:44.184 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:15:44.184 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-22T07:15:44.184 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-22T07:15:44.184 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-22T07:15:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-03-22T07:15:44.267 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-03-22T07:15:44.267 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-03-22T07:15:45.432 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-03-22T07:15:45.432 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/26 2024-03-22T07:15:45.432 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 3/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 6/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 7/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:17.2.7-726.g9c4e0c34.el9.x 8/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86 9/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 10/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 11/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 12/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 13/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-03-22T07:15:45.433 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 23/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-03-22T07:15:45.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 25/26 2024-03-22T07:15:46.331 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.332 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.333 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.333 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-22T07:15:46.333 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.333 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-22T07:15:46.333 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-22T07:15:46.333 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-22T07:15:46.334 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.334 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-22T07:15:46.334 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.334 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-22T07:15:46.334 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-22T07:15:46.334 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:15:46.335 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-22T07:15:46.336 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:46.336 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:15:46.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-03-22T07:15:47.256 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:27 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:15:47.407 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:15:47.408 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 48 M 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 163 k 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-22T07:15:47.409 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 49 M 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 196 M 2024-03-22T07:15:47.410 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:15:47.842 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): libcephsqlite-17.2.7-726.g9c4e0c34.el9.x 635 kB/s | 163 kB 00:00 2024-03-22T07:15:47.951 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 594 kB/s | 217 kB 00:00 2024-03-22T07:15:48.009 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 300 kB 00:00 2024-03-22T07:15:48.036 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 748 kB/s | 63 kB 00:00 2024-03-22T07:15:48.427 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 449 kB/s | 187 kB 00:00 2024-03-22T07:15:55.673 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 494 kB/s | 19 MB 00:39 2024-03-22T07:16:00.557 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.1 MB 00:01 2024-03-22T07:16:01.884 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): ceph-test-17.2.7-726.g9c4e0c34.el9.x86_6 3.4 MB/s | 48 MB 00:14 2024-03-22T07:16:01.886 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:01.886 INFO:teuthology.orchestra.run.smithi134.stdout:Total 3.4 MB/s | 49 MB 00:14 2024-03-22T07:16:01.898 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:01.915 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:01.916 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:02.304 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:02.304 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:02.908 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:02.976 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-22T07:16:02.992 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-03-22T07:16:03.010 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-22T07:16:03.051 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-22T07:16:03.094 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-22T07:16:03.120 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/6 2024-03-22T07:16:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/6 2024-03-22T07:16:07.593 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 6/6 2024-03-22T07:16:09.760 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 6/6 2024-03-22T07:16:09.760 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/6 2024-03-22T07:16:09.760 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/6 2024-03-22T07:16:09.760 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-22T07:16:09.760 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-22T07:16:09.760 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-22T07:16:10.129 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-16.el9.x86_64 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:10.130 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:10.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-03-22T07:16:11.025 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:51 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:11.178 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================== 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================== 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 6.5 k 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 2.1 M 2024-03-22T07:16:11.180 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 1.4 M 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 240 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 3.7 M 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 15 M 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-22T07:16:11.181 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-22T07:16:11.182 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================== 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout:Install 33 Packages 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 27 M 2024-03-22T07:16:11.183 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 100 M 2024-03-22T07:16:11.184 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:11.868 INFO:teuthology.orchestra.run.smithi134.stdout:(1/33): ceph-17.2.7-726.g9c4e0c34.el9.x86_64.rp 41 kB/s | 6.5 kB 00:00 2024-03-22T07:16:12.076 INFO:teuthology.orchestra.run.smithi134.stdout:(2/33): ceph-mds-17.2.7-726.g9c4e0c34.el9.x86_6 5.6 MB/s | 2.1 MB 00:00 2024-03-22T07:16:12.360 INFO:teuthology.orchestra.run.smithi134.stdout:(3/33): ceph-mon-17.2.7-726.g9c4e0c34.el9.x86_6 7.5 MB/s | 3.7 MB 00:00 2024-03-22T07:16:12.435 INFO:teuthology.orchestra.run.smithi134.stdout:(4/33): ceph-mgr-modules-core-17.2.7-726.g9c4e0 3.1 MB/s | 240 kB 00:00 2024-03-22T07:16:12.744 INFO:teuthology.orchestra.run.smithi134.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 468 kB/s | 144 kB 00:00 2024-03-22T07:16:12.886 INFO:teuthology.orchestra.run.smithi134.stdout:(6/33): ceph-osd-17.2.7-726.g9c4e0c34.el9.x86_6 19 MB/s | 15 MB 00:00 2024-03-22T07:16:12.911 INFO:teuthology.orchestra.run.smithi134.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 189 kB/s | 32 kB 00:00 2024-03-22T07:16:12.961 INFO:teuthology.orchestra.run.smithi134.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 631 kB/s | 47 kB 00:00 2024-03-22T07:16:12.986 INFO:teuthology.orchestra.run.smithi134.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 513 kB/s | 39 kB 00:00 2024-03-22T07:16:13.020 INFO:teuthology.orchestra.run.smithi134.stdout:(10/33): ceph-mgr-17.2.7-726.g9c4e0c34.el9.x86_ 1.1 MB/s | 1.4 MB 00:01 2024-03-22T07:16:13.103 INFO:teuthology.orchestra.run.smithi134.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2024-03-22T07:16:13.237 INFO:teuthology.orchestra.run.smithi134.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 474 kB/s | 103 kB 00:00 2024-03-22T07:16:13.271 INFO:teuthology.orchestra.run.smithi134.stdout:(13/33): python3-cryptography-36.0.1-4.el9.x86_ 4.0 MB/s | 1.1 MB 00:00 2024-03-22T07:16:13.297 INFO:teuthology.orchestra.run.smithi134.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 646 kB/s | 124 kB 00:00 2024-03-22T07:16:13.321 INFO:teuthology.orchestra.run.smithi134.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.2 MB/s | 187 kB 00:00 2024-03-22T07:16:13.813 INFO:teuthology.orchestra.run.smithi134.stdout:(16/33): python3-requests-2.25.1-8.el9.noarch.r 242 kB/s | 125 kB 00:00 2024-03-22T07:16:14.063 INFO:teuthology.orchestra.run.smithi134.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 57 kB/s | 43 kB 00:00 2024-03-22T07:16:14.180 INFO:teuthology.orchestra.run.smithi134.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 92 kB/s | 11 kB 00:00 2024-03-22T07:16:14.305 INFO:teuthology.orchestra.run.smithi134.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 175 kB/s | 172 kB 00:00 2024-03-22T07:16:14.331 INFO:teuthology.orchestra.run.smithi134.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 118 kB/s | 18 kB 00:00 2024-03-22T07:16:14.422 INFO:teuthology.orchestra.run.smithi134.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 198 kB/s | 23 kB 00:00 2024-03-22T07:16:14.448 INFO:teuthology.orchestra.run.smithi134.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 166 kB/s | 19 kB 00:00 2024-03-22T07:16:14.540 INFO:teuthology.orchestra.run.smithi134.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-03-22T07:16:14.565 INFO:teuthology.orchestra.run.smithi134.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 396 kB/s | 46 kB 00:00 2024-03-22T07:16:14.765 INFO:teuthology.orchestra.run.smithi134.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 350 kB/s | 79 kB 00:00 2024-03-22T07:16:14.891 INFO:teuthology.orchestra.run.smithi134.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 131 kB/s | 16 kB 00:00 2024-03-22T07:16:14.941 INFO:teuthology.orchestra.run.smithi134.stdout:(27/33): python3-cherrypy-18.6.1-2.el9.noarch.r 318 kB/s | 358 kB 00:01 2024-03-22T07:16:15.082 INFO:teuthology.orchestra.run.smithi134.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 253 kB/s | 36 kB 00:00 2024-03-22T07:16:15.108 INFO:teuthology.orchestra.run.smithi134.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 502 kB/s | 272 kB 00:00 2024-03-22T07:16:15.141 INFO:teuthology.orchestra.run.smithi134.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 359 kB/s | 90 kB 00:00 2024-03-22T07:16:15.258 INFO:teuthology.orchestra.run.smithi134.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 171 kB/s | 20 kB 00:00 2024-03-22T07:16:15.475 INFO:teuthology.orchestra.run.smithi134.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 585 kB/s | 230 kB 00:00 2024-03-22T07:16:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 603 kB/s | 427 kB 00:00 2024-03-22T07:16:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:Total 5.8 MB/s | 27 MB 00:04 2024-03-22T07:16:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:16.209 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:16.209 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:17.463 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:17.520 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-03-22T07:16:17.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-03-22T07:16:17.585 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-03-22T07:16:17.676 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-03-22T07:16:17.755 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-03-22T07:16:17.796 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-03-22T07:16:17.896 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-03-22T07:16:17.946 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-03-22T07:16:17.993 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-03-22T07:16:18.042 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-03-22T07:16:18.107 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-03-22T07:16:18.292 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-03-22T07:16:18.338 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-03-22T07:16:18.373 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-03-22T07:16:18.412 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-03-22T07:16:18.442 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-03-22T07:16:18.523 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-03-22T07:16:18.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-22T07:16:18.586 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-03-22T07:16:18.625 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-03-22T07:16:18.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-03-22T07:16:18.695 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-03-22T07:16:18.784 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-03-22T07:16:18.825 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-03-22T07:16:18.898 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-03-22T07:16:19.035 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-03-22T07:16:19.167 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-22T07:16:19.317 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-726.g9c4e0c34.el9.n 28/33 2024-03-22T07:16:19.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 29/33 2024-03-22T07:16:19.372 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 29/33 2024-03-22T07:16:19.372 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:16:19.372 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-22T07:16:19.372 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-22T07:16:19.372 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-22T07:16:19.372 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:20.706 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 30/33 2024-03-22T07:16:20.735 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 30/33 2024-03-22T07:16:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:16:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-22T07:16:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-22T07:16:20.735 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-22T07:16:20.735 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:21.118 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 31/33 2024-03-22T07:16:21.138 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 31/33 2024-03-22T07:16:21.139 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:16:21.139 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-22T07:16:21.139 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-22T07:16:21.139 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-22T07:16:21.139 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 32/33 2024-03-22T07:16:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 32/33 2024-03-22T07:16:21.364 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:16:21.364 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-22T07:16:21.364 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-22T07:16:21.364 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-22T07:16:21.364 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 33/33 2024-03-22T07:16:23.147 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 33/33 2024-03-22T07:16:23.147 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/33 2024-03-22T07:16:23.147 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 3/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-726.g9c4e0c34.el9.n 6/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-03-22T07:16:23.148 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-03-22T07:16:23.149 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-03-22T07:16:23.150 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-03-22T07:16:24.075 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-03-22T07:16:24.075 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:24.075 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:24.075 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:24.075 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-22T07:16:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-22T07:16:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-22T07:16:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-22T07:16:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-22T07:16:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-22T07:16:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:24.078 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:24.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-03-22T07:16:24.927 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:04 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:25.024 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:16:25.078 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:25.078 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:16:25.079 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:25.152 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-03-22T07:16:25.714 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:05 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:25.826 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 933 kB/s | 21 MB 00:22 2024-03-22T07:16:25.861 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 82 k 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:16:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:25.863 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 82 k 2024-03-22T07:16:25.863 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 372 k 2024-03-22T07:16:25.863 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:26.172 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-17.2.7-726.g9c4e0c34.el9.noarch.rpm 265 kB/s | 82 kB 00:00 2024-03-22T07:16:26.173 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:26.173 INFO:teuthology.orchestra.run.smithi134.stdout:Total 264 kB/s | 82 kB 00:00 2024-03-22T07:16:26.173 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:26.178 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:26.178 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:26.180 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:26.180 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:26.252 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:26.664 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:16:26.760 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:16:27.134 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:16:27.405 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:16:27.406 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:27.406 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:27.406 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:27.406 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:27.406 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:27.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-03-22T07:16:28.175 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:08 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:28.329 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:28.329 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:28.329 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 137 k 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 137 k 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 379 k 2024-03-22T07:16:28.330 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-17.2.7-726.g9c4e0c3 390 kB/s | 137 kB 00:00 2024-03-22T07:16:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:Total 388 kB/s | 137 kB 00:00 2024-03-22T07:16:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:28.694 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:28.694 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:28.742 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:28.742 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:28.883 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:28.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.e 1/1 2024-03-22T07:16:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.e 1/1 2024-03-22T07:16:28.974 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:16:28.975 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-22T07:16:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:29.887 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.e 1/1 2024-03-22T07:16:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:29.888 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:29.888 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:29.888 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:30.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-03-22T07:16:30.728 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:10 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:30.825 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:16:30.877 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:16:30.878 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:30.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-03-22T07:16:30.998 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 5.1 kB/s | 1.7 kB 00:00 2024-03-22T07:16:31.515 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:11 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:31.665 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:31.666 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:31.666 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:31.666 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:31.666 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 1.7 M 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 23 k 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 15 k 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:31.667 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:31.668 INFO:teuthology.orchestra.run.smithi134.stdout:Install 7 Packages 2024-03-22T07:16:31.668 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:31.668 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.0 M 2024-03-22T07:16:31.668 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 8.1 M 2024-03-22T07:16:31.668 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:32.003 INFO:teuthology.orchestra.run.smithi134.stdout:(1/7): ceph-prometheus-alerts-17.2.7-726.g9c4e0 78 kB/s | 15 kB 00:00 2024-03-22T07:16:32.103 INFO:teuthology.orchestra.run.smithi134.stdout:(2/7): ceph-grafana-dashboards-17.2.7-726.g9c4e 81 kB/s | 23 kB 00:00 2024-03-22T07:16:32.179 INFO:teuthology.orchestra.run.smithi134.stdout:(3/7): ceph-mgr-dashboard-17.2.7-726.g9c4e0c34. 4.7 MB/s | 1.7 MB 00:00 2024-03-22T07:16:32.329 INFO:teuthology.orchestra.run.smithi134.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 28 kB/s | 9.0 kB 00:00 2024-03-22T07:16:32.504 INFO:teuthology.orchestra.run.smithi134.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 109 kB/s | 41 kB 00:00 2024-03-22T07:16:32.554 INFO:teuthology.orchestra.run.smithi134.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 82 kB/s | 31 kB 00:00 2024-03-22T07:16:32.679 INFO:teuthology.orchestra.run.smithi134.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 538 kB/s | 188 kB 00:00 2024-03-22T07:16:32.684 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:32.685 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-03-22T07:16:32.685 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:32.691 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:32.692 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:32.756 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:32.757 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:33.056 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:33.122 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-03-22T07:16:33.156 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-03-22T07:16:33.203 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-03-22T07:16:33.234 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-03-22T07:16:33.263 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-726.g9c4e0c34.el9.no 5/7 2024-03-22T07:16:33.484 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:16:33.489 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-726.g9c4e0c34.el9.n 6/7 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 14 M 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 3.1 M 2024-03-22T07:16:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 2.9 M 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 5.0 M 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 23 M 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 25 k 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 636 k 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-22T07:16:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 457 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 4.9 M 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 45 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 117 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 156 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 320 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 293 k 2024-03-22T07:16:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 99 k 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout:Install 22 Packages 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 2 Packages 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 58 M 2024-03-22T07:16:33.509 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:16:33.516 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 7/7 2024-03-22T07:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 7/7 2024-03-22T07:16:34.023 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-726.g9c4e0c34.el9.n 1/7 2024-03-22T07:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 2/7 2024-03-22T07:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-726.g9c4e0c34.el9.no 3/7 2024-03-22T07:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-03-22T07:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-03-22T07:16:34.024 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-03-22T07:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-03-22T07:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:34.320 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-22T07:16:34.321 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-22T07:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:34.322 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:34.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-22T07:16:34.958 INFO:teuthology.orchestra.run.smithi195.stdout:(1/24): ceph-base-17.2.7-726.g9c4e0c34.el9.x86_ 4.0 MB/s | 5.0 MB 00:01 2024-03-22T07:16:35.016 INFO:teuthology.orchestra.run.smithi195.stdout:(2/24): ceph-selinux-17.2.7-726.g9c4e0c34.el9.x 431 kB/s | 25 kB 00:00 2024-03-22T07:16:35.143 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:15 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:35.283 INFO:teuthology.orchestra.run.smithi195.stdout:(3/24): ceph-radosgw-17.2.7-726.g9c4e0c34.el9.x 8.9 MB/s | 14 MB 00:01 2024-03-22T07:16:35.293 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout:=========================================================================================== 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout:=========================================================================================== 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 7.4 M 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-22T07:16:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout:=========================================================================================== 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 37 M 2024-03-22T07:16:35.296 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 209 M 2024-03-22T07:16:35.297 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:35.308 INFO:teuthology.orchestra.run.smithi195.stdout:(4/24): libcephfs2-17.2.7-726.g9c4e0c34.el9.x86 2.1 MB/s | 636 kB 00:00 2024-03-22T07:16:35.350 INFO:teuthology.orchestra.run.smithi195.stdout:(5/24): libradosstriper1-17.2.7-726.g9c4e0c34.e 6.7 MB/s | 457 kB 00:00 2024-03-22T07:16:35.434 INFO:teuthology.orchestra.run.smithi195.stdout:(6/24): python3-ceph-argparse-17.2.7-726.g9c4e0 542 kB/s | 45 kB 00:00 2024-03-22T07:16:35.517 INFO:teuthology.orchestra.run.smithi195.stdout:(7/24): python3-ceph-common-17.2.7-726.g9c4e0c3 1.4 MB/s | 117 kB 00:00 2024-03-22T07:16:35.609 INFO:teuthology.orchestra.run.smithi195.stdout:(8/24): python3-cephfs-17.2.7-726.g9c4e0c34.el9 1.7 MB/s | 156 kB 00:00 2024-03-22T07:16:35.636 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 238 kB/s | 32 kB 00:00 2024-03-22T07:16:35.670 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 532 kB/s | 17 kB 00:00 2024-03-22T07:16:35.684 INFO:teuthology.orchestra.run.smithi195.stdout:(9/24): librgw2-17.2.7-726.g9c4e0c34.el9.x86_64 13 MB/s | 4.9 MB 00:00 2024-03-22T07:16:35.710 INFO:teuthology.orchestra.run.smithi195.stdout:(10/24): python3-rados-17.2.7-726.g9c4e0c34.el9 3.1 MB/s | 320 kB 00:00 2024-03-22T07:16:35.745 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-03-22T07:16:35.752 INFO:teuthology.orchestra.run.smithi195.stdout:(11/24): python3-rbd-17.2.7-726.g9c4e0c34.el9.x 4.3 MB/s | 293 kB 00:00 2024-03-22T07:16:35.770 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 347 kB/s | 34 kB 00:00 2024-03-22T07:16:35.777 INFO:teuthology.orchestra.run.smithi195.stdout:(12/24): python3-rgw-17.2.7-726.g9c4e0c34.el9.x 1.4 MB/s | 99 kB 00:00 2024-03-22T07:16:35.936 INFO:teuthology.orchestra.run.smithi195.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 327 kB/s | 44 kB 00:00 2024-03-22T07:16:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2024-03-22T07:16:35.961 INFO:teuthology.orchestra.run.smithi195.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 761 kB/s | 159 kB 00:00 2024-03-22T07:16:36.011 INFO:teuthology.orchestra.run.smithi195.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-22T07:16:36.012 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-22T07:16:36.037 INFO:teuthology.orchestra.run.smithi195.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-22T07:16:36.038 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-03-22T07:16:36.054 INFO:teuthology.orchestra.run.smithi195.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 992 kB/s | 41 kB 00:00 2024-03-22T07:16:36.280 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): ceph-mgr-diskprediction-local-17.2.7-72 9.5 MB/s | 7.4 MB 00:00 2024-03-22T07:16:36.295 INFO:teuthology.orchestra.run.smithi195.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 201 kB/s | 49 kB 00:00 2024-03-22T07:16:36.412 INFO:teuthology.orchestra.run.smithi195.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-03-22T07:16:36.430 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-03-22T07:16:36.463 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-03-22T07:16:36.513 INFO:teuthology.orchestra.run.smithi195.stdout:(20/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 648 kB/s | 309 kB 00:00 2024-03-22T07:16:36.514 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 844 kB/s | 195 kB 00:00 2024-03-22T07:16:36.738 INFO:teuthology.orchestra.run.smithi195.stdout:(21/24): ceph-common-17.2.7-726.g9c4e0c34.el9.x 7.4 MB/s | 23 MB 00:03 2024-03-22T07:16:36.904 INFO:teuthology.orchestra.run.smithi195.stdout:(22/24): librados2-17.2.7-726.g9c4e0c34.el9.x86 7.9 MB/s | 3.1 MB 00:00 2024-03-22T07:16:36.947 INFO:teuthology.orchestra.run.smithi195.stdout:(23/24): thrift-0.15.0-2.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-03-22T07:16:36.964 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 460 kB/s | 245 kB 00:00 2024-03-22T07:16:36.967 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:36.967 INFO:teuthology.orchestra.run.smithi134.stdout:Total 22 MB/s | 37 MB 00:01 2024-03-22T07:16:37.010 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:37.036 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:37.036 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:37.139 INFO:teuthology.orchestra.run.smithi195.stdout:(24/24): librbd1-17.2.7-726.g9c4e0c34.el9.x86_6 7.3 MB/s | 2.9 MB 00:00 2024-03-22T07:16:37.142 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:37.143 INFO:teuthology.orchestra.run.smithi195.stdout:Total 16 MB/s | 58 MB 00:03 2024-03-22T07:16:37.143 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:16:37.173 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:16:37.173 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:16:37.474 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:37.474 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:37.631 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:16:37.631 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:16:38.169 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:38.241 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-22T07:16:38.276 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-22T07:16:38.378 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-22T07:16:38.430 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-22T07:16:38.608 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-22T07:16:38.636 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-22T07:16:38.713 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-22T07:16:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:16:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-03-22T07:16:39.258 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/26 2024-03-22T07:16:39.349 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/26 2024-03-22T07:16:39.376 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-22T07:16:39.436 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 3/26 2024-03-22T07:16:39.484 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/26 2024-03-22T07:16:39.494 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-22T07:16:39.565 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/26 2024-03-22T07:16:39.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-03-22T07:16:39.655 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-03-22T07:16:40.089 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-03-22T07:16:40.120 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 8/26 2024-03-22T07:16:40.200 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 8/26 2024-03-22T07:16:40.228 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-03-22T07:16:40.271 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:17.2.7-726.g9c4e0c34.el9.x 10/26 2024-03-22T07:16:40.308 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 11/26 2024-03-22T07:16:40.371 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 12/26 2024-03-22T07:16:40.398 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 13/26 2024-03-22T07:16:40.455 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 13/26 2024-03-22T07:16:40.495 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-03-22T07:16:40.561 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-03-22T07:16:40.597 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-03-22T07:16:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-22T07:16:40.893 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-03-22T07:16:40.918 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 18/26 2024-03-22T07:16:40.990 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 18/26 2024-03-22T07:16:41.065 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 19/26 2024-03-22T07:16:41.104 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86 20/26 2024-03-22T07:16:41.759 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-22T07:16:41.793 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c 12/12 2024-03-22T07:16:43.540 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 21/26 2024-03-22T07:16:43.568 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 21/26 2024-03-22T07:16:44.103 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 21/26 2024-03-22T07:16:44.139 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 22/26 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c 12/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c 1/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-22T07:16:44.237 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-22T07:16:44.238 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-22T07:16:44.238 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-22T07:16:44.247 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 22/26 2024-03-22T07:16:44.247 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-22T07:16:44.247 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-22T07:16:44.247 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:44.281 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 23/26 2024-03-22T07:16:44.716 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-22T07:16:44.716 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:44.716 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:44.716 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:44.716 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:44.717 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:45.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-03-22T07:16:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:25 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:45.824 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:45.825 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-03-22T07:16:45.825 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:45.825 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 47 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-22T07:16:45.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:45.827 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.0 M 2024-03-22T07:16:45.828 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-03-22T07:16:45.828 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:46.176 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 129 kB/s | 18 kB 00:00 2024-03-22T07:16:46.201 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 148 kB/s | 24 kB 00:00 2024-03-22T07:16:46.284 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 174 kB 00:00 2024-03-22T07:16:46.310 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 132 kB 00:00 2024-03-22T07:16:46.335 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-22T07:16:46.352 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2024-03-22T07:16:46.370 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): ceph-mgr-rook-17.2.7-726.g9c4e0c34.el9. 142 kB/s | 47 kB 00:00 2024-03-22T07:16:46.686 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2024-03-22T07:16:46.703 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 88 kB/s | 32 kB 00:00 2024-03-22T07:16:46.861 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2024-03-22T07:16:46.903 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 379 kB/s | 203 kB 00:00 2024-03-22T07:16:46.995 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 671 kB/s | 90 kB 00:00 2024-03-22T07:16:47.170 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.1 MB/s | 1.0 MB 00:00 2024-03-22T07:16:47.176 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:47.177 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-03-22T07:16:47.177 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:47.188 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:47.189 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:47.277 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:47.277 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:47.785 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:47.985 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-22T07:16:48.047 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-22T07:16:48.102 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-22T07:16:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-22T07:16:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-22T07:16:48.284 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-22T07:16:48.399 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-22T07:16:48.450 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-22T07:16:49.163 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-22T07:16:49.203 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-22T07:16:49.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-22T07:16:49.283 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-22T07:16:49.307 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 13/13 2024-03-22T07:16:50.134 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 13/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 1/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-22T07:16:50.135 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-22T07:16:50.482 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-22T07:16:50.482 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-22T07:16:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-22T07:16:50.484 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:50.484 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:50.715 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-03-22T07:16:51.283 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:31 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:51.434 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:51.434 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 123 k 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-03-22T07:16:51.435 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-03-22T07:16:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:51.436 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 6.8 M 2024-03-22T07:16:51.436 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-03-22T07:16:51.436 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:51.879 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-mgr-cephadm-17.2.7-726.g9c4e0c34.el 544 kB/s | 123 kB 00:00 2024-03-22T07:16:51.896 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-03-22T07:16:52.021 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 5.8 MB 00:00 2024-03-22T07:16:52.413 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 112 kB/s | 58 kB 00:00 2024-03-22T07:16:52.480 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 124 kB/s | 51 kB 00:00 2024-03-22T07:16:52.630 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 732 kB/s | 548 kB 00:00 2024-03-22T07:16:52.633 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:52.633 INFO:teuthology.orchestra.run.smithi134.stdout:Total 5.7 MB/s | 6.8 MB 00:01 2024-03-22T07:16:52.647 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:52.657 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:52.657 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:52.745 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:52.745 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:53.032 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-22T07:16:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-22T07:16:53.739 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-22T07:16:53.739 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 23/26 2024-03-22T07:16:53.739 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-03-22T07:16:53.739 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-03-22T07:16:53.739 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-03-22T07:16:53.740 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-03-22T07:16:53.740 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-03-22T07:16:53.740 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-03-22T07:16:53.740 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-03-22T07:16:53.740 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:53.825 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-22T07:16:53.881 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-22T07:16:53.911 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 6/6 2024-03-22T07:16:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 6/6 2024-03-22T07:16:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/6 2024-03-22T07:16:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-22T07:16:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-22T07:16:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-22T07:16:54.756 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-22T07:16:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 24/26 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-22T07:16:55.043 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-22T07:16:55.044 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-22T07:16:55.044 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:55.044 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:55.097 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 24/26 2024-03-22T07:16:55.098 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:16:55.098 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-22T07:16:55.098 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-22T07:16:55.098 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-22T07:16:55.098 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:55.099 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-03-22T07:16:55.206 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-03-22T07:16:55.206 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-03-22T07:16:55.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-03-22T07:16:55.848 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:35 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:55.997 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:55.998 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:55.998 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 812 k 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 891 k 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.6 M 2024-03-22T07:16:55.999 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:56.131 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 598 kB/s | 79 kB 00:00 2024-03-22T07:16:56.323 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-17.2.7-726.g9c4e0c34.el9.x86_6 2.5 MB/s | 812 kB 00:00 2024-03-22T07:16:56.324 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.7 MB/s | 891 kB 00:00 2024-03-22T07:16:56.325 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:56.345 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:56.416 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:56.416 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-03-22T07:16:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/26 2024-03-22T07:16:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 3/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 6/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 7/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:17.2.7-726.g9c4e0c34.el9.x 8/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86 9/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 10/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 11/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 12/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 13/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-03-22T07:16:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 23/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-03-22T07:16:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 25/26 2024-03-22T07:16:56.595 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:56.735 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-22T07:16:56.797 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/2 2024-03-22T07:16:57.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-03-22T07:16:57.320 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.321 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-22T07:16:57.322 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:57.323 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:16:57.495 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/2 2024-03-22T07:16:57.495 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/2 2024-03-22T07:16:57.640 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-test 2024-03-22T07:16:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-22T07:16:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:57.800 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:16:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-22T07:16:57.800 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:57.800 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:16:58.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-03-22T07:16:58.201 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:28 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:16:58.348 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:16:58.349 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 48 M 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 163 k 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:58.350 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:16:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:16:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-03-22T07:16:58.351 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:16:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 49 M 2024-03-22T07:16:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 196 M 2024-03-22T07:16:58.351 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:16:58.645 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-03-22T07:16:58.671 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:38 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:16:58.703 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-03-22T07:16:58.754 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-22T07:16:58.820 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 126 k 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:16:58.821 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:16:58.822 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:16:58.822 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 126 k 2024-03-22T07:16:58.822 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 448 k 2024-03-22T07:16:58.822 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:16:58.912 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): libcephsqlite-17.2.7-726.g9c4e0c34.el9.x 372 kB/s | 163 kB 00:00 2024-03-22T07:16:59.144 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-17.2.7-726.g9c4e0c34.el9.x86_64. 392 kB/s | 126 kB 00:00 2024-03-22T07:16:59.145 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:16:59.145 INFO:teuthology.orchestra.run.smithi134.stdout:Total 390 kB/s | 126 kB 00:00 2024-03-22T07:16:59.145 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:16:59.150 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:16:59.150 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:16:59.205 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:16:59.206 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:16:59.350 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:16:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:16:59.629 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 214 kB/s | 187 kB 00:00 2024-03-22T07:16:59.865 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:00.123 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:00.123 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:00.124 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:17:00.124 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:00.124 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:00.124 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:00.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-03-22T07:17:00.972 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:40 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:01.076 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:01.131 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:01.132 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:01.132 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:01.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-03-22T07:17:01.396 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): ceph-test-17.2.7-726.g9c4e0c34.el9.x86_6 16 MB/s | 48 MB 00:02 2024-03-22T07:17:01.399 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:01.399 INFO:teuthology.orchestra.run.smithi195.stdout:Total 16 MB/s | 49 MB 00:03 2024-03-22T07:17:01.414 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:01.436 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:01.436 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:01.787 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:41 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:01.821 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:01.821 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:01.937 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 25 k 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:01.939 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:17:01.940 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:01.940 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 25 k 2024-03-22T07:17:01.940 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 110 k 2024-03-22T07:17:01.940 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:17:02.182 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-17.2.7-726.g9c4e0c34.el9.x86_64 103 kB/s | 25 kB 00:00 2024-03-22T07:17:02.183 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:02.183 INFO:teuthology.orchestra.run.smithi134.stdout:Total 102 kB/s | 25 kB 00:00 2024-03-22T07:17:02.183 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:17:02.186 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:17:02.187 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:17:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:17:02.188 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:17:02.272 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:17:02.387 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:02.418 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:02.512 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-22T07:17:02.546 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-22T07:17:02.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-22T07:17:02.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-22T07:17:02.640 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/6 2024-03-22T07:17:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:03.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:03.005 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:03.006 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:17:03.006 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:03.006 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:03.006 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:03.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-03-22T07:17:03.738 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:43 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:03.837 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:03.891 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:03.892 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:03.892 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:03.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-03-22T07:17:04.524 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:44 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:04.621 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:04.673 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:04.674 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:04.674 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:04.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-03-22T07:17:05.305 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:45 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:05.402 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:05.457 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:05.458 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:05.458 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:05.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-03-22T07:17:06.080 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:46 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:06.177 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:06.230 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:06.230 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:06.230 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:06.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-03-22T07:17:06.861 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:46 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:06.958 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:07.010 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:07.011 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:07.011 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:07.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-03-22T07:17:07.112 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/6 2024-03-22T07:17:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 6/6 2024-03-22T07:17:07.654 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:47 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:07.750 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:07.802 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:07.803 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-22T07:17:07.803 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:07.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-03-22T07:17:08.454 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:48 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:08.603 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:08.603 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 82 k 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 82 k 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 222 k 2024-03-22T07:17:08.604 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:17:08.910 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-17.2.7-726.g9c4e0c34.el9.x86_64.rpm 267 kB/s | 82 kB 00:00 2024-03-22T07:17:08.911 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:08.911 INFO:teuthology.orchestra.run.smithi134.stdout:Total 266 kB/s | 82 kB 00:00 2024-03-22T07:17:08.911 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:17:08.918 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:17:08.918 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:17:08.972 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:17:08.972 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:17:09.104 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:17:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:09.463 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 6/6 2024-03-22T07:17:09.463 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/6 2024-03-22T07:17:09.463 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/6 2024-03-22T07:17:09.463 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-22T07:17:09.463 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-22T07:17:09.463 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-22T07:17:09.620 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:09.869 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-16.el9.x86_64 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:09.870 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:09.890 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:09.891 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:09.891 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:17:09.891 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:09.891 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:09.891 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:10.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph 2024-03-22T07:17:10.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-03-22T07:17:10.692 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:40 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:10.698 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:50 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:10.849 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================== 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================== 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 6.5 k 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 2.1 M 2024-03-22T07:17:10.852 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 1.4 M 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 240 k 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 3.7 M 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 15 M 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-22T07:17:10.853 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-22T07:17:10.854 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-22T07:17:10.854 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-22T07:17:10.854 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-22T07:17:10.854 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-22T07:17:10.854 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-22T07:17:10.854 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-22T07:17:10.855 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================== 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout:Install 33 Packages 2024-03-22T07:17:10.856 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:10.857 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 27 M 2024-03-22T07:17:10.857 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 100 M 2024-03-22T07:17:10.857 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:10.857 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 2.9 M 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.9 M 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 12 M 2024-03-22T07:17:10.858 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:17:11.238 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-17.2.7-726.g9c4e0c34.el9.x86_64.rpm 7.7 MB/s | 2.9 MB 00:00 2024-03-22T07:17:11.239 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:11.239 INFO:teuthology.orchestra.run.smithi134.stdout:Total 7.7 MB/s | 2.9 MB 00:00 2024-03-22T07:17:11.239 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:17:11.249 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:17:11.249 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:17:11.319 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:17:11.319 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:17:11.365 INFO:teuthology.orchestra.run.smithi195.stdout:(1/33): ceph-17.2.7-726.g9c4e0c34.el9.x86_64.rp 42 kB/s | 6.5 kB 00:00 2024-03-22T07:17:11.599 INFO:teuthology.orchestra.run.smithi195.stdout:(2/33): ceph-mds-17.2.7-726.g9c4e0c34.el9.x86_6 5.3 MB/s | 2.1 MB 00:00 2024-03-22T07:17:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:17:11.805 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:11.807 INFO:teuthology.orchestra.run.smithi195.stdout:(3/33): ceph-mon-17.2.7-726.g9c4e0c34.el9.x86_6 8.4 MB/s | 3.7 MB 00:00 2024-03-22T07:17:11.830 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:11.830 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:17:11.830 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-22T07:17:11.830 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-22T07:17:11.830 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-22T07:17:11.830 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:11.891 INFO:teuthology.orchestra.run.smithi195.stdout:(4/33): ceph-mgr-modules-core-17.2.7-726.g9c4e0 2.8 MB/s | 240 kB 00:00 2024-03-22T07:17:11.999 INFO:teuthology.orchestra.run.smithi195.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2024-03-22T07:17:12.033 INFO:teuthology.orchestra.run.smithi195.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 952 kB/s | 32 kB 00:00 2024-03-22T07:17:12.067 INFO:teuthology.orchestra.run.smithi195.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-22T07:17:12.109 INFO:teuthology.orchestra.run.smithi195.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 928 kB/s | 39 kB 00:00 2024-03-22T07:17:12.150 INFO:teuthology.orchestra.run.smithi195.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-03-22T07:17:12.217 INFO:teuthology.orchestra.run.smithi195.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 17 MB/s | 1.1 MB 00:00 2024-03-22T07:17:12.251 INFO:teuthology.orchestra.run.smithi195.stdout:(11/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-03-22T07:17:12.401 INFO:teuthology.orchestra.run.smithi195.stdout:(12/33): ceph-osd-17.2.7-726.g9c4e0c34.el9.x86_ 19 MB/s | 15 MB 00:00 2024-03-22T07:17:12.418 INFO:teuthology.orchestra.run.smithi195.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 744 kB/s | 124 kB 00:00 2024-03-22T07:17:12.444 INFO:teuthology.orchestra.run.smithi195.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2024-03-22T07:17:12.477 INFO:teuthology.orchestra.run.smithi195.stdout:(15/33): ceph-mgr-17.2.7-726.g9c4e0c34.el9.x86_ 1.1 MB/s | 1.4 MB 00:01 2024-03-22T07:17:12.777 INFO:teuthology.orchestra.run.smithi195.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-03-22T07:17:12.853 INFO:teuthology.orchestra.run.smithi195.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 457 kB/s | 172 kB 00:00 2024-03-22T07:17:12.878 INFO:teuthology.orchestra.run.smithi195.stdout:(18/33): python3-requests-2.25.1-8.el9.noarch.r 272 kB/s | 125 kB 00:00 2024-03-22T07:17:12.936 INFO:teuthology.orchestra.run.smithi195.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-03-22T07:17:12.945 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:12.945 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:12.945 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:17:12.945 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:12.945 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:12.945 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:13.045 INFO:teuthology.orchestra.run.smithi195.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-03-22T07:17:13.062 INFO:teuthology.orchestra.run.smithi195.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 230 kB/s | 23 kB 00:00 2024-03-22T07:17:13.129 INFO:teuthology.orchestra.run.smithi195.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 235 kB/s | 19 kB 00:00 2024-03-22T07:17:13.154 INFO:teuthology.orchestra.run.smithi195.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-03-22T07:17:13.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-03-22T07:17:13.179 INFO:teuthology.orchestra.run.smithi195.stdout:(24/33): python3-jaraco-classes-3.2.1-5.el9.noa 59 kB/s | 18 kB 00:00 2024-03-22T07:17:13.213 INFO:teuthology.orchestra.run.smithi195.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 553 kB/s | 46 kB 00:00 2024-03-22T07:17:13.247 INFO:teuthology.orchestra.run.smithi195.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 857 kB/s | 79 kB 00:00 2024-03-22T07:17:13.305 INFO:teuthology.orchestra.run.smithi195.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 178 kB/s | 16 kB 00:00 2024-03-22T07:17:13.339 INFO:teuthology.orchestra.run.smithi195.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 978 kB/s | 90 kB 00:00 2024-03-22T07:17:13.397 INFO:teuthology.orchestra.run.smithi195.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 390 kB/s | 36 kB 00:00 2024-03-22T07:17:13.431 INFO:teuthology.orchestra.run.smithi195.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-03-22T07:17:13.467 INFO:teuthology.orchestra.run.smithi195.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-03-22T07:17:13.501 INFO:teuthology.orchestra.run.smithi195.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 289 kB/s | 20 kB 00:00 2024-03-22T07:17:13.526 INFO:teuthology.orchestra.run.smithi195.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-03-22T07:17:13.532 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:13.532 INFO:teuthology.orchestra.run.smithi195.stdout:Total 10 MB/s | 27 MB 00:02 2024-03-22T07:17:13.546 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:13.586 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:13.586 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:13.758 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:53 ago on Fri 22 Mar 2024 07:15:20 AM UTC. 2024-03-22T07:17:13.909 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 165 k 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-22T07:17:13.910 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-22T07:17:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:13.911 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 165 k 2024-03-22T07:17:13.911 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 477 k 2024-03-22T07:17:13.911 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-22T07:17:13.918 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:13.918 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:14.133 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-17.2.7-726.g9c4e0c34.el9.x86_64.rpm 746 kB/s | 165 kB 00:00 2024-03-22T07:17:14.133 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:14.133 INFO:teuthology.orchestra.run.smithi134.stdout:Total 740 kB/s | 165 kB 00:00 2024-03-22T07:17:14.133 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-22T07:17:14.141 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-22T07:17:14.141 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-22T07:17:14.196 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-22T07:17:14.196 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-22T07:17:14.346 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-22T07:17:14.455 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:14.895 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:15.151 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:15.187 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:15.187 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:15.187 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-22T07:17:15.187 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:15.188 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:17:15.188 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-22T07:17:15.212 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-03-22T07:17:15.244 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-03-22T07:17:15.277 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-03-22T07:17:15.369 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-03-22T07:17:15.436 DEBUG:teuthology.parallel:result is None 2024-03-22T07:17:15.439 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-03-22T07:17:15.480 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-03-22T07:17:15.560 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-03-22T07:17:15.614 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-03-22T07:17:15.652 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-03-22T07:17:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-03-22T07:17:15.767 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-03-22T07:17:15.950 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-03-22T07:17:16.006 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-03-22T07:17:16.049 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-03-22T07:17:16.088 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-03-22T07:17:16.118 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-03-22T07:17:16.193 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-03-22T07:17:16.228 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-22T07:17:16.261 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-03-22T07:17:16.302 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-03-22T07:17:16.337 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-03-22T07:17:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-03-22T07:17:16.460 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-03-22T07:17:16.502 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-03-22T07:17:16.575 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-03-22T07:17:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-03-22T07:17:16.838 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-22T07:17:16.984 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-726.g9c4e0c34.el9.n 28/33 2024-03-22T07:17:17.030 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 29/33 2024-03-22T07:17:17.052 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 29/33 2024-03-22T07:17:17.052 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:17:17.052 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-22T07:17:17.052 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-22T07:17:17.052 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-22T07:17:17.052 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 30/33 2024-03-22T07:17:18.479 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 30/33 2024-03-22T07:17:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:17:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-22T07:17:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-22T07:17:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-22T07:17:18.479 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:18.870 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 31/33 2024-03-22T07:17:18.891 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 31/33 2024-03-22T07:17:18.891 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:17:18.891 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-22T07:17:18.891 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-22T07:17:18.891 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-22T07:17:18.892 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 32/33 2024-03-22T07:17:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 32/33 2024-03-22T07:17:19.125 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:17:19.125 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-22T07:17:19.125 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-22T07:17:19.126 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-22T07:17:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:19.191 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 33/33 2024-03-22T07:17:20.759 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 33/33 2024-03-22T07:17:20.759 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 3/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 4/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 5/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-726.g9c4e0c34.el9.n 6/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-03-22T07:17:20.760 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-03-22T07:17:20.761 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-03-22T07:17:20.762 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-03-22T07:17:20.762 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-22T07:17:20.762 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-03-22T07:17:20.762 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-03-22T07:17:20.762 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-03-22T07:17:20.762 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-03-22T07:17:20.763 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:21.644 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-22T07:17:21.645 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-22T07:17:21.646 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:21.647 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:21.987 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-base 2024-03-22T07:17:22.576 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:52 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:22.672 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-base-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:22.723 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:22.724 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:17:22.724 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:22.780 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install cephadm 2024-03-22T07:17:23.341 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:53 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:23.489 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 82 k 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 82 k 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 372 k 2024-03-22T07:17:23.490 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:23.801 INFO:teuthology.orchestra.run.smithi195.stdout:cephadm-17.2.7-726.g9c4e0c34.el9.noarch.rpm 264 kB/s | 82 kB 00:00 2024-03-22T07:17:23.801 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:23.802 INFO:teuthology.orchestra.run.smithi195.stdout:Total 263 kB/s | 82 kB 00:00 2024-03-22T07:17:23.802 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:23.807 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:23.807 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:23.808 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:23.809 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:23.883 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:24.282 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:17:24.380 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:17:24.736 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:17:25.036 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/1 2024-03-22T07:17:25.036 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:25.036 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:25.036 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:25.036 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:25.037 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:25.311 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-immutable-object-cache 2024-03-22T07:17:25.885 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:55 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:26.040 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 137 k 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:17:26.042 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:26.042 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 137 k 2024-03-22T07:17:26.042 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 379 k 2024-03-22T07:17:26.042 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:26.359 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-immutable-object-cache-17.2.7-726.g9c4e0c3 434 kB/s | 137 kB 00:00 2024-03-22T07:17:26.359 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:26.360 INFO:teuthology.orchestra.run.smithi195.stdout:Total 432 kB/s | 137 kB 00:00 2024-03-22T07:17:26.360 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:26.367 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:26.368 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:26.419 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:26.420 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:26.610 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.e 1/1 2024-03-22T07:17:26.634 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.e 1/1 2024-03-22T07:17:26.634 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:17:26.635 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-22T07:17:26.635 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:27.541 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.e 1/1 2024-03-22T07:17:27.542 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:27.542 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:27.542 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:27.542 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:27.542 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:27.778 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr 2024-03-22T07:17:28.349 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:58 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:28.446 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-mgr-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:28.499 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:28.500 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:17:28.500 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:28.555 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-dashboard 2024-03-22T07:17:29.114 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:59 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:29.263 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:29.264 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:29.264 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 1.7 M 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 23 k 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 15 k 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:29.265 INFO:teuthology.orchestra.run.smithi195.stdout:Install 7 Packages 2024-03-22T07:17:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:29.266 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.0 M 2024-03-22T07:17:29.266 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 8.1 M 2024-03-22T07:17:29.266 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:29.571 INFO:teuthology.orchestra.run.smithi195.stdout:(1/7): ceph-grafana-dashboards-17.2.7-726.g9c4e 92 kB/s | 23 kB 00:00 2024-03-22T07:17:29.597 INFO:teuthology.orchestra.run.smithi195.stdout:(2/7): ceph-prometheus-alerts-17.2.7-726.g9c4e0 52 kB/s | 15 kB 00:00 2024-03-22T07:17:29.847 INFO:teuthology.orchestra.run.smithi195.stdout:(3/7): ceph-mgr-dashboard-17.2.7-726.g9c4e0c34. 3.2 MB/s | 1.7 MB 00:00 2024-03-22T07:17:29.856 INFO:teuthology.orchestra.run.smithi195.stdout:[MIRROR] python3-jwt+crypto-2.4.0-1.el9.noarch.rpm: Status code: 500 for https://mirror.servaxnet.com/epel/9/Everything/x86_64/Packages/p/python3-jwt%2bcrypto-2.4.0-1.el9.noarch.rpm (IP: 162.255.226.75) 2024-03-22T07:17:29.876 INFO:teuthology.orchestra.run.smithi195.stdout:[MIRROR] python3-repoze-lru-0.7-16.el9.noarch.rpm: Status code: 500 for https://mirror.servaxnet.com/epel/9/Everything/x86_64/Packages/p/python3-repoze-lru-0.7-16.el9.noarch.rpm (IP: 162.255.226.75) 2024-03-22T07:17:29.930 INFO:teuthology.orchestra.run.smithi195.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 123 kB/s | 41 kB 00:00 2024-03-22T07:17:29.947 INFO:teuthology.orchestra.run.smithi195.stdout:(5/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 24 kB/s | 9.0 kB 00:00 2024-03-22T07:17:29.973 INFO:teuthology.orchestra.run.smithi195.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 245 kB/s | 31 kB 00:00 2024-03-22T07:17:29.973 INFO:teuthology.orchestra.run.smithi195.stdout:[MIRROR] python3-routes-2.5.1-5.el9.noarch.rpm: Status code: 500 for https://mirror.servaxnet.com/epel/9/Everything/x86_64/Packages/p/python3-routes-2.5.1-5.el9.noarch.rpm (IP: 162.255.226.75) 2024-03-22T07:17:30.114 INFO:teuthology.orchestra.run.smithi195.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-03-22T07:17:30.117 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:30.117 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.3 MB/s | 2.0 MB 00:00 2024-03-22T07:17:30.117 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:30.126 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:30.126 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:30.188 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:30.188 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-03-22T07:17:30.574 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-03-22T07:17:30.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-03-22T07:17:30.670 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-03-22T07:17:30.699 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-726.g9c4e0c34.el9.no 5/7 2024-03-22T07:17:30.916 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-726.g9c4e0c34.el9.n 6/7 2024-03-22T07:17:30.943 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 7/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 7/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-726.g9c4e0c34.el9.n 1/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 2/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-726.g9c4e0c34.el9.no 3/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-03-22T07:17:31.492 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-22T07:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:31.794 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:32.004 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-22T07:17:32.562 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:02 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:32.713 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================== 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================== 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 7.4 M 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-22T07:17:32.714 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================== 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout:Install 12 Packages 2024-03-22T07:17:32.715 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:32.716 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 37 M 2024-03-22T07:17:32.716 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 209 M 2024-03-22T07:17:32.716 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:33.022 INFO:teuthology.orchestra.run.smithi195.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 225 kB/s | 32 kB 00:00 2024-03-22T07:17:33.047 INFO:teuthology.orchestra.run.smithi195.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 720 kB/s | 17 kB 00:00 2024-03-22T07:17:33.072 INFO:teuthology.orchestra.run.smithi195.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2024-03-22T07:17:33.131 INFO:teuthology.orchestra.run.smithi195.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-03-22T07:17:33.298 INFO:teuthology.orchestra.run.smithi195.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2024-03-22T07:17:33.356 INFO:teuthology.orchestra.run.smithi195.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2024-03-22T07:17:33.381 INFO:teuthology.orchestra.run.smithi195.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-03-22T07:17:33.482 INFO:teuthology.orchestra.run.smithi195.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 8.0 MB/s | 803 kB 00:00 2024-03-22T07:17:33.557 INFO:teuthology.orchestra.run.smithi195.stdout:(9/12): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-03-22T07:17:33.708 INFO:teuthology.orchestra.run.smithi195.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-22T07:17:33.799 INFO:teuthology.orchestra.run.smithi195.stdout:(11/12): ceph-mgr-diskprediction-local-17.2.7-7 8.1 MB/s | 7.4 MB 00:00 2024-03-22T07:17:33.999 INFO:teuthology.orchestra.run.smithi195.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 556 kB/s | 245 kB 00:00 2024-03-22T07:17:34.002 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:34.002 INFO:teuthology.orchestra.run.smithi195.stdout:Total 29 MB/s | 37 MB 00:01 2024-03-22T07:17:34.044 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:34.067 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:34.068 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:34.495 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:34.495 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:35.197 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:35.262 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-22T07:17:35.295 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-22T07:17:35.408 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-22T07:17:35.440 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-22T07:17:35.617 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-22T07:17:35.648 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-22T07:17:35.724 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-22T07:17:36.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-22T07:17:36.493 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-22T07:17:37.762 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-22T07:17:38.793 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-22T07:17:38.822 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c 12/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c 12/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c 1/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-22T07:17:41.265 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-22T07:17:41.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-22T07:17:41.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-22T07:17:41.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-22T07:17:41.266 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-22T07:17:41.697 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:41.698 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:42.040 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-rook 2024-03-22T07:17:42.616 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:12 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:42.766 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:42.767 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-03-22T07:17:42.767 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 47 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-22T07:17:42.768 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-03-22T07:17:42.769 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:42.770 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.0 M 2024-03-22T07:17:42.770 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 26 M 2024-03-22T07:17:42.770 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:43.247 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 181 kB/s | 24 kB 00:00 2024-03-22T07:17:43.272 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 113 kB/s | 18 kB 00:00 2024-03-22T07:17:43.322 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-22T07:17:43.347 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-22T07:17:43.365 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.9 MB/s | 211 kB 00:00 2024-03-22T07:17:43.390 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2024-03-22T07:17:43.415 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): ceph-mgr-rook-17.2.7-726.g9c4e0c34.el9. 156 kB/s | 47 kB 00:00 2024-03-22T07:17:43.832 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 69 kB/s | 32 kB 00:00 2024-03-22T07:17:43.857 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 32 kB/s | 15 kB 00:00 2024-03-22T07:17:44.049 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 308 kB/s | 59 kB 00:00 2024-03-22T07:17:44.108 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 293 kB/s | 203 kB 00:00 2024-03-22T07:17:44.233 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 488 kB/s | 90 kB 00:00 2024-03-22T07:17:45.258 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 733 kB/s | 1.0 MB 00:01 2024-03-22T07:17:45.264 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:45.264 INFO:teuthology.orchestra.run.smithi195.stdout:Total 839 kB/s | 2.0 MB 00:02 2024-03-22T07:17:45.264 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:45.279 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:45.280 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:45.374 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:45.374 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:45.897 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:46.064 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-22T07:17:46.118 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-22T07:17:46.173 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-22T07:17:46.210 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-22T07:17:46.252 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-22T07:17:46.363 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-22T07:17:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-22T07:17:46.528 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-22T07:17:47.247 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-22T07:17:47.292 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-22T07:17:47.326 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-22T07:17:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-22T07:17:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 13/13 2024-03-22T07:17:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 13/13 2024-03-22T07:17:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 1/13 2024-03-22T07:17:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-22T07:17:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-22T07:17:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-22T07:17:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-22T07:17:48.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-22T07:17:48.603 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:48.603 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:48.603 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:48.603 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:48.604 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:48.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-cephadm 2024-03-22T07:17:49.398 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:19 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:49.549 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:49.550 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-03-22T07:17:49.550 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:49.550 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-03-22T07:17:49.550 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:49.550 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:17.2.7-726.g9c4e0c34.el9 ceph-noarch 123 k 2024-03-22T07:17:49.551 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:17:49.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-22T07:17:49.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-22T07:17:49.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-22T07:17:49.551 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-22T07:17:49.552 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-22T07:17:49.552 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:49.552 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:49.552 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-03-22T07:17:49.552 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-03-22T07:17:49.552 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:49.553 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 6.8 M 2024-03-22T07:17:49.554 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 33 M 2024-03-22T07:17:49.554 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:49.938 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-03-22T07:17:50.036 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-03-22T07:17:50.095 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): ceph-mgr-cephadm-17.2.7-726.g9c4e0c34.el 329 kB/s | 123 kB 00:00 2024-03-22T07:17:50.529 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 123 kB/s | 58 kB 00:00 2024-03-22T07:17:50.554 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 111 kB/s | 51 kB 00:00 2024-03-22T07:17:50.704 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 718 kB/s | 548 kB 00:00 2024-03-22T07:17:50.707 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:50.707 INFO:teuthology.orchestra.run.smithi195.stdout:Total 5.9 MB/s | 6.8 MB 00:01 2024-03-22T07:17:50.721 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:50.731 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:50.731 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:50.821 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:50.822 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:51.122 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:51.307 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-22T07:17:51.356 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-22T07:17:51.873 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-22T07:17:51.958 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-22T07:17:52.013 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-22T07:17:52.043 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 6/6 2024-03-22T07:17:52.824 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 6/6 2024-03-22T07:17:52.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 1/6 2024-03-22T07:17:52.824 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-22T07:17:52.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-22T07:17:52.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-22T07:17:52.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:17.2.7-726.g9c4e0c34.el9.noarch 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-22T07:17:53.122 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:53.123 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:53.352 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-fuse 2024-03-22T07:17:53.913 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:23 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:54.063 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:54.063 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:54.063 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-22T07:17:54.063 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 812 k 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Install 2 Packages 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 891 k 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 2.6 M 2024-03-22T07:17:54.064 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:54.197 INFO:teuthology.orchestra.run.smithi195.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 594 kB/s | 79 kB 00:00 2024-03-22T07:17:54.364 INFO:teuthology.orchestra.run.smithi195.stdout:(2/2): ceph-fuse-17.2.7-726.g9c4e0c34.el9.x86_6 2.7 MB/s | 812 kB 00:00 2024-03-22T07:17:54.365 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:54.365 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.9 MB/s | 891 kB 00:00 2024-03-22T07:17:54.365 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:54.385 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:54.386 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:54.456 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:54.456 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:54.636 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:54.759 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-22T07:17:54.829 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/2 2024-03-22T07:17:55.480 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2/2 2024-03-22T07:17:55.480 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/2 2024-03-22T07:17:55.764 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-22T07:17:55.764 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:55.764 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:55.764 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-22T07:17:55.764 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:55.764 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:55.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados-devel 2024-03-22T07:17:56.569 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:26 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:56.725 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:56.726 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-03-22T07:17:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 126 k 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 126 k 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 448 k 2024-03-22T07:17:56.727 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:17:57.077 INFO:teuthology.orchestra.run.smithi195.stdout:librados-devel-17.2.7-726.g9c4e0c34.el9.x86_64. 360 kB/s | 126 kB 00:00 2024-03-22T07:17:57.078 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:17:57.078 INFO:teuthology.orchestra.run.smithi195.stdout:Total 359 kB/s | 126 kB 00:00 2024-03-22T07:17:57.078 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:17:57.083 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:17:57.083 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:17:57.138 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:17:57.138 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:17:57.294 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:17:57.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:57.800 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:58.355 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs2 2024-03-22T07:17:58.926 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:28 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:59.027 INFO:teuthology.orchestra.run.smithi195.stdout:Package libcephfs2-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:17:59.079 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:59.080 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:17:59.080 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:17:59.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs-devel 2024-03-22T07:17:59.713 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:29 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 25 k 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:17:59.863 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 25 k 2024-03-22T07:17:59.864 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 110 k 2024-03-22T07:17:59.864 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:18:00.239 INFO:teuthology.orchestra.run.smithi195.stdout:libcephfs-devel-17.2.7-726.g9c4e0c34.el9.x86_64 66 kB/s | 25 kB 00:00 2024-03-22T07:18:00.240 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:18:00.240 INFO:teuthology.orchestra.run.smithi195.stdout:Total 66 kB/s | 25 kB 00:00 2024-03-22T07:18:00.240 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:18:00.243 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:18:00.243 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:18:00.245 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:18:00.245 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:18:00.330 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:18:00.429 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:00.838 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:01.103 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:01.103 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:01.103 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:18:01.103 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:18:01.103 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:01.103 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:01.261 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados2 2024-03-22T07:18:01.829 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:31 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:01.927 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:18:01.979 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:01.980 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:18:01.980 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:02.038 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librbd1 2024-03-22T07:18:02.600 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:32 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:02.697 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:18:02.749 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:02.750 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:18:02.750 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:02.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rados 2024-03-22T07:18:03.372 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:33 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:03.468 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rados-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:18:03.522 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:03.523 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:18:03.523 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:03.585 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rgw 2024-03-22T07:18:04.142 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:34 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:04.239 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rgw-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:18:04.290 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:04.291 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:18:04.291 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:04.348 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-cephfs 2024-03-22T07:18:04.916 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:34 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:05.014 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-cephfs-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:18:05.065 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:05.066 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:18:05.066 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:05.126 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rbd 2024-03-22T07:18:05.689 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:35 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:05.786 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 is already installed. 2024-03-22T07:18:05.840 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:05.841 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-03-22T07:18:05.841 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:05.901 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-fuse 2024-03-22T07:18:06.467 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:36 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:06.617 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 82 k 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:18:06.618 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:06.619 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 82 k 2024-03-22T07:18:06.619 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 222 k 2024-03-22T07:18:06.619 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:18:07.067 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-fuse-17.2.7-726.g9c4e0c34.el9.x86_64.rpm 182 kB/s | 82 kB 00:00 2024-03-22T07:18:07.068 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:18:07.068 INFO:teuthology.orchestra.run.smithi195.stdout:Total 182 kB/s | 82 kB 00:00 2024-03-22T07:18:07.068 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:18:07.075 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:18:07.075 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:18:07.131 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:18:07.131 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:18:07.270 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:18:07.373 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:07.734 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:08.027 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:08.027 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:08.028 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:18:08.028 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:18:08.028 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:08.028 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:08.252 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-mirror 2024-03-22T07:18:08.825 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:38 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:08.980 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:08.980 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 2.9 M 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.9 M 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 12 M 2024-03-22T07:18:08.981 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:18:10.579 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-mirror-17.2.7-726.g9c4e0c34.el9.x86_64.rpm 1.8 MB/s | 2.9 MB 00:01 2024-03-22T07:18:10.580 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:18:10.580 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.8 MB/s | 2.9 MB 00:01 2024-03-22T07:18:10.580 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:18:10.591 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:18:10.591 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:18:10.665 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:18:10.666 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:18:11.081 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:18:11.155 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:11.179 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:11.179 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-22T07:18:11.179 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-22T07:18:11.179 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-22T07:18:11.179 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-22T07:18:11.179 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:12.320 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:18:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:18:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:12.320 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:12.531 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-nbd 2024-03-22T07:18:13.107 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:43 ago on Fri 22 Mar 2024 07:16:30 AM UTC. 2024-03-22T07:18:13.260 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-22T07:18:13.260 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:13.260 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-03-22T07:18:13.260 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:17.2.7-726.g9c4e0c34.el9 ceph 165 k 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 165 k 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 477 k 2024-03-22T07:18:13.261 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-22T07:18:13.610 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-nbd-17.2.7-726.g9c4e0c34.el9.x86_64.rpm 474 kB/s | 165 kB 00:00 2024-03-22T07:18:13.610 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:18:13.610 INFO:teuthology.orchestra.run.smithi195.stdout:Total 473 kB/s | 165 kB 00:00 2024-03-22T07:18:13.610 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-22T07:18:13.618 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-22T07:18:13.672 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-22T07:18:13.673 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-22T07:18:13.827 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-22T07:18:13.924 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:14.355 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:14.628 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 1/1 2024-03-22T07:18:14.629 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:14.629 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-22T07:18:14.629 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:17.2.7-726.g9c4e0c34.el9.x86_64 2024-03-22T07:18:14.629 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:18:14.629 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-22T07:18:14.851 DEBUG:teuthology.parallel:result is None 2024-03-22T07:18:14.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:18:14.851 INFO:teuthology.packaging:ref: None 2024-03-22T07:18:14.851 INFO:teuthology.packaging:tag: None 2024-03-22T07:18:14.851 INFO:teuthology.packaging:branch: quincy 2024-03-22T07:18:14.851 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:18:14.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-03-22T07:18:15.114 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-22T07:18:15.139 INFO:teuthology.orchestra.run.smithi134.stdout:17.2.7-726.g9c4e0c34.el9 2024-03-22T07:18:15.140 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-726.g9c4e0c34.el9 2024-03-22T07:18:15.140 INFO:teuthology.task.install:The correct ceph version 17.2.7-726.g9c4e0c34 is installed. 2024-03-22T07:18:15.142 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-22T07:18:15.142 INFO:teuthology.packaging:ref: None 2024-03-22T07:18:15.142 INFO:teuthology.packaging:tag: None 2024-03-22T07:18:15.142 INFO:teuthology.packaging:branch: quincy 2024-03-22T07:18:15.142 INFO:teuthology.packaging:sha1: db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:18:15.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-03-22T07:18:15.388 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-22T07:18:15.412 INFO:teuthology.orchestra.run.smithi195.stdout:17.2.7-726.g9c4e0c34.el9 2024-03-22T07:18:15.412 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-726.g9c4e0c34.el9 2024-03-22T07:18:15.412 INFO:teuthology.task.install:The correct ceph version 17.2.7-726.g9c4e0c34 is installed. 2024-03-22T07:18:15.414 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-22T07:18:15.414 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:18:15.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-22T07:18:15.451 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:18:15.452 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-22T07:18:15.481 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-22T07:18:15.481 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:18:15.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-03-22T07:18:15.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-22T07:18:15.591 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:18:15.591 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-03-22T07:18:15.619 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-22T07:18:15.686 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-22T07:18:15.687 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:18:15.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-22T07:18:15.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-22T07:18:15.784 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:18:15.785 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-22T07:18:15.811 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-22T07:18:15.878 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-22T07:18:15.878 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:18:15.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-03-22T07:18:15.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-22T07:18:15.972 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:18:15.972 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-03-22T07:18:15.998 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-22T07:18:16.065 INFO:teuthology.run_tasks:Running task print... 2024-03-22T07:18:16.076 INFO:teuthology.task.print:**** done install task... 2024-03-22T07:18:16.076 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-22T07:18:16.211 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'db0330b1e4e2470d52b750e251e55a522b4f7d69'} 2024-03-22T07:18:16.212 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-03-22T07:18:16.212 INFO:tasks.cephadm:Cluster fsid is 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:18:16.212 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-22T07:18:16.212 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-03-22T07:18:16.213 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi134': '172.21.15.134', 'mon.smithi195': '172.21.15.195'} 2024-03-22T07:18:16.213 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-22T07:18:16.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-03-22T07:18:16.242 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2024-03-22T07:18:16.269 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-03-22T07:18:16.269 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-22T07:18:16.525 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Mar 22 07:18 /home/ubuntu/cephtest/cephadm 2024-03-22T07:18:16.525 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-22T07:18:16.757 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Mar 22 07:18 /home/ubuntu/cephtest/cephadm 2024-03-22T07:18:16.757 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-22T07:18:16.773 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-22T07:18:16.799 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-03-22T07:18:16.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-03-22T07:18:16.815 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-03-22T07:18:17.591 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-03-22T07:18:17.771 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-03-22T07:18:47.229 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:18:47.229 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)", 2024-03-22T07:18:47.229 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "837124da804ffab28571a3e286aff1c534a701f228c0d3d7a309fcb128aca1de", 2024-03-22T07:18:47.229 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-03-22T07:18:47.229 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232" 2024-03-22T07:18:47.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-03-22T07:18:47.230 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:18:53.138 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-03-22T07:18:53.138 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)", 2024-03-22T07:18:53.139 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "837124da804ffab28571a3e286aff1c534a701f228c0d3d7a309fcb128aca1de", 2024-03-22T07:18:53.139 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2024-03-22T07:18:53.139 INFO:teuthology.orchestra.run.smithi195.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232" 2024-03-22T07:18:53.139 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-03-22T07:18:53.139 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-03-22T07:18:53.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-03-22T07:18:53.195 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2024-03-22T07:18:53.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-03-22T07:18:53.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2024-03-22T07:18:53.294 INFO:tasks.cephadm:Writing seed config... 2024-03-22T07:18:53.295 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-03-22T07:18:53.295 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-03-22T07:18:53.295 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-03-22T07:18:53.295 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-03-22T07:18:53.295 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-03-22T07:18:53.295 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-22T07:18:53.296 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-22T07:18:53.296 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-03-22T07:18:53.296 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-22T07:18:53.297 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-22T07:18:53.298 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-22T07:18:53.299 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-22T07:18:53.299 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:18:53.299 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-22T07:18:53.323 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5a05dc38-e81c-11ee-95cd-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-22T07:18:53.324 DEBUG:teuthology.orchestra.run.smithi134:mon.smithi134> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service 2024-03-22T07:18:53.367 INFO:tasks.cephadm:Bootstrapping... 2024-03-22T07:18:53.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.134 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:18:53.575 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-22T07:18:53.576 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '5a05dc38-e81c-11ee-95cd-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.134', '--skip-admin-label'] 2024-03-22T07:18:53.602 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-22T07:18:53.603 INFO:teuthology.orchestra.run.smithi134.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-22T07:18:53.603 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying podman|docker is present... 2024-03-22T07:18:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-22T07:18:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying lvm2 is present... 2024-03-22T07:18:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying time synchronization is in place... 2024-03-22T07:18:53.633 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-22T07:18:53.633 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-22T07:18:53.640 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-22T07:18:53.640 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-03-22T07:18:53.647 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout enabled 2024-03-22T07:18:53.654 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout active 2024-03-22T07:18:53.654 INFO:teuthology.orchestra.run.smithi134.stdout:Unit chronyd.service is enabled and running 2024-03-22T07:18:53.654 INFO:teuthology.orchestra.run.smithi134.stdout:Repeating the final host check... 2024-03-22T07:18:53.678 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-22T07:18:53.678 INFO:teuthology.orchestra.run.smithi134.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-22T07:18:53.678 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl is present 2024-03-22T07:18:53.678 INFO:teuthology.orchestra.run.smithi134.stdout:lvcreate is present 2024-03-22T07:18:53.684 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-22T07:18:53.684 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-22T07:18:53.690 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-22T07:18:53.690 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-03-22T07:18:53.697 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout enabled 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout active 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Unit chronyd.service is enabled and running 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Host looks OK 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Cluster fsid: 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Acquiring lock 139762551972000 on /run/cephadm/5a05dc38-e81c-11ee-95cd-87774f69a715.lock 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Lock 139762551972000 acquired on /run/cephadm/5a05dc38-e81c-11ee-95cd-87774f69a715.lock 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying IP 172.21.15.134 port 3300 ... 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying IP 172.21.15.134 port 6789 ... 2024-03-22T07:18:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:Base mon IP(s) is [172.21.15.134:3300, 172.21.15.134:6789], mon addrv is [v2:172.21.15.134:3300,v1:172.21.15.134:6789] 2024-03-22T07:18:53.707 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.134 metric 100 2024-03-22T07:18:53.708 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.134 metric 100 2024-03-22T07:18:53.710 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-22T07:18:53.710 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-22T07:18:53.710 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1685sec hoplimit 64 pref medium 2024-03-22T07:18:53.713 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:Mon IP `172.21.15.134` is in CIDR network `172.21.0.0/20` 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:Mon IP `172.21.15.134` is in CIDR network `172.21.0.0/20` 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-22T07:18:53.714 INFO:teuthology.orchestra.run.smithi134.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-22T07:18:53.715 INFO:teuthology.orchestra.run.smithi134.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stdout 837124da804ffab28571a3e286aff1c534a701f228c0d3d7a309fcb128aca1de 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Getting image source signatures 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying blob sha256:601ec453fe24458667695dda21742a4f3ea719c31ad8aa8ec48bf585cc42a7d7 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying blob sha256:9516588f908cdb14b5e4062a6063db2d9291b355c3f32e2a99864608a4a7b649 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Copying config sha256:837124da804ffab28571a3e286aff1c534a701f228c0d3d7a309fcb128aca1de 2024-03-22T07:18:56.943 INFO:teuthology.orchestra.run.smithi134.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-22T07:19:05.527 INFO:teuthology.orchestra.run.smithi134.stdout:ceph: stdout ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable) 2024-03-22T07:19:05.528 INFO:teuthology.orchestra.run.smithi134.stdout:Ceph version: ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable) 2024-03-22T07:19:05.528 INFO:teuthology.orchestra.run.smithi134.stdout:Extracting ceph user uid/gid from container image... 2024-03-22T07:19:06.406 INFO:teuthology.orchestra.run.smithi134.stdout:stat: stdout 167 167 2024-03-22T07:19:06.406 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial keys... 2024-03-22T07:19:07.322 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQDqMP1lSyiTKhAAk34m3aZvOy+ivh6T9f167Q== 2024-03-22T07:19:08.295 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQDrMP1lyyWLJhAA9N/K+7kOXwsCMH5k5VdouQ== 2024-03-22T07:19:09.176 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph-authtool: stdout AQDsMP1lDhRsIhAAgUzP3Q9phMPaW1nifUQPJw== 2024-03-22T07:19:09.177 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial monmap... 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool for smithi134 [v2:172.21.15.134:3300,v1:172.21.15.134:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:setting min_mon_release = octopus 2024-03-22T07:19:10.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: set fsid to 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:10.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-22T07:19:10.051 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:19:10.051 INFO:teuthology.orchestra.run.smithi134.stdout:Creating mon... 2024-03-22T07:19:11.988 INFO:teuthology.orchestra.run.smithi134.stdout:create mon.smithi134 on 2024-03-22T07:19:12.192 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-22T07:19:12.355 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-22T07:19:12.504 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715.target → /etc/systemd/system/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715.target. 2024-03-22T07:19:12.504 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715.target → /etc/systemd/system/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715.target. 2024-03-22T07:19:12.686 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134 2024-03-22T07:19:12.686 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service: Unit ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service not loaded. 2024-03-22T07:19:12.861 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715.target.wants/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service → /etc/systemd/system/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@.service. 2024-03-22T07:19:13.387 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-22T07:19:13.387 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-03-22T07:19:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-22T07:19:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-03-22T07:19:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-03-22T07:19:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to enable service . firewalld.service is not available 2024-03-22T07:19:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mon to start... 2024-03-22T07:19:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mon... 2024-03-22T07:19:14.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:14 smithi134 ceph-mon[28682]: from='client.? 172.21.15.134:0/1011502' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout cluster: 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout id: 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout services: 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi134 (age 0.582299s) 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout data: 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-22T07:19:14.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout pgs: 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3fb94700 1 Processor -- start 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3fb94700 1 -- start start 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3fb94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb380771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3fb94700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb38079090 con 0x7feb38078c80 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3d930700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb380771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3d930700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb380771e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41270/0 (socket says 172.21.15.134:41270) 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.829+0000 7feb3d930700 1 -- 172.21.15.134:0/2961512695 learned_addr learned my addr 172.21.15.134:0/2961512695 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.830+0000 7feb3d930700 1 -- 172.21.15.134:0/2961512695 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38077720 con 0x7feb38078c80 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.830+0000 7feb3d930700 1 --2- 172.21.15.134:0/2961512695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb380771e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb280098e0 tx=0x7feb28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e336374c6e8a4c server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.830+0000 7feb3c92e700 1 -- 172.21.15.134:0/2961512695 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2800b860 con 0x7feb38078c80 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.830+0000 7feb3c92e700 1 -- 172.21.15.134:0/2961512695 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2800b9c0 con 0x7feb38078c80 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.830+0000 7feb3c92e700 1 -- 172.21.15.134:0/2961512695 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2800bc90 con 0x7feb38078c80 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- 172.21.15.134:0/2961512695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 msgr2=0x7feb380771e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:14.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 --2- 172.21.15.134:0/2961512695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb380771e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb280098e0 tx=0x7feb28009250 comp rx=0 tx=0).stop 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- 172.21.15.134:0/2961512695 shutdown_connections 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 --2- 172.21.15.134:0/2961512695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb380771e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- 172.21.15.134:0/2961512695 >> 172.21.15.134:0/2961512695 conn(0x7feb380fdee0 msgr2=0x7feb381002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- 172.21.15.134:0/2961512695 shutdown_connections 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- 172.21.15.134:0/2961512695 wait complete. 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 Processor -- start 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- start start 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb38112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3fb94700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb38113490 con 0x7feb38078c80 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3d930700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb38112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3d930700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb38112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41274/0 (socket says 172.21.15.134:41274) 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.831+0000 7feb3d930700 1 -- 172.21.15.134:0/1011502 learned_addr learned my addr 172.21.15.134:0/1011502 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb3d930700 1 -- 172.21.15.134:0/1011502 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280094f0 con 0x7feb38078c80 2024-03-22T07:19:14.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb3d930700 1 --2- 172.21.15.134:0/1011502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb38112f50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7feb28009290 tx=0x7feb28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2801c5c0 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2801c740 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2801ca50 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb38113690 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb38114200 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feb2801a450 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.832+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feb2802e790 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.833+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3805f5f0 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.835+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feb2801ce30 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.903+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7feb38114c10 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.903+0000 7feb2e7fc700 1 -- 172.21.15.134:0/1011502 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7feb2801a890 con 0x7feb38078c80 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 msgr2=0x7feb38112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 --2- 172.21.15.134:0/1011502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb38112f50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7feb28009290 tx=0x7feb28016000 comp rx=0 tx=0).stop 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 shutdown_connections 2024-03-22T07:19:14.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 --2- 172.21.15.134:0/1011502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb38078c80 0x7feb38112f50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 >> 172.21.15.134:0/1011502 conn(0x7feb380fdee0 msgr2=0x7feb38109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 shutdown_connections 2024-03-22T07:19:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:13.904+0000 7feb3fb94700 1 -- 172.21.15.134:0/1011502 wait complete. 2024-03-22T07:19:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:mon is available 2024-03-22T07:19:14.468 INFO:teuthology.orchestra.run.smithi134.stdout:Assimilating anything we can from ceph.conf... 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [global] 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout fsid = 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.134:3300,v1:172.21.15.134:6789] 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:15.513 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [osd] 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce86268700 1 Processor -- start 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce86268700 1 -- start start 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce86268700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80105410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce86268700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80105950 con 0x7fce80076b50 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:15.514 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80105410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41282/0 (socket says 172.21.15.134:41282) 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce7ffff700 1 -- 172.21.15.134:0/1046566395 learned_addr learned my addr 172.21.15.134:0/1046566395 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.876+0000 7fce7ffff700 1 -- 172.21.15.134:0/1046566395 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80105a90 con 0x7fce80076b50 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce7ffff700 1 --2- 172.21.15.134:0/1046566395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80105410 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fce700098e0 tx=0x7fce70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babc7a70ed260466 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce7effd700 1 -- 172.21.15.134:0/1046566395 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7000b860 con 0x7fce80076b50 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce7effd700 1 -- 172.21.15.134:0/1046566395 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000b9c0 con 0x7fce80076b50 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce7effd700 1 -- 172.21.15.134:0/1046566395 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7000bc90 con 0x7fce80076b50 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 -- 172.21.15.134:0/1046566395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 msgr2=0x7fce80105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 --2- 172.21.15.134:0/1046566395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80105410 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fce700098e0 tx=0x7fce70009250 comp rx=0 tx=0).stop 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 -- 172.21.15.134:0/1046566395 shutdown_connections 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 --2- 172.21.15.134:0/1046566395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80105410 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 -- 172.21.15.134:0/1046566395 >> 172.21.15.134:0/1046566395 conn(0x7fce800fce40 msgr2=0x7fce800ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 -- 172.21.15.134:0/1046566395 shutdown_connections 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.877+0000 7fce86268700 1 -- 172.21.15.134:0/1046566395 wait complete. 2024-03-22T07:19:15.515 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce86268700 1 Processor -- start 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce86268700 1 -- start start 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce86268700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce86268700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80111330 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41284/0 (socket says 172.21.15.134:41284) 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.878+0000 7fce7ffff700 1 -- 172.21.15.134:0/3347577996 learned_addr learned my addr 172.21.15.134:0/3347577996 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7ffff700 1 -- 172.21.15.134:0/3347577996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700094f0 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7ffff700 1 --2- 172.21.15.134:0/3347577996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80110df0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fce70009290 tx=0x7fce70016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7001c5c0 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7001c740 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80111530 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7001ca50 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80111f60 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fce7001a450 con 0x7fce80076b50 2024-03-22T07:19:15.516 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.879+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fce70025790 con 0x7fce80076b50 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.880+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8004bed0 con 0x7fce80076b50 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.882+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fce7001a930 con 0x7fce80076b50 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.949+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fce8010aaa0 con 0x7fce80076b50 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.952+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fce7001ce70 con 0x7fce80076b50 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.952+0000 7fce7cff9700 1 -- 172.21.15.134:0/3347577996 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fce7001be60 con 0x7fce80076b50 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 msgr2=0x7fce80110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 --2- 172.21.15.134:0/3347577996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80110df0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fce70009290 tx=0x7fce70016000 comp rx=0 tx=0).stop 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 shutdown_connections 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 --2- 172.21.15.134:0/3347577996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce80076b50 0x7fce80110df0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 >> 172.21.15.134:0/3347577996 conn(0x7fce800fce40 msgr2=0x7fce800fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 shutdown_connections 2024-03-22T07:19:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:14.953+0000 7fce86268700 1 -- 172.21.15.134:0/3347577996 wait complete. 2024-03-22T07:19:15.518 INFO:teuthology.orchestra.run.smithi134.stdout:Generating new minimal ceph.conf... 2024-03-22T07:19:15.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:15 smithi134 ceph-mon[28682]: from='client.? 172.21.15.134:0/3347577996' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-22T07:19:15.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:15 smithi134 ceph-mon[28682]: from='client.? 172.21.15.134:0/3347577996' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-22T07:19:16.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:16 smithi134 ceph-mon[28682]: from='client.? 172.21.15.134:0/3339933303' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:19:17.263 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.918+0000 7f5b4d1c8700 1 Processor -- start 2024-03-22T07:19:17.270 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.918+0000 7f5b4d1c8700 1 -- start start 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.918+0000 7f5b4d1c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48102b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.918+0000 7f5b4d1c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48103070 con 0x7f5b48102720 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b46d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b46d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41294/0 (socket says 172.21.15.134:41294) 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b46d9d700 1 -- 172.21.15.134:0/3373190953 learned_addr learned my addr 172.21.15.134:0/3373190953 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b46d9d700 1 -- 172.21.15.134:0/3373190953 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b481031b0 con 0x7f5b48102720 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b46d9d700 1 --2- 172.21.15.134:0/3373190953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48102b30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0098e0 tx=0x7f5b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671755a1bd92172c server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b45d9b700 1 -- 172.21.15.134:0/3373190953 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c00b860 con 0x7f5b48102720 2024-03-22T07:19:17.271 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b45d9b700 1 -- 172.21.15.134:0/3373190953 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5b3c00be50 con 0x7f5b48102720 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.919+0000 7f5b45d9b700 1 -- 172.21.15.134:0/3373190953 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c010380 con 0x7f5b48102720 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3373190953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 msgr2=0x7f5b48102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 --2- 172.21.15.134:0/3373190953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48102b30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0098e0 tx=0x7f5b3c009250 comp rx=0 tx=0).stop 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3373190953 shutdown_connections 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 --2- 172.21.15.134:0/3373190953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48102b30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3373190953 >> 172.21.15.134:0/3373190953 conn(0x7f5b480fdee0 msgr2=0x7f5b481002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3373190953 shutdown_connections 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3373190953 wait complete. 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.920+0000 7f5b4d1c8700 1 Processor -- start 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b4d1c8700 1 -- start start 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b4d1c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48111560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b4d1c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48111aa0 con 0x7f5b48102720 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b46d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48111560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b46d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48111560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41306/0 (socket says 172.21.15.134:41306) 2024-03-22T07:19:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b46d9d700 1 -- 172.21.15.134:0/3339933303 learned_addr learned my addr 172.21.15.134:0/3339933303 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b46d9d700 1 -- 172.21.15.134:0/3339933303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0094f0 con 0x7f5b48102720 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b46d9d700 1 --2- 172.21.15.134:0/3339933303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00b440 tx=0x7f5b3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c010760 con 0x7f5b48102720 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5b3c010d50 con 0x7f5b48102720 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c01ae20 con 0x7f5b48102720 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b48111ca0 con 0x7f5b48102720 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.921+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b48112810 con 0x7f5b48102720 2024-03-22T07:19:17.273 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.922+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5b3c02e6c0 con 0x7f5b48102720 2024-03-22T07:19:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.922+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5b3c024950 con 0x7f5b48102720 2024-03-22T07:19:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.922+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4805f5f0 con 0x7f5b48102720 2024-03-22T07:19:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.925+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5b3c029070 con 0x7f5b48102720 2024-03-22T07:19:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.990+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5b48104540 con 0x7f5b48102720 2024-03-22T07:19:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.991+0000 7f5b2f7fe700 1 -- 172.21.15.134:0/3339933303 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f5b3c01a6a0 con 0x7f5b48102720 2024-03-22T07:19:17.274 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.991+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 msgr2=0x7f5b48111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.991+0000 7f5b4d1c8700 1 --2- 172.21.15.134:0/3339933303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48111560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00b440 tx=0x7f5b3c009250 comp rx=0 tx=0).stop 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.991+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 shutdown_connections 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.991+0000 7f5b4d1c8700 1 --2- 172.21.15.134:0/3339933303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102720 0x7f5b48111560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.991+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 >> 172.21.15.134:0/3339933303 conn(0x7f5b480fdee0 msgr2=0x7f5b480fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.992+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 shutdown_connections 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:15.992+0000 7f5b4d1c8700 1 -- 172.21.15.134:0/3339933303 wait complete. 2024-03-22T07:19:17.275 INFO:teuthology.orchestra.run.smithi134.stdout:Restarting the monitor... 2024-03-22T07:19:17.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:17 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:19:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:17 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[28678]: 2024-03-22T07:19:17.537+0000 7fdbced6f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:19:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:17 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[28678]: 2024-03-22T07:19:17.537+0000 7fdbced6f700 -1 mon.smithi134@0(leader) e1 *** Got Signal Terminated *** 2024-03-22T07:19:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:17 smithi134 podman[28929]: 2024-03-22 07:19:17.75394176 +0000 UTC m=+0.322006570 container died fbd81dcb1b8c8e362194df1567b139eaa4aaae621a78cffba6c6477909f5c40e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9c4e0c3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-22T07:19:18.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 podman[28929]: 2024-03-22 07:19:18.080765061 +0000 UTC m=+0.648829912 container cleanup fbd81dcb1b8c8e362194df1567b139eaa4aaae621a78cffba6c6477909f5c40e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240319, RELEASE=quincy-9c4e0c3, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-22T07:19:18.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 bash[28929]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134 2024-03-22T07:19:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 podman[28943]: 2024-03-22 07:19:18.281549711 +0000 UTC m=+0.529893376 container remove fbd81dcb1b8c8e362194df1567b139eaa4aaae621a78cffba6c6477909f5c40e (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9c4e0c3, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=) 2024-03-22T07:19:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service: Deactivated successfully. 2024-03-22T07:19:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:19:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 systemd[1]: Starting Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:19:18.969 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 podman[29038]: 2024-03-22 07:19:18.621602794 +0000 UTC m=+0.017532895 image pull 837124da804ffab28571a3e286aff1c534a701f228c0d3d7a309fcb128aca1de quay.ceph.io/ceph-ci/ceph:quincy 2024-03-22T07:19:18.969 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 podman[29038]: 2024-03-22 07:19:18.749387124 +0000 UTC m=+0.145317267 container create ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=quincy-9c4e0c3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-22T07:19:18.970 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 podman[29038]: 2024-03-22 07:19:18.943562437 +0000 UTC m=+0.339492538 container init ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=quincy-9c4e0c3, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:19:18.970 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 podman[29038]: 2024-03-22 07:19:18.94642789 +0000 UTC m=+0.342357992 container start ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, RELEASE=quincy-9c4e0c3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-22T07:19:18.970 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: set uid:gid to 167:167 (ceph:ceph) 2024-03-22T07:19:18.970 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable), process ceph-mon, pid 2 2024-03-22T07:19:18.970 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: pidfile_write: ignore empty --pid-file 2024-03-22T07:19:18.970 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: load: jerasure load: lrc 2024-03-22T07:19:19.023 INFO:teuthology.orchestra.run.smithi134.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: RocksDB version: 6.15.5 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Compile date Mar 21 2024 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: DB SUMMARY 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: DB Session ID: 44LVQ4YNZ459AJE0MD0S 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: CURRENT file: CURRENT 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: IDENTITY file: IDENTITY 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000008.sst 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000010.log size: 97298 ; 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.error_if_exists: 0 2024-03-22T07:19:19.236 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.create_if_missing: 0 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.paranoid_checks: 1 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.env: 0x55c3c332ea80 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.fs: Posix File System 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.info_log: 0x55c3c4badc00 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_file_opening_threads: 16 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.statistics: (nil) 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.use_fsync: 0 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_log_file_size: 0 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.keep_log_file_num: 1000 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.recycle_log_file_num: 0 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.allow_fallocate: 1 2024-03-22T07:19:19.237 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.allow_mmap_reads: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.allow_mmap_writes: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.use_direct_reads: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.create_missing_column_families: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.db_log_dir: 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi134/store.db 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-22T07:19:19.238 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.advise_random_on_open: 1 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.db_write_buffer_size: 0 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.write_buffer_manager: 0x55c3c5922a50 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.rate_limiter: (nil) 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.wal_recovery_mode: 2 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.enable_thread_tracking: 0 2024-03-22T07:19:19.240 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.enable_pipelined_write: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.unordered_write: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.row_cache: None 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.wal_filter: None 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.allow_ingest_behind: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.preserve_deletes: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.two_write_queues: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.manual_wal_flush: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.atomic_flush: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-22T07:19:19.241 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.log_readahead_size: 0 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.best_efforts_recovery: 0 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.allow_data_in_errors: 0 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.db_host_id: __hostname__ 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_background_jobs: 2 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_background_compactions: -1 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_subcompactions: 1 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-22T07:19:19.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_total_wal_size: 0 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_open_files: -1 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bytes_per_sync: 0 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_readahead_size: 0 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_background_flushes: -1 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Compression algorithms supported: 2024-03-22T07:19:19.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kZSTD supported: 0 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kXpressCompression supported: 0 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kLZ4HCCompression supported: 1 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kZlibCompression supported: 1 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kSnappyCompression supported: 1 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kLZ4Compression supported: 1 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: kBZip2Compression supported: 0 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000009 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.merge_operator: 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_filter: None 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_filter_factory: None 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.sst_partitioner_factory: None 2024-03-22T07:19:19.244 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c3c4c02f58) 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: hash_index_allow_collision: 1 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 1 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-03-22T07:19:19.245 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x55c3c4c35090 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-03-22T07:19:19.246 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 4 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.write_buffer_size: 33554432 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_write_buffer_number: 2 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression: NoCompression 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression: Disabled 2024-03-22T07:19:19.247 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.prefix_extractor: nullptr 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.num_levels: 7 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.level: 32767 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.strategy: 0 2024-03-22T07:19:19.248 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compression_opts.enabled: false 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.target_file_size_base: 67108864 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-22T07:19:19.249 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.arena_block_size: 4194304 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.disable_auto_compactions: 0 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-22T07:19:19.250 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.table_properties_collectors: 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.inplace_update_support: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.bloom_locality: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.max_successive_merges: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-22T07:19:19.251 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.paranoid_file_checks: 0 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.force_consistency_checks: 1 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.report_bg_io_stats: 0 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.ttl: 2592000 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.enable_blob_files: false 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.min_blob_size: 0 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.blob_file_size: 268435456 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711091958971918, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-03-22T07:19:19.252 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711091958972680, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92570, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90665, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83380, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1711091958, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "4dcdf53e-c488-4171-b76f-37adeb69f14d", "db_session_id": "44LVQ4YNZ459AJE0MD0S"}} 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711091958972995, "job": 1, "event": "recovery_finished"} 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55c3c4bc9180 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: DB pointer 0x55c3c4c9e000 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-22T07:19:19.253 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 2/0 92.20 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 92.20 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:19:19.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 30.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 30.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-22T07:19:19.255 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 2/0 92.20 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 92.20 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 168.2 0.00 0.00 1 0.001 0 0 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-22T07:19:19.256 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 30.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: starting mon.smithi134 rank 0 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???) e1 preinit fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).mds e1 new map 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).mds e1 print_map 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e1 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:19:19.257 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: -1 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: No filesystems configured 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:18 smithi134 ceph-mon[29057]: mon.smithi134@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 bash[29038]: ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 systemd[1]: Started Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 ceph-mon[29057]: mon.smithi134 is new leader, mons smithi134 in quorum (ranks 0) 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 ceph-mon[29057]: monmap e1: 1 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 ceph-mon[29057]: fsmap 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 ceph-mon[29057]: osdmap e1: 0 total, 0 up, 0 in 2024-03-22T07:19:19.258 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:19 smithi134 ceph-mon[29057]: mgrmap e1: no daemons active 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.443+0000 7eff1e905700 1 Processor -- start 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.443+0000 7eff1e905700 1 -- start start 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.443+0000 7eff1e905700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18103120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.443+0000 7eff1e905700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18103660 con 0x7eff18102d10 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff17fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18103120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff17fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18103120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41316/0 (socket says 172.21.15.134:41316) 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff17fff700 1 -- 172.21.15.134:0/3508285027 learned_addr learned my addr 172.21.15.134:0/3508285027 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff17fff700 1 -- 172.21.15.134:0/3508285027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff181037a0 con 0x7eff18102d10 2024-03-22T07:19:20.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff17fff700 1 --2- 172.21.15.134:0/3508285027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18103120 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff080098e0 tx=0x7eff08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224160d2db725ac8 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff16ffd700 1 -- 172.21.15.134:0/3508285027 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff0800b860 con 0x7eff18102d10 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff16ffd700 1 -- 172.21.15.134:0/3508285027 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7eff0800be50 con 0x7eff18102d10 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.444+0000 7eff16ffd700 1 -- 172.21.15.134:0/3508285027 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff08010380 con 0x7eff18102d10 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 -- 172.21.15.134:0/3508285027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 msgr2=0x7eff18103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 --2- 172.21.15.134:0/3508285027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18103120 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff080098e0 tx=0x7eff08009250 comp rx=0 tx=0).stop 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 -- 172.21.15.134:0/3508285027 shutdown_connections 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 --2- 172.21.15.134:0/3508285027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18103120 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 -- 172.21.15.134:0/3508285027 >> 172.21.15.134:0/3508285027 conn(0x7eff180fc500 msgr2=0x7eff180fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 -- 172.21.15.134:0/3508285027 shutdown_connections 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.445+0000 7eff1e905700 1 -- 172.21.15.134:0/3508285027 wait complete. 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff1e905700 1 Processor -- start 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff1e905700 1 -- start start 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff1e905700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff1e905700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18113c90 con 0x7eff18102d10 2024-03-22T07:19:20.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff17fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff17fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41324/0 (socket says 172.21.15.134:41324) 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff17fff700 1 -- 172.21.15.134:0/3353500017 learned_addr learned my addr 172.21.15.134:0/3353500017 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff17fff700 1 -- 172.21.15.134:0/3353500017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff080094f0 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.446+0000 7eff17fff700 1 --2- 172.21.15.134:0/3353500017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18113750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7eff0800b440 tx=0x7eff08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff08010760 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18113e90 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7eff08010d50 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff0801ae20 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff18114a00 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7eff080246f0 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.447+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7eff0802e9b0 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.448+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1805f5f0 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.450+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7eff08029070 con 0x7eff18102d10 2024-03-22T07:19:20.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.515+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7eff181089b0 con 0x7eff18102d10 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.520+0000 7eff14ff9700 1 -- 172.21.15.134:0/3353500017 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7eff0801a6a0 con 0x7eff18102d10 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 msgr2=0x7eff18113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 --2- 172.21.15.134:0/3353500017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18113750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7eff0800b440 tx=0x7eff08009250 comp rx=0 tx=0).stop 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 shutdown_connections 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 --2- 172.21.15.134:0/3353500017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff18102d10 0x7eff18113750 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 >> 172.21.15.134:0/3353500017 conn(0x7eff180fc500 msgr2=0x7eff180fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 shutdown_connections 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:19.521+0000 7eff1e905700 1 -- 172.21.15.134:0/3353500017 wait complete. 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Creating mgr... 2024-03-22T07:19:20.103 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying port 9283 ... 2024-03-22T07:19:20.272 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mgr.smithi134.wtwqre 2024-03-22T07:19:20.272 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mgr.smithi134.wtwqre.service: Unit ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mgr.smithi134.wtwqre.service not loaded. 2024-03-22T07:19:20.418 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715.target.wants/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mgr.smithi134.wtwqre.service → /etc/systemd/system/ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@.service. 2024-03-22T07:19:20.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:20 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3353500017' entity='client.admin' 2024-03-22T07:19:20.950 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-22T07:19:20.950 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-03-22T07:19:20.957 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-22T07:19:20.957 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-03-22T07:19:20.957 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-03-22T07:19:20.957 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to enable service . firewalld.service is not available 2024-03-22T07:19:20.965 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-22T07:19:20.965 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-03-22T07:19:20.973 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-22T07:19:20.973 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-03-22T07:19:20.973 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-03-22T07:19:20.973 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-03-22T07:19:20.973 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr to start... 2024-03-22T07:19:20.973 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr... 2024-03-22T07:19:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:21 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2194443893' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-22T07:19:22.189 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:22.192 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:19:22.192 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "5a05dc38-e81c-11ee-95cd-87774f69a715", 2024-03-22T07:19:22.192 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-03-22T07:19:22.192 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-22T07:19:22.192 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-22T07:19:22.192 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-22T07:19:22.193 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.194 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-22T07:19:22.194 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:22.194 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-22T07:19:22.194 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-22T07:19:22.194 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-22T07:19:22.202 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-22T07:19:22.203 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-03-22T07:19:13.323283+0000", 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.470+0000 7f3069352700 1 Processor -- start 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.470+0000 7f3069352700 1 -- start start 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.470+0000 7f3069352700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f30641019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:22.204 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.470+0000 7f3069352700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3064101f20 con 0x7f30641015d0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3062ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f30641019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3062ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f30641019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41340/0 (socket says 172.21.15.134:41340) 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3062ffd700 1 -- 172.21.15.134:0/3740764601 learned_addr learned my addr 172.21.15.134:0/3740764601 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3062ffd700 1 -- 172.21.15.134:0/3740764601 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064102060 con 0x7f30641015d0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3062ffd700 1 --2- 172.21.15.134:0/3740764601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f30641019e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f305800bb80 tx=0x7f305800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70222942e4fef1a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3061ffb700 1 -- 172.21.15.134:0/3740764601 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f305800dd00 con 0x7f30641015d0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3061ffb700 1 -- 172.21.15.134:0/3740764601 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f305800de60 con 0x7f30641015d0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.471+0000 7f3061ffb700 1 -- 172.21.15.134:0/3740764601 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30580188a0 con 0x7f30641015d0 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 -- 172.21.15.134:0/3740764601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 msgr2=0x7f30641019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 --2- 172.21.15.134:0/3740764601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f30641019e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f305800bb80 tx=0x7f305800b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 -- 172.21.15.134:0/3740764601 shutdown_connections 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 --2- 172.21.15.134:0/3740764601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f30641019e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 -- 172.21.15.134:0/3740764601 >> 172.21.15.134:0/3740764601 conn(0x7f30640fcd50 msgr2=0x7f30640ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 -- 172.21.15.134:0/3740764601 shutdown_connections 2024-03-22T07:19:22.205 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.472+0000 7f3069352700 1 -- 172.21.15.134:0/3740764601 wait complete. 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.473+0000 7f3069352700 1 Processor -- start 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.473+0000 7f3069352700 1 -- start start 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.473+0000 7f3069352700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f306410f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.473+0000 7f3069352700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306410f8c0 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3062ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f306410f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3062ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f306410f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41350/0 (socket says 172.21.15.134:41350) 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3062ffd700 1 -- 172.21.15.134:0/2194443893 learned_addr learned my addr 172.21.15.134:0/2194443893 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3062ffd700 1 -- 172.21.15.134:0/2194443893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305800b790 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3062ffd700 1 --2- 172.21.15.134:0/2194443893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f306410f380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3058018600 tx=0x7f305800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3058010b70 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f305801d050 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30580225b0 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306410fac0 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3064110630 con 0x7f30641015d0 2024-03-22T07:19:22.206 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f30580227b0 con 0x7f30641015d0 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.474+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3058014070 con 0x7f30641015d0 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.475+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306405f5f0 con 0x7f30641015d0 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.477+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3058010cd0 con 0x7f30641015d0 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.549+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3064103440 con 0x7f30641015d0 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.549+0000 7f304b7fe700 1 -- 172.21.15.134:0/2194443893 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f3058023a00 con 0x7f30641015d0 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 msgr2=0x7f306410f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 --2- 172.21.15.134:0/2194443893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f306410f380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3058018600 tx=0x7f305800b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 shutdown_connections 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 --2- 172.21.15.134:0/2194443893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30641015d0 0x7f306410f380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 >> 172.21.15.134:0/2194443893 conn(0x7f30640fcd50 msgr2=0x7f3064105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 shutdown_connections 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:21.551+0000 7f3069352700 1 -- 172.21.15.134:0/2194443893 wait complete. 2024-03-22T07:19:22.207 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (1/15)... 2024-03-22T07:19:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:24 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/34801157' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "5a05dc38-e81c-11ee-95cd-87774f69a715", 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-22T07:19:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-22T07:19:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:25.684 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-22T07:19:25.684 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-22T07:19:25.684 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-22T07:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-22T07:19:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-03-22T07:19:13.323283+0000", 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60d050b700 1 Processor -- start 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60d050b700 1 -- start start 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60d050b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c8102b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:25.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60d050b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8103080 con 0x7f60c8102730 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60ce2a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c8102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60ce2a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c8102b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36724/0 (socket says 172.21.15.134:36724) 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.661+0000 7f60ce2a7700 1 -- 172.21.15.134:0/3226102573 learned_addr learned my addr 172.21.15.134:0/3226102573 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.662+0000 7f60ce2a7700 1 -- 172.21.15.134:0/3226102573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c81031c0 con 0x7f60c8102730 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.662+0000 7f60ce2a7700 1 --2- 172.21.15.134:0/3226102573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c8102b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f60b80098e0 tx=0x7f60b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb852ebf3b98d0a server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.662+0000 7f60cd2a5700 1 -- 172.21.15.134:0/3226102573 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b800b860 con 0x7f60c8102730 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.662+0000 7f60cd2a5700 1 -- 172.21.15.134:0/3226102573 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f60b800be50 con 0x7f60c8102730 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.662+0000 7f60cd2a5700 1 -- 172.21.15.134:0/3226102573 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b8010380 con 0x7f60c8102730 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 -- 172.21.15.134:0/3226102573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 msgr2=0x7f60c8102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 --2- 172.21.15.134:0/3226102573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c8102b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f60b80098e0 tx=0x7f60b8009250 comp rx=0 tx=0).stop 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 -- 172.21.15.134:0/3226102573 shutdown_connections 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 --2- 172.21.15.134:0/3226102573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c8102b40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 -- 172.21.15.134:0/3226102573 >> 172.21.15.134:0/3226102573 conn(0x7f60c80fdf10 msgr2=0x7f60c8100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:25.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 -- 172.21.15.134:0/3226102573 shutdown_connections 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 -- 172.21.15.134:0/3226102573 wait complete. 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 Processor -- start 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.663+0000 7f60d050b700 1 -- start start 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60d050b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c81115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60d050b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8111b30 con 0x7f60c8102730 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60ce2a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c81115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60ce2a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c81115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36734/0 (socket says 172.21.15.134:36734) 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60ce2a7700 1 -- 172.21.15.134:0/34801157 learned_addr learned my addr 172.21.15.134:0/34801157 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60ce2a7700 1 -- 172.21.15.134:0/34801157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80094f0 con 0x7f60c8102730 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60ce2a7700 1 --2- 172.21.15.134:0/34801157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c81115f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006fd0 tx=0x7f60b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b80107c0 con 0x7f60c8102730 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f60b8010db0 con 0x7f60c8102730 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c8111d30 con 0x7f60c8102730 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b801ada0 con 0x7f60c8102730 2024-03-22T07:19:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.664+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c81128a0 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.665+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f60b8019690 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.665+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f60b80248c0 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.665+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c81121c0 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.667+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f60b8029060 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.739+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f60c804bed0 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.740+0000 7f60beffd700 1 -- 172.21.15.134:0/34801157 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f60b8020070 con 0x7f60c8102730 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 msgr2=0x7f60c81115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 --2- 172.21.15.134:0/34801157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c81115f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60b8006fd0 tx=0x7f60b8009250 comp rx=0 tx=0).stop 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 shutdown_connections 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 --2- 172.21.15.134:0/34801157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8102730 0x7f60c81115f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 >> 172.21.15.134:0/34801157 conn(0x7f60c80fdf10 msgr2=0x7f60c80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 shutdown_connections 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:24.741+0000 7f60d050b700 1 -- 172.21.15.134:0/34801157 wait complete. 2024-03-22T07:19:25.697 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (2/15)... 2024-03-22T07:19:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: mgrmap e2: smithi134.wtwqre(active, starting, since 0.00287241s) 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:27.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:27 smithi134 ceph-mon[29057]: from='mgr.14100 172.21.15.134:0/67642969' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:28 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2937602443' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-22T07:19:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:28 smithi134 ceph-mon[29057]: mgrmap e3: smithi134.wtwqre(active, since 1.00596s) 2024-03-22T07:19:28.837 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:28.837 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:19:28.837 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "5a05dc38-e81c-11ee-95cd-87774f69a715", 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-22T07:19:28.838 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-22T07:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-22T07:19:28.847 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-22T07:19:28.847 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-22T07:19:28.848 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-03-22T07:19:13.323283+0000", 2024-03-22T07:19:28.849 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea077df700 1 Processor -- start 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea077df700 1 -- start start 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea077df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea077df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea001058f0 con 0x7fea00076bb0 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea0557b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea0557b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001053b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36808/0 (socket says 172.21.15.134:36808) 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea0557b700 1 -- 172.21.15.134:0/4283899445 learned_addr learned my addr 172.21.15.134:0/4283899445 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea0557b700 1 -- 172.21.15.134:0/4283899445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea00105a30 con 0x7fea00076bb0 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fea0557b700 1 --2- 172.21.15.134:0/4283899445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001053b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0098e0 tx=0x7fe9fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3d065d41e61139 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fe9f7fff700 1 -- 172.21.15.134:0/4283899445 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9fc00b860 con 0x7fea00076bb0 2024-03-22T07:19:28.850 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fe9f7fff700 1 -- 172.21.15.134:0/4283899445 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe9fc00be50 con 0x7fea00076bb0 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.131+0000 7fe9f7fff700 1 -- 172.21.15.134:0/4283899445 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9fc010380 con 0x7fea00076bb0 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 -- 172.21.15.134:0/4283899445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 msgr2=0x7fea001053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 --2- 172.21.15.134:0/4283899445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001053b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0098e0 tx=0x7fe9fc009250 comp rx=0 tx=0).stop 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 -- 172.21.15.134:0/4283899445 shutdown_connections 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 --2- 172.21.15.134:0/4283899445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001053b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 -- 172.21.15.134:0/4283899445 >> 172.21.15.134:0/4283899445 conn(0x7fea000fce40 msgr2=0x7fea000ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 -- 172.21.15.134:0/4283899445 shutdown_connections 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 -- 172.21.15.134:0/4283899445 wait complete. 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.132+0000 7fea077df700 1 Processor -- start 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea077df700 1 -- start start 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea077df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea077df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00111b10 con 0x7fea00076bb0 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea0557b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:28.851 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea0557b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36820/0 (socket says 172.21.15.134:36820) 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea0557b700 1 -- 172.21.15.134:0/2937602443 learned_addr learned my addr 172.21.15.134:0/2937602443 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea0557b700 1 -- 172.21.15.134:0/2937602443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0094f0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea0557b700 1 --2- 172.21.15.134:0/2937602443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001115d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0090b0 tx=0x7fe9fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9fc010760 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea00111d10 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe9fc010d50 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.133+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9fc01ace0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.134+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea00112880 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.134+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 2) v1 ==== 43124+0+0 (secure 0 0 0) 0x7fe9fc02d3f0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.134+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0005f5f0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.135+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe9fc049d60 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.137+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe9fc02b8e0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.205+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fea0004bed0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.205+0000 7fe9f5ffb700 1 -- 172.21.15.134:0/2937602443 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe9fc02b2f0 con 0x7fea00076bb0 2024-03-22T07:19:28.852 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 msgr2=0x7fea001115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 --2- 172.21.15.134:0/2937602443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001115d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0090b0 tx=0x7fe9fc009250 comp rx=0 tx=0).stop 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 shutdown_connections 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 --2- 172.21.15.134:0/2937602443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea00076bb0 0x7fea001115d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 >> 172.21.15.134:0/2937602443 conn(0x7fea000fce40 msgr2=0x7fea000fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 shutdown_connections 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:28.206+0000 7fea077df700 1 -- 172.21.15.134:0/2937602443 wait complete. 2024-03-22T07:19:28.853 INFO:teuthology.orchestra.run.smithi134.stdout:mgr not available, waiting (3/15)... 2024-03-22T07:19:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:30 smithi134 ceph-mon[29057]: mgrmap e4: smithi134.wtwqre(active, since 2s) 2024-03-22T07:19:31.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:31 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2788577672' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-22T07:19:32.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:32.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:19:32.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsid": "5a05dc38-e81c-11ee-95cd-87774f69a715", 2024-03-22T07:19:32.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "health": { 2024-03-22T07:19:32.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-22T07:19:32.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 0 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "smithi134" 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-22T07:19:32.096 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "restful" 2024-03-22T07:19:32.097 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ], 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "modified": "2024-03-22T07:19:13.323283+0000", 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout }, 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe78dbee700 1 Processor -- start 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe78dbee700 1 -- start start 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe78dbee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788102b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe78dbee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788103070 con 0x7fe788102720 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe7877fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:32.098 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe7877fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36828/0 (socket says 172.21.15.134:36828) 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.252+0000 7fe7877fe700 1 -- 172.21.15.134:0/1303214130 learned_addr learned my addr 172.21.15.134:0/1303214130 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.253+0000 7fe7877fe700 1 -- 172.21.15.134:0/1303214130 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7881031b0 con 0x7fe788102720 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.253+0000 7fe7877fe700 1 --2- 172.21.15.134:0/1303214130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788102b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe7780098e0 tx=0x7fe778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399280b89c389ed5 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.253+0000 7fe7867fc700 1 -- 172.21.15.134:0/1303214130 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe77800b860 con 0x7fe788102720 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.253+0000 7fe7867fc700 1 -- 172.21.15.134:0/1303214130 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe77800be50 con 0x7fe788102720 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.253+0000 7fe7867fc700 1 -- 172.21.15.134:0/1303214130 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe778010380 con 0x7fe788102720 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 -- 172.21.15.134:0/1303214130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 msgr2=0x7fe788102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 --2- 172.21.15.134:0/1303214130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788102b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe7780098e0 tx=0x7fe778009250 comp rx=0 tx=0).stop 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 -- 172.21.15.134:0/1303214130 shutdown_connections 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 --2- 172.21.15.134:0/1303214130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788102b30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 -- 172.21.15.134:0/1303214130 >> 172.21.15.134:0/1303214130 conn(0x7fe7880fdee0 msgr2=0x7fe7881002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 -- 172.21.15.134:0/1303214130 shutdown_connections 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 -- 172.21.15.134:0/1303214130 wait complete. 2024-03-22T07:19:32.099 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.254+0000 7fe78dbee700 1 Processor -- start 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe78dbee700 1 -- start start 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe78dbee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788078bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe78dbee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788079110 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe7877fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788078bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe7877fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788078bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36838/0 (socket says 172.21.15.134:36838) 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe7877fe700 1 -- 172.21.15.134:0/2788577672 learned_addr learned my addr 172.21.15.134:0/2788577672 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe7877fe700 1 -- 172.21.15.134:0/2788577672 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7780094f0 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe7877fe700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788078bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe778000c00 tx=0x7fe778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7780107c0 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe778010db0 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe788077180 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.255+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe77801ad00 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.256+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe788077670 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.256+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fe7780193c0 con 0x7fe788102720 2024-03-22T07:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.256+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78804bed0 con 0x7fe788102720 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.257+0000 7fe76ffff700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe770036740 0x7fe770038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.257+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe77804a600 con 0x7fe788102720 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.257+0000 7fe786ffd700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe770036740 0x7fe770038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.257+0000 7fe786ffd700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe770036740 0x7fe770038bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009990 tx=0x7fe77c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.262+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe77802c3a0 con 0x7fe788102720 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.520+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe788104540 con 0x7fe788102720 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.520+0000 7fe76ffff700 1 -- 172.21.15.134:0/2788577672 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe778022340 con 0x7fe788102720 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe770036740 msgr2=0x7fe770038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe770036740 0x7fe770038bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009990 tx=0x7fe77c006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 msgr2=0x7fe788078bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788078bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe778000c00 tx=0x7fe778009250 comp rx=0 tx=0).stop 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 shutdown_connections 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe770036740 0x7fe770038bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 --2- 172.21.15.134:0/2788577672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe788102720 0x7fe788078bd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:32.101 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 >> 172.21.15.134:0/2788577672 conn(0x7fe7880fdee0 msgr2=0x7fe7880fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:32.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.522+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 shutdown_connections 2024-03-22T07:19:32.102 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:31.523+0000 7fe78dbee700 1 -- 172.21.15.134:0/2788577672 wait complete. 2024-03-22T07:19:32.102 INFO:teuthology.orchestra.run.smithi134.stdout:mgr is available 2024-03-22T07:19:32.987 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:32 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2359101412' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-22T07:19:33.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:33.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [global] 2024-03-22T07:19:33.247 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout fsid = 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout [osd] 2024-03-22T07:19:33.248 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.489+0000 7fe02b8af700 1 Processor -- start 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.489+0000 7fe02b8af700 1 -- start start 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02b8af700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024102b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02b8af700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe024103080 con 0x7fe024102730 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02964b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02964b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024102b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36852/0 (socket says 172.21.15.134:36852) 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02964b700 1 -- 172.21.15.134:0/328734476 learned_addr learned my addr 172.21.15.134:0/328734476 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02964b700 1 -- 172.21.15.134:0/328734476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0241031c0 con 0x7fe024102730 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe02964b700 1 --2- 172.21.15.134:0/328734476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024102b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0140098e0 tx=0x7fe014009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a884bbf0228cdd6c server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe01bfff700 1 -- 172.21.15.134:0/328734476 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe01400b860 con 0x7fe024102730 2024-03-22T07:19:33.249 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe01bfff700 1 -- 172.21.15.134:0/328734476 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe01400be50 con 0x7fe024102730 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.490+0000 7fe01bfff700 1 -- 172.21.15.134:0/328734476 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe014010380 con 0x7fe024102730 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 -- 172.21.15.134:0/328734476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 msgr2=0x7fe024102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 --2- 172.21.15.134:0/328734476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024102b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0140098e0 tx=0x7fe014009250 comp rx=0 tx=0).stop 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 -- 172.21.15.134:0/328734476 shutdown_connections 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 --2- 172.21.15.134:0/328734476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024102b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 -- 172.21.15.134:0/328734476 >> 172.21.15.134:0/328734476 conn(0x7fe0240fdf10 msgr2=0x7fe024100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 -- 172.21.15.134:0/328734476 shutdown_connections 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.491+0000 7fe02b8af700 1 -- 172.21.15.134:0/328734476 wait complete. 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02b8af700 1 Processor -- start 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02b8af700 1 -- start start 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02b8af700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024078bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02b8af700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe024079110 con 0x7fe024102730 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02964b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024078bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:33.250 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02964b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024078bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36854/0 (socket says 172.21.15.134:36854) 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02964b700 1 -- 172.21.15.134:0/2359101412 learned_addr learned my addr 172.21.15.134:0/2359101412 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02964b700 1 -- 172.21.15.134:0/2359101412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140094f0 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02964b700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024078bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe014006fd0 tx=0x7fe014009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0140107c0 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe014010db0 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe024077180 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.492+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe01401ada0 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.493+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe024077670 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.493+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fe014019410 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.494+0000 7fe019ffb700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe010036790 0x7fe010038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.494+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe014049dc0 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.494+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02404bed0 con 0x7fe024102730 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.494+0000 7fe028e4a700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe010036790 0x7fe010038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.494+0000 7fe028e4a700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe010036790 0x7fe010038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe020009990 tx=0x7fe020006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:33.251 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.498+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe014022310 con 0x7fe024102730 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.683+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe024077a70 con 0x7fe024102730 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.684+0000 7fe019ffb700 1 -- 172.21.15.134:0/2359101412 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fe014023b10 con 0x7fe024102730 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe010036790 msgr2=0x7fe010038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe010036790 0x7fe010038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe020009990 tx=0x7fe020006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 msgr2=0x7fe024078bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024078bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe014006fd0 tx=0x7fe014009250 comp rx=0 tx=0).stop 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 shutdown_connections 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fe010036790 0x7fe010038c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 --2- 172.21.15.134:0/2359101412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe024102730 0x7fe024078bd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.686+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 >> 172.21.15.134:0/2359101412 conn(0x7fe0240fdf10 msgr2=0x7fe0240feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:33.252 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.687+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 shutdown_connections 2024-03-22T07:19:33.253 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:32.687+0000 7fe02b8af700 1 -- 172.21.15.134:0/2359101412 wait complete. 2024-03-22T07:19:33.253 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling cephadm module... 2024-03-22T07:19:34.293 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:33 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2238200409' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-22T07:19:34.635 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.684+0000 7f6c9749f700 1 Processor -- start 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.684+0000 7f6c9749f700 1 -- start start 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.684+0000 7f6c9749f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901030d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.684+0000 7f6c9749f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90103610 con 0x7f6c90102cc0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c9523b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c9523b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40570/0 (socket says 172.21.15.134:40570) 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c9523b700 1 -- 172.21.15.134:0/440217212 learned_addr learned my addr 172.21.15.134:0/440217212 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c9523b700 1 -- 172.21.15.134:0/440217212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90103750 con 0x7f6c90102cc0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c9523b700 1 --2- 172.21.15.134:0/440217212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901030d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009e50 tx=0x7f6c8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1954d386bac395a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c87fff700 1 -- 172.21.15.134:0/440217212 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c0092e0 con 0x7f6c90102cc0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c87fff700 1 -- 172.21.15.134:0/440217212 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c8c012430 con 0x7f6c90102cc0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.685+0000 7f6c87fff700 1 -- 172.21.15.134:0/440217212 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c0075c0 con 0x7f6c90102cc0 2024-03-22T07:19:34.636 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 -- 172.21.15.134:0/440217212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 msgr2=0x7f6c901030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 --2- 172.21.15.134:0/440217212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901030d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009e50 tx=0x7f6c8c009840 comp rx=0 tx=0).stop 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 -- 172.21.15.134:0/440217212 shutdown_connections 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 --2- 172.21.15.134:0/440217212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901030d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 -- 172.21.15.134:0/440217212 >> 172.21.15.134:0/440217212 conn(0x7f6c900fc4d0 msgr2=0x7f6c900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 -- 172.21.15.134:0/440217212 shutdown_connections 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 -- 172.21.15.134:0/440217212 wait complete. 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 Processor -- start 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.686+0000 7f6c9749f700 1 -- start start 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9749f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9749f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90113ce0 con 0x7f6c90102cc0 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9523b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9523b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40576/0 (socket says 172.21.15.134:40576) 2024-03-22T07:19:34.637 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9523b700 1 -- 172.21.15.134:0/2238200409 learned_addr learned my addr 172.21.15.134:0/2238200409 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9523b700 1 -- 172.21.15.134:0/2238200409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009ae0 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9523b700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901137a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009ab0 tx=0x7f6c8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c0092e0 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c8c007d10 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c90113ee0 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.687+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c8c01c990 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.688+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c90114a50 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.688+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f6c8c019070 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.688+0000 7f6c85ffb700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7f6c7c036740 0x7f6c7c038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.688+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6c8c049e00 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.688+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9005f5f0 con 0x7f6c90102cc0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.688+0000 7f6c94a3a700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7f6c7c036740 0x7f6c7c038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.689+0000 7f6c94a3a700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7f6c7c036740 0x7f6c7c038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009990 tx=0x7f6c80006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:34.638 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.693+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6c8c017080 con 0x7f6c90102cc0 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.929+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f6c90114dd0 con 0x7f6c90102cc0 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.982+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f6c8c0243b0 con 0x7f6c90102cc0 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.983+0000 7f6c85ffb700 1 -- 172.21.15.134:0/2238200409 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f6c8c048fd0 con 0x7f6c90102cc0 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7f6c7c036740 msgr2=0x7f6c7c038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7f6c7c036740 0x7f6c7c038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009990 tx=0x7f6c80006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 msgr2=0x7f6c901137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901137a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009ab0 tx=0x7f6c8c009840 comp rx=0 tx=0).stop 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 shutdown_connections 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7f6c7c036740 0x7f6c7c038bf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 --2- 172.21.15.134:0/2238200409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c90102cc0 0x7f6c901137a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 >> 172.21.15.134:0/2238200409 conn(0x7f6c900fc4d0 msgr2=0x7f6c900fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 shutdown_connections 2024-03-22T07:19:34.639 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:33.985+0000 7f6c9749f700 1 -- 172.21.15.134:0/2238200409 wait complete. 2024-03-22T07:19:35.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:34 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2238200409' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-22T07:19:35.243 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:34 smithi134 ceph-mon[29057]: mgrmap e5: smithi134.wtwqre(active, since 6s) 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "active_name": "smithi134.wtwqre", 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.093+0000 7ff224663700 1 Processor -- start 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.093+0000 7ff224663700 1 -- start start 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff224663700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c102b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff224663700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c103070 con 0x7ff21c102720 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff2223ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff2223ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40602/0 (socket says 172.21.15.134:40602) 2024-03-22T07:19:35.943 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff2223ff700 1 -- 172.21.15.134:0/2113610721 learned_addr learned my addr 172.21.15.134:0/2113610721 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff2223ff700 1 -- 172.21.15.134:0/2113610721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c1031b0 con 0x7ff21c102720 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.094+0000 7ff2223ff700 1 --2- 172.21.15.134:0/2113610721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c102b30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0098e0 tx=0x7ff20c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce1b836da86d7f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.095+0000 7ff2213fd700 1 -- 172.21.15.134:0/2113610721 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20c00b860 con 0x7ff21c102720 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.095+0000 7ff2213fd700 1 -- 172.21.15.134:0/2113610721 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff20c00be50 con 0x7ff21c102720 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.095+0000 7ff2213fd700 1 -- 172.21.15.134:0/2113610721 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20c010380 con 0x7ff21c102720 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.095+0000 7ff224663700 1 -- 172.21.15.134:0/2113610721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 msgr2=0x7ff21c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.095+0000 7ff224663700 1 --2- 172.21.15.134:0/2113610721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c102b30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0098e0 tx=0x7ff20c009250 comp rx=0 tx=0).stop 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 -- 172.21.15.134:0/2113610721 shutdown_connections 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 --2- 172.21.15.134:0/2113610721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c102b30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 -- 172.21.15.134:0/2113610721 >> 172.21.15.134:0/2113610721 conn(0x7ff21c0fde40 msgr2=0x7ff21c1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 -- 172.21.15.134:0/2113610721 shutdown_connections 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 -- 172.21.15.134:0/2113610721 wait complete. 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 Processor -- start 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 -- start start 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c111550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:35.944 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff224663700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c111a90 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff2223ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff2223ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40612/0 (socket says 172.21.15.134:40612) 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.096+0000 7ff2223ff700 1 -- 172.21.15.134:0/1126189686 learned_addr learned my addr 172.21.15.134:0/1126189686 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff2223ff700 1 -- 172.21.15.134:0/1126189686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0094f0 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff2223ff700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c111550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000c00 tx=0x7ff20c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20c0107c0 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff20c010db0 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff20c01ad00 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c111c90 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.097+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c112800 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.098+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ff20c0193c0 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.098+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c05f5f0 con 0x7ff21c102720 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.098+0000 7ff212ffd700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 0x7ff208038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:35.945 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.098+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff20c04a690 con 0x7ff21c102720 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.098+0000 7ff221bfe700 1 -- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 msgr2=0x7ff208038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.098+0000 7ff221bfe700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 0x7ff208038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.103+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff20c022930 con 0x7ff21c102720 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.299+0000 7ff221bfe700 1 -- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 msgr2=0x7ff208038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.299+0000 7ff221bfe700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 0x7ff208038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.340+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff21c112ba0 con 0x7ff21c102720 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.341+0000 7ff212ffd700 1 -- 172.21.15.134:0/1126189686 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff20c022340 con 0x7ff21c102720 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 msgr2=0x7ff208038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 0x7ff208038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:35.946 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 msgr2=0x7ff21c111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c111550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff20c000c00 tx=0x7ff20c009250 comp rx=0 tx=0).stop 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 shutdown_connections 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7ff208036790 0x7ff208038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 --2- 172.21.15.134:0/1126189686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff21c102720 0x7ff21c111550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 >> 172.21.15.134:0/1126189686 conn(0x7ff21c0fde40 msgr2=0x7ff21c0fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 shutdown_connections 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:35.343+0000 7ff224663700 1 -- 172.21.15.134:0/1126189686 wait complete. 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for the mgr to restart... 2024-03-22T07:19:35.947 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr epoch 5... 2024-03-22T07:19:36.193 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:35 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1126189686' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-22T07:19:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: Active manager daemon smithi134.wtwqre restarted 2024-03-22T07:19:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:19:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: osdmap e2: 0 total, 0 up, 0 in 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: mgrmap e6: smithi134.wtwqre(active, starting, since 0.00321764s) 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:19:40.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:40 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:19:41.790 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:41 smithi134 ceph-mon[29057]: Found migration_current of "None". Setting to last migration. 2024-03-22T07:19:41.790 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:41 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:19:41.790 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:41 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:19:41.791 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:41 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:41.791 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:41 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:19:41.791 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:41 smithi134 ceph-mon[29057]: mgrmap e7: smithi134.wtwqre(active, since 1.00592s) 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2bb683700 1 Processor -- start 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2bb683700 1 -- start start 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2bb683700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b40771c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2bb683700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4079070 con 0x7fb2b4078c60 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2b941f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b40771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:42.035 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2b941f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b40771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40622/0 (socket says 172.21.15.134:40622) 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2b941f700 1 -- 172.21.15.134:0/3791105479 learned_addr learned my addr 172.21.15.134:0/3791105479 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.404+0000 7fb2b941f700 1 -- 172.21.15.134:0/3791105479 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4077700 con 0x7fb2b4078c60 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2b941f700 1 --2- 172.21.15.134:0/3791105479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b40771c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00098e0 tx=0x7fb2b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb835024e5fec00 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2abfff700 1 -- 172.21.15.134:0/3791105479 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2b000b860 con 0x7fb2b4078c60 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2abfff700 1 -- 172.21.15.134:0/3791105479 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb2b000be50 con 0x7fb2b4078c60 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2abfff700 1 -- 172.21.15.134:0/3791105479 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2b0010380 con 0x7fb2b4078c60 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2bb683700 1 -- 172.21.15.134:0/3791105479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 msgr2=0x7fb2b40771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2bb683700 1 --2- 172.21.15.134:0/3791105479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b40771c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00098e0 tx=0x7fb2b0009250 comp rx=0 tx=0).stop 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2bb683700 1 -- 172.21.15.134:0/3791105479 shutdown_connections 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2bb683700 1 --2- 172.21.15.134:0/3791105479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b40771c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.405+0000 7fb2bb683700 1 -- 172.21.15.134:0/3791105479 >> 172.21.15.134:0/3791105479 conn(0x7fb2b40fde40 msgr2=0x7fb2b41002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2bb683700 1 -- 172.21.15.134:0/3791105479 shutdown_connections 2024-03-22T07:19:42.036 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2bb683700 1 -- 172.21.15.134:0/3791105479 wait complete. 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2bb683700 1 Processor -- start 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2bb683700 1 -- start start 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2bb683700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b41137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2bb683700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4113d10 con 0x7fb2b4078c60 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2b941f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b41137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2b941f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b41137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40634/0 (socket says 172.21.15.134:40634) 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.406+0000 7fb2b941f700 1 -- 172.21.15.134:0/1387088721 learned_addr learned my addr 172.21.15.134:0/1387088721 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2b941f700 1 -- 172.21.15.134:0/1387088721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00094f0 con 0x7fb2b4078c60 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2b941f700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b41137d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0006fd0 tx=0x7fb2b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2b00107c0 con 0x7fb2b4078c60 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb2b0010db0 con 0x7fb2b4078c60 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2b001ada0 con 0x7fb2b4078c60 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4113f10 con 0x7fb2b4078c60 2024-03-22T07:19:42.037 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.407+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4114a80 con 0x7fb2b4078c60 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.409+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fb2b0010920 con 0x7fb2b4078c60 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.409+0000 7fb2a9ffb700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.409+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 --> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2a0039350 con 0x7fb2a0036790 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.409+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb2b0049d40 con 0x7fb2b4078c60 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.409+0000 7fb2b8c1e700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 msgr2=0x7fb2a0038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.409+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.610+0000 7fb2b8c1e700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 msgr2=0x7fb2a0038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:36.610+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:37.011+0000 7fb2b8c1e700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 msgr2=0x7fb2a0038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:37.011+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:37.812+0000 7fb2b8c1e700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 msgr2=0x7fb2a0038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:37.812+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:39.413+0000 7fb2b8c1e700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 msgr2=0x7fb2a0038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/1050133516 2024-03-22T07:19:42.038 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:39.413+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:40.484+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7fb2b00197d0 con 0x7fb2b4078c60 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:40.484+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 msgr2=0x7fb2a0038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:40.484+0000 7fb2a9ffb700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.486+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7fb2b004b890 con 0x7fb2b4078c60 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.486+0000 7fb2a9ffb700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2a0039fc0 0x7fb2a003c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.486+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2a0039350 con 0x7fb2a0039fc0 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.486+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2a0039fc0 0x7fb2a003c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.487+0000 7fb2b8c1e700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2a0039fc0 0x7fb2a003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40039d0 tx=0x7fb2a4009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.487+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fb2a0039350 con 0x7fb2a0039fc0 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.493+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fb2b41143a0 con 0x7fb2a0039fc0 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2a9ffb700 1 -- 172.21.15.134:0/1387088721 <== mgr.14120 v2:172.21.15.134:6800/55103982 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb2b41143a0 con 0x7fb2a0039fc0 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2a0039fc0 msgr2=0x7fb2a003c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2a0039fc0 0x7fb2a003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40039d0 tx=0x7fb2a4009350 comp rx=0 tx=0).stop 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 msgr2=0x7fb2b41137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:42.039 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b41137d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0006fd0 tx=0x7fb2b0009250 comp rx=0 tx=0).stop 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 shutdown_connections 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2a0039fc0 0x7fb2a003c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2b4078c60 0x7fb2b41137d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 --2- 172.21.15.134:0/1387088721 >> [v2:172.21.15.134:6800/1050133516,v1:172.21.15.134:6801/1050133516] conn(0x7fb2a0036790 0x7fb2a0038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 >> 172.21.15.134:0/1387088721 conn(0x7fb2b40fde40 msgr2=0x7fb2b40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 shutdown_connections 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:41.494+0000 7fb2bb683700 1 -- 172.21.15.134:0/1387088721 wait complete. 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:mgr epoch 5 is available 2024-03-22T07:19:42.040 INFO:teuthology.orchestra.run.smithi134.stdout:Setting orchestrator backend to cephadm... 2024-03-22T07:19:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:42 smithi134 ceph-mon[29057]: [22/Mar/2024:07:19:41] ENGINE Bus STARTING 2024-03-22T07:19:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:42 smithi134 ceph-mon[29057]: [22/Mar/2024:07:19:41] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:19:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:42 smithi134 ceph-mon[29057]: [22/Mar/2024:07:19:41] ENGINE Bus STARTED 2024-03-22T07:19:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:42 smithi134 ceph-mon[29057]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-22T07:19:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:42 smithi134 ceph-mon[29057]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4f06475700 1 Processor -- start 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4f06475700 1 -- start start 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4f06475700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f001019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4f06475700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f00101f20 con 0x7f4f001015d0 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4efffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f001019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4efffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f001019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40710/0 (socket says 172.21.15.134:40710) 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4efffff700 1 -- 172.21.15.134:0/4066826381 learned_addr learned my addr 172.21.15.134:0/4066826381 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.440+0000 7f4efffff700 1 -- 172.21.15.134:0/4066826381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00102060 con 0x7f4f001015d0 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4efffff700 1 --2- 172.21.15.134:0/4066826381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f001019e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000bb80 tx=0x7f4ef000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc1bbdde925b5f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4efeffd700 1 -- 172.21.15.134:0/4066826381 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef000dd00 con 0x7f4f001015d0 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4efeffd700 1 -- 172.21.15.134:0/4066826381 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4ef000de60 con 0x7f4f001015d0 2024-03-22T07:19:43.256 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4efeffd700 1 -- 172.21.15.134:0/4066826381 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef00188a0 con 0x7f4f001015d0 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 -- 172.21.15.134:0/4066826381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 msgr2=0x7f4f001019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 --2- 172.21.15.134:0/4066826381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f001019e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000bb80 tx=0x7f4ef000b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 -- 172.21.15.134:0/4066826381 shutdown_connections 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 --2- 172.21.15.134:0/4066826381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f001019e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 -- 172.21.15.134:0/4066826381 >> 172.21.15.134:0/4066826381 conn(0x7f4f000fcd50 msgr2=0x7f4f000ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 -- 172.21.15.134:0/4066826381 shutdown_connections 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.441+0000 7f4f06475700 1 -- 172.21.15.134:0/4066826381 wait complete. 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4f06475700 1 Processor -- start 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4f06475700 1 -- start start 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4f06475700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f0010f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4f06475700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0010f8c0 con 0x7f4f001015d0 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4efffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f0010f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4efffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f0010f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40712/0 (socket says 172.21.15.134:40712) 2024-03-22T07:19:43.257 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.442+0000 7f4efffff700 1 -- 172.21.15.134:0/3564715460 learned_addr learned my addr 172.21.15.134:0/3564715460 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4efffff700 1 -- 172.21.15.134:0/3564715460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef000b790 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4efffff700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f0010f380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0018600 tx=0x7f4ef000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef0010bd0 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4ef001d050 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0010fac0 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ef0022670 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.443+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f00110630 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.444+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f4ef0022820 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.444+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0005f5f0 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.444+0000 7f4efcff9700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4ee80366b0 0x7f4ee8038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.444+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4ef0014070 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.444+0000 7f4eff7fe700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4ee80366b0 0x7f4ee8038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.444+0000 7f4eff7fe700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4ee80366b0 0x7f4ee8038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009990 tx=0x7f4ef4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.449+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4ef0021d70 con 0x7f4f001015d0 2024-03-22T07:19:43.258 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.536+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f4ef002d980 con 0x7f4f001015d0 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.648+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f00110a40 con 0x7f4ee80366b0 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.656+0000 7f4efcff9700 1 -- 172.21.15.134:0/3564715460 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4f00110a40 con 0x7f4ee80366b0 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4ee80366b0 msgr2=0x7f4ee8038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4ee80366b0 0x7f4ee8038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009990 tx=0x7f4ef4006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 msgr2=0x7f4f0010f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f0010f380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0018600 tx=0x7f4ef000b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 shutdown_connections 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4ee80366b0 0x7f4ee8038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 --2- 172.21.15.134:0/3564715460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f001015d0 0x7f4f0010f380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.658+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 >> 172.21.15.134:0/3564715460 conn(0x7f4f000fcd50 msgr2=0x7f4f00105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.659+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 shutdown_connections 2024-03-22T07:19:43.259 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:42.659+0000 7f4f06475700 1 -- 172.21.15.134:0/3564715460 wait complete. 2024-03-22T07:19:43.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:43 smithi134 ceph-mon[29057]: mgrmap e8: smithi134.wtwqre(active, since 2s) 2024-03-22T07:19:43.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:43 smithi134 ceph-mon[29057]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:43.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:43 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:43.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:43 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:19:44.479 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e3da8c700 1 Processor -- start 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e3da8c700 1 -- start start 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e3da8c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e38103050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e3da8c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38103590 con 0x7f7e38102c40 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e38103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e38103050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40200/0 (socket says 172.21.15.134:40200) 2024-03-22T07:19:44.480 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e377fe700 1 -- 172.21.15.134:0/1562627750 learned_addr learned my addr 172.21.15.134:0/1562627750 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e377fe700 1 -- 172.21.15.134:0/1562627750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e381036d0 con 0x7f7e38102c40 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.680+0000 7f7e377fe700 1 --2- 172.21.15.134:0/1562627750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e38103050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e280098e0 tx=0x7f7e28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d59812b4923073 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e367fc700 1 -- 172.21.15.134:0/1562627750 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e2800b860 con 0x7f7e38102c40 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e367fc700 1 -- 172.21.15.134:0/1562627750 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7e2800be50 con 0x7f7e38102c40 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e367fc700 1 -- 172.21.15.134:0/1562627750 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e28010380 con 0x7f7e38102c40 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 -- 172.21.15.134:0/1562627750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 msgr2=0x7f7e38103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 --2- 172.21.15.134:0/1562627750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e38103050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e280098e0 tx=0x7f7e28009250 comp rx=0 tx=0).stop 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 -- 172.21.15.134:0/1562627750 shutdown_connections 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 --2- 172.21.15.134:0/1562627750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e38103050 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 -- 172.21.15.134:0/1562627750 >> 172.21.15.134:0/1562627750 conn(0x7f7e380fc560 msgr2=0x7f7e380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 -- 172.21.15.134:0/1562627750 shutdown_connections 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.681+0000 7f7e3da8c700 1 -- 172.21.15.134:0/1562627750 wait complete. 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e3da8c700 1 Processor -- start 2024-03-22T07:19:44.481 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e3da8c700 1 -- start start 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e3da8c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e381013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e3da8c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381142e0 con 0x7f7e38102c40 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e381013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e381013f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40212/0 (socket says 172.21.15.134:40212) 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e377fe700 1 -- 172.21.15.134:0/3018415705 learned_addr learned my addr 172.21.15.134:0/3018415705 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.682+0000 7f7e377fe700 1 -- 172.21.15.134:0/3018415705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280094f0 con 0x7f7e38102c40 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.683+0000 7f7e377fe700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e381013f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800ba90 tx=0x7f7e28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.683+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e280107c0 con 0x7f7e38102c40 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.683+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7e28010db0 con 0x7f7e38102c40 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.683+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e38114420 con 0x7f7e38102c40 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.683+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e2801add0 con 0x7f7e38102c40 2024-03-22T07:19:44.482 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.683+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e381148b0 con 0x7f7e38102c40 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.684+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f7e2802e440 con 0x7f7e38102c40 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.684+0000 7f7e1ffff700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7e20036790 0x7f7e20038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.684+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3804bed0 con 0x7f7e38102c40 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.684+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7e2804a630 con 0x7f7e38102c40 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.684+0000 7f7e36ffd700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7e20036790 0x7f7e20038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.684+0000 7f7e36ffd700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7e20036790 0x7f7e20038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009990 tx=0x7f7e2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.689+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7e28018940 con 0x7f7e38102c40 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.876+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e380fd7f0 con 0x7f7e20036790 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.877+0000 7f7e1ffff700 1 -- 172.21.15.134:0/3018415705 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f7e380fd7f0 con 0x7f7e20036790 2024-03-22T07:19:44.483 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7e20036790 msgr2=0x7f7e20038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7e20036790 0x7f7e20038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009990 tx=0x7f7e2c006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 msgr2=0x7f7e381013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e381013f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800ba90 tx=0x7f7e28009250 comp rx=0 tx=0).stop 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 shutdown_connections 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7e20036790 0x7f7e20038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 --2- 172.21.15.134:0/3018415705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e38102c40 0x7f7e381013f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.879+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 >> 172.21.15.134:0/3018415705 conn(0x7f7e380fc560 msgr2=0x7f7e380fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.880+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 shutdown_connections 2024-03-22T07:19:44.484 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:43.880+0000 7f7e3da8c700 1 -- 172.21.15.134:0/3018415705 wait complete. 2024-03-22T07:19:44.485 INFO:teuthology.orchestra.run.smithi134.stdout:Generating ssh key... 2024-03-22T07:19:44.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:44 smithi134 ceph-mon[29057]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.919+0000 7fd143aee700 1 Processor -- start 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.919+0000 7fd143aee700 1 -- start start 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.919+0000 7fd143aee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c104190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.919+0000 7fd143aee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c1046d0 con 0x7fd13c103d80 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd14188a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd14188a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c104190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40220/0 (socket says 172.21.15.134:40220) 2024-03-22T07:19:45.811 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd14188a700 1 -- 172.21.15.134:0/51649704 learned_addr learned my addr 172.21.15.134:0/51649704 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd14188a700 1 -- 172.21.15.134:0/51649704 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c104810 con 0x7fd13c103d80 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd14188a700 1 --2- 172.21.15.134:0/51649704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c104190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0098e0 tx=0x7fd12c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e6fa8d12fc427a server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd140888700 1 -- 172.21.15.134:0/51649704 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd12c00b860 con 0x7fd13c103d80 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd140888700 1 -- 172.21.15.134:0/51649704 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd12c00be50 con 0x7fd13c103d80 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.920+0000 7fd140888700 1 -- 172.21.15.134:0/51649704 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd12c010380 con 0x7fd13c103d80 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 -- 172.21.15.134:0/51649704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 msgr2=0x7fd13c104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 --2- 172.21.15.134:0/51649704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c104190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0098e0 tx=0x7fd12c009250 comp rx=0 tx=0).stop 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 -- 172.21.15.134:0/51649704 shutdown_connections 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 --2- 172.21.15.134:0/51649704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c104190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 -- 172.21.15.134:0/51649704 >> 172.21.15.134:0/51649704 conn(0x7fd13c0fc560 msgr2=0x7fd13c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 -- 172.21.15.134:0/51649704 shutdown_connections 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 -- 172.21.15.134:0/51649704 wait complete. 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 Processor -- start 2024-03-22T07:19:45.812 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.921+0000 7fd143aee700 1 -- start start 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd143aee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c1115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd143aee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c111b00 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd14188a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c1115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd14188a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c1115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40232/0 (socket says 172.21.15.134:40232) 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd14188a700 1 -- 172.21.15.134:0/1811718542 learned_addr learned my addr 172.21.15.134:0/1811718542 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd14188a700 1 -- 172.21.15.134:0/1811718542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c0094f0 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd14188a700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c1115c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd12c006b00 tx=0x7fd12c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd12c010760 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd12c010d50 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c111d00 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd12c01ad40 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.922+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c112870 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.923+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd12c0108c0 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.923+0000 7fd13a7fc700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd124036790 0x7fd124038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.923+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c05f5f0 con 0x7fd13c103d80 2024-03-22T07:19:45.813 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.923+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd12c04a590 con 0x7fd13c103d80 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.923+0000 7fd141089700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd124036790 0x7fd124038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.924+0000 7fd141089700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd124036790 0x7fd124038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd130009990 tx=0x7fd130006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:44.928+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd12c01a5c0 con 0x7fd13c103d80 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.112+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd13c0fd810 con 0x7fd124036790 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.221+0000 7fd13a7fc700 1 -- 172.21.15.134:0/1811718542 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd13c0fd810 con 0x7fd124036790 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd124036790 msgr2=0x7fd124038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd124036790 0x7fd124038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd130009990 tx=0x7fd130006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 msgr2=0x7fd13c1115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c1115c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd12c006b00 tx=0x7fd12c009250 comp rx=0 tx=0).stop 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 shutdown_connections 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd124036790 0x7fd124038c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 --2- 172.21.15.134:0/1811718542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd13c103d80 0x7fd13c1115c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:45.814 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 >> 172.21.15.134:0/1811718542 conn(0x7fd13c0fc560 msgr2=0x7fd13c0fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:45.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 shutdown_connections 2024-03-22T07:19:45.815 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:45.223+0000 7fd143aee700 1 -- 172.21.15.134:0/1811718542 wait complete. 2024-03-22T07:19:46.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:46 smithi134 ceph-mon[29057]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:46.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:46 smithi134 ceph-mon[29057]: Generating ssh key... 2024-03-22T07:19:46.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:46 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:46.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:46 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:47.009 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU2Hvei4x1jKfTf5ktNAMLQv+nWIJQeExFxhP/UfjjBdBoJhNeZGVFmS6ZwCSSNn/FttepBNTEXhFLCCU5Av5GWGoX1/RtgTVfFXiJXtmcSiBJoEGxV2lNmbmp5SPKnV33eV4ym03c1VIC+INwyYVIUU3aa9Sm1smYLG5YUSCstv0F+X4GFxVTyUa/ycB567OaokGN8BH26hkNuN6u7LNOvCDHvUUWCAtnfbbwtxnvLMVbVXqndtSHG3XeI47tYrq7KptN4T2/RjE3/HVnKBjM2tF5qVlC+kUqsRzPMPoa47aJki+nugwVPG8G/MZeqqAzWCLu6aZ2/TO1f6q+mrMROs96+9TAihNW41jqQE2wIeYmrF8LwMfeMWzjPkEpEKlonIiVi4nC8A8thXSbHTuKSiTczb5T9eoqXQmp+C66NsguLlE9QDrLf+ZoFOOQknS9Kb75wQFA7P0wJsdq7KR5XYlYuPtK3DVIWauHj+lS0/0oHro5xQf4Ez8KQtqK5XM= ceph-5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:19:47.009 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f794b700 1 Processor -- start 2024-03-22T07:19:47.009 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f794b700 1 -- start start 2024-03-22T07:19:47.009 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f794b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f0102b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:47.009 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f794b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0103080 con 0x7f80f0102730 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f56e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f0102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f56e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f0102b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40248/0 (socket says 172.21.15.134:40248) 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f56e7700 1 -- 172.21.15.134:0/1948939707 learned_addr learned my addr 172.21.15.134:0/1948939707 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.226+0000 7f80f56e7700 1 -- 172.21.15.134:0/1948939707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f01031c0 con 0x7f80f0102730 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80f56e7700 1 --2- 172.21.15.134:0/1948939707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f0102b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0098e0 tx=0x7f80ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f292f7e9d35c3299 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80e7fff700 1 -- 172.21.15.134:0/1948939707 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80ec00b860 con 0x7f80f0102730 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80e7fff700 1 -- 172.21.15.134:0/1948939707 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f80ec00be50 con 0x7f80f0102730 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80e7fff700 1 -- 172.21.15.134:0/1948939707 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80ec010380 con 0x7f80f0102730 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80f794b700 1 -- 172.21.15.134:0/1948939707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 msgr2=0x7f80f0102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80f794b700 1 --2- 172.21.15.134:0/1948939707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f0102b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0098e0 tx=0x7f80ec009250 comp rx=0 tx=0).stop 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80f794b700 1 -- 172.21.15.134:0/1948939707 shutdown_connections 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80f794b700 1 --2- 172.21.15.134:0/1948939707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f0102b40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:47.010 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.227+0000 7f80f794b700 1 -- 172.21.15.134:0/1948939707 >> 172.21.15.134:0/1948939707 conn(0x7f80f00fdf10 msgr2=0x7f80f0100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f794b700 1 -- 172.21.15.134:0/1948939707 shutdown_connections 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f794b700 1 -- 172.21.15.134:0/1948939707 wait complete. 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f794b700 1 Processor -- start 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f794b700 1 -- start start 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f794b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f01115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f794b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0111b30 con 0x7f80f0102730 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f56e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f01115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f56e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f01115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40262/0 (socket says 172.21.15.134:40262) 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.228+0000 7f80f56e7700 1 -- 172.21.15.134:0/2103702230 learned_addr learned my addr 172.21.15.134:0/2103702230 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80f56e7700 1 -- 172.21.15.134:0/2103702230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0094f0 con 0x7f80f0102730 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80f56e7700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f01115f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f80ec006fd0 tx=0x7f80ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80ec0107c0 con 0x7f80f0102730 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f80ec010db0 con 0x7f80f0102730 2024-03-22T07:19:47.011 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f0111d30 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80ec01ada0 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.229+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f01128a0 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.230+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f80ec010920 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.230+0000 7f80e5ffb700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f80dc0367e0 0x7f80dc038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.230+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f01121c0 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.230+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f80ec049d30 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.230+0000 7f80f4ee6700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f80dc0367e0 0x7f80dc038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.231+0000 7f80f4ee6700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f80dc0367e0 0x7f80dc038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009990 tx=0x7f80e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.235+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f80ec020070 con 0x7f80f0102730 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.419+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f80f00ff2d0 con 0x7f80dc0367e0 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.419+0000 7f80e5ffb700 1 -- 172.21.15.134:0/2103702230 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f80f00ff2d0 con 0x7f80dc0367e0 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f80dc0367e0 msgr2=0x7f80dc038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f80dc0367e0 0x7f80dc038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009990 tx=0x7f80e0006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:47.012 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 msgr2=0x7f80f01115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f01115f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f80ec006fd0 tx=0x7f80ec009250 comp rx=0 tx=0).stop 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 shutdown_connections 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f80dc0367e0 0x7f80dc038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 --2- 172.21.15.134:0/2103702230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80f0102730 0x7f80f01115f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.421+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 >> 172.21.15.134:0/2103702230 conn(0x7f80f00fdf10 msgr2=0x7f80f00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.422+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 shutdown_connections 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:46.422+0000 7f80f794b700 1 -- 172.21.15.134:0/2103702230 wait complete. 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:Adding key to root@localhost authorized_keys... 2024-03-22T07:19:47.013 INFO:teuthology.orchestra.run.smithi134.stdout:Adding host smithi134... 2024-03-22T07:19:47.489 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:47 smithi134 ceph-mon[29057]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:48.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:48 smithi134 ceph-mon[29057]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "addr": "172.21.15.134", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:49.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:49 smithi134 ceph-mon[29057]: Deploying cephadm binary to smithi134 2024-03-22T07:19:50.311 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Added host 'smithi134' with addr '172.21.15.134' 2024-03-22T07:19:50.311 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.420+0000 7f0ed97fe700 1 Processor -- start 2024-03-22T07:19:50.311 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed97fe700 1 -- start start 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed97fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4105310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed97fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4105850 con 0x7f0ed4076be0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4105310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4105310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40268/0 (socket says 172.21.15.134:40268) 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed2ffd700 1 -- 172.21.15.134:0/1807455417 learned_addr learned my addr 172.21.15.134:0/1807455417 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed2ffd700 1 -- 172.21.15.134:0/1807455417 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4105990 con 0x7f0ed4076be0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed2ffd700 1 --2- 172.21.15.134:0/1807455417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4105310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40098e0 tx=0x7f0ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3305b09f29072298 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.421+0000 7f0ed1ffb700 1 -- 172.21.15.134:0/1807455417 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ec400b860 con 0x7f0ed4076be0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed1ffb700 1 -- 172.21.15.134:0/1807455417 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0ec400be50 con 0x7f0ed4076be0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed1ffb700 1 -- 172.21.15.134:0/1807455417 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ec4010380 con 0x7f0ed4076be0 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 -- 172.21.15.134:0/1807455417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 msgr2=0x7f0ed4105310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 --2- 172.21.15.134:0/1807455417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4105310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40098e0 tx=0x7f0ec4009250 comp rx=0 tx=0).stop 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 -- 172.21.15.134:0/1807455417 shutdown_connections 2024-03-22T07:19:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 --2- 172.21.15.134:0/1807455417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4105310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 -- 172.21.15.134:0/1807455417 >> 172.21.15.134:0/1807455417 conn(0x7f0ed40fcdc0 msgr2=0x7f0ed40ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 -- 172.21.15.134:0/1807455417 shutdown_connections 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.422+0000 7f0ed97fe700 1 -- 172.21.15.134:0/1807455417 wait complete. 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed97fe700 1 Processor -- start 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed97fe700 1 -- start start 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed97fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed97fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41031a0 con 0x7f0ed4076be0 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40278/0 (socket says 172.21.15.134:40278) 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.423+0000 7f0ed2ffd700 1 -- 172.21.15.134:0/818971469 learned_addr learned my addr 172.21.15.134:0/818971469 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ed2ffd700 1 -- 172.21.15.134:0/818971469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40094f0 con 0x7f0ed4076be0 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ed2ffd700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4102c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4003050 tx=0x7f0ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ec4010760 con 0x7f0ed4076be0 2024-03-22T07:19:50.313 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f0ec4010d50 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ec401ae20 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4101210 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.424+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4101700 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.425+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f0ec402e440 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.425+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed404bed0 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.425+0000 7f0ebb7fe700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f0ebc0367e0 0x7f0ebc038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.425+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ec404a4a0 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.425+0000 7f0ed27fc700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f0ebc0367e0 0x7f0ebc038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.426+0000 7f0ed27fc700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f0ebc0367e0 0x7f0ebc038c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009990 tx=0x7f0ec8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.430+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0ec4018940 con 0x7f0ed4076be0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:47.627+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "addr": "172.21.15.134", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ed4101e10 con 0x7f0ebc0367e0 2024-03-22T07:19:50.314 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.655+0000 7f0ebb7fe700 1 -- 172.21.15.134:0/818971469 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0ed4101e10 con 0x7f0ebc0367e0 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f0ebc0367e0 msgr2=0x7f0ebc038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f0ebc0367e0 0x7f0ebc038c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009990 tx=0x7f0ec8006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 msgr2=0x7f0ed4102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4102c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4003050 tx=0x7f0ec4009250 comp rx=0 tx=0).stop 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 shutdown_connections 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f0ebc0367e0 0x7f0ebc038c90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 --2- 172.21.15.134:0/818971469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ed4076be0 0x7f0ed4102c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 >> 172.21.15.134:0/818971469 conn(0x7f0ed40fcdc0 msgr2=0x7f0ed40fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 shutdown_connections 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:49.658+0000 7f0ed97fe700 1 -- 172.21.15.134:0/818971469 wait complete. 2024-03-22T07:19:50.315 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying mon service with default placement... 2024-03-22T07:19:50.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:50 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:50.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:50 smithi134 ceph-mon[29057]: Added host smithi134 2024-03-22T07:19:50.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:50 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:19:51.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-22T07:19:51.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.729+0000 7f422cdd3700 1 Processor -- start 2024-03-22T07:19:51.694 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.729+0000 7f422cdd3700 1 -- start start 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422cdd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f42281019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422cdd3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228101f20 con 0x7f42281015d0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f42281019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f42281019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40294/0 (socket says 172.21.15.134:40294) 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422659c700 1 -- 172.21.15.134:0/2071172297 learned_addr learned my addr 172.21.15.134:0/2071172297 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422659c700 1 -- 172.21.15.134:0/2071172297 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228102060 con 0x7f42281015d0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422659c700 1 --2- 172.21.15.134:0/2071172297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f42281019e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42180098e0 tx=0x7f4218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e29c338f6f9f040 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422559a700 1 -- 172.21.15.134:0/2071172297 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f421800b860 con 0x7f42281015d0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422559a700 1 -- 172.21.15.134:0/2071172297 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f421800be50 con 0x7f42281015d0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.730+0000 7f422559a700 1 -- 172.21.15.134:0/2071172297 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4218010380 con 0x7f42281015d0 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 -- 172.21.15.134:0/2071172297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 msgr2=0x7f42281019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 --2- 172.21.15.134:0/2071172297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f42281019e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42180098e0 tx=0x7f4218009250 comp rx=0 tx=0).stop 2024-03-22T07:19:51.695 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 -- 172.21.15.134:0/2071172297 shutdown_connections 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 --2- 172.21.15.134:0/2071172297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f42281019e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 -- 172.21.15.134:0/2071172297 >> 172.21.15.134:0/2071172297 conn(0x7f42280fcd50 msgr2=0x7f42280ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 -- 172.21.15.134:0/2071172297 shutdown_connections 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.731+0000 7f422cdd3700 1 -- 172.21.15.134:0/2071172297 wait complete. 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422cdd3700 1 Processor -- start 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422cdd3700 1 -- start start 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422cdd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f4228071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422cdd3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281142c0 con 0x7f42281015d0 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f4228071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f4228071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40308/0 (socket says 172.21.15.134:40308) 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422659c700 1 -- 172.21.15.134:0/515522412 learned_addr learned my addr 172.21.15.134:0/515522412 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422659c700 1 -- 172.21.15.134:0/515522412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180094f0 con 0x7f42281015d0 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422659c700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f4228071200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4218006b00 tx=0x7f4218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:51.696 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4218010760 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228114400 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4218010d50 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f421801ad40 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.732+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4228114890 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.733+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f421802e440 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.733+0000 7f4216ffd700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4210036790 0x7f4210038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.733+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f421804a700 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.733+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422804bed0 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.733+0000 7f4225d9b700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4210036790 0x7f4210038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.734+0000 7f4225d9b700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4210036790 0x7f4210038c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f421c009990 tx=0x7f421c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.738+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4218018350 con 0x7f42281015d0 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.949+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f42280fe000 con 0x7f4210036790 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.956+0000 7f4216ffd700 1 -- 172.21.15.134:0/515522412 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f42280fe000 con 0x7f4210036790 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4210036790 msgr2=0x7f4210038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:51.697 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4210036790 0x7f4210038c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f421c009990 tx=0x7f421c006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 msgr2=0x7f4228071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f4228071200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4218006b00 tx=0x7f4218009250 comp rx=0 tx=0).stop 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 shutdown_connections 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f4210036790 0x7f4210038c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 --2- 172.21.15.134:0/515522412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42281015d0 0x7f4228071200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 >> 172.21.15.134:0/515522412 conn(0x7f42280fcd50 msgr2=0x7f42280fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 shutdown_connections 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:50.958+0000 7f422cdd3700 1 -- 172.21.15.134:0/515522412 wait complete. 2024-03-22T07:19:51.698 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying mgr service with default placement... 2024-03-22T07:19:52.233 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:51 smithi134 ceph-mon[29057]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:52.233 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:51 smithi134 ceph-mon[29057]: Saving service mon spec with placement count:5 2024-03-22T07:19:52.233 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:51 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.143+0000 7f7b50266700 1 Processor -- start 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.143+0000 7f7b50266700 1 -- start start 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b50266700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b480771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b50266700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48079090 con 0x7f7b48078c80 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b4e002700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b480771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b4e002700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b480771e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40310/0 (socket says 172.21.15.134:40310) 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b4e002700 1 -- 172.21.15.134:0/1982213582 learned_addr learned my addr 172.21.15.134:0/1982213582 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b4e002700 1 -- 172.21.15.134:0/1982213582 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48077720 con 0x7f7b48078c80 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.144+0000 7f7b4e002700 1 --2- 172.21.15.134:0/1982213582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b480771e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b380098e0 tx=0x7f7b38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1b5cce5e68dd87 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b4d000700 1 -- 172.21.15.134:0/1982213582 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b3800b860 con 0x7f7b48078c80 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b4d000700 1 -- 172.21.15.134:0/1982213582 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7b3800be50 con 0x7f7b48078c80 2024-03-22T07:19:52.904 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b4d000700 1 -- 172.21.15.134:0/1982213582 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b38010380 con 0x7f7b48078c80 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 -- 172.21.15.134:0/1982213582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 msgr2=0x7f7b480771e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 --2- 172.21.15.134:0/1982213582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b480771e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b380098e0 tx=0x7f7b38009250 comp rx=0 tx=0).stop 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 -- 172.21.15.134:0/1982213582 shutdown_connections 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 --2- 172.21.15.134:0/1982213582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b480771e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 -- 172.21.15.134:0/1982213582 >> 172.21.15.134:0/1982213582 conn(0x7f7b480fdee0 msgr2=0x7f7b481002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 -- 172.21.15.134:0/1982213582 shutdown_connections 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.145+0000 7f7b50266700 1 -- 172.21.15.134:0/1982213582 wait complete. 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b50266700 1 Processor -- start 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b50266700 1 -- start start 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b50266700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b48113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b50266700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48113d50 con 0x7f7b48078c80 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b4e002700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b48113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b4e002700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b48113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40320/0 (socket says 172.21.15.134:40320) 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b4e002700 1 -- 172.21.15.134:0/3812363892 learned_addr learned my addr 172.21.15.134:0/3812363892 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:52.905 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.146+0000 7f7b4e002700 1 -- 172.21.15.134:0/3812363892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380094f0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.147+0000 7f7b4e002700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b48113810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b38006d40 tx=0x7f7b38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.147+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b38010760 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.147+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48113f50 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.147+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7b38010d50 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.147+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b3801adc0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.147+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b48114ac0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.148+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f7b380108c0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.148+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4805f5f0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.148+0000 7f7b3e7fc700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7b34036770 0x7f7b34038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.148+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7b38049ce0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.148+0000 7f7b4d801700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7b34036770 0x7f7b34038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.148+0000 7f7b4d801700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7b34036770 0x7f7b34038c20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009990 tx=0x7f7b44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.153+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7b3802b6c0 con 0x7f7b48078c80 2024-03-22T07:19:52.906 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.351+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b480ff260 con 0x7f7b34036770 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.358+0000 7f7b3e7fc700 1 -- 172.21.15.134:0/3812363892 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7b480ff260 con 0x7f7b34036770 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7b34036770 msgr2=0x7f7b34038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7b34036770 0x7f7b34038c20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009990 tx=0x7f7b44006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 msgr2=0x7f7b48113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b48113810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b38006d40 tx=0x7f7b38009250 comp rx=0 tx=0).stop 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 shutdown_connections 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f7b34036770 0x7f7b34038c20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 --2- 172.21.15.134:0/3812363892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b48078c80 0x7f7b48113810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 >> 172.21.15.134:0/3812363892 conn(0x7f7b480fdee0 msgr2=0x7f7b480fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 shutdown_connections 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:52.361+0000 7f7b50266700 1 -- 172.21.15.134:0/3812363892 wait complete. 2024-03-22T07:19:52.907 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying crash service with default placement... 2024-03-22T07:19:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:53 smithi134 ceph-mon[29057]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:53 smithi134 ceph-mon[29057]: Saving service mgr spec with placement count:2 2024-03-22T07:19:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:53 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:54.908 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:54 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:54.908 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:54 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:54.908 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:54 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:54.915 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.123+0000 7faf8d9fd700 1 Processor -- start 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.123+0000 7faf8d9fd700 1 -- start start 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.123+0000 7faf8d9fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88102b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.123+0000 7faf8d9fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88103080 con 0x7faf88102730 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88102b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52118/0 (socket says 172.21.15.134:52118) 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf86ffd700 1 -- 172.21.15.134:0/1236403005 learned_addr learned my addr 172.21.15.134:0/1236403005 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf86ffd700 1 -- 172.21.15.134:0/1236403005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf881031c0 con 0x7faf88102730 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf86ffd700 1 --2- 172.21.15.134:0/1236403005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88102b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf780098e0 tx=0x7faf78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdffa902bf6bd84 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf867fc700 1 -- 172.21.15.134:0/1236403005 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf7800b860 con 0x7faf88102730 2024-03-22T07:19:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf867fc700 1 -- 172.21.15.134:0/1236403005 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf7800be90 con 0x7faf88102730 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.124+0000 7faf867fc700 1 -- 172.21.15.134:0/1236403005 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf780103c0 con 0x7faf88102730 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 -- 172.21.15.134:0/1236403005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 msgr2=0x7faf88102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 --2- 172.21.15.134:0/1236403005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88102b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf780098e0 tx=0x7faf78009250 comp rx=0 tx=0).stop 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 -- 172.21.15.134:0/1236403005 shutdown_connections 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 --2- 172.21.15.134:0/1236403005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88102b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 -- 172.21.15.134:0/1236403005 >> 172.21.15.134:0/1236403005 conn(0x7faf880fdf10 msgr2=0x7faf88100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 -- 172.21.15.134:0/1236403005 shutdown_connections 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 -- 172.21.15.134:0/1236403005 wait complete. 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.125+0000 7faf8d9fd700 1 Processor -- start 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf8d9fd700 1 -- start start 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf8d9fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88078bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf8d9fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88079110 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88078bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf86ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88078bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52120/0 (socket says 172.21.15.134:52120) 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf86ffd700 1 -- 172.21.15.134:0/906883096 learned_addr learned my addr 172.21.15.134:0/906883096 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf86ffd700 1 -- 172.21.15.134:0/906883096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780094f0 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf86ffd700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88078bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf780094c0 tx=0x7faf78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf78010680 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf78010cb0 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf88077180 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf7801ad40 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.126+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf88077670 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.127+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7faf78025400 con 0x7faf88102730 2024-03-22T07:19:54.918 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.127+0000 7faf7ffff700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7faf74036790 0x7faf74038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.127+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faf7801a460 con 0x7faf88102730 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.127+0000 7faf7e7fc700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7faf74036790 0x7faf74038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.127+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8804bed0 con 0x7faf88102730 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.128+0000 7faf7e7fc700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7faf74036790 0x7faf74038c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faf70009990 tx=0x7faf70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.132+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7faf78020070 con 0x7faf88102730 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.341+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7faf88077d00 con 0x7faf74036790 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.345+0000 7faf7ffff700 1 -- 172.21.15.134:0/906883096 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7faf88077d00 con 0x7faf74036790 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.347+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7faf74036790 msgr2=0x7faf74038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.347+0000 7faf8d9fd700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7faf74036790 0x7faf74038c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faf70009990 tx=0x7faf70006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 msgr2=0x7faf88078bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88078bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf780094c0 tx=0x7faf78009250 comp rx=0 tx=0).stop 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 shutdown_connections 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7faf74036790 0x7faf74038c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:54.919 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 --2- 172.21.15.134:0/906883096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf88102730 0x7faf88078bd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:54.920 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 >> 172.21.15.134:0/906883096 conn(0x7faf880fdf10 msgr2=0x7faf880feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:54.920 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 shutdown_connections 2024-03-22T07:19:54.920 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:54.348+0000 7faf8d9fd700 1 -- 172.21.15.134:0/906883096 wait complete. 2024-03-22T07:19:54.920 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying prometheus service with default placement... 2024-03-22T07:19:55.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:55 smithi134 ceph-mon[29057]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:55.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:55 smithi134 ceph-mon[29057]: Saving service crash spec with placement * 2024-03-22T07:19:55.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:55 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:56.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-03-22T07:19:56.776 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.306+0000 7f221c5f6700 1 Processor -- start 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.306+0000 7f221c5f6700 1 -- start start 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.306+0000 7f221c5f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.306+0000 7f221c5f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214103000 con 0x7f22141026b0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f221a392700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f221a392700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214102ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52130/0 (socket says 172.21.15.134:52130) 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f221a392700 1 -- 172.21.15.134:0/2812527272 learned_addr learned my addr 172.21.15.134:0/2812527272 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f221a392700 1 -- 172.21.15.134:0/2812527272 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214103140 con 0x7f22141026b0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f221a392700 1 --2- 172.21.15.134:0/2812527272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214102ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f22040098e0 tx=0x7f2204009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2e12039890bd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f2219390700 1 -- 172.21.15.134:0/2812527272 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f220400b860 con 0x7f22141026b0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f2219390700 1 -- 172.21.15.134:0/2812527272 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f220400be90 con 0x7f22141026b0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.307+0000 7f2219390700 1 -- 172.21.15.134:0/2812527272 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22040103c0 con 0x7f22141026b0 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 -- 172.21.15.134:0/2812527272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 msgr2=0x7f2214102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 --2- 172.21.15.134:0/2812527272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214102ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f22040098e0 tx=0x7f2204009250 comp rx=0 tx=0).stop 2024-03-22T07:19:56.777 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 -- 172.21.15.134:0/2812527272 shutdown_connections 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 --2- 172.21.15.134:0/2812527272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214102ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 -- 172.21.15.134:0/2812527272 >> 172.21.15.134:0/2812527272 conn(0x7f22140fde70 msgr2=0x7f2214100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 -- 172.21.15.134:0/2812527272 shutdown_connections 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 -- 172.21.15.134:0/2812527272 wait complete. 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 Processor -- start 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.308+0000 7f221c5f6700 1 -- start start 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221c5f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221c5f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214111ad0 con 0x7f22141026b0 2024-03-22T07:19:56.778 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221a392700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221a392700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52144/0 (socket says 172.21.15.134:52144) 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221a392700 1 -- 172.21.15.134:0/2687625030 learned_addr learned my addr 172.21.15.134:0/2687625030 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221a392700 1 -- 172.21.15.134:0/2687625030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040094f0 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221a392700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214111590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22040090b0 tx=0x7f2204009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2204010840 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2204010e70 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2214111cd0 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2204024e40 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.309+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2214112840 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.310+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f220401a510 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.310+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221405f5f0 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.310+0000 7f220affd700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2200036740 0x7f2200038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.310+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f220404a8e0 con 0x7f22141026b0 2024-03-22T07:19:56.779 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.310+0000 7f2219b91700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2200036740 0x7f2200038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.311+0000 7f2219b91700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2200036740 0x7f2200038bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2210009990 tx=0x7f2210006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.315+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2204018940 con 0x7f22141026b0 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.550+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f22140ff100 con 0x7f2200036740 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.554+0000 7f220affd700 1 -- 172.21.15.134:0/2687625030 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f22140ff100 con 0x7f2200036740 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2200036740 msgr2=0x7f2200038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2200036740 0x7f2200038bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2210009990 tx=0x7f2210006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 msgr2=0x7f2214111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214111590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22040090b0 tx=0x7f2204009250 comp rx=0 tx=0).stop 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 shutdown_connections 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2200036740 0x7f2200038bf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 --2- 172.21.15.134:0/2687625030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22141026b0 0x7f2214111590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 >> 172.21.15.134:0/2687625030 conn(0x7f22140fde70 msgr2=0x7f22140fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 shutdown_connections 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:55.557+0000 7f221c5f6700 1 -- 172.21.15.134:0/2687625030 wait complete. 2024-03-22T07:19:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying grafana service with default placement... 2024-03-22T07:19:56.980 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:56 smithi134 ceph-mon[29057]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:56.980 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:56 smithi134 ceph-mon[29057]: Saving service prometheus spec with placement count:1 2024-03-22T07:19:56.980 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:56 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:58.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-03-22T07:19:58.050 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.189+0000 7f9560e01700 1 Processor -- start 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.189+0000 7f9560e01700 1 -- start start 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f9560e01700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f9560e01700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c101f20 con 0x7f955c1015d0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52152/0 (socket says 172.21.15.134:52152) 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955a59c700 1 -- 172.21.15.134:0/3333393960 learned_addr learned my addr 172.21.15.134:0/3333393960 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955a59c700 1 -- 172.21.15.134:0/3333393960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c102060 con 0x7f955c1015d0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955a59c700 1 --2- 172.21.15.134:0/3333393960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1019e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f954c00bb80 tx=0x7f954c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec223753c44c843 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955959a700 1 -- 172.21.15.134:0/3333393960 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f954c00dd00 con 0x7f955c1015d0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955959a700 1 -- 172.21.15.134:0/3333393960 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f954c00de60 con 0x7f955c1015d0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.190+0000 7f955959a700 1 -- 172.21.15.134:0/3333393960 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f954c018920 con 0x7f955c1015d0 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 -- 172.21.15.134:0/3333393960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 msgr2=0x7f955c1019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 --2- 172.21.15.134:0/3333393960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1019e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f954c00bb80 tx=0x7f954c00b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:58.051 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 -- 172.21.15.134:0/3333393960 shutdown_connections 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 --2- 172.21.15.134:0/3333393960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1019e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 -- 172.21.15.134:0/3333393960 >> 172.21.15.134:0/3333393960 conn(0x7f955c0fcd50 msgr2=0x7f955c0ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 -- 172.21.15.134:0/3333393960 shutdown_connections 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.191+0000 7f9560e01700 1 -- 172.21.15.134:0/3333393960 wait complete. 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f9560e01700 1 Processor -- start 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f9560e01700 1 -- start start 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f9560e01700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f9560e01700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c113cf0 con 0x7f955c1015d0 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f955a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f955a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52162/0 (socket says 172.21.15.134:52162) 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f955a59c700 1 -- 172.21.15.134:0/3945183360 learned_addr learned my addr 172.21.15.134:0/3945183360 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f955a59c700 1 -- 172.21.15.134:0/3945183360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c00b790 con 0x7f955c1015d0 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.192+0000 7f955a59c700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1137b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f954c0106a0 tx=0x7f954c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.193+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f954c00dc70 con 0x7f955c1015d0 2024-03-22T07:19:58.052 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.193+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f954c010c30 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.193+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c113ef0 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.193+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f954c021550 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.193+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c114a60 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.194+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f954c0217c0 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.194+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c05f5f0 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.194+0000 7f954affd700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f95440367e0 0x7f9544038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.194+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f954c014070 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.194+0000 7f9559d9b700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f95440367e0 0x7f9544038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.194+0000 7f9559d9b700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f95440367e0 0x7f9544038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9550009990 tx=0x7f9550006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.199+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f954c00e930 con 0x7f955c1015d0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.409+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f955c114e10 con 0x7f95440367e0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.414+0000 7f954affd700 1 -- 172.21.15.134:0/3945183360 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f955c114e10 con 0x7f95440367e0 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f95440367e0 msgr2=0x7f9544038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f95440367e0 0x7f9544038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9550009990 tx=0x7f9550006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:58.053 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 msgr2=0x7f955c1137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1137b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f954c0106a0 tx=0x7f954c00b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 shutdown_connections 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f95440367e0 0x7f9544038c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 --2- 172.21.15.134:0/3945183360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f955c1015d0 0x7f955c1137b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 >> 172.21.15.134:0/3945183360 conn(0x7f955c0fcd50 msgr2=0x7f955c105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 shutdown_connections 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:57.416+0000 7f9560e01700 1 -- 172.21.15.134:0/3945183360 wait complete. 2024-03-22T07:19:58.054 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying node-exporter service with default placement... 2024-03-22T07:19:58.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:58 smithi134 ceph-mon[29057]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:58 smithi134 ceph-mon[29057]: Saving service grafana spec with placement count:1 2024-03-22T07:19:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:58 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:58 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:59 smithi134 ceph-mon[29057]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:19:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:59 smithi134 ceph-mon[29057]: Saving service node-exporter spec with placement * 2024-03-22T07:19:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:19:59 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef45ea700 1 Processor -- start 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef45ea700 1 -- start start 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef45ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec103020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef45ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec103560 con 0x7fbeec102c10 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef2386700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef2386700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52164/0 (socket says 172.21.15.134:52164) 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef2386700 1 -- 172.21.15.134:0/1840529877 learned_addr learned my addr 172.21.15.134:0/1840529877 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.485+0000 7fbef2386700 1 -- 172.21.15.134:0/1840529877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec1036a0 con 0x7fbeec102c10 2024-03-22T07:19:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef2386700 1 --2- 172.21.15.134:0/1840529877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec103020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbee800bb80 tx=0x7fbee800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f664ef395f9b61ff server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef1384700 1 -- 172.21.15.134:0/1840529877 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbee800dd00 con 0x7fbeec102c10 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef1384700 1 -- 172.21.15.134:0/1840529877 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbee800de60 con 0x7fbeec102c10 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef1384700 1 -- 172.21.15.134:0/1840529877 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbee8018920 con 0x7fbeec102c10 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 -- 172.21.15.134:0/1840529877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 msgr2=0x7fbeec103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 --2- 172.21.15.134:0/1840529877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec103020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbee800bb80 tx=0x7fbee800b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 -- 172.21.15.134:0/1840529877 shutdown_connections 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 --2- 172.21.15.134:0/1840529877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec103020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 -- 172.21.15.134:0/1840529877 >> 172.21.15.134:0/1840529877 conn(0x7fbeec0fc560 msgr2=0x7fbeec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 -- 172.21.15.134:0/1840529877 shutdown_connections 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.486+0000 7fbef45ea700 1 -- 172.21.15.134:0/1840529877 wait complete. 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef45ea700 1 Processor -- start 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef45ea700 1 -- start start 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef45ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec10f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef45ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec10f910 con 0x7fbeec102c10 2024-03-22T07:19:59.873 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef2386700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec10f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef2386700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec10f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52166/0 (socket says 172.21.15.134:52166) 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef2386700 1 -- 172.21.15.134:0/3072904413 learned_addr learned my addr 172.21.15.134:0/3072904413 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.487+0000 7fbef2386700 1 -- 172.21.15.134:0/3072904413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee800b790 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.488+0000 7fbef2386700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec10f3d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007010 tx=0x7fbee800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.488+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbee8010b90 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.488+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbee801d050 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.488+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec10fb10 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.488+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbee8022590 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.488+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec110680 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.489+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec05f5f0 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.489+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fbee8023470 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.489+0000 7fbee2ffd700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fbed80367e0 0x7fbed8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.489+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbee8014070 con 0x7fbeec102c10 2024-03-22T07:19:59.874 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.489+0000 7fbef1b85700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fbed80367e0 0x7fbed8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.490+0000 7fbef1b85700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fbed80367e0 0x7fbed8038c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009990 tx=0x7fbedc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.494+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fbee800e360 con 0x7fbeec102c10 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.702+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fbeec110a30 con 0x7fbed80367e0 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.707+0000 7fbee2ffd700 1 -- 172.21.15.134:0/3072904413 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fbeec110a30 con 0x7fbed80367e0 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fbed80367e0 msgr2=0x7fbed8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fbed80367e0 0x7fbed8038c90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009990 tx=0x7fbedc006e40 comp rx=0 tx=0).stop 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 msgr2=0x7fbeec10f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec10f3d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007010 tx=0x7fbee800b4f0 comp rx=0 tx=0).stop 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 shutdown_connections 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fbed80367e0 0x7fbed8038c90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 --2- 172.21.15.134:0/3072904413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbeec102c10 0x7fbeec10f3d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 >> 172.21.15.134:0/3072904413 conn(0x7fbeec0fc560 msgr2=0x7fbeec105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 shutdown_connections 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:19:58.709+0000 7fbef45ea700 1 -- 172.21.15.134:0/3072904413 wait complete. 2024-03-22T07:19:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:Deploying alertmanager service with default placement... 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.718+0000 7f24a1fad700 1 Processor -- start 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.718+0000 7f24a1fad700 1 -- start start 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f24a1fad700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c0771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f24a1fad700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0790f0 con 0x7f249c078ce0 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f249b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c0771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f249b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c0771e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52168/0 (socket says 172.21.15.134:52168) 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f249b7fe700 1 -- 172.21.15.134:0/2249197856 learned_addr learned my addr 172.21.15.134:0/2249197856 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f249b7fe700 1 -- 172.21.15.134:0/2249197856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c077720 con 0x7f249c078ce0 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.719+0000 7f249b7fe700 1 --2- 172.21.15.134:0/2249197856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c0771e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24900098e0 tx=0x7f2490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e85b9b880da20 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f249a7fc700 1 -- 172.21.15.134:0/2249197856 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f249000b860 con 0x7f249c078ce0 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f249a7fc700 1 -- 172.21.15.134:0/2249197856 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f249000be90 con 0x7f249c078ce0 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f249a7fc700 1 -- 172.21.15.134:0/2249197856 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24900103c0 con 0x7f249c078ce0 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 -- 172.21.15.134:0/2249197856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 msgr2=0x7f249c0771e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 --2- 172.21.15.134:0/2249197856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c0771e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24900098e0 tx=0x7f2490009250 comp rx=0 tx=0).stop 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 -- 172.21.15.134:0/2249197856 shutdown_connections 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 --2- 172.21.15.134:0/2249197856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c0771e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 -- 172.21.15.134:0/2249197856 >> 172.21.15.134:0/2249197856 conn(0x7f249c0fdf10 msgr2=0x7f249c100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 -- 172.21.15.134:0/2249197856 shutdown_connections 2024-03-22T07:20:01.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.720+0000 7f24a1fad700 1 -- 172.21.15.134:0/2249197856 wait complete. 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f24a1fad700 1 Processor -- start 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f24a1fad700 1 -- start start 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f24a1fad700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f24a1fad700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c113d30 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f249b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f249b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c1137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52180/0 (socket says 172.21.15.134:52180) 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.721+0000 7f249b7fe700 1 -- 172.21.15.134:0/2474002753 learned_addr learned my addr 172.21.15.134:0/2474002753 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f249b7fe700 1 -- 172.21.15.134:0/2474002753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900094f0 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f249b7fe700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c1137f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24900094c0 tx=0x7f2490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2490010890 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2490010ec0 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c113f30 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24900243f0 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.722+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c114aa0 con 0x7f249c078ce0 2024-03-22T07:20:01.468 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.723+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f249002d3f0 con 0x7f249c078ce0 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.723+0000 7f2483fff700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2484036790 0x7f2484038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.723+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f249004a310 con 0x7f249c078ce0 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.723+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c05f5f0 con 0x7f249c078ce0 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.723+0000 7f249affd700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2484036790 0x7f2484038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.723+0000 7f249affd700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2484036790 0x7f2484038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f248c009990 tx=0x7f248c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.728+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f249002b8e0 con 0x7f249c078ce0 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.927+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f249c0ff240 con 0x7f2484036790 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.934+0000 7f2483fff700 1 -- 172.21.15.134:0/2474002753 <== mgr.14120 v2:172.21.15.134:6800/55103982 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f249c0ff240 con 0x7f2484036790 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2484036790 msgr2=0x7f2484038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2484036790 0x7f2484038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f248c009990 tx=0x7f248c006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 msgr2=0x7f249c1137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c1137f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24900094c0 tx=0x7f2490009250 comp rx=0 tx=0).stop 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 shutdown_connections 2024-03-22T07:20:01.469 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2484036790 0x7f2484038c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:01.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 --2- 172.21.15.134:0/2474002753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f249c078ce0 0x7f249c1137f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:01.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 >> 172.21.15.134:0/2474002753 conn(0x7f249c0fdf10 msgr2=0x7f249c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:01.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 shutdown_connections 2024-03-22T07:20:01.470 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:00.936+0000 7f24a1fad700 1 -- 172.21.15.134:0/2474002753 wait complete. 2024-03-22T07:20:02.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:01 smithi134 ceph-mon[29057]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:02.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:01 smithi134 ceph-mon[29057]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:20:02.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:01 smithi134 ceph-mon[29057]: Saving service alertmanager spec with placement count:1 2024-03-22T07:20:02.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:01 smithi134 ceph-mon[29057]: from='mgr.14120 172.21.15.134:0/1762113101' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f2691eb5700 1 Processor -- start 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f2691eb5700 1 -- start start 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f2691eb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c102b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f2691eb5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c103070 con 0x7f268c102720 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f268b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f268b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52186/0 (socket says 172.21.15.134:52186) 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f268b7fe700 1 -- 172.21.15.134:0/3123271613 learned_addr learned my addr 172.21.15.134:0/3123271613 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:02.602 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.881+0000 7f268b7fe700 1 -- 172.21.15.134:0/3123271613 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c1031b0 con 0x7f268c102720 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f268b7fe700 1 --2- 172.21.15.134:0/3123271613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c102b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f267c0098e0 tx=0x7f267c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90076ed7efe0f1b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f268a7fc700 1 -- 172.21.15.134:0/3123271613 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f267c00b860 con 0x7f268c102720 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f268a7fc700 1 -- 172.21.15.134:0/3123271613 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f267c00be90 con 0x7f268c102720 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f268a7fc700 1 -- 172.21.15.134:0/3123271613 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f267c0103c0 con 0x7f268c102720 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 -- 172.21.15.134:0/3123271613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 msgr2=0x7f268c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 --2- 172.21.15.134:0/3123271613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c102b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f267c0098e0 tx=0x7f267c009250 comp rx=0 tx=0).stop 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 -- 172.21.15.134:0/3123271613 shutdown_connections 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 --2- 172.21.15.134:0/3123271613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c102b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 -- 172.21.15.134:0/3123271613 >> 172.21.15.134:0/3123271613 conn(0x7f268c0fdee0 msgr2=0x7f268c1002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 -- 172.21.15.134:0/3123271613 shutdown_connections 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.882+0000 7f2691eb5700 1 -- 172.21.15.134:0/3123271613 wait complete. 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f2691eb5700 1 Processor -- start 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f2691eb5700 1 -- start start 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f2691eb5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c1115a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f2691eb5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c111ae0 con 0x7f268c102720 2024-03-22T07:20:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f268b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c1115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f268b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c1115a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52196/0 (socket says 172.21.15.134:52196) 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.883+0000 7f268b7fe700 1 -- 172.21.15.134:0/2478687643 learned_addr learned my addr 172.21.15.134:0/2478687643 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f268b7fe700 1 -- 172.21.15.134:0/2478687643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0094f0 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f268b7fe700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c1115a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f267c011680 tx=0x7f267c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f267c010890 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f267c010ec0 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c111ce0 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f267c0243f0 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.884+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c112850 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.885+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f267c02d3f0 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.885+0000 7f2673fff700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f26740367e0 0x7f2674038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.885+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c05f5f0 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.885+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f267c04a200 con 0x7f268c102720 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.885+0000 7f268affd700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f26740367e0 0x7f2674038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.885+0000 7f268affd700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f26740367e0 0x7f2674038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2680009990 tx=0x7f2680006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:02.604 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:01.890+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f267c02dcb0 con 0x7f268c102720 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.072+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f268c04bed0 con 0x7f268c102720 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.078+0000 7f2673fff700 1 -- 172.21.15.134:0/2478687643 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f267c018be0 con 0x7f268c102720 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f26740367e0 msgr2=0x7f2674038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f26740367e0 0x7f2674038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2680009990 tx=0x7f2680006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 msgr2=0x7f268c1115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c1115a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f267c011680 tx=0x7f267c009250 comp rx=0 tx=0).stop 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 shutdown_connections 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f26740367e0 0x7f2674038c90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 --2- 172.21.15.134:0/2478687643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f268c102720 0x7f268c1115a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.080+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 >> 172.21.15.134:0/2478687643 conn(0x7f268c0fdee0 msgr2=0x7f268c0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.081+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 shutdown_connections 2024-03-22T07:20:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.081+0000 7f2691eb5700 1 -- 172.21.15.134:0/2478687643 wait complete. 2024-03-22T07:20:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:03 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2478687643' entity='client.admin' 2024-03-22T07:20:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:03 smithi134 ceph-mon[29057]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:03.826 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f3035df8700 1 Processor -- start 2024-03-22T07:20:03.826 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f3035df8700 1 -- start start 2024-03-22T07:20:03.826 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f3035df8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f3030102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:03.826 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f3035df8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30301034e0 con 0x7f3030102b90 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f302f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f3030102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f302f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f3030102fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52202/0 (socket says 172.21.15.134:52202) 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f302f7fe700 1 -- 172.21.15.134:0/1419775098 learned_addr learned my addr 172.21.15.134:0/1419775098 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f302f7fe700 1 -- 172.21.15.134:0/1419775098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030103620 con 0x7f3030102b90 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.996+0000 7f302f7fe700 1 --2- 172.21.15.134:0/1419775098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f3030102fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3028009e50 tx=0x7f3028009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0672e924aac36a server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f302e7fc700 1 -- 172.21.15.134:0/1419775098 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30280092e0 con 0x7f3030102b90 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f302e7fc700 1 -- 172.21.15.134:0/1419775098 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3028012430 con 0x7f3030102b90 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f302e7fc700 1 -- 172.21.15.134:0/1419775098 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30280075a0 con 0x7f3030102b90 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 -- 172.21.15.134:0/1419775098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 msgr2=0x7f3030102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 --2- 172.21.15.134:0/1419775098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f3030102fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3028009e50 tx=0x7f3028009840 comp rx=0 tx=0).stop 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 -- 172.21.15.134:0/1419775098 shutdown_connections 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 --2- 172.21.15.134:0/1419775098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f3030102fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 -- 172.21.15.134:0/1419775098 >> 172.21.15.134:0/1419775098 conn(0x7f30300fc4d0 msgr2=0x7f30300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 -- 172.21.15.134:0/1419775098 shutdown_connections 2024-03-22T07:20:03.827 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.997+0000 7f3035df8700 1 -- 172.21.15.134:0/1419775098 wait complete. 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f3035df8700 1 Processor -- start 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f3035df8700 1 -- start start 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f3035df8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f30301013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f3035df8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030114300 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f302f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f30301013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f302f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f30301013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52208/0 (socket says 172.21.15.134:52208) 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f302f7fe700 1 -- 172.21.15.134:0/3319807188 learned_addr learned my addr 172.21.15.134:0/3319807188 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f302f7fe700 1 -- 172.21.15.134:0/3319807188 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009ae0 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.998+0000 7f302f7fe700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f30301013a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3028009fd0 tx=0x7f3028009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.999+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30280092e0 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.999+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3028007ce0 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.999+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3030114440 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.999+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3028025930 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.999+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3030114930 con 0x7f3030102b90 2024-03-22T07:20:03.828 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:02.999+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f3028019050 con 0x7f3030102b90 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.000+0000 7f3027fff700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f301c0367e0 0x7f301c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.000+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f302804a100 con 0x7f3030102b90 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.000+0000 7f302effd700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f301c0367e0 0x7f301c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.000+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303004bed0 con 0x7f3030102b90 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.000+0000 7f302effd700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f301c0367e0 0x7f301c038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3018009990 tx=0x7f3018006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.005+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3028020070 con 0x7f3030102b90 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.190+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f3030102420 con 0x7f3030102b90 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.196+0000 7f3027fff700 1 -- 172.21.15.134:0/3319807188 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f3028017030 con 0x7f3030102b90 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f301c0367e0 msgr2=0x7f301c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f301c0367e0 0x7f301c038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3018009990 tx=0x7f3018006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 msgr2=0x7f30301013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f30301013a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3028009fd0 tx=0x7f3028009840 comp rx=0 tx=0).stop 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 shutdown_connections 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f301c0367e0 0x7f301c038c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:03.829 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 --2- 172.21.15.134:0/3319807188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3030102b90 0x7f30301013a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:03.830 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 >> 172.21.15.134:0/3319807188 conn(0x7f30300fc4d0 msgr2=0x7f30300fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:03.830 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 shutdown_connections 2024-03-22T07:20:03.830 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:03.198+0000 7f3035df8700 1 -- 172.21.15.134:0/3319807188 wait complete. 2024-03-22T07:20:03.830 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling the dashboard module... 2024-03-22T07:20:04.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:04 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3319807188' entity='client.admin' 2024-03-22T07:20:05.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:05 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/563677093' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-22T07:20:05.525 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:05 smithi134 ceph-mon[29057]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:05.866 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f279216a700 1 Processor -- start 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f279216a700 1 -- start start 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f279216a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c105310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f279216a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c105850 con 0x7f278c076be0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f278b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c105310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f278b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c105310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58688/0 (socket says 172.21.15.134:58688) 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.229+0000 7f278b7fe700 1 -- 172.21.15.134:0/4030564308 learned_addr learned my addr 172.21.15.134:0/4030564308 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f278b7fe700 1 -- 172.21.15.134:0/4030564308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c105990 con 0x7f278c076be0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f278b7fe700 1 --2- 172.21.15.134:0/4030564308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c105310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f277c0098e0 tx=0x7f277c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a287b0826ad0ed server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f278a7fc700 1 -- 172.21.15.134:0/4030564308 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f277c00b860 con 0x7f278c076be0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f278a7fc700 1 -- 172.21.15.134:0/4030564308 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f277c00be90 con 0x7f278c076be0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f278a7fc700 1 -- 172.21.15.134:0/4030564308 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f277c0103c0 con 0x7f278c076be0 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f279216a700 1 -- 172.21.15.134:0/4030564308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 msgr2=0x7f278c105310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f279216a700 1 --2- 172.21.15.134:0/4030564308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c105310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f277c0098e0 tx=0x7f277c009250 comp rx=0 tx=0).stop 2024-03-22T07:20:05.867 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f279216a700 1 -- 172.21.15.134:0/4030564308 shutdown_connections 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f279216a700 1 --2- 172.21.15.134:0/4030564308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c105310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.230+0000 7f279216a700 1 -- 172.21.15.134:0/4030564308 >> 172.21.15.134:0/4030564308 conn(0x7f278c0fcdc0 msgr2=0x7f278c0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.231+0000 7f279216a700 1 -- 172.21.15.134:0/4030564308 shutdown_connections 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.231+0000 7f279216a700 1 -- 172.21.15.134:0/4030564308 wait complete. 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.231+0000 7f279216a700 1 Processor -- start 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.231+0000 7f279216a700 1 -- start start 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.231+0000 7f279216a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c1115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.231+0000 7f279216a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c111af0 con 0x7f278c076be0 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f278b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c1115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f278b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c1115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58694/0 (socket says 172.21.15.134:58694) 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f278b7fe700 1 -- 172.21.15.134:0/563677093 learned_addr learned my addr 172.21.15.134:0/563677093 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f278b7fe700 1 -- 172.21.15.134:0/563677093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0094f0 con 0x7f278c076be0 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f278b7fe700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c1115b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f277c0094c0 tx=0x7f277c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f277c010890 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f277c010ec0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c111cf0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f277c0243f0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.232+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c112860 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.233+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f277c02d3f0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.233+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c05f5f0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.233+0000 7f2773fff700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2774036790 0x7f2774038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.233+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f277c04a3f0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.234+0000 7f278affd700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2774036790 0x7f2774038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.234+0000 7f278affd700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2774036790 0x7f2774038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2780009990 tx=0x7f2780006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.238+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f277c02b8e0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:04.474+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f278c04bed0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.200+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f277c01a7e0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.202+0000 7f2773fff700 1 -- 172.21.15.134:0/563677093 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f277c02cbc0 con 0x7f278c076be0 2024-03-22T07:20:05.869 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2774036790 msgr2=0x7f2774038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2774036790 0x7f2774038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2780009990 tx=0x7f2780006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 msgr2=0x7f278c1115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c1115b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f277c0094c0 tx=0x7f277c009250 comp rx=0 tx=0).stop 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 shutdown_connections 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7f2774036790 0x7f2774038c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 --2- 172.21.15.134:0/563677093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f278c076be0 0x7f278c1115b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.204+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 >> 172.21.15.134:0/563677093 conn(0x7f278c0fcdc0 msgr2=0x7f278c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.205+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 shutdown_connections 2024-03-22T07:20:05.870 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:05.205+0000 7f279216a700 1 -- 172.21.15.134:0/563677093 wait complete. 2024-03-22T07:20:06.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:06 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/563677093' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-22T07:20:06.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:06 smithi134 ceph-mon[29057]: mgrmap e9: smithi134.wtwqre(active, since 24s) 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "active_name": "smithi134.wtwqre", 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:20:07.091 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.266+0000 7fd5681d9700 1 Processor -- start 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.266+0000 7fd5681d9700 1 -- start start 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.266+0000 7fd5681d9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.266+0000 7fd5681d9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601058f0 con 0x7fd560076b20 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd565f75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd565f75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601053b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58710/0 (socket says 172.21.15.134:58710) 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd565f75700 1 -- 172.21.15.134:0/3455815535 learned_addr learned my addr 172.21.15.134:0/3455815535 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd565f75700 1 -- 172.21.15.134:0/3455815535 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560105a30 con 0x7fd560076b20 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd565f75700 1 --2- 172.21.15.134:0/3455815535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601053b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0098e0 tx=0x7fd55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54493ac5d677106 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd564f73700 1 -- 172.21.15.134:0/3455815535 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55c00b860 con 0x7fd560076b20 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd564f73700 1 -- 172.21.15.134:0/3455815535 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd55c00be90 con 0x7fd560076b20 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.267+0000 7fd564f73700 1 -- 172.21.15.134:0/3455815535 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55c0103c0 con 0x7fd560076b20 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 -- 172.21.15.134:0/3455815535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 msgr2=0x7fd5601053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 --2- 172.21.15.134:0/3455815535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601053b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0098e0 tx=0x7fd55c009250 comp rx=0 tx=0).stop 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 -- 172.21.15.134:0/3455815535 shutdown_connections 2024-03-22T07:20:07.092 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 --2- 172.21.15.134:0/3455815535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601053b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 -- 172.21.15.134:0/3455815535 >> 172.21.15.134:0/3455815535 conn(0x7fd5600fcd80 msgr2=0x7fd5600ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 -- 172.21.15.134:0/3455815535 shutdown_connections 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.268+0000 7fd5681d9700 1 -- 172.21.15.134:0/3455815535 wait complete. 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5681d9700 1 Processor -- start 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5681d9700 1 -- start start 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5681d9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5681d9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560111b20 con 0x7fd560076b20 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd565f75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd565f75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58726/0 (socket says 172.21.15.134:58726) 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd565f75700 1 -- 172.21.15.134:0/3132357420 learned_addr learned my addr 172.21.15.134:0/3132357420 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd565f75700 1 -- 172.21.15.134:0/3132357420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0094f0 con 0x7fd560076b20 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd565f75700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601115e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0094c0 tx=0x7fd55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55c010890 con 0x7fd560076b20 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd55c010ec0 con 0x7fd560076b20 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55c0243f0 con 0x7fd560076b20 2024-03-22T07:20:07.093 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.269+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd560111d20 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.270+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd560112890 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.270+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fd55c01a7e0 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.270+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56005f5f0 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.271+0000 7fd5567fc700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 0x7fd54c038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.271+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd55c04a2e0 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.271+0000 7fd565774700 1 -- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 msgr2=0x7fd54c038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.271+0000 7fd565774700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 0x7fd54c038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.275+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd55c02b8e0 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.472+0000 7fd565774700 1 -- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 msgr2=0x7fd54c038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.472+0000 7fd565774700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 0x7fd54c038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.522+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd560112c30 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.522+0000 7fd5567fc700 1 -- 172.21.15.134:0/3132357420 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd55c02b2f0 con 0x7fd560076b20 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 msgr2=0x7fd54c038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:20:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 0x7fd54c038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 msgr2=0x7fd5601115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601115e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0094c0 tx=0x7fd55c009250 comp rx=0 tx=0).stop 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 shutdown_connections 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fd54c036830 0x7fd54c038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 --2- 172.21.15.134:0/3132357420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd560076b20 0x7fd5601115e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 >> 172.21.15.134:0/3132357420 conn(0x7fd5600fcd80 msgr2=0x7fd5600fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 shutdown_connections 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:06.524+0000 7fd5681d9700 1 -- 172.21.15.134:0/3132357420 wait complete. 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for the mgr to restart... 2024-03-22T07:20:07.095 INFO:teuthology.orchestra.run.smithi134.stdout:Waiting for mgr epoch 9... 2024-03-22T07:20:07.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:07 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3132357420' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-22T07:20:12.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: Active manager daemon smithi134.wtwqre restarted 2024-03-22T07:20:12.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:20:12.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: osdmap e3: 0 total, 0 up, 0 in 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: mgrmap e10: smithi134.wtwqre(active, starting, since 0.00342872s) 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:20:12.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:11 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:20:13.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:20:13.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:20:13.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: [22/Mar/2024:07:20:12] ENGINE Bus STARTING 2024-03-22T07:20:13.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: [22/Mar/2024:07:20:12] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:20:13.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: [22/Mar/2024:07:20:12] ENGINE Bus STARTED 2024-03-22T07:20:13.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:13.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:12 smithi134 ceph-mon[29057]: mgrmap e11: smithi134.wtwqre(active, since 1.00563s) 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout { 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout } 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2f4e61700 1 Processor -- start 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2f4e61700 1 -- start start 2024-03-22T07:20:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2f4e61700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0105410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2f4e61700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0105950 con 0x7fb2f0076b50 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2ee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2ee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0105410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58738/0 (socket says 172.21.15.134:58738) 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.534+0000 7fb2ee59c700 1 -- 172.21.15.134:0/568620907 learned_addr learned my addr 172.21.15.134:0/568620907 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2ee59c700 1 -- 172.21.15.134:0/568620907 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0105a90 con 0x7fb2f0076b50 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2ee59c700 1 --2- 172.21.15.134:0/568620907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0105410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00098e0 tx=0x7fb2e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5edd46d4a9a607 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2ed59a700 1 -- 172.21.15.134:0/568620907 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e000b860 con 0x7fb2f0076b50 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2ed59a700 1 -- 172.21.15.134:0/568620907 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2e000be90 con 0x7fb2f0076b50 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2ed59a700 1 -- 172.21.15.134:0/568620907 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e00103c0 con 0x7fb2f0076b50 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2f4e61700 1 -- 172.21.15.134:0/568620907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 msgr2=0x7fb2f0105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.535+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/568620907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0105410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00098e0 tx=0x7fb2e0009250 comp rx=0 tx=0).stop 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 -- 172.21.15.134:0/568620907 shutdown_connections 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/568620907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0105410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 -- 172.21.15.134:0/568620907 >> 172.21.15.134:0/568620907 conn(0x7fb2f00fce40 msgr2=0x7fb2f00ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:13.463 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 -- 172.21.15.134:0/568620907 shutdown_connections 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 -- 172.21.15.134:0/568620907 wait complete. 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 Processor -- start 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 -- start start 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2f4e61700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0111b80 con 0x7fb2f0076b50 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.536+0000 7fb2ee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2ee59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58748/0 (socket says 172.21.15.134:58748) 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2ee59c700 1 -- 172.21.15.134:0/1900440799 learned_addr learned my addr 172.21.15.134:0/1900440799 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2ee59c700 1 -- 172.21.15.134:0/1900440799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00094f0 con 0x7fb2f0076b50 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2ee59c700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0111640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00105b0 tx=0x7fb2e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e0010840 con 0x7fb2f0076b50 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2e0010e70 con 0x7fb2f0076b50 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f0111d80 con 0x7fb2f0076b50 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e001ae30 con 0x7fb2f0076b50 2024-03-22T07:20:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.537+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f01128f0 con 0x7fb2f0076b50 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.538+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fb2e002e440 con 0x7fb2f0076b50 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.538+0000 7fb2deffd700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.538+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 --> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2f005f5f0 con 0x7fb2d8036830 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.538+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb2e004a7d0 con 0x7fb2f0076b50 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.538+0000 7fb2edd9b700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 msgr2=0x7fb2d8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.538+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.739+0000 7fb2edd9b700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 msgr2=0x7fb2d8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:07.739+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:08.140+0000 7fb2edd9b700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 msgr2=0x7fb2d8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:08.140+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-22T07:20:13.465 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:08.941+0000 7fb2edd9b700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 msgr2=0x7fb2d8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:08.941+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:10.542+0000 7fb2edd9b700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 msgr2=0x7fb2d8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/55103982 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:10.542+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:11.798+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7fb2e001a430 con 0x7fb2f0076b50 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:11.798+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 msgr2=0x7fb2d8038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:11.798+0000 7fb2deffd700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.800+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7fb2e001a710 con 0x7fb2f0076b50 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.800+0000 7fb2deffd700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb2d8039ff0 0x7fb2d803c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.800+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2f005f5f0 con 0x7fb2d8039ff0 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.800+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb2d8039ff0 0x7fb2d803c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.801+0000 7fb2edd9b700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb2d8039ff0 0x7fb2d803c3d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40039d0 tx=0x7fb2e4009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.801+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fb2f005f5f0 con 0x7fb2d8039ff0 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.807+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fb2f0112210 con 0x7fb2d8039ff0 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2deffd700 1 -- 172.21.15.134:0/1900440799 <== mgr.14162 v2:172.21.15.134:6800/3465812625 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fb2f0112210 con 0x7fb2d8039ff0 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb2d8039ff0 msgr2=0x7fb2d803c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb2d8039ff0 0x7fb2d803c3d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40039d0 tx=0x7fb2e4009350 comp rx=0 tx=0).stop 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 msgr2=0x7fb2f0111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0111640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00105b0 tx=0x7fb2e0009250 comp rx=0 tx=0).stop 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 shutdown_connections 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2f0076b50 0x7fb2f0111640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb2d8039ff0 0x7fb2d803c3d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 --2- 172.21.15.134:0/1900440799 >> [v2:172.21.15.134:6800/55103982,v1:172.21.15.134:6801/55103982] conn(0x7fb2d8036830 0x7fb2d8038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 >> 172.21.15.134:0/1900440799 conn(0x7fb2f00fce40 msgr2=0x7fb2f00fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 shutdown_connections 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:12.808+0000 7fb2f4e61700 1 -- 172.21.15.134:0/1900440799 wait complete. 2024-03-22T07:20:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:mgr epoch 9 is available 2024-03-22T07:20:13.468 INFO:teuthology.orchestra.run.smithi134.stdout:Generating a dashboard self-signed certificate... 2024-03-22T07:20:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:14 smithi134 ceph-mon[29057]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-22T07:20:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:14 smithi134 ceph-mon[29057]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-22T07:20:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:14 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:14 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c94c6700 1 Processor -- start 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c94c6700 1 -- start start 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c94c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4103050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c94c6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4103590 con 0x7fc7c4102c40 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4103050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39408/0 (socket says 172.21.15.134:39408) 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.924+0000 7fc7c2ffd700 1 -- 172.21.15.134:0/183450664 learned_addr learned my addr 172.21.15.134:0/183450664 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c2ffd700 1 -- 172.21.15.134:0/183450664 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c41036d0 con 0x7fc7c4102c40 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c2ffd700 1 --2- 172.21.15.134:0/183450664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4103050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009e50 tx=0x7fc7bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bd252e40b5fb5d server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c1ffb700 1 -- 172.21.15.134:0/183450664 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7bc0092e0 con 0x7fc7c4102c40 2024-03-22T07:20:14.749 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c1ffb700 1 -- 172.21.15.134:0/183450664 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7bc012430 con 0x7fc7c4102c40 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c1ffb700 1 -- 172.21.15.134:0/183450664 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7bc0075a0 con 0x7fc7c4102c40 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c94c6700 1 -- 172.21.15.134:0/183450664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 msgr2=0x7fc7c4103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c94c6700 1 --2- 172.21.15.134:0/183450664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4103050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009e50 tx=0x7fc7bc009840 comp rx=0 tx=0).stop 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c94c6700 1 -- 172.21.15.134:0/183450664 shutdown_connections 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c94c6700 1 --2- 172.21.15.134:0/183450664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4103050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c94c6700 1 -- 172.21.15.134:0/183450664 >> 172.21.15.134:0/183450664 conn(0x7fc7c40fc560 msgr2=0x7fc7c40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.925+0000 7fc7c94c6700 1 -- 172.21.15.134:0/183450664 shutdown_connections 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c94c6700 1 -- 172.21.15.134:0/183450664 wait complete. 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c94c6700 1 Processor -- start 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c94c6700 1 -- start start 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c94c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c94c6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4111ba0 con 0x7fc7c4102c40 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4111660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39418/0 (socket says 172.21.15.134:39418) 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.926+0000 7fc7c2ffd700 1 -- 172.21.15.134:0/1414700180 learned_addr learned my addr 172.21.15.134:0/1414700180 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:14.750 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7c2ffd700 1 -- 172.21.15.134:0/1414700180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009ae0 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7c2ffd700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4111660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc012de0 tx=0x7fc7bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7bc0092e0 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7bc007ce0 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c4111da0 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc7bc025930 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.927+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c4112910 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.928+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7fc7bc019050 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.928+0000 7fc7ab7fe700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fc7ac0366b0 0x7fc7ac038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.928+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc7bc04a040 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.928+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c405f5f0 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.928+0000 7fc7c27fc700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fc7ac0366b0 0x7fc7ac038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.928+0000 7fc7c27fc700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fc7ac0366b0 0x7fc7ac038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009990 tx=0x7fc7b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:13.933+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc7bc020020 con 0x7fc7c4102c40 2024-03-22T07:20:14.751 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.061+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fc7bc01c500 con 0x7fc7c4102c40 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.134+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7c4113390 con 0x7fc7ac0366b0 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.200+0000 7fc7ab7fe700 1 -- 172.21.15.134:0/1414700180 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc7c4113390 con 0x7fc7ac0366b0 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.202+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fc7ac0366b0 msgr2=0x7fc7ac038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.202+0000 7fc7c94c6700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fc7ac0366b0 0x7fc7ac038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009990 tx=0x7fc7b8006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.202+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 msgr2=0x7fc7c4111660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.202+0000 7fc7c94c6700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4111660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc012de0 tx=0x7fc7bc009840 comp rx=0 tx=0).stop 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.203+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 shutdown_connections 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.203+0000 7fc7c94c6700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fc7ac0366b0 0x7fc7ac038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.203+0000 7fc7c94c6700 1 --2- 172.21.15.134:0/1414700180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7c4102c40 0x7fc7c4111660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.203+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 >> 172.21.15.134:0/1414700180 conn(0x7fc7c40fc560 msgr2=0x7fc7c40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.203+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 shutdown_connections 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:14.203+0000 7fc7c94c6700 1 -- 172.21.15.134:0/1414700180 wait complete. 2024-03-22T07:20:14.752 INFO:teuthology.orchestra.run.smithi134.stdout:Creating initial admin user... 2024-03-22T07:20:15.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:15 smithi134 ceph-mon[29057]: mgrmap e12: smithi134.wtwqre(active, since 2s) 2024-03-22T07:20:15.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:15 smithi134 ceph-mon[29057]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:20:15.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:15 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:15.145 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:15 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:16.452 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$gzgsNVaujMHMGSTUVfjDd.pFzqGn9vAHBvznyraVVgAQm4QbAX1uy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711092015, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.172+0000 7f24e6e03700 1 Processor -- start 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.172+0000 7f24e6e03700 1 -- start start 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.172+0000 7f24e6e03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e0107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.172+0000 7f24e6e03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e0103140 con 0x7f24e0076b80 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24e4b9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e0107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24e4b9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e0107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39428/0 (socket says 172.21.15.134:39428) 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24e4b9f700 1 -- 172.21.15.134:0/489528630 learned_addr learned my addr 172.21.15.134:0/489528630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24e4b9f700 1 -- 172.21.15.134:0/489528630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e0107c90 con 0x7f24e0076b80 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24e4b9f700 1 --2- 172.21.15.134:0/489528630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e0107750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098e0 tx=0x7f24d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee6b8b3ff38f529 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24df7fe700 1 -- 172.21.15.134:0/489528630 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24d400b860 con 0x7f24e0076b80 2024-03-22T07:20:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24df7fe700 1 -- 172.21.15.134:0/489528630 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24d400be90 con 0x7f24e0076b80 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.173+0000 7f24df7fe700 1 -- 172.21.15.134:0/489528630 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24d40103c0 con 0x7f24e0076b80 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 -- 172.21.15.134:0/489528630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 msgr2=0x7f24e0107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 --2- 172.21.15.134:0/489528630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e0107750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24d40098e0 tx=0x7f24d4009250 comp rx=0 tx=0).stop 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 -- 172.21.15.134:0/489528630 shutdown_connections 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 --2- 172.21.15.134:0/489528630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e0107750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 -- 172.21.15.134:0/489528630 >> 172.21.15.134:0/489528630 conn(0x7f24e00fcd80 msgr2=0x7f24e00ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 -- 172.21.15.134:0/489528630 shutdown_connections 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 -- 172.21.15.134:0/489528630 wait complete. 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.174+0000 7f24e6e03700 1 Processor -- start 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e6e03700 1 -- start start 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e6e03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e01137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e6e03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e0113d10 con 0x7f24e0076b80 2024-03-22T07:20:16.454 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e4b9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e01137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e4b9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e01137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39434/0 (socket says 172.21.15.134:39434) 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e4b9f700 1 -- 172.21.15.134:0/3567424059 learned_addr learned my addr 172.21.15.134:0/3567424059 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e4b9f700 1 -- 172.21.15.134:0/3567424059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40094f0 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.175+0000 7f24e4b9f700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e01137d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24d4006d40 tx=0x7f24d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.176+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24d4010840 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.176+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24d4010e70 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.176+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24d4024ea0 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.176+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e0113f10 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.176+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e0114a80 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.177+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f24d4024780 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.177+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e005f5f0 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.177+0000 7f24dd7fa700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f24d00367e0 0x7f24d0038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.177+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f24d404a800 con 0x7f24e0076b80 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.177+0000 7f24dffff700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f24d00367e0 0x7f24d0038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:16.455 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.177+0000 7f24dffff700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f24d00367e0 0x7f24d0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009990 tx=0x7f24cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.182+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f24d402c930 con 0x7f24e0076b80 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.389+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f24e005f410 con 0x7f24d00367e0 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.611+0000 7f24dd7fa700 1 -- 172.21.15.134:0/3567424059 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f24e005f410 con 0x7f24d00367e0 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.613+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f24d00367e0 msgr2=0x7f24d0038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.613+0000 7f24e6e03700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f24d00367e0 0x7f24d0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009990 tx=0x7f24cc006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.613+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 msgr2=0x7f24e01137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.613+0000 7f24e6e03700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e01137d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24d4006d40 tx=0x7f24d4009250 comp rx=0 tx=0).stop 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.614+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 shutdown_connections 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.614+0000 7f24e6e03700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f24d00367e0 0x7f24d0038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.614+0000 7f24e6e03700 1 --2- 172.21.15.134:0/3567424059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e0076b80 0x7f24e01137d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:16.456 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.614+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 >> 172.21.15.134:0/3567424059 conn(0x7f24e00fcd80 msgr2=0x7f24e00fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:16.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.614+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 shutdown_connections 2024-03-22T07:20:16.457 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:15.614+0000 7f24e6e03700 1 -- 172.21.15.134:0/3567424059 wait complete. 2024-03-22T07:20:16.457 INFO:teuthology.orchestra.run.smithi134.stdout:Fetching dashboard port number... 2024-03-22T07:20:16.719 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:16 smithi134 ceph-mon[29057]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:20:16.719 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:16 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:17 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/594644774' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-22T07:20:17.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stdout 8443 2024-03-22T07:20:17.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.940+0000 7fa7642b7700 1 Processor -- start 2024-03-22T07:20:17.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.940+0000 7fa7642b7700 1 -- start start 2024-03-22T07:20:17.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa7642b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c104e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:17.878 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa7642b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c105450 con 0x7fa75c104a70 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa762053700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa762053700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39438/0 (socket says 172.21.15.134:39438) 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa762053700 1 -- 172.21.15.134:0/478175513 learned_addr learned my addr 172.21.15.134:0/478175513 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa762053700 1 -- 172.21.15.134:0/478175513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c105590 con 0x7fa75c104a70 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.941+0000 7fa762053700 1 --2- 172.21.15.134:0/478175513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c104e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7580098e0 tx=0x7fa758009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc790076e653392 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.942+0000 7fa761051700 1 -- 172.21.15.134:0/478175513 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa75800b860 con 0x7fa75c104a70 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.942+0000 7fa761051700 1 -- 172.21.15.134:0/478175513 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa75800be90 con 0x7fa75c104a70 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.942+0000 7fa761051700 1 -- 172.21.15.134:0/478175513 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7580103c0 con 0x7fa75c104a70 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.942+0000 7fa7642b7700 1 -- 172.21.15.134:0/478175513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 msgr2=0x7fa75c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.942+0000 7fa7642b7700 1 --2- 172.21.15.134:0/478175513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c104e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7580098e0 tx=0x7fa758009250 comp rx=0 tx=0).stop 2024-03-22T07:20:17.879 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.943+0000 7fa7642b7700 1 -- 172.21.15.134:0/478175513 shutdown_connections 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.943+0000 7fa7642b7700 1 --2- 172.21.15.134:0/478175513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c104e80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.943+0000 7fa7642b7700 1 -- 172.21.15.134:0/478175513 >> 172.21.15.134:0/478175513 conn(0x7fa75c077fd0 msgr2=0x7fa75c0783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.943+0000 7fa7642b7700 1 -- 172.21.15.134:0/478175513 shutdown_connections 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.943+0000 7fa7642b7700 1 -- 172.21.15.134:0/478175513 wait complete. 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa7642b7700 1 Processor -- start 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa7642b7700 1 -- start start 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa7642b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c1137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa7642b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c113cf0 con 0x7fa75c104a70 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa762053700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c1137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa762053700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c1137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39454/0 (socket says 172.21.15.134:39454) 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa762053700 1 -- 172.21.15.134:0/594644774 learned_addr learned my addr 172.21.15.134:0/594644774 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa762053700 1 -- 172.21.15.134:0/594644774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580094f0 con 0x7fa75c104a70 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.944+0000 7fa762053700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c1137b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa758011c10 tx=0x7fa758009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.945+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa758010890 con 0x7fa75c104a70 2024-03-22T07:20:17.880 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.945+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa758010ec0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.945+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c113ef0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.945+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7580243f0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.945+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c114a60 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.945+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fa75802d3f0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.946+0000 7fa752ffd700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa748036830 0x7fa748038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.946+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa75804a510 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.946+0000 7fa761852700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa748036830 0x7fa748038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.946+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c05f5f0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.946+0000 7fa761852700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa748036830 0x7fa748038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009990 tx=0x7fa74c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:16.951+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa75802b8e0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.142+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fa75c04bed0 con 0x7fa75c104a70 2024-03-22T07:20:17.881 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.142+0000 7fa752ffd700 1 -- 172.21.15.134:0/594644774 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fa75802b2f0 con 0x7fa75c104a70 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa748036830 msgr2=0x7fa748038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa748036830 0x7fa748038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009990 tx=0x7fa74c006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 msgr2=0x7fa75c1137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c1137b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa758011c10 tx=0x7fa758009250 comp rx=0 tx=0).stop 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 shutdown_connections 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa748036830 0x7fa748038ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 --2- 172.21.15.134:0/594644774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa75c104a70 0x7fa75c1137b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 >> 172.21.15.134:0/594644774 conn(0x7fa75c077fd0 msgr2=0x7fa75c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 shutdown_connections 2024-03-22T07:20:17.882 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:17.144+0000 7fa7642b7700 1 -- 172.21.15.134:0/594644774 wait complete. 2024-03-22T07:20:17.885 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-22T07:20:17.885 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout disabled 2024-03-22T07:20:17.893 INFO:teuthology.orchestra.run.smithi134.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-22T07:20:17.893 INFO:teuthology.orchestra.run.smithi134.stdout:systemctl: stdout inactive 2024-03-22T07:20:17.893 INFO:teuthology.orchestra.run.smithi134.stdout:firewalld.service is not enabled 2024-03-22T07:20:17.893 INFO:teuthology.orchestra.run.smithi134.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-22T07:20:17.895 INFO:teuthology.orchestra.run.smithi134.stdout:Ceph Dashboard is now available at: 2024-03-22T07:20:17.895 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:17.896 INFO:teuthology.orchestra.run.smithi134.stdout: URL: https://smithi134.front.sepia.ceph.com:8443/ 2024-03-22T07:20:17.896 INFO:teuthology.orchestra.run.smithi134.stdout: User: admin 2024-03-22T07:20:17.896 INFO:teuthology.orchestra.run.smithi134.stdout: Password: 11oym8k9vr 2024-03-22T07:20:17.896 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:17.896 INFO:teuthology.orchestra.run.smithi134.stdout:Saving cluster configuration to /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config directory 2024-03-22T07:20:17.896 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling autotune for osd_memory_target 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.288+0000 7f031a00b700 1 Processor -- start 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.288+0000 7f031a00b700 1 -- start start 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f031a00b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314102b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f031a00b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314103090 con 0x7f0314102740 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f03137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314102b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f03137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314102b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39468/0 (socket says 172.21.15.134:39468) 2024-03-22T07:20:19.109 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f03137fe700 1 -- 172.21.15.134:0/1510017081 learned_addr learned my addr 172.21.15.134:0/1510017081 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f03137fe700 1 -- 172.21.15.134:0/1510017081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03141031d0 con 0x7f0314102740 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.289+0000 7f03137fe700 1 --2- 172.21.15.134:0/1510017081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314102b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03080098e0 tx=0x7f0308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a3d14feb78e58c server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f03127fc700 1 -- 172.21.15.134:0/1510017081 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f030800b860 con 0x7f0314102740 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f03127fc700 1 -- 172.21.15.134:0/1510017081 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030800be90 con 0x7f0314102740 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f03127fc700 1 -- 172.21.15.134:0/1510017081 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03080103c0 con 0x7f0314102740 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 -- 172.21.15.134:0/1510017081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 msgr2=0x7f0314102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 --2- 172.21.15.134:0/1510017081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314102b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03080098e0 tx=0x7f0308009250 comp rx=0 tx=0).stop 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 -- 172.21.15.134:0/1510017081 shutdown_connections 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 --2- 172.21.15.134:0/1510017081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314102b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 -- 172.21.15.134:0/1510017081 >> 172.21.15.134:0/1510017081 conn(0x7f03140fdea0 msgr2=0x7f03141002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 -- 172.21.15.134:0/1510017081 shutdown_connections 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.290+0000 7f031a00b700 1 -- 172.21.15.134:0/1510017081 wait complete. 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f031a00b700 1 Processor -- start 2024-03-22T07:20:19.110 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f031a00b700 1 -- start start 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f031a00b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314078bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f031a00b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314079110 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f03137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314078bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f03137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314078bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39478/0 (socket says 172.21.15.134:39478) 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f03137fe700 1 -- 172.21.15.134:0/3072048536 learned_addr learned my addr 172.21.15.134:0/3072048536 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.291+0000 7f03137fe700 1 -- 172.21.15.134:0/3072048536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080094f0 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.292+0000 7f03137fe700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314078bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0308011c10 tx=0x7f0308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.292+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0308010890 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.292+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0314077180 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.292+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0308010ec0 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.292+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03080243f0 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.292+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0314077670 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.293+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f030802d3f0 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.293+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031404bed0 con 0x7f0314102740 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.293+0000 7f02fbfff700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f02fc0367e0 0x7f02fc038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:19.111 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.293+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f030804a5d0 con 0x7f0314102740 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.293+0000 7f0312ffd700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f02fc0367e0 0x7f02fc038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.293+0000 7f0312ffd700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f02fc0367e0 0x7f02fc038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0304009990 tx=0x7f0304006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.302+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0308018b00 con 0x7f0314102740 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.487+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0314077af0 con 0x7f0314102740 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.488+0000 7f02fbfff700 1 -- 172.21.15.134:0/3072048536 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0308018b00 con 0x7f0314102740 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f02fc0367e0 msgr2=0x7f02fc038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f02fc0367e0 0x7f02fc038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0304009990 tx=0x7f0304006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 msgr2=0x7f0314078bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314078bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0308011c10 tx=0x7f0308009250 comp rx=0 tx=0).stop 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 shutdown_connections 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f02fc0367e0 0x7f02fc038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 --2- 172.21.15.134:0/3072048536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0314102740 0x7f0314078bd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 >> 172.21.15.134:0/3072048536 conn(0x7f03140fdea0 msgr2=0x7f03140fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 shutdown_connections 2024-03-22T07:20:19.112 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:18.490+0000 7f031a00b700 1 -- 172.21.15.134:0/3072048536 wait complete. 2024-03-22T07:20:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:19 smithi134 ceph-mon[29057]: mgrmap e13: smithi134.wtwqre(active, since 6s) 2024-03-22T07:20:20.387 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff51a152700 1 Processor -- start 2024-03-22T07:20:20.388 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff51a152700 1 -- start start 2024-03-22T07:20:20.388 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff51a152700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff514102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:20.388 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff51a152700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5141030c0 con 0x7ff514102770 2024-03-22T07:20:20.388 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff5137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff514102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:20.388 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff5137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff514102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39488/0 (socket says 172.21.15.134:39488) 2024-03-22T07:20:20.388 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.526+0000 7ff5137fe700 1 -- 172.21.15.134:0/2380010183 learned_addr learned my addr 172.21.15.134:0/2380010183 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff5137fe700 1 -- 172.21.15.134:0/2380010183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514103200 con 0x7ff514102770 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff5137fe700 1 --2- 172.21.15.134:0/2380010183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff514102b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098e0 tx=0x7ff504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b291d5313e42b92b server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff512ffd700 1 -- 172.21.15.134:0/2380010183 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff50400b860 con 0x7ff514102770 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff512ffd700 1 -- 172.21.15.134:0/2380010183 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff50400be90 con 0x7ff514102770 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff512ffd700 1 -- 172.21.15.134:0/2380010183 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5040103c0 con 0x7ff514102770 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff51a152700 1 -- 172.21.15.134:0/2380010183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 msgr2=0x7ff514102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.527+0000 7ff51a152700 1 --2- 172.21.15.134:0/2380010183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff514102b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098e0 tx=0x7ff504009250 comp rx=0 tx=0).stop 2024-03-22T07:20:20.389 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 -- 172.21.15.134:0/2380010183 shutdown_connections 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 --2- 172.21.15.134:0/2380010183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff514102b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 -- 172.21.15.134:0/2380010183 >> 172.21.15.134:0/2380010183 conn(0x7ff5140fde90 msgr2=0x7ff514100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 -- 172.21.15.134:0/2380010183 shutdown_connections 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 -- 172.21.15.134:0/2380010183 wait complete. 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 Processor -- start 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 -- start start 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff5141115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:20.390 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.528+0000 7ff51a152700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514111b10 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff5137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff5141115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff5137fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff5141115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39498/0 (socket says 172.21.15.134:39498) 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff5137fe700 1 -- 172.21.15.134:0/4182446489 learned_addr learned my addr 172.21.15.134:0/4182446489 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff5137fe700 1 -- 172.21.15.134:0/4182446489 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040094f0 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff5137fe700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff5141115d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff504011680 tx=0x7ff504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff504010890 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff504010ec0 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5040243f0 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff514111d10 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.529+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff514112880 con 0x7ff514102770 2024-03-22T07:20:20.391 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.530+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff50402d3f0 con 0x7ff514102770 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.530+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51405f5f0 con 0x7ff514102770 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.530+0000 7ff510ff9700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7ff500036880 0x7ff500038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.530+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff50404a520 con 0x7ff514102770 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.530+0000 7ff50affd700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7ff500036880 0x7ff500038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.531+0000 7ff50affd700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7ff500036880 0x7ff500038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009990 tx=0x7ff4fc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.535+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff50402dac0 con 0x7ff514102770 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.827+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7ff51404bed0 con 0x7ff514102770 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.832+0000 7ff510ff9700 1 -- 172.21.15.134:0/4182446489 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7ff50402c350 con 0x7ff514102770 2024-03-22T07:20:20.392 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7ff500036880 msgr2=0x7ff500038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7ff500036880 0x7ff500038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009990 tx=0x7ff4fc006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 msgr2=0x7ff5141115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff5141115d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff504011680 tx=0x7ff504009250 comp rx=0 tx=0).stop 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 shutdown_connections 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7ff500036880 0x7ff500038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 --2- 172.21.15.134:0/4182446489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff514102770 0x7ff5141115d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 >> 172.21.15.134:0/4182446489 conn(0x7ff5140fde90 msgr2=0x7ff5140feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 shutdown_connections 2024-03-22T07:20:20.393 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr 2024-03-22T07:20:19.834+0000 7ff51a152700 1 -- 172.21.15.134:0/4182446489 wait complete. 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout:Or, if you are only running a single cluster on this host: 2024-03-22T07:20:20.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph telemetry on 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.395 INFO:teuthology.orchestra.run.smithi134.stdout:For more information see: 2024-03-22T07:20:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-03-22T07:20:20.396 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:20.396 INFO:teuthology.orchestra.run.smithi134.stdout:Bootstrap complete. 2024-03-22T07:20:20.420 INFO:tasks.cephadm:Fetching config... 2024-03-22T07:20:20.420 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:20:20.420 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-22T07:20:20.475 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-22T07:20:20.475 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:20:20.476 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-22T07:20:20.531 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-22T07:20:20.531 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:20:20.531 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/keyring of=/dev/stdout 2024-03-22T07:20:20.600 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-22T07:20:20.600 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:20:20.601 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-22T07:20:20.655 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-22T07:20:20.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU2Hvei4x1jKfTf5ktNAMLQv+nWIJQeExFxhP/UfjjBdBoJhNeZGVFmS6ZwCSSNn/FttepBNTEXhFLCCU5Av5GWGoX1/RtgTVfFXiJXtmcSiBJoEGxV2lNmbmp5SPKnV33eV4ym03c1VIC+INwyYVIUU3aa9Sm1smYLG5YUSCstv0F+X4GFxVTyUa/ycB567OaokGN8BH26hkNuN6u7LNOvCDHvUUWCAtnfbbwtxnvLMVbVXqndtSHG3XeI47tYrq7KptN4T2/RjE3/HVnKBjM2tF5qVlC+kUqsRzPMPoa47aJki+nugwVPG8G/MZeqqAzWCLu6aZ2/TO1f6q+mrMROs96+9TAihNW41jqQE2wIeYmrF8LwMfeMWzjPkEpEKlonIiVi4nC8A8thXSbHTuKSiTczb5T9eoqXQmp+C66NsguLlE9QDrLf+ZoFOOQknS9Kb75wQFA7P0wJsdq7KR5XYlYuPtK3DVIWauHj+lS0/0oHro5xQf4Ez8KQtqK5XM= ceph-5a05dc38-e81c-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-22T07:20:20.745 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU2Hvei4x1jKfTf5ktNAMLQv+nWIJQeExFxhP/UfjjBdBoJhNeZGVFmS6ZwCSSNn/FttepBNTEXhFLCCU5Av5GWGoX1/RtgTVfFXiJXtmcSiBJoEGxV2lNmbmp5SPKnV33eV4ym03c1VIC+INwyYVIUU3aa9Sm1smYLG5YUSCstv0F+X4GFxVTyUa/ycB567OaokGN8BH26hkNuN6u7LNOvCDHvUUWCAtnfbbwtxnvLMVbVXqndtSHG3XeI47tYrq7KptN4T2/RjE3/HVnKBjM2tF5qVlC+kUqsRzPMPoa47aJki+nugwVPG8G/MZeqqAzWCLu6aZ2/TO1f6q+mrMROs96+9TAihNW41jqQE2wIeYmrF8LwMfeMWzjPkEpEKlonIiVi4nC8A8thXSbHTuKSiTczb5T9eoqXQmp+C66NsguLlE9QDrLf+ZoFOOQknS9Kb75wQFA7P0wJsdq7KR5XYlYuPtK3DVIWauHj+lS0/0oHro5xQf4Ez8KQtqK5XM= ceph-5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:20:20.759 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU2Hvei4x1jKfTf5ktNAMLQv+nWIJQeExFxhP/UfjjBdBoJhNeZGVFmS6ZwCSSNn/FttepBNTEXhFLCCU5Av5GWGoX1/RtgTVfFXiJXtmcSiBJoEGxV2lNmbmp5SPKnV33eV4ym03c1VIC+INwyYVIUU3aa9Sm1smYLG5YUSCstv0F+X4GFxVTyUa/ycB567OaokGN8BH26hkNuN6u7LNOvCDHvUUWCAtnfbbwtxnvLMVbVXqndtSHG3XeI47tYrq7KptN4T2/RjE3/HVnKBjM2tF5qVlC+kUqsRzPMPoa47aJki+nugwVPG8G/MZeqqAzWCLu6aZ2/TO1f6q+mrMROs96+9TAihNW41jqQE2wIeYmrF8LwMfeMWzjPkEpEKlonIiVi4nC8A8thXSbHTuKSiTczb5T9eoqXQmp+C66NsguLlE9QDrLf+ZoFOOQknS9Kb75wQFA7P0wJsdq7KR5XYlYuPtK3DVIWauHj+lS0/0oHro5xQf4Ez8KQtqK5XM= ceph-5a05dc38-e81c-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-22T07:20:20.806 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU2Hvei4x1jKfTf5ktNAMLQv+nWIJQeExFxhP/UfjjBdBoJhNeZGVFmS6ZwCSSNn/FttepBNTEXhFLCCU5Av5GWGoX1/RtgTVfFXiJXtmcSiBJoEGxV2lNmbmp5SPKnV33eV4ym03c1VIC+INwyYVIUU3aa9Sm1smYLG5YUSCstv0F+X4GFxVTyUa/ycB567OaokGN8BH26hkNuN6u7LNOvCDHvUUWCAtnfbbwtxnvLMVbVXqndtSHG3XeI47tYrq7KptN4T2/RjE3/HVnKBjM2tF5qVlC+kUqsRzPMPoa47aJki+nugwVPG8G/MZeqqAzWCLu6aZ2/TO1f6q+mrMROs96+9TAihNW41jqQE2wIeYmrF8LwMfeMWzjPkEpEKlonIiVi4nC8A8thXSbHTuKSiTczb5T9eoqXQmp+C66NsguLlE9QDrLf+ZoFOOQknS9Kb75wQFA7P0wJsdq7KR5XYlYuPtK3DVIWauHj+lS0/0oHro5xQf4Ez8KQtqK5XM= ceph-5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:20:20.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-22T07:20:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:20 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/4182446489' entity='client.admin' 2024-03-22T07:20:21.077 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 -- 172.21.15.134:0/660274258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 msgr2=0x7ff0100fb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 --2- 172.21.15.134:0/660274258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff0100fb8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff0000048c0 tx=0x7ff000009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 -- 172.21.15.134:0/660274258 shutdown_connections 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 --2- 172.21.15.134:0/660274258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff0100fb8b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 -- 172.21.15.134:0/660274258 >> 172.21.15.134:0/660274258 conn(0x7ff0100f70d0 msgr2=0x7ff0100f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 -- 172.21.15.134:0/660274258 shutdown_connections 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 -- 172.21.15.134:0/660274258 wait complete. 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 Processor -- start 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.266+0000 7ff014cbc700 1 -- start start 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff014cbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff01010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff014cbc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01010f800 con 0x7ff0100fb4a0 2024-03-22T07:20:23.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff00e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff01010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff00e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff01010f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39514/0 (socket says 172.21.15.134:39514) 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff00e59c700 1 -- 172.21.15.134:0/1401723992 learned_addr learned my addr 172.21.15.134:0/1401723992 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff00e59c700 1 -- 172.21.15.134:0/1401723992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000005040 con 0x7ff0100fb4a0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff00e59c700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff01010f2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff000009680 tx=0x7ff000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00000bed0 con 0x7ff0100fb4a0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff00000b5c0 con 0x7ff0100fb4a0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01010fa00 con 0x7ff0100fb4a0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00001c5b0 con 0x7ff0100fb4a0 2024-03-22T07:20:23.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.267+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010110570 con 0x7ff0100fb4a0 2024-03-22T07:20:23.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.268+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff000004d30 con 0x7ff0100fb4a0 2024-03-22T07:20:23.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.268+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010105170 con 0x7ff0100fb4a0 2024-03-22T07:20:23.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.268+0000 7feffeffd700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7feff8036880 0x7feff8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:23.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.268+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff000049a40 con 0x7ff0100fb4a0 2024-03-22T07:20:23.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.268+0000 7ff00dd9b700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7feff8036880 0x7feff8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:23.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.269+0000 7ff00dd9b700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7feff8036880 0x7feff8038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff004009990 tx=0x7ff004006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:23.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.273+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff000011960 con 0x7ff0100fb4a0 2024-03-22T07:20:23.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.467+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ff010104ae0 con 0x7ff0100fb4a0 2024-03-22T07:20:23.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.472+0000 7feffeffd700 1 -- 172.21.15.134:0/1401723992 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff000011370 con 0x7ff0100fb4a0 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7feff8036880 msgr2=0x7feff8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7feff8036880 0x7feff8038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff004009990 tx=0x7ff004006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 msgr2=0x7ff01010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff01010f2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff000009680 tx=0x7ff000009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 shutdown_connections 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7feff8036880 0x7feff8038d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:23.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 --2- 172.21.15.134:0/1401723992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0100fb4a0 0x7ff01010f2c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:23.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 >> 172.21.15.134:0/1401723992 conn(0x7ff0100f70d0 msgr2=0x7ff010105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:23.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 shutdown_connections 2024-03-22T07:20:23.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:23.474+0000 7ff014cbc700 1 -- 172.21.15.134:0/1401723992 wait complete. 2024-03-22T07:20:23.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:23.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:23.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:20:23.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:23.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:20:23.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-22T07:20:23.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:20:23.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:23 smithi134 ceph-mon[29057]: Deploying daemon crash.smithi134 on smithi134 2024-03-22T07:20:24.398 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-22T07:20:24.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-22T07:20:24.759 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:24 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1401723992' entity='client.admin' 2024-03-22T07:20:25.064 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.444+0000 7fdf3a918700 1 -- 172.21.15.134:0/502917992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 msgr2=0x7fdf340fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.444+0000 7fdf3a918700 1 --2- 172.21.15.134:0/502917992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf340fe4c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf240048c0 tx=0x7fdf24009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.444+0000 7fdf3a918700 1 -- 172.21.15.134:0/502917992 shutdown_connections 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.444+0000 7fdf3a918700 1 --2- 172.21.15.134:0/502917992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf340fe4c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.444+0000 7fdf3a918700 1 -- 172.21.15.134:0/502917992 >> 172.21.15.134:0/502917992 conn(0x7fdf340f6850 msgr2=0x7fdf340f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.444+0000 7fdf3a918700 1 -- 172.21.15.134:0/502917992 shutdown_connections 2024-03-22T07:20:27.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.445+0000 7fdf3a918700 1 -- 172.21.15.134:0/502917992 wait complete. 2024-03-22T07:20:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.445+0000 7fdf3a918700 1 Processor -- start 2024-03-22T07:20:27.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.445+0000 7fdf3a918700 1 -- start start 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.445+0000 7fdf3a918700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf3410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.445+0000 7fdf3a918700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3410d630 con 0x7fdf340fe0b0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf3410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf3410d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35162/0 (socket says 172.21.15.134:35162) 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf33fff700 1 -- 172.21.15.134:0/201008529 learned_addr learned my addr 172.21.15.134:0/201008529 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf33fff700 1 -- 172.21.15.134:0/201008529 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24005040 con 0x7fdf340fe0b0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf33fff700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf3410d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf240096b0 tx=0x7fdf24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf2400bed0 con 0x7fdf340fe0b0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf2400b5c0 con 0x7fdf340fe0b0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3410d830 con 0x7fdf340fe0b0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3410e3a0 con 0x7fdf340fe0b0 2024-03-22T07:20:27.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.446+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf2401c5b0 con 0x7fdf340fe0b0 2024-03-22T07:20:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.447+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fdf2401c820 con 0x7fdf340fe0b0 2024-03-22T07:20:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.447+0000 7fdf30ff9700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdf1c036880 0x7fdf1c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.447+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf34102f80 con 0x7fdf340fe0b0 2024-03-22T07:20:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.447+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdf24049b70 con 0x7fdf340fe0b0 2024-03-22T07:20:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.447+0000 7fdf337fe700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdf1c036880 0x7fdf1c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:27.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.448+0000 7fdf337fe700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdf1c036880 0x7fdf1c038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009990 tx=0x7fdf28006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:27.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.452+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdf2404be60 con 0x7fdf340fe0b0 2024-03-22T07:20:27.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.665+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf3405f690 con 0x7fdf1c036880 2024-03-22T07:20:27.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.669+0000 7fdf30ff9700 1 -- 172.21.15.134:0/201008529 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdf3405f690 con 0x7fdf1c036880 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdf1c036880 msgr2=0x7fdf1c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdf1c036880 0x7fdf1c038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009990 tx=0x7fdf28006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 msgr2=0x7fdf3410d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf3410d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf240096b0 tx=0x7fdf24009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 shutdown_connections 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdf1c036880 0x7fdf1c038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 --2- 172.21.15.134:0/201008529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf340fe0b0 0x7fdf3410d0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 >> 172.21.15.134:0/201008529 conn(0x7fdf340f6850 msgr2=0x7fdf340f7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 shutdown_connections 2024-03-22T07:20:27.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:27.671+0000 7fdf3a918700 1 -- 172.21.15.134:0/201008529 wait complete. 2024-03-22T07:20:28.306 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2024-03-22T07:20:28.306 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:20:28.306 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2024-03-22T07:20:28.325 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:20:28.325 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:20:28.383 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2024-03-22T07:20:28.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch host add smithi195 2024-03-22T07:20:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:28 smithi134 ceph-mon[29057]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:20:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:28 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:28.802 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:20:30.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:29 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:30.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:29 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:30.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:29 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:30.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:29 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:30.182 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:29 smithi134 ceph-mon[29057]: Deploying daemon node-exporter.smithi134 on smithi134 2024-03-22T07:20:30.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- 172.21.15.134:0/1249452246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 msgr2=0x7f953c0ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 --2- 172.21.15.134:0/1249452246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c0ff650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f952c0048c0 tx=0x7f952c009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- 172.21.15.134:0/1249452246 shutdown_connections 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 --2- 172.21.15.134:0/1249452246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c0ff650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- 172.21.15.134:0/1249452246 >> 172.21.15.134:0/1249452246 conn(0x7f953c0f70c0 msgr2=0x7f953c0f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- 172.21.15.134:0/1249452246 shutdown_connections 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- 172.21.15.134:0/1249452246 wait complete. 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 Processor -- start 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- start start 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.445+0000 7f9541de2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c10d620 con 0x7f953c0669e0 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f953b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:30.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f953b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35186/0 (socket says 172.21.15.134:35186) 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f953b7fe700 1 -- 172.21.15.134:0/2851135458 learned_addr learned my addr 172.21.15.134:0/2851135458 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f953b7fe700 1 -- 172.21.15.134:0/2851135458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c005040 con 0x7f953c0669e0 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f953b7fe700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c10d0e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b900 tx=0x7f952c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f952c00b5c0 con 0x7f953c0669e0 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f952c00be70 con 0x7f953c0669e0 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953c10d820 con 0x7f953c0669e0 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f952c01c590 con 0x7f953c0669e0 2024-03-22T07:20:30.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.446+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c10e390 con 0x7f953c0669e0 2024-03-22T07:20:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.447+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f952c01c850 con 0x7f953c0669e0 2024-03-22T07:20:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.447+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953c102f60 con 0x7f953c0669e0 2024-03-22T07:20:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.447+0000 7f9523fff700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f9524036880 0x7f9524038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.447+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f952c0495d0 con 0x7f953c0669e0 2024-03-22T07:20:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.448+0000 7f953affd700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f9524036880 0x7f9524038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:30.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.448+0000 7f953affd700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f9524036880 0x7f9524038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9530009990 tx=0x7f9530006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:30.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.452+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f952c011960 con 0x7f953c0669e0 2024-03-22T07:20:30.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:30.648+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f953c10e5d0 con 0x7f9524036880 2024-03-22T07:20:31.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:31 smithi134 ceph-mon[29057]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:20:32.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.680+0000 7f9523fff700 1 -- 172.21.15.134:0/2851135458 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f953c10e5d0 con 0x7f9524036880 2024-03-22T07:20:32.680 INFO:teuthology.orchestra.run.smithi134.stdout:Added host 'smithi195' with addr '172.21.15.195' 2024-03-22T07:20:32.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f9524036880 msgr2=0x7f9524038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f9524036880 0x7f9524038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9530009990 tx=0x7f9530006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 msgr2=0x7f953c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c10d0e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b900 tx=0x7f952c009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 shutdown_connections 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f9524036880 0x7f9524038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 --2- 172.21.15.134:0/2851135458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f953c0669e0 0x7f953c10d0e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 >> 172.21.15.134:0/2851135458 conn(0x7f953c0f70c0 msgr2=0x7f953c103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 shutdown_connections 2024-03-22T07:20:32.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:32.682+0000 7f9541de2700 1 -- 172.21.15.134:0/2851135458 wait complete. 2024-03-22T07:20:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:32 smithi134 ceph-mon[29057]: Deploying cephadm binary to smithi195 2024-03-22T07:20:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:32 smithi134 ceph-mon[29057]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:32 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:32 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:33.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch host ls --format=json 2024-03-22T07:20:34.184 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:33 smithi134 ceph-mon[29057]: Added host smithi195 2024-03-22T07:20:34.328 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:20:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:34 smithi134 ceph-mon[29057]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:34 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:34 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:34 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:34 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 -- 172.21.15.134:0/3855211892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 msgr2=0x7f17340ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 --2- 172.21.15.134:0/3855211892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340ffa30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17240048c0 tx=0x7f1724009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 -- 172.21.15.134:0/3855211892 shutdown_connections 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 --2- 172.21.15.134:0/3855211892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340ffa30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 -- 172.21.15.134:0/3855211892 >> 172.21.15.134:0/3855211892 conn(0x7f17340f70d0 msgr2=0x7f17340f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 -- 172.21.15.134:0/3855211892 shutdown_connections 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 -- 172.21.15.134:0/3855211892 wait complete. 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.006+0000 7f173be95700 1 Processor -- start 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f173be95700 1 -- start start 2024-03-22T07:20:36.154 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f173be95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f173be95700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340fd4f0 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f1739c31700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f1739c31700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340fcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57850/0 (socket says 172.21.15.134:57850) 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f1739c31700 1 -- 172.21.15.134:0/1309989568 learned_addr learned my addr 172.21.15.134:0/1309989568 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f1739c31700 1 -- 172.21.15.134:0/1309989568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1724005040 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f1739c31700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340fcfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f172400b900 tx=0x7f1724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f172400b5c0 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f172400be70 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340fb5c0 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f172401c590 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.007+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17340fbab0 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.008+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f172401c800 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.008+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1734102f60 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.008+0000 7f17327fc700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f171c0368d0 0x7f171c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.008+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f17240494a0 con 0x7f17340fd650 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.008+0000 7f1739430700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f171c0368d0 0x7f171c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:36.155 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.009+0000 7f1739430700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f171c0368d0 0x7f171c038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1728009990 tx=0x7f1728006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:36.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.013+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1724011960 con 0x7f17340fd650 2024-03-22T07:20:36.156 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:35 smithi134 ceph-mon[29057]: Deploying daemon alertmanager.smithi134 on smithi134 2024-03-22T07:20:36.208 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.208+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17341064a0 con 0x7f171c0368d0 2024-03-22T07:20:36.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.209+0000 7f17327fc700 1 -- 172.21.15.134:0/1309989568 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f17341064a0 con 0x7f171c0368d0 2024-03-22T07:20:36.210 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:20:36.210 INFO:teuthology.orchestra.run.smithi134.stdout:[{"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f171c0368d0 msgr2=0x7f171c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f171c0368d0 0x7f171c038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1728009990 tx=0x7f1728006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 msgr2=0x7f17340fcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340fcfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f172400b900 tx=0x7f1724009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 shutdown_connections 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f171c0368d0 0x7f171c038d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 --2- 172.21.15.134:0/1309989568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fd650 0x7f17340fcfb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.211+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 >> 172.21.15.134:0/1309989568 conn(0x7f17340f70d0 msgr2=0x7f1734103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:36.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.212+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 shutdown_connections 2024-03-22T07:20:36.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:36.212+0000 7f173be95700 1 -- 172.21.15.134:0/1309989568 wait complete. 2024-03-22T07:20:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:36 smithi134 ceph-mon[29057]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:36 smithi134 ceph-mon[29057]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-22T07:20:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:36 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:37.179 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-22T07:20:37.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd crush tunables default 2024-03-22T07:20:37.477 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:20:39.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:38 smithi134 ceph-mon[29057]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.974+0000 7f71e897c700 1 -- 172.21.15.134:0/871202260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 msgr2=0x7f71e4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.974+0000 7f71e897c700 1 --2- 172.21.15.134:0/871202260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e4070350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71d40048c0 tx=0x7f71d4009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 -- 172.21.15.134:0/871202260 shutdown_connections 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 --2- 172.21.15.134:0/871202260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e4070350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 -- 172.21.15.134:0/871202260 >> 172.21.15.134:0/871202260 conn(0x7f71e40f81c0 msgr2=0x7f71e40fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 -- 172.21.15.134:0/871202260 shutdown_connections 2024-03-22T07:20:40.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 -- 172.21.15.134:0/871202260 wait complete. 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 Processor -- start 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 -- start start 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e410f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e897c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e410f850 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e410f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e410f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57880/0 (socket says 172.21.15.134:57880) 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.975+0000 7f71e259c700 1 -- 172.21.15.134:0/476535005 learned_addr learned my addr 172.21.15.134:0/476535005 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71e259c700 1 -- 172.21.15.134:0/476535005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4005040 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71e259c700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e410f310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009680 tx=0x7f71d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71d400bed0 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71d400b5c0 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e410fa50 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71d401c5b0 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.976+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41105c0 con 0x7f71e4071e40 2024-03-22T07:20:40.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.977+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f71d401c710 con 0x7f71e4071e40 2024-03-22T07:20:40.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.977+0000 7f71d2ffd700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f71cc036880 0x7f71cc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:40.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.977+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e4105180 con 0x7f71e4071e40 2024-03-22T07:20:40.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.977+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f71d4049ae0 con 0x7f71e4071e40 2024-03-22T07:20:40.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.977+0000 7f71e1d9b700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f71cc036880 0x7f71cc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:40.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.977+0000 7f71e1d9b700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f71cc036880 0x7f71cc038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009990 tx=0x7f71d8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:40.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:39.982+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f71d4025400 con 0x7f71e4071e40 2024-03-22T07:20:40.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.174+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f71e405f5f0 con 0x7f71e4071e40 2024-03-22T07:20:40.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.870+0000 7f71d2ffd700 1 -- 172.21.15.134:0/476535005 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f71d4011b60 con 0x7f71e4071e40 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f71cc036880 msgr2=0x7f71cc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f71cc036880 0x7f71cc038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009990 tx=0x7f71d8006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 msgr2=0x7f71e410f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e410f310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009680 tx=0x7f71d4009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 shutdown_connections 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f71cc036880 0x7f71cc038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 --2- 172.21.15.134:0/476535005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71e4071e40 0x7f71e410f310 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 >> 172.21.15.134:0/476535005 conn(0x7f71e40f81c0 msgr2=0x7f71e40f8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 shutdown_connections 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:20:40.872+0000 7f71e897c700 1 -- 172.21.15.134:0/476535005 wait complete. 2024-03-22T07:20:40.873 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2024-03-22T07:20:41.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:40 smithi134 ceph-mon[29057]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:41.194 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:40 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/476535005' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-22T07:20:41.494 INFO:tasks.cephadm:Adding mon.smithi134 on smithi134 2024-03-22T07:20:41.494 INFO:tasks.cephadm:Adding mon.smithi195 on smithi195 2024-03-22T07:20:41.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch apply mon '2;smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195' 2024-03-22T07:20:41.744 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:41.791 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:42.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:41 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/476535005' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-22T07:20:42.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:41 smithi134 ceph-mon[29057]: osdmap e4: 0 total, 0 up, 0 in 2024-03-22T07:20:43.164 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:42 smithi134 ceph-mon[29057]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 -- 172.21.15.195:0/839132719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 msgr2=0x7f51280fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 --2- 172.21.15.195:0/839132719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f51280fce70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51240048c0 tx=0x7f5124009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 -- 172.21.15.195:0/839132719 shutdown_connections 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 --2- 172.21.15.195:0/839132719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f51280fce70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 -- 172.21.15.195:0/839132719 >> 172.21.15.195:0/839132719 conn(0x7f51280f81c0 msgr2=0x7f51280fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 -- 172.21.15.195:0/839132719 shutdown_connections 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 -- 172.21.15.195:0/839132719 wait complete. 2024-03-22T07:20:43.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 Processor -- start 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.365+0000 7f512fc7e700 1 -- start start 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512fc7e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f512810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512fc7e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512810d5f0 con 0x7f51280fca60 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512da1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f512810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512da1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f512810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:46946/0 (socket says 172.21.15.195:46946) 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512da1a700 1 -- 172.21.15.195:0/2657668469 learned_addr learned my addr 172.21.15.195:0/2657668469 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512da1a700 1 -- 172.21.15.195:0/2657668469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124005040 con 0x7f51280fca60 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512da1a700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f512810d0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51240096b0 tx=0x7f5124009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f512400bed0 con 0x7f51280fca60 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f512400b5c0 con 0x7f51280fca60 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f512401c5b0 con 0x7f51280fca60 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512810d7f0 con 0x7f51280fca60 2024-03-22T07:20:43.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.366+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512810e360 con 0x7f51280fca60 2024-03-22T07:20:43.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.367+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f5124013420 con 0x7f51280fca60 2024-03-22T07:20:43.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.367+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5128102f70 con 0x7f51280fca60 2024-03-22T07:20:43.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.367+0000 7f511e7fc700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f5114036880 0x7f5114038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:43.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.367+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5124049a80 con 0x7f51280fca60 2024-03-22T07:20:43.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.368+0000 7f512d219700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f5114036880 0x7f5114038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:43.370 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.368+0000 7f512d219700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f5114036880 0x7f5114038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5118009990 tx=0x7f5118006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:43.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.372+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5124013a80 con 0x7f51280fca60 2024-03-22T07:20:43.567 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.567+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 --> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f512810e650 con 0x7f5114036880 2024-03-22T07:20:43.573 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.572+0000 7f511e7fc700 1 -- 172.21.15.195:0/2657668469 <== mgr.14162 v2:172.21.15.134:6800/3465812625 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f512810e650 con 0x7f5114036880 2024-03-22T07:20:43.573 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f5114036880 msgr2=0x7f5114038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f5114036880 0x7f5114038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5118009990 tx=0x7f5118006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 msgr2=0x7f512810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f512810d0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51240096b0 tx=0x7f5124009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 shutdown_connections 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f5114036880 0x7f5114038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 --2- 172.21.15.195:0/2657668469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51280fca60 0x7f512810d0b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:43.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 >> 172.21.15.195:0/2657668469 conn(0x7f51280f81c0 msgr2=0x7f5128103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:43.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 shutdown_connections 2024-03-22T07:20:43.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:43.574+0000 7f512fc7e700 1 -- 172.21.15.195:0/2657668469 wait complete. 2024-03-22T07:20:44.032 DEBUG:teuthology.orchestra.run.smithi195:mon.smithi195> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195.service 2024-03-22T07:20:44.035 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:20:44.035 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:20:44.310 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:44.359 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: Saving service mon spec with placement smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195;count:2 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-22T07:20:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:44 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:45.688 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 -- 172.21.15.195:0/2444470851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 msgr2=0x7fdbac0fbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 --2- 172.21.15.195:0/2444470851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac0fbd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdba80048c0 tx=0x7fdba8009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 -- 172.21.15.195:0/2444470851 shutdown_connections 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 --2- 172.21.15.195:0/2444470851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac0fbd60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 -- 172.21.15.195:0/2444470851 >> 172.21.15.195:0/2444470851 conn(0x7fdbac0f7090 msgr2=0x7fdbac0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 -- 172.21.15.195:0/2444470851 shutdown_connections 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.687+0000 7fdbb3b58700 1 -- 172.21.15.195:0/2444470851 wait complete. 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb3b58700 1 Processor -- start 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb3b58700 1 -- start start 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb3b58700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac1019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb3b58700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac101ee0 con 0x7fdbac0fb950 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb18f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac1019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb18f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac1019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:46964/0 (socket says 172.21.15.195:46964) 2024-03-22T07:20:45.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb18f4700 1 -- 172.21.15.195:0/928980232 learned_addr learned my addr 172.21.15.195:0/928980232 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.688+0000 7fdbb18f4700 1 -- 172.21.15.195:0/928980232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba8005040 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.689+0000 7fdbb18f4700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac1019a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdba80096b0 tx=0x7fdba8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.689+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba800bed0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.689+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdba800b5c0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.689+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac0fffb0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.689+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdba801c5b0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.689+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1004a0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.690+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fdba8013420 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.690+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac05f5f0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.690+0000 7fdba27fc700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdb98036880 0x7fdb98038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.690+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdba8049ae0 con 0x7fdbac0fb950 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.690+0000 7fdbb10f3700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdb98036880 0x7fdb98038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:45.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.690+0000 7fdbb10f3700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdb98036880 0x7fdb98038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:45.695 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.695+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdba8013a80 con 0x7fdbac0fb950 2024-03-22T07:20:45.965 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.963+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdbac04bed0 con 0x7fdbac0fb950 2024-03-22T07:20:45.966 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.964+0000 7fdba27fc700 1 -- 172.21.15.195:0/928980232 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fdba8011370 con 0x7fdbac0fb950 2024-03-22T07:20:45.966 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:20:45.966 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdb98036880 msgr2=0x7fdb98038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdb98036880 0x7fdb98038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 msgr2=0x7fdbac1019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac1019a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdba80096b0 tx=0x7fdba8009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 shutdown_connections 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fdb98036880 0x7fdb98038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 --2- 172.21.15.195:0/928980232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbac0fb950 0x7fdbac1019a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 >> 172.21.15.195:0/928980232 conn(0x7fdbac0f7090 msgr2=0x7fdbac103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 shutdown_connections 2024-03-22T07:20:45.967 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:45.966+0000 7fdbb3b58700 1 -- 172.21.15.195:0/928980232 wait complete. 2024-03-22T07:20:45.968 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:20:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:45 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-22T07:20:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:45 smithi134 ceph-mon[29057]: Deploying daemon grafana.smithi134 on smithi134 2024-03-22T07:20:46.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:46 smithi134 ceph-mon[29057]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:46.836 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:46 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/928980232' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:20:47.563 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:20:47.563 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:20:47.813 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:47.861 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:48.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:47 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:49.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:48 smithi134 ceph-mon[29057]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:49.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 -- 172.21.15.195:0/1563522471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 msgr2=0x7f65c80ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:49.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 --2- 172.21.15.195:0/1563522471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80ff6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009c60 tx=0x7f65c0004d10 comp rx=0 tx=0).stop 2024-03-22T07:20:49.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 -- 172.21.15.195:0/1563522471 shutdown_connections 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 --2- 172.21.15.195:0/1563522471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80ff6d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 -- 172.21.15.195:0/1563522471 >> 172.21.15.195:0/1563522471 conn(0x7f65c80f70c0 msgr2=0x7f65c80f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 -- 172.21.15.195:0/1563522471 shutdown_connections 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 -- 172.21.15.195:0/1563522471 wait complete. 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 Processor -- start 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.371+0000 7f65d048e700 1 -- start start 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65d048e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80fd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65d048e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80fd560 con 0x7f65c8066940 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65ce22a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:49.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65ce22a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80fd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:43118/0 (socket says 172.21.15.195:43118) 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65ce22a700 1 -- 172.21.15.195:0/1510806660 learned_addr learned my addr 172.21.15.195:0/1510806660 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65ce22a700 1 -- 172.21.15.195:0/1510806660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0009940 con 0x7f65c8066940 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65ce22a700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80fd020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65c00097b0 tx=0x7f65c0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65c0012410 con 0x7f65c8066940 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65c0012a40 con 0x7f65c8066940 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c80fb630 con 0x7f65c8066940 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65c001ba20 con 0x7f65c8066940 2024-03-22T07:20:49.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.372+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c80fbb20 con 0x7f65c8066940 2024-03-22T07:20:49.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.373+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f65c0019040 con 0x7f65c8066940 2024-03-22T07:20:49.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.373+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c805f5f0 con 0x7f65c8066940 2024-03-22T07:20:49.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.374+0000 7f65c6ffd700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f65b0036880 0x7f65b0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:49.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.374+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f65c0049c60 con 0x7f65c8066940 2024-03-22T07:20:49.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.374+0000 7f65cda29700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f65b0036880 0x7f65b0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:49.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.374+0000 7f65cda29700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f65b0036880 0x7f65b0038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009990 tx=0x7f65bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:49.379 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.379+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f65c0012bb0 con 0x7f65c8066940 2024-03-22T07:20:49.640 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.639+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f65c8106430 con 0x7f65c8066940 2024-03-22T07:20:49.640 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.640+0000 7f65c6ffd700 1 -- 172.21.15.195:0/1510806660 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f65c0017090 con 0x7f65c8066940 2024-03-22T07:20:49.640 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:20:49.641 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:20:49.642 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.641+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f65b0036880 msgr2=0x7f65b0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:49.642 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.641+0000 7f65d048e700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f65b0036880 0x7f65b0038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009990 tx=0x7f65bc006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:49.642 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.641+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 msgr2=0x7f65c80fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:49.642 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.641+0000 7f65d048e700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80fd020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65c00097b0 tx=0x7f65c0004d10 comp rx=0 tx=0).stop 2024-03-22T07:20:49.642 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.642+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 shutdown_connections 2024-03-22T07:20:49.643 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.642+0000 7f65d048e700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f65b0036880 0x7f65b0038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:49.643 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.642+0000 7f65d048e700 1 --2- 172.21.15.195:0/1510806660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c8066940 0x7f65c80fd020 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:49.643 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.642+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 >> 172.21.15.195:0/1510806660 conn(0x7f65c80f70c0 msgr2=0x7f65c8103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:49.643 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.642+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 shutdown_connections 2024-03-22T07:20:49.643 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:49.642+0000 7f65d048e700 1 -- 172.21.15.195:0/1510806660 wait complete. 2024-03-22T07:20:49.643 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:20:50.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:49 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1510806660' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:20:51.219 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:20:51.219 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:20:51.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:50 smithi134 ceph-mon[29057]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:51.466 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:51.512 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:53.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 -- 172.21.15.195:0/1316542839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 msgr2=0x7f77f80fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 --2- 172.21.15.195:0/1316542839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f80fce70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0048c0 tx=0x7f77ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 -- 172.21.15.195:0/1316542839 shutdown_connections 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 --2- 172.21.15.195:0/1316542839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f80fce70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 -- 172.21.15.195:0/1316542839 >> 172.21.15.195:0/1316542839 conn(0x7f77f80f81c0 msgr2=0x7f77f80fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 -- 172.21.15.195:0/1316542839 shutdown_connections 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.014+0000 7f77fed5f700 1 -- 172.21.15.195:0/1316542839 wait complete. 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fed5f700 1 Processor -- start 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fed5f700 1 -- start start 2024-03-22T07:20:53.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fed5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f8071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fed5f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80722a0 con 0x7f77f80fca60 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fcafb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f8071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fcafb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f8071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:43138/0 (socket says 172.21.15.195:43138) 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.015+0000 7f77fcafb700 1 -- 172.21.15.195:0/1673625908 learned_addr learned my addr 172.21.15.195:0/1673625908 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77fcafb700 1 -- 172.21.15.195:0/1673625908 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec005040 con 0x7f77f80fca60 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77fcafb700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f8071d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0096b0 tx=0x7f77ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77ec00bed0 con 0x7f77f80fca60 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f8070370 con 0x7f77f80fca60 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77ec00b5c0 con 0x7f77f80fca60 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77ec01c5b0 con 0x7f77f80fca60 2024-03-22T07:20:53.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.016+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f8070860 con 0x7f77f80fca60 2024-03-22T07:20:53.019 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.017+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f77ec013420 con 0x7f77f80fca60 2024-03-22T07:20:53.019 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.017+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f805f5f0 con 0x7f77f80fca60 2024-03-22T07:20:53.019 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.017+0000 7f77f57fa700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f77e8036880 0x7f77e8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:53.019 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.017+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f77ec049ae0 con 0x7f77f80fca60 2024-03-22T07:20:53.020 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.017+0000 7f77f7fff700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f77e8036880 0x7f77e8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:53.020 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.017+0000 7f77f7fff700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f77e8036880 0x7f77e8038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009990 tx=0x7f77e4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:53.022 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.022+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f77ec025400 con 0x7f77f80fca60 2024-03-22T07:20:53.281 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.280+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f77f804bed0 con 0x7f77f80fca60 2024-03-22T07:20:53.281 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.280+0000 7f77f57fa700 1 -- 172.21.15.195:0/1673625908 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f77ec011370 con 0x7f77f80fca60 2024-03-22T07:20:53.281 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:20:53.281 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:20:53.283 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f77e8036880 msgr2=0x7f77e8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f77e8036880 0x7f77e8038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009990 tx=0x7f77e4006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 msgr2=0x7f77f8071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f8071d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0096b0 tx=0x7f77ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 shutdown_connections 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f77e8036880 0x7f77e8038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 --2- 172.21.15.195:0/1673625908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f80fca60 0x7f77f8071d60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 >> 172.21.15.195:0/1673625908 conn(0x7f77f80f81c0 msgr2=0x7f77f8103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 shutdown_connections 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:53.283+0000 7f77fed5f700 1 -- 172.21.15.195:0/1673625908 wait complete. 2024-03-22T07:20:53.284 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:20:53.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:52 smithi134 ceph-mon[29057]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:54.122 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:53 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1673625908' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:20:55.005 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:20:55.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:20:55.253 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:55.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:54 smithi134 ceph-mon[29057]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:55.299 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:56.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 -- 172.21.15.195:0/657115147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 msgr2=0x7faaa80fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 --2- 172.21.15.195:0/657115147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa80fd460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009c60 tx=0x7faaa0004d10 comp rx=0 tx=0).stop 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 -- 172.21.15.195:0/657115147 shutdown_connections 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 --2- 172.21.15.195:0/657115147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa80fd460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 -- 172.21.15.195:0/657115147 >> 172.21.15.195:0/657115147 conn(0x7faaa80f70d0 msgr2=0x7faaa80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 -- 172.21.15.195:0/657115147 shutdown_connections 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.702+0000 7faab0650700 1 -- 172.21.15.195:0/657115147 wait complete. 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faab0650700 1 Processor -- start 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faab0650700 1 -- start start 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faab0650700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa810bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:56.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faab0650700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa810c500 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faaae3ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa810bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faaae3ec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa810bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:60352/0 (socket says 172.21.15.195:60352) 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.703+0000 7faaae3ec700 1 -- 172.21.15.195:0/1695861634 learned_addr learned my addr 172.21.15.195:0/1695861634 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faaae3ec700 1 -- 172.21.15.195:0/1695861634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009940 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faaae3ec700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa810bfc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009500 tx=0x7faaa0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faaa0007c80 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faaa001d910 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa810c700 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faaa00129d0 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.704+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa810d270 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.705+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7faaa0019040 con 0x7faaa80fd050 2024-03-22T07:20:56.706 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.705+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa8101e70 con 0x7faaa80fd050 2024-03-22T07:20:56.707 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.705+0000 7faa9effd700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7faa94036880 0x7faa94038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:20:56.707 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.705+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faaa004a450 con 0x7faaa80fd050 2024-03-22T07:20:56.707 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.705+0000 7faaadbeb700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7faa94036880 0x7faa94038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:20:56.707 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.706+0000 7faaadbeb700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7faa94036880 0x7faa94038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa98009990 tx=0x7faa98006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:20:56.710 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.710+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7faaa002eb40 con 0x7faaa80fd050 2024-03-22T07:20:56.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.971+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faaa810dbd0 con 0x7faaa80fd050 2024-03-22T07:20:56.973 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.972+0000 7faa9effd700 1 -- 172.21.15.195:0/1695861634 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7faaa0017020 con 0x7faaa80fd050 2024-03-22T07:20:56.973 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:20:56.973 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7faa94036880 msgr2=0x7faa94038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7faa94036880 0x7faa94038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa98009990 tx=0x7faa98006e40 comp rx=0 tx=0).stop 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 msgr2=0x7faaa810bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa810bfc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009500 tx=0x7faaa0004d10 comp rx=0 tx=0).stop 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 shutdown_connections 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7faa94036880 0x7faa94038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 --2- 172.21.15.195:0/1695861634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa80fd050 0x7faaa810bfc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 >> 172.21.15.195:0/1695861634 conn(0x7faaa80f70d0 msgr2=0x7faaa8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 shutdown_connections 2024-03-22T07:20:56.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:20:56.974+0000 7faab0650700 1 -- 172.21.15.195:0/1695861634 wait complete. 2024-03-22T07:20:56.976 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:20:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:56 smithi134 ceph-mon[29057]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1695861634' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:57.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:57 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:20:58.524 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:20:58.524 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:20:58.766 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:58.811 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:20:59.294 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:58 smithi134 ceph-mon[29057]: Deploying daemon prometheus.smithi134 on smithi134 2024-03-22T07:20:59.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:20:58 smithi134 ceph-mon[29057]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 -- 172.21.15.195:0/2911132762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 msgr2=0x7fd9180fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 --2- 172.21.15.195:0/2911132762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd9180fe4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9000048c0 tx=0x7fd900009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 -- 172.21.15.195:0/2911132762 shutdown_connections 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 --2- 172.21.15.195:0/2911132762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd9180fe4c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 -- 172.21.15.195:0/2911132762 >> 172.21.15.195:0/2911132762 conn(0x7fd9180f6850 msgr2=0x7fd9180f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 -- 172.21.15.195:0/2911132762 shutdown_connections 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.363+0000 7fd91d453700 1 -- 172.21.15.195:0/2911132762 wait complete. 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd91d453700 1 Processor -- start 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd91d453700 1 -- start start 2024-03-22T07:21:00.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd91d453700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd91810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd91d453700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91810d630 con 0x7fd9180fe0b0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd916ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd91810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd916ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd91810d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:60366/0 (socket says 172.21.15.195:60366) 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.364+0000 7fd916ffd700 1 -- 172.21.15.195:0/2302781813 learned_addr learned my addr 172.21.15.195:0/2302781813 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd916ffd700 1 -- 172.21.15.195:0/2302781813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900005040 con 0x7fd9180fe0b0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd916ffd700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd91810d0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd9000096b0 tx=0x7fd900009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd90000bed0 con 0x7fd9180fe0b0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91810d830 con 0x7fd9180fe0b0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd90000b5c0 con 0x7fd9180fe0b0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd90001c5b0 con 0x7fd9180fe0b0 2024-03-22T07:21:00.367 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.365+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91810e3a0 con 0x7fd9180fe0b0 2024-03-22T07:21:00.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.366+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fd90001c820 con 0x7fd9180fe0b0 2024-03-22T07:21:00.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.366+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd918102f80 con 0x7fd9180fe0b0 2024-03-22T07:21:00.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.366+0000 7fd90f7fe700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fd904036880 0x7fd904038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:00.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.366+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd900049c00 con 0x7fd9180fe0b0 2024-03-22T07:21:00.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.366+0000 7fd9167fc700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fd904036880 0x7fd904038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:00.369 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.367+0000 7fd9167fc700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fd904036880 0x7fd904038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd908009990 tx=0x7fd908006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:00.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.371+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd900023300 con 0x7fd9180fe0b0 2024-03-22T07:21:00.629 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.628+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd91810ee70 con 0x7fd9180fe0b0 2024-03-22T07:21:00.630 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.629+0000 7fd90f7fe700 1 -- 172.21.15.195:0/2302781813 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd900049e60 con 0x7fd9180fe0b0 2024-03-22T07:21:00.630 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:00.630 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fd904036880 msgr2=0x7fd904038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fd904036880 0x7fd904038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd908009990 tx=0x7fd908006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 msgr2=0x7fd91810d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd91810d0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd9000096b0 tx=0x7fd900009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 shutdown_connections 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fd904036880 0x7fd904038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 --2- 172.21.15.195:0/2302781813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9180fe0b0 0x7fd91810d0f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 >> 172.21.15.195:0/2302781813 conn(0x7fd9180f6850 msgr2=0x7fd918103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 shutdown_connections 2024-03-22T07:21:00.632 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:00.631+0000 7fd91d453700 1 -- 172.21.15.195:0/2302781813 wait complete. 2024-03-22T07:21:00.633 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:01.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:00 smithi134 ceph-mon[29057]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:01.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:00 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/2302781813' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:02.177 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:02.178 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:02.423 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:02.471 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:02 smithi134 ceph-mon[29057]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:02 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:03.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 -- 172.21.15.195:0/1136354862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 msgr2=0x7fb8340fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:03.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 --2- 172.21.15.195:0/1136354862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb8340fce70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb8240048c0 tx=0x7fb824009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:03.837 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 -- 172.21.15.195:0/1136354862 shutdown_connections 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 --2- 172.21.15.195:0/1136354862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb8340fce70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 -- 172.21.15.195:0/1136354862 >> 172.21.15.195:0/1136354862 conn(0x7fb8340f81c0 msgr2=0x7fb8340fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 -- 172.21.15.195:0/1136354862 shutdown_connections 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 -- 172.21.15.195:0/1136354862 wait complete. 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 Processor -- start 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.836+0000 7fb838a0f700 1 -- start start 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb838a0f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb83410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb838a0f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83410d5d0 con 0x7fb8340fca60 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb83259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb83410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb83259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb83410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:60386/0 (socket says 172.21.15.195:60386) 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb83259c700 1 -- 172.21.15.195:0/3182769025 learned_addr learned my addr 172.21.15.195:0/3182769025 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:03.838 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb83259c700 1 -- 172.21.15.195:0/3182769025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824005040 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb83259c700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb83410d090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb8240096b0 tx=0x7fb824009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb82400bed0 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb82400b5c0 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb82401c5b0 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83410d7d0 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.837+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83410e340 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.838+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fb824013420 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.838+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb834102f70 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.839+0000 7fb822ffd700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb81c0368d0 0x7fb81c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.839+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb8240499c0 con 0x7fb8340fca60 2024-03-22T07:21:03.840 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.839+0000 7fb831d9b700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb81c0368d0 0x7fb81c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:03.841 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.839+0000 7fb831d9b700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb81c0368d0 0x7fb81c038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb828009990 tx=0x7fb828006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:03.844 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:03.843+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb824025400 con 0x7fb8340fca60 2024-03-22T07:21:04.105 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.104+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb83410ed50 con 0x7fb8340fca60 2024-03-22T07:21:04.105 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.105+0000 7fb822ffd700 1 -- 172.21.15.195:0/3182769025 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fb824004d30 con 0x7fb8340fca60 2024-03-22T07:21:04.105 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:04.105 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:04.107 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb81c0368d0 msgr2=0x7fb81c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb81c0368d0 0x7fb81c038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb828009990 tx=0x7fb828006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 msgr2=0x7fb83410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb83410d090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb8240096b0 tx=0x7fb824009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 shutdown_connections 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fb81c0368d0 0x7fb81c038d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 --2- 172.21.15.195:0/3182769025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca60 0x7fb83410d090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 >> 172.21.15.195:0/3182769025 conn(0x7fb8340f81c0 msgr2=0x7fb834103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 shutdown_connections 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:04.107+0000 7fb838a0f700 1 -- 172.21.15.195:0/3182769025 wait complete. 2024-03-22T07:21:04.108 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:05.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:04 smithi134 ceph-mon[29057]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:05.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:04 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3182769025' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:05.608 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:05.609 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:05.857 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:05.905 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:06 smithi134 ceph-mon[29057]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.334+0000 7fa22ad9d700 1 -- 172.21.15.195:0/4266676754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 msgr2=0x7fa2240fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 --2- 172.21.15.195:0/4266676754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa2240fbd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2180048c0 tx=0x7fa218009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 -- 172.21.15.195:0/4266676754 shutdown_connections 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 --2- 172.21.15.195:0/4266676754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa2240fbd50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 -- 172.21.15.195:0/4266676754 >> 172.21.15.195:0/4266676754 conn(0x7fa2240f70c0 msgr2=0x7fa2240f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 -- 172.21.15.195:0/4266676754 shutdown_connections 2024-03-22T07:21:07.336 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 -- 172.21.15.195:0/4266676754 wait complete. 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 Processor -- start 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 -- start start 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa22410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.335+0000 7fa22ad9d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22410c4d0 con 0x7fa2240fb940 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa228b39700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa22410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa228b39700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa22410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:58032/0 (socket says 172.21.15.195:58032) 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa228b39700 1 -- 172.21.15.195:0/207382456 learned_addr learned my addr 172.21.15.195:0/207382456 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa228b39700 1 -- 172.21.15.195:0/207382456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218005040 con 0x7fa2240fb940 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa228b39700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa22410bf90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa218009680 tx=0x7fa218009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa21800b5c0 con 0x7fa2240fb940 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa21800be70 con 0x7fa2240fb940 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22410c6d0 con 0x7fa2240fb940 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2180135a0 con 0x7fa2240fb940 2024-03-22T07:21:07.337 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.336+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22410d240 con 0x7fa2240fb940 2024-03-22T07:21:07.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.337+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa218013860 con 0x7fa2240fb940 2024-03-22T07:21:07.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.337+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa224101e50 con 0x7fa2240fb940 2024-03-22T07:21:07.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.337+0000 7fa2217fa700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa214036880 0x7fa214038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:07.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.337+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa2180496a0 con 0x7fa2240fb940 2024-03-22T07:21:07.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.337+0000 7fa223fff700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa214036880 0x7fa214038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:07.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.338+0000 7fa223fff700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa214036880 0x7fa214038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa210009990 tx=0x7fa210006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:07.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.342+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa218011960 con 0x7fa2240fb940 2024-03-22T07:21:07.602 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.602+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa22410dc50 con 0x7fa2240fb940 2024-03-22T07:21:07.603 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.603+0000 7fa2217fa700 1 -- 172.21.15.195:0/207382456 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa218011370 con 0x7fa2240fb940 2024-03-22T07:21:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:07.603 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:07.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa214036880 msgr2=0x7fa214038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:07.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa214036880 0x7fa214038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa210009990 tx=0x7fa210006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:07.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 msgr2=0x7fa22410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:07.605 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa22410bf90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa218009680 tx=0x7fa218009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:07.606 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 shutdown_connections 2024-03-22T07:21:07.606 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7fa214036880 0x7fa214038d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:07.606 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 --2- 172.21.15.195:0/207382456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2240fb940 0x7fa22410bf90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:07.606 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 >> 172.21.15.195:0/207382456 conn(0x7fa2240f70c0 msgr2=0x7fa224102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:07.606 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 shutdown_connections 2024-03-22T07:21:07.607 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:07.605+0000 7fa22ad9d700 1 -- 172.21.15.195:0/207382456 wait complete. 2024-03-22T07:21:07.607 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:08.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:07 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/207382456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:08.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:07 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:08.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:07 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:08.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:07 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:08.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:07 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-22T07:21:09.187 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:09.188 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:09.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:08 smithi134 ceph-mon[29057]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:09.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:08 smithi134 ceph-mon[29057]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-22T07:21:09.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:08 smithi134 ceph-mon[29057]: mgrmap e14: smithi134.wtwqre(active, since 56s) 2024-03-22T07:21:09.437 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:09.485 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:10.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 -- 172.21.15.195:0/3499969715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 msgr2=0x7f2df00fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:10.921 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 --2- 172.21.15.195:0/3499969715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df00fce70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2de00048c0 tx=0x7f2de0009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:10.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 -- 172.21.15.195:0/3499969715 shutdown_connections 2024-03-22T07:21:10.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 --2- 172.21.15.195:0/3499969715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df00fce70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:10.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 -- 172.21.15.195:0/3499969715 >> 172.21.15.195:0/3499969715 conn(0x7f2df00f81c0 msgr2=0x7f2df00fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:10.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 -- 172.21.15.195:0/3499969715 shutdown_connections 2024-03-22T07:21:10.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.916+0000 7f2df6752700 1 -- 172.21.15.195:0/3499969715 wait complete. 2024-03-22T07:21:10.922 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.917+0000 7f2df6752700 1 Processor -- start 2024-03-22T07:21:10.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.917+0000 7f2df6752700 1 -- start start 2024-03-22T07:21:10.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.917+0000 7f2df6752700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:10.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.917+0000 7f2df6752700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df010d5d0 con 0x7f2df00fca60 2024-03-22T07:21:10.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2deffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:10.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2deffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:58056/0 (socket says 172.21.15.195:58056) 2024-03-22T07:21:10.923 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2deffff700 1 -- 172.21.15.195:0/1951241564 learned_addr learned my addr 172.21.15.195:0/1951241564 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2deffff700 1 -- 172.21.15.195:0/1951241564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0005040 con 0x7f2df00fca60 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2deffff700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df010d090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009680 tx=0x7f2de0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2de000b5c0 con 0x7f2df00fca60 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2de000be70 con 0x7f2df00fca60 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df010d7d0 con 0x7f2df00fca60 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2de00135a0 con 0x7f2df00fca60 2024-03-22T07:21:10.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.918+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df010e340 con 0x7f2df00fca60 2024-03-22T07:21:10.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.919+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f2de0004d30 con 0x7f2df00fca60 2024-03-22T07:21:10.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.919+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df0102f70 con 0x7f2df00fca60 2024-03-22T07:21:10.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.919+0000 7f2decff9700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 0x7f2dd8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:10.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.919+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2de0049490 con 0x7f2df00fca60 2024-03-22T07:21:10.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.919+0000 7f2def7fe700 1 -- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 msgr2=0x7f2dd8038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3465812625 2024-03-22T07:21:10.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.919+0000 7f2def7fe700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 0x7f2dd8038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:21:10.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:10.924+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2de0011960 con 0x7f2df00fca60 2024-03-22T07:21:11.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.120+0000 7f2def7fe700 1 -- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 msgr2=0x7f2dd8038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3465812625 2024-03-22T07:21:11.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.120+0000 7f2def7fe700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 0x7f2dd8038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-22T07:21:11.186 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.187+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2df010ed50 con 0x7f2df00fca60 2024-03-22T07:21:11.187 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.187+0000 7f2decff9700 1 -- 172.21.15.195:0/1951241564 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2de0021070 con 0x7f2df00fca60 2024-03-22T07:21:11.187 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:11.187 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 msgr2=0x7f2dd8038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 0x7f2dd8038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 msgr2=0x7f2df010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:11.189 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df010d090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009680 tx=0x7f2de0009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:11.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 shutdown_connections 2024-03-22T07:21:11.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f2dd80368d0 0x7f2dd8038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:11.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 --2- 172.21.15.195:0/1951241564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df00fca60 0x7f2df010d090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:11.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.189+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 >> 172.21.15.195:0/1951241564 conn(0x7f2df00f81c0 msgr2=0x7f2df0103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:11.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.190+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 shutdown_connections 2024-03-22T07:21:11.190 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:11.190+0000 7f2df6752700 1 -- 172.21.15.195:0/1951241564 wait complete. 2024-03-22T07:21:11.191 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:11.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:11 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1951241564' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:12.706 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:12.707 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:12.951 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:12.998 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:14.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 -- 172.21.15.195:0/2308359713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 msgr2=0x7f08340fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:14.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 --2- 172.21.15.195:0/2308359713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f08340fce50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08240048c0 tx=0x7f0824009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:14.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 -- 172.21.15.195:0/2308359713 shutdown_connections 2024-03-22T07:21:14.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 --2- 172.21.15.195:0/2308359713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f08340fce50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:14.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 -- 172.21.15.195:0/2308359713 >> 172.21.15.195:0/2308359713 conn(0x7f08340f81c0 msgr2=0x7f08340fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 -- 172.21.15.195:0/2308359713 shutdown_connections 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.312+0000 7f083a6c0700 1 -- 172.21.15.195:0/2308359713 wait complete. 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f083a6c0700 1 Processor -- start 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f083a6c0700 1 -- start start 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f083a6c0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f083410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f083a6c0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083410d5d0 con 0x7f08340fca40 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f0833fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f083410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f0833fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f083410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:58074/0 (socket says 172.21.15.195:58074) 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.313+0000 7f0833fff700 1 -- 172.21.15.195:0/2540523257 learned_addr learned my addr 172.21.15.195:0/2540523257 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f0833fff700 1 -- 172.21.15.195:0/2540523257 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824005040 con 0x7f08340fca40 2024-03-22T07:21:14.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f0833fff700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f083410d090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0824009680 tx=0x7f0824009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:14.315 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f082400b5c0 con 0x7f08340fca40 2024-03-22T07:21:14.315 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f082400be70 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083410d7d0 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08240135a0 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.314+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083410e340 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.315+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f082401c430 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.315+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0834102f50 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.315+0000 7f0830ff9700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 0x7f0820038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.315+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0824049420 con 0x7f08340fca40 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.315+0000 7f08337fe700 1 -- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 msgr2=0x7f0820038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3465812625 2024-03-22T07:21:14.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.315+0000 7f08337fe700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 0x7f0820038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:21:14.319 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.320+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f08240117e0 con 0x7f08340fca40 2024-03-22T07:21:14.515 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.515+0000 7f08337fe700 1 -- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 msgr2=0x7f0820038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6800/3465812625 2024-03-22T07:21:14.515 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.515+0000 7f08337fe700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 0x7f0820038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-22T07:21:14.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.579+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f083410ed50 con 0x7f08340fca40 2024-03-22T07:21:14.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.580+0000 7f0830ff9700 1 -- 172.21.15.195:0/2540523257 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0824021070 con 0x7f08340fca40 2024-03-22T07:21:14.581 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 msgr2=0x7f0820038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 0x7f0820038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 msgr2=0x7f083410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f083410d090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0824009680 tx=0x7f0824009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 shutdown_connections 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:6800/3465812625,v1:172.21.15.134:6801/3465812625] conn(0x7f08200368d0 0x7f0820038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 --2- 172.21.15.195:0/2540523257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08340fca40 0x7f083410d090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 >> 172.21.15.195:0/2540523257 conn(0x7f08340f81c0 msgr2=0x7f0834103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 shutdown_connections 2024-03-22T07:21:14.583 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:14.582+0000 7f083a6c0700 1 -- 172.21.15.195:0/2540523257 wait complete. 2024-03-22T07:21:14.584 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:14 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/2540523257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: Active manager daemon smithi134.wtwqre restarted 2024-03-22T07:21:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:21:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: osdmap e5: 0 total, 0 up, 0 in 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: mgrmap e15: smithi134.wtwqre(active, starting, since 0.00284377s) 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:21:15.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:21:16.153 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:16.154 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:16.398 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:16.446 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: [22/Mar/2024:07:21:16] ENGINE Bus STARTING 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: [22/Mar/2024:07:21:16] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: [22/Mar/2024:07:21:16] ENGINE Bus STARTED 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:17.216 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:16 smithi134 ceph-mon[29057]: mgrmap e16: smithi134.wtwqre(active, since 1.00511s) 2024-03-22T07:21:17.924 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 -- 172.21.15.195:0/459360972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 msgr2=0x7fed740fbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 --2- 172.21.15.195:0/459360972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed740fbd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0048c0 tx=0x7fed6c009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 -- 172.21.15.195:0/459360972 shutdown_connections 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 --2- 172.21.15.195:0/459360972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed740fbd60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 -- 172.21.15.195:0/459360972 >> 172.21.15.195:0/459360972 conn(0x7fed740f7090 msgr2=0x7fed740f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 -- 172.21.15.195:0/459360972 shutdown_connections 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 -- 172.21.15.195:0/459360972 wait complete. 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 Processor -- start 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.922+0000 7fed78db0700 1 -- start start 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed78db0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed74113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed78db0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74113bb0 con 0x7fed740fb950 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed7259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed74113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:17.925 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed7259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed74113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:32848/0 (socket says 172.21.15.195:32848) 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed7259c700 1 -- 172.21.15.195:0/3213233219 learned_addr learned my addr 172.21.15.195:0/3213233219 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed7259c700 1 -- 172.21.15.195:0/3213233219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c005040 con 0x7fed740fb950 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed7259c700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed74113670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0096b0 tx=0x7fed6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.923+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed6c00bed0 con 0x7fed740fb950 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.924+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed6c00b5c0 con 0x7fed740fb950 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.924+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed74113db0 con 0x7fed740fb950 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.924+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed6c01c5b0 con 0x7fed740fb950 2024-03-22T07:21:17.926 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.924+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74114920 con 0x7fed740fb950 2024-03-22T07:21:17.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.924+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) v1 ==== 43289+0+0 (secure 0 0 0) 0x7fed6c01c820 con 0x7fed740fb950 2024-03-22T07:21:17.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.924+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74100d50 con 0x7fed740fb950 2024-03-22T07:21:17.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.925+0000 7fed62ffd700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed5c036710 0x7fed5c038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:17.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.925+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fed6c049c30 con 0x7fed740fb950 2024-03-22T07:21:17.927 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.925+0000 7fed71d9b700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed5c036710 0x7fed5c038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:17.928 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.925+0000 7fed71d9b700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed5c036710 0x7fed5c038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fed68009990 tx=0x7fed68006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:17.930 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:17.929+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fed6c011dd0 con 0x7fed740fb950 2024-03-22T07:21:18.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.121+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fed6c010d70 con 0x7fed740fb950 2024-03-22T07:21:18.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.195+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fed74115330 con 0x7fed740fb950 2024-03-22T07:21:18.197 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.196+0000 7fed62ffd700 1 -- 172.21.15.195:0/3213233219 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fed6c025400 con 0x7fed740fb950 2024-03-22T07:21:18.197 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:18.197 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed5c036710 msgr2=0x7fed5c038bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed5c036710 0x7fed5c038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fed68009990 tx=0x7fed68006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 msgr2=0x7fed74113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed74113670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0096b0 tx=0x7fed6c009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 shutdown_connections 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed5c036710 0x7fed5c038bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 --2- 172.21.15.195:0/3213233219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed740fb950 0x7fed74113670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 >> 172.21.15.195:0/3213233219 conn(0x7fed740f7090 msgr2=0x7fed74101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 shutdown_connections 2024-03-22T07:21:18.199 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:18.198+0000 7fed78db0700 1 -- 172.21.15.195:0/3213233219 wait complete. 2024-03-22T07:21:18.200 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:18.522 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:19 smithi134 ceph-mon[29057]: mgrmap e17: smithi134.wtwqre(active, since 2s) 2024-03-22T07:21:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:19 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3213233219' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:19.768 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:19.768 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:20.018 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:20.072 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-22T07:21:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:21:22.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 -- 172.21.15.195:0/3723056174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 msgr2=0x7facec0fbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:22.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 --2- 172.21.15.195:0/3723056174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec0fbd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facdc0048c0 tx=0x7facdc009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:22.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 -- 172.21.15.195:0/3723056174 shutdown_connections 2024-03-22T07:21:22.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 --2- 172.21.15.195:0/3723056174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec0fbd60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:22.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 -- 172.21.15.195:0/3723056174 >> 172.21.15.195:0/3723056174 conn(0x7facec0f7090 msgr2=0x7facec0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 -- 172.21.15.195:0/3723056174 shutdown_connections 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 -- 172.21.15.195:0/3723056174 wait complete. 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.026+0000 7facf29de700 1 Processor -- start 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facf29de700 1 -- start start 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facf29de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facf29de700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec10fd80 con 0x7facec0fb950 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facebfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facebfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec066860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:32864/0 (socket says 172.21.15.195:32864) 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facebfff700 1 -- 172.21.15.195:0/3995683477 learned_addr learned my addr 172.21.15.195:0/3995683477 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facebfff700 1 -- 172.21.15.195:0/3995683477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc005040 con 0x7facec0fb950 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.027+0000 7facebfff700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec066860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facdc0096b0 tx=0x7facdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.028+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facdc00bed0 con 0x7facec0fb950 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.028+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facdc00b5c0 con 0x7facec0fb950 2024-03-22T07:21:22.049 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.028+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec10fec0 con 0x7facec0fb950 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.028+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facdc01c5b0 con 0x7facec0fb950 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.028+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec1103b0 con 0x7facec0fb950 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.028+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7facdc01c820 con 0x7facec0fb950 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.029+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec105910 con 0x7facec0fb950 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.029+0000 7face8ff9700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facd4036970 0x7facd4038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.029+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7facdc049d00 con 0x7facec0fb950 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.029+0000 7faceb7fe700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facd4036970 0x7facd4038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.029+0000 7faceb7fe700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facd4036970 0x7facd4038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7face0009990 tx=0x7face0006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:22.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.034+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7facdc023300 con 0x7facec0fb950 2024-03-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.309+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7facec05f5f0 con 0x7facec0fb950 2024-03-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.309+0000 7face8ff9700 1 -- 172.21.15.195:0/3995683477 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7facdc011b60 con 0x7facec0fb950 2024-03-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facd4036970 msgr2=0x7facd4038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facd4036970 0x7facd4038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7face0009990 tx=0x7face0006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 msgr2=0x7facec066860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec066860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facdc0096b0 tx=0x7facdc009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 shutdown_connections 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facd4036970 0x7facd4038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 --2- 172.21.15.195:0/3995683477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facec0fb950 0x7facec066860 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.311+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 >> 172.21.15.195:0/3995683477 conn(0x7facec0f7090 msgr2=0x7facec102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.312+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 shutdown_connections 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:22.312+0000 7facf29de700 1 -- 172.21.15.195:0/3995683477 wait complete. 2024-03-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:23.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:21:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:23.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:23.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3995683477' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:23.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:23.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:23.921 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:23.922 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:21:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:21:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:21:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:21:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:21:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-22T07:21:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:23 smithi134 ceph-mon[29057]: Deploying daemon crash.smithi195 on smithi195 2024-03-22T07:21:24.175 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 -- 172.21.15.195:0/1205961322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 msgr2=0x7eff00102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 --2- 172.21.15.195:0/1205961322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff00102ec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efefc0048c0 tx=0x7efefc009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 -- 172.21.15.195:0/1205961322 shutdown_connections 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 --2- 172.21.15.195:0/1205961322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff00102ec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 -- 172.21.15.195:0/1205961322 >> 172.21.15.195:0/1205961322 conn(0x7eff000f6c30 msgr2=0x7eff000f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 -- 172.21.15.195:0/1205961322 shutdown_connections 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.061+0000 7eff081d3700 1 -- 172.21.15.195:0/1205961322 wait complete. 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff081d3700 1 Processor -- start 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff081d3700 1 -- start start 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff081d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff001130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff081d3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00113600 con 0x7eff00102af0 2024-03-22T07:21:26.065 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff05f6f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff001130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff05f6f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff001130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:32890/0 (socket says 172.21.15.195:32890) 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff05f6f700 1 -- 172.21.15.195:0/3717135887 learned_addr learned my addr 172.21.15.195:0/3717135887 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.062+0000 7eff05f6f700 1 -- 172.21.15.195:0/3717135887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc005040 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.063+0000 7eff05f6f700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff001130c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efefc00b7f0 tx=0x7efefc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.063+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efefc0093f0 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.063+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff00113860 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.063+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efefc013420 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.063+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff00113cd0 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.063+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efefc0265a0 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.064+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000fe1e0 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.064+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7efefc013a70 con 0x7eff00102af0 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.064+0000 7efef67fc700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efeec036920 0x7efeec038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:26.066 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.064+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efefc049430 con 0x7eff00102af0 2024-03-22T07:21:26.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.064+0000 7eff0576e700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efeec036920 0x7efeec038dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:26.067 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.065+0000 7eff0576e700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efeec036920 0x7efeec038dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efef0009990 tx=0x7efef0006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:26.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.069+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7efefc011780 con 0x7eff00102af0 2024-03-22T07:21:26.338 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.338+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7eff0005f5f0 con 0x7eff00102af0 2024-03-22T07:21:26.339 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.338+0000 7efef67fc700 1 -- 172.21.15.195:0/3717135887 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7efefc021020 con 0x7eff00102af0 2024-03-22T07:21:26.339 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:26.339 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:26.341 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efeec036920 msgr2=0x7efeec038dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:26.341 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efeec036920 0x7efeec038dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efef0009990 tx=0x7efef0006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:26.341 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 msgr2=0x7eff001130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:26.341 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff001130c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efefc00b7f0 tx=0x7efefc009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:26.341 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 shutdown_connections 2024-03-22T07:21:26.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efeec036920 0x7efeec038dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:26.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 --2- 172.21.15.195:0/3717135887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff00102af0 0x7eff001130c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:26.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.340+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 >> 172.21.15.195:0/3717135887 conn(0x7eff000f6c30 msgr2=0x7eff000f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:26.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.341+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 shutdown_connections 2024-03-22T07:21:26.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:26.341+0000 7eff081d3700 1 -- 172.21.15.195:0/3717135887 wait complete. 2024-03-22T07:21:26.342 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:26.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:26 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3717135887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:27 smithi134 ceph-mon[29057]: Deploying daemon node-exporter.smithi195 on smithi195 2024-03-22T07:21:28.059 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:28.060 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:28.314 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3979758762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 msgr2=0x7f3a30101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 --2- 172.21.15.195:0/3979758762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30101da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a240048c0 tx=0x7f3a24009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3979758762 shutdown_connections 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 --2- 172.21.15.195:0/3979758762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30101da0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3979758762 >> 172.21.15.195:0/3979758762 conn(0x7f3a300f6c30 msgr2=0x7f3a300f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3979758762 shutdown_connections 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.099+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3979758762 wait complete. 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a36b7f700 1 Processor -- start 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a36b7f700 1 -- start start 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a36b7f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30111f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:31.102 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a36b7f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a301124c0 con 0x7f3a301019d0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a3491b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30111f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a3491b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30111f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:46604/0 (socket says 172.21.15.195:46604) 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.100+0000 7f3a3491b700 1 -- 172.21.15.195:0/3381586636 learned_addr learned my addr 172.21.15.195:0/3381586636 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a3491b700 1 -- 172.21.15.195:0/3381586636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24005040 con 0x7f3a301019d0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a3491b700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30111f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400b820 tx=0x7f3a24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a240093f0 con 0x7f3a301019d0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a301126c0 con 0x7f3a301019d0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a24013420 con 0x7f3a301019d0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a2401c570 con 0x7f3a301019d0 2024-03-22T07:21:31.103 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.101+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a30112bb0 con 0x7f3a301019d0 2024-03-22T07:21:31.104 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.102+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a300fd1f0 con 0x7f3a301019d0 2024-03-22T07:21:31.104 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.102+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f3a2401c830 con 0x7f3a301019d0 2024-03-22T07:21:31.104 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.102+0000 7f3a2d7fa700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3a20036970 0x7f3a20038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:31.104 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.102+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3a24049b70 con 0x7f3a301019d0 2024-03-22T07:21:31.104 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.103+0000 7f3a2ffff700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3a20036970 0x7f3a20038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:31.105 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.103+0000 7f3a2ffff700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3a20036970 0x7f3a20038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009990 tx=0x7f3a1c006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:31.108 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.107+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3a24023300 con 0x7f3a301019d0 2024-03-22T07:21:31.385 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.384+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3a3005f5f0 con 0x7f3a301019d0 2024-03-22T07:21:31.387 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.386+0000 7f3a2d7fa700 1 -- 172.21.15.195:0/3381586636 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3a24011b10 con 0x7f3a301019d0 2024-03-22T07:21:31.387 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:31.387 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:31.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3a20036970 msgr2=0x7f3a20038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:31.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3a20036970 0x7f3a20038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009990 tx=0x7f3a1c006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:31.389 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 msgr2=0x7f3a30111f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30111f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400b820 tx=0x7f3a24009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 shutdown_connections 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3a20036970 0x7f3a20038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 --2- 172.21.15.195:0/3381586636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a301019d0 0x7f3a30111f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 >> 172.21.15.195:0/3381586636 conn(0x7f3a300f6c30 msgr2=0x7f3a300f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 shutdown_connections 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:31.389+0000 7f3a36b7f700 1 -- 172.21.15.195:0/3381586636 wait complete. 2024-03-22T07:21:31.390 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:31.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:31.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:31.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:31 smithi134 ceph-mon[29057]: Deploying daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:21:32.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:32 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3381586636' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:33.316 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:33.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:33.580 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:21:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:34 smithi134 ceph-mon[29057]: Deploying daemon mon.smithi195 on smithi195 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2983809458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 msgr2=0x7ff9d0101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 --2- 172.21.15.195:0/2983809458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0101da0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00048c0 tx=0x7ff9c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2983809458 shutdown_connections 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 --2- 172.21.15.195:0/2983809458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0101da0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2983809458 >> 172.21.15.195:0/2983809458 conn(0x7ff9d0071800 msgr2=0x7ff9d0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2983809458 shutdown_connections 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2983809458 wait complete. 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 Processor -- start 2024-03-22T07:21:35.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- start start 2024-03-22T07:21:35.811 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:35.811 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.809+0000 7ff9d4dc1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0112640 con 0x7ff9d01019d0 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.810+0000 7ff9ce59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.810+0000 7ff9ce59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0112100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.195:46634/0 (socket says 172.21.15.195:46634) 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.810+0000 7ff9ce59c700 1 -- 172.21.15.195:0/2940907615 learned_addr learned my addr 172.21.15.195:0/2940907615 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.810+0000 7ff9ce59c700 1 -- 172.21.15.195:0/2940907615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0005040 con 0x7ff9d01019d0 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.810+0000 7ff9ce59c700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0112100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b820 tx=0x7ff9c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.810+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9c00093c0 con 0x7ff9d01019d0 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.811+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0112840 con 0x7ff9d01019d0 2024-03-22T07:21:35.812 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.811+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9c0013420 con 0x7ff9d01019d0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.811+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9c001c5b0 con 0x7ff9d01019d0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.811+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0112cb0 con 0x7ff9d01019d0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.811+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7ff9c001c7f0 con 0x7ff9d01019d0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.811+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d00fd0d0 con 0x7ff9d01019d0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.812+0000 7ff9beffd700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff9b8036970 0x7ff9b8038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.812+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff9c0049ce0 con 0x7ff9d01019d0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.812+0000 7ff9cdd9b700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff9b8036970 0x7ff9b8038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:35.813 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.812+0000 7ff9cdd9b700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff9b8036970 0x7ff9b8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009990 tx=0x7ff9c4006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:35.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:35.817+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff9c0023300 con 0x7ff9d01019d0 2024-03-22T07:21:36.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.090+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9d005f5f0 con 0x7ff9d01019d0 2024-03-22T07:21:36.091 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.091+0000 7ff9beffd700 1 -- 172.21.15.195:0/2940907615 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff9c0011b60 con 0x7ff9d01019d0 2024-03-22T07:21:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:36.091 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:19:09.497844Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-22T07:21:36.093 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff9b8036970 msgr2=0x7ff9b8038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:36.093 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff9b8036970 0x7ff9b8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009990 tx=0x7ff9c4006e40 comp rx=0 tx=0).stop 2024-03-22T07:21:36.093 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 msgr2=0x7ff9d0112100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0112100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000b820 tx=0x7ff9c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 shutdown_connections 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff9b8036970 0x7ff9b8038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 --2- 172.21.15.195:0/2940907615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d01019d0 0x7ff9d0112100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 >> 172.21.15.195:0/2940907615 conn(0x7ff9d0071800 msgr2=0x7ff9d00650d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 shutdown_connections 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:36.093+0000 7ff9d4dc1700 1 -- 172.21.15.195:0/2940907615 wait complete. 2024-03-22T07:21:36.094 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2024-03-22T07:21:36.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:36 smithi134 ceph-mon[29057]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:36.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:36.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:36 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/2940907615' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:37.783 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-22T07:21:37.784 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-22T07:21:38.144 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:21:38.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:38 smithi134 ceph-mon[29057]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.531 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 podman[36095]: 2024-03-22 07:21:39.399243863 +0000 UTC m=+0.558128742 container create 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=quincy-9c4e0c3, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 podman[36095]: 2024-03-22 07:21:39.602051522 +0000 UTC m=+0.760936401 container init 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, RELEASE=quincy-9c4e0c3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 podman[36095]: 2024-03-22 07:21:39.605050755 +0000 UTC m=+0.763935634 container start 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-9c4e0c3, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: set uid:gid to 167:167 (ceph:ceph) 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable), process ceph-mon, pid 2 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pidfile_write: ignore empty --pid-file 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: load: jerasure load: lrc 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: RocksDB version: 6.15.5 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Compile date Mar 21 2024 2024-03-22T07:21:39.873 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: DB SUMMARY 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: DB Session ID: Y8FZLPWCULMWV6JPO3VX 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: CURRENT file: CURRENT 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: IDENTITY file: IDENTITY 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi195/store.db dir, Total Num: 0, files: 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi195/store.db: 000004.log size: 511 ; 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.error_if_exists: 0 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.create_if_missing: 0 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.paranoid_checks: 1 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.env: 0x55ee409c2a80 2024-03-22T07:21:39.874 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.fs: Posix File System 2024-03-22T07:21:39.875 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.info_log: 0x55ee42b0fc00 2024-03-22T07:21:39.875 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_file_opening_threads: 16 2024-03-22T07:21:39.875 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.statistics: (nil) 2024-03-22T07:21:39.875 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.use_fsync: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_log_file_size: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.keep_log_file_num: 1000 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.recycle_log_file_num: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.allow_fallocate: 1 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.allow_mmap_reads: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.allow_mmap_writes: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.use_direct_reads: 0 2024-03-22T07:21:39.876 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.create_missing_column_families: 0 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.db_log_dir: 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi195/store.db 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.advise_random_on_open: 1 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.db_write_buffer_size: 0 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.write_buffer_manager: 0x55ee43884a50 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-22T07:21:39.877 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.rate_limiter: (nil) 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.wal_recovery_mode: 2 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.enable_thread_tracking: 0 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.enable_pipelined_write: 0 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.unordered_write: 0 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-22T07:21:39.878 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.row_cache: None 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.wal_filter: None 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.allow_ingest_behind: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.preserve_deletes: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.two_write_queues: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.manual_wal_flush: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.atomic_flush: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.log_readahead_size: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.best_efforts_recovery: 0 2024-03-22T07:21:39.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.allow_data_in_errors: 0 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.db_host_id: __hostname__ 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_background_jobs: 2 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_background_compactions: -1 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_subcompactions: 1 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-22T07:21:39.880 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-22T07:21:39.881 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_total_wal_size: 0 2024-03-22T07:21:39.881 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-22T07:21:39.881 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-22T07:21:39.881 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-22T07:21:39.881 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-22T07:21:39.881 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_open_files: -1 2024-03-22T07:21:39.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bytes_per_sync: 0 2024-03-22T07:21:39.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-22T07:21:39.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-22T07:21:39.882 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_readahead_size: 0 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_background_flushes: -1 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Compression algorithms supported: 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kZSTD supported: 0 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kXpressCompression supported: 0 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kLZ4HCCompression supported: 1 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kZlibCompression supported: 1 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kSnappyCompression supported: 1 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kLZ4Compression supported: 1 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: kBZip2Compression supported: 0 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-22T07:21:39.883 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000003 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.merge_operator: 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_filter: None 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_filter_factory: None 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.sst_partitioner_factory: None 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ee42b64f58) 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks: 1 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_top_level_index_and_filter: 1 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_type: 0 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_index_type: 0 2024-03-22T07:21:39.884 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_shortening: 1 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: hash_index_allow_collision: 1 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: checksum: 1 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: no_block_cache: 0 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache: 0x55ee42b97090 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_name: BinnedLRUCache 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_options: 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: capacity : 536870912 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_shard_bits : 4 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: strict_capacity_limit : 0 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: high_pri_pool_ratio: 0.000 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_compressed: (nil) 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: persistent_cache: (nil) 2024-03-22T07:21:39.885 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size: 4096 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size_deviation: 10 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_restart_interval: 16 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_block_restart_interval: 1 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_block_size: 4096 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: partition_filters: 0 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: use_delta_encoding: 1 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: whole_key_filtering: 1 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: verify_compression: 0 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: read_amp_bytes_per_bit: 0 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: format_version: 4 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_index_compression: 1 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_align: 0 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.write_buffer_size: 33554432 2024-03-22T07:21:39.886 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_write_buffer_number: 2 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression: NoCompression 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression: Disabled 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.prefix_extractor: nullptr 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.num_levels: 7 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-22T07:21:39.887 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.level: 32767 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.strategy: 0 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compression_opts.enabled: false 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.target_file_size_base: 67108864 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-22T07:21:39.888 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.arena_block_size: 4194304 2024-03-22T07:21:39.889 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.disable_auto_compactions: 0 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-22T07:21:39.891 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.table_properties_collectors: 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.inplace_update_support: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.bloom_locality: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.max_successive_merges: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.paranoid_file_checks: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.force_consistency_checks: 1 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.report_bg_io_stats: 0 2024-03-22T07:21:39.892 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.ttl: 2592000 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.enable_blob_files: false 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.min_blob_size: 0 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.blob_file_size: 268435456 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092099630771, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092099631074, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1711092099, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "7fcb5c71-6c82-4c4b-9e02-cc547623cba6", "db_session_id": "Y8FZLPWCULMWV6JPO3VX"}} 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-03-22T07:21:39.893 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092099631400, "job": 1, "event": "recovery_finished"} 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi195/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55ee42b2b180 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: DB pointer 0x55ee42c00000 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** DB Stats ** 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:21:39.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-22T07:21:39.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.896 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.1 0.00 0.00 1 0.000 0 0 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-22T07:21:39.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195 does not exist in monmap, will attempt to join an existing cluster 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: using public_addr v2:172.21.15.195:0/0 -> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: starting mon.smithi195 rank -1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi195 fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(???) e0 preinit fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).mds e1 new map 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).mds e1 print_map 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: e1 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: legacy client fscid: -1 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: No filesystems configured 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-22T07:21:39.898 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon node-exporter.smithi134 on smithi134 2024-03-22T07:21:39.899 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying cephadm binary to smithi195 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Added host smithi195 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon alertmanager.smithi134 on smithi134 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.900 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/476535005' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/476535005' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: osdmap e4: 0 total, 0 up, 0 in 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Saving service mon spec with placement smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195;count:2 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon grafana.smithi134 on smithi134 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/928980232' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1510806660' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.902 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1673625908' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1695861634' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon prometheus.smithi134 on smithi134 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.903 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/2302781813' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3182769025' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/207382456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14162 172.21.15.134:0/3053445682' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-22T07:21:39.904 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mgrmap e14: smithi134.wtwqre(active, since 56s) 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1951241564' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/2540523257' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Active manager daemon smithi134.wtwqre restarted 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: osdmap e5: 0 total, 0 up, 0 in 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mgrmap e15: smithi134.wtwqre(active, starting, since 0.00284377s) 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:21:39.905 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: [22/Mar/2024:07:21:16] ENGINE Bus STARTING 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: [22/Mar/2024:07:21:16] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: [22/Mar/2024:07:21:16] ENGINE Bus STARTED 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mgrmap e16: smithi134.wtwqre(active, since 1.00511s) 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mgrmap e17: smithi134.wtwqre(active, since 2s) 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3213233219' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3995683477' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.907 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon crash.smithi195 on smithi195 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3717135887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.908 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon node-exporter.smithi195 on smithi195 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:21:39.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3381586636' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: Deploying daemon mon.smithi195 on smithi195 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/2940907615' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 ceph-mon[36144]: mon.smithi195@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 bash[36095]: 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 2024-03-22T07:21:39.910 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:39 smithi195 systemd[1]: Started Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:21:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: mon.smithi134 calling monitor election 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: mon.smithi195 calling monitor election 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: mon.smithi134 is new leader, mons smithi134,smithi195 in quorum (ranks 0,1) 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: fsmap 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: osdmap e5: 0 total, 0 up, 0 in 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: mgrmap e17: smithi134.wtwqre(active, since 29s) 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: overall HEALTH_OK 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:44 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:21:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: mon.smithi134 calling monitor election 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: mon.smithi195 calling monitor election 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: mon.smithi134 is new leader, mons smithi134,smithi195 in quorum (ranks 0,1) 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: fsmap 2024-03-22T07:21:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: osdmap e5: 0 total, 0 up, 0 in 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: mgrmap e17: smithi134.wtwqre(active, since 29s) 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: overall HEALTH_OK 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2222996599' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:45.207 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:44 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:45 smithi134 ceph-mon[29057]: mgrmap e18: smithi134.wtwqre(active, since 29s), standbys: smithi195.jxfsnc 2024-03-22T07:21:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:21:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:21:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:21:46.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:46.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:46.067 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:45 smithi195 ceph-mon[36144]: mgrmap e18: smithi134.wtwqre(active, since 29s), standbys: smithi195.jxfsnc 2024-03-22T07:21:46.067 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:21:46.067 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:21:46.067 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:21:46.068 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:46.068 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 -- 172.21.15.195:0/4090363064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 msgr2=0x7f85000087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 --2- 172.21.15.195:0/4090363064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f85000087f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8514064eb0 tx=0x7f8510002040 comp rx=0 tx=0).stop 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 -- 172.21.15.195:0/4090363064 shutdown_connections 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 --2- 172.21.15.195:0/4090363064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f85000087f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 -- 172.21.15.195:0/4090363064 >> 172.21.15.195:0/4090363064 conn(0x7f8514072070 msgr2=0x7f8514072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 -- 172.21.15.195:0/4090363064 shutdown_connections 2024-03-22T07:21:46.082 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.081+0000 7f851c3e7700 1 -- 172.21.15.195:0/4090363064 wait complete. 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851c3e7700 1 Processor -- start 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851c3e7700 1 -- start start 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851c3e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f8514111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851c3e7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851c3e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514111cd0 con 0x7f8500008400 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851c3e7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851410b620 con 0x7f85141116c0 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f8519982700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f851a183700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f8514111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f8519982700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:36952/0 (socket says 172.21.15.195:36952) 2024-03-22T07:21:46.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f8519982700 1 -- 172.21.15.195:0/3439339708 learned_addr learned my addr 172.21.15.195:0/3439339708 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f8519982700 1 -- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 msgr2=0x7f851410b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f8519982700 1 -- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 msgr2=0x7f851410b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.082+0000 7f8519982700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f8519982700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f851a183700 1 -- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 msgr2=0x7f851410b0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f851a183700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f851a183700 1 -- 172.21.15.195:0/3439339708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510005040 con 0x7f8500008400 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f851a183700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f8514111180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8514064eb0 tx=0x7f8510002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8510018e70 con 0x7f8500008400 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8510004db0 con 0x7f8500008400 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851410b8a0 con 0x7f8500008400 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8510022c50 con 0x7f8500008400 2024-03-22T07:21:46.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.083+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851410bd80 con 0x7f8500008400 2024-03-22T07:21:46.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.084+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8514105100 con 0x7f8500008400 2024-03-22T07:21:46.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.084+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f8510022440 con 0x7f8500008400 2024-03-22T07:21:46.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.085+0000 7f850affd700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f84f8069320 0x7f84f806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:46.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.085+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8510088000 con 0x7f8500008400 2024-03-22T07:21:46.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.085+0000 7f8519982700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f84f8069320 0x7f84f806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:46.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.086+0000 7f8519982700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f84f8069320 0x7f84f806b7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8504006fd0 tx=0x7f8504008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:46.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.090+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8510058e20 con 0x7f8500008400 2024-03-22T07:21:46.355 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.354+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f85140fd290 con 0x7f8500008400 2024-03-22T07:21:46.355 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.355+0000 7f850affd700 1 -- 172.21.15.195:0/3439339708 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f85100877b0 con 0x7f8500008400 2024-03-22T07:21:46.355 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-22T07:21:46.355 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","modified":"2024-03-22T07:21:39.657957Z","created":"2024-03-22T07:19:09.497844Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi195","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f84f8069320 msgr2=0x7f84f806b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f84f8069320 0x7f84f806b7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8504006fd0 tx=0x7f8504008040 comp rx=0 tx=0).stop 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 msgr2=0x7f8514111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f8514111180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8514064eb0 tx=0x7f8510002040 comp rx=0 tx=0).stop 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 shutdown_connections 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8500008400 0x7f8514111180 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f84f8069320 0x7f84f806b7d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 --2- 172.21.15.195:0/3439339708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85141116c0 0x7f851410b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 >> 172.21.15.195:0/3439339708 conn(0x7f8514072070 msgr2=0x7f8514100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 shutdown_connections 2024-03-22T07:21:46.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:21:46.357+0000 7f851c3e7700 1 -- 172.21.15.195:0/3439339708 wait complete. 2024-03-22T07:21:46.359 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2024-03-22T07:21:46.963 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-22T07:21:46.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph config generate-minimal-conf 2024-03-22T07:21:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:46 smithi134 ceph-mon[29057]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:46 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3439339708' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:46 smithi195 ceph-mon[36144]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:46 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3439339708' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-22T07:21:47.237 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: Reconfiguring mon.smithi134 (unknown last config time)... 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:48 smithi134 ceph-mon[29057]: Reconfiguring daemon mon.smithi134 on smithi134 2024-03-22T07:21:48.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: Reconfiguring mon.smithi134 (unknown last config time)... 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:48.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:48 smithi195 ceph-mon[36144]: Reconfiguring daemon mon.smithi134 on smithi134 2024-03-22T07:21:49.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 -- 172.21.15.134:0/1262075156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc070cc0 msgr2=0x7f33dc109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:49.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 --2- 172.21.15.134:0/1262075156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc070cc0 0x7f33dc109190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f33c8004970 tx=0x7f33c8009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:49.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 -- 172.21.15.134:0/1262075156 shutdown_connections 2024-03-22T07:21:49.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 --2- 172.21.15.134:0/1262075156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc070cc0 0x7f33dc109190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:49.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 --2- 172.21.15.134:0/1262075156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33dc0703b0 0x7f33dc070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:49.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 -- 172.21.15.134:0/1262075156 >> 172.21.15.134:0/1262075156 conn(0x7f33dc0f89b0 msgr2=0x7f33dc0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 -- 172.21.15.134:0/1262075156 shutdown_connections 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 -- 172.21.15.134:0/1262075156 wait complete. 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 Processor -- start 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.976+0000 7f33e2b16700 1 -- start start 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e2b16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 0x7f33dc115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e2b16700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33dc070cc0 0x7f33dc1160b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e2b16700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc116700 con 0x7f33dc0703b0 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e2b16700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc10fce0 con 0x7f33dc070cc0 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 0x7f33dc115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 0x7f33dc115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:41914/0 (socket says 172.21.15.134:41914) 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 -- 172.21.15.134:0/2803008006 learned_addr learned my addr 172.21.15.134:0/2803008006 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:21:49.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33dbfff700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33dc070cc0 0x7f33dc1160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 -- 172.21.15.134:0/2803008006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33dc070cc0 msgr2=0x7f33dc1160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33dc070cc0 0x7f33dc1160b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 -- 172.21.15.134:0/2803008006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8005040 con 0x7f33dc0703b0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.977+0000 7f33e08b2700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 0x7f33dc115b70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f33d0002a50 tx=0x7f33d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.978+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d0007cc0 con 0x7f33dc0703b0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.978+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33d000f040 con 0x7f33dc0703b0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.978+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc10ffc0 con 0x7f33dc0703b0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.978+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d000da30 con 0x7f33dc0703b0 2024-03-22T07:21:49.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.978+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc1104d0 con 0x7f33dc0703b0 2024-03-22T07:21:49.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.979+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc071a40 con 0x7f33dc0703b0 2024-03-22T07:21:49.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.979+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f33d000db90 con 0x7f33dc0703b0 2024-03-22T07:21:49.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.979+0000 7f33d97fa700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33cc069210 0x7f33cc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:21:49.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.980+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f33d0085d50 con 0x7f33dc0703b0 2024-03-22T07:21:49.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.980+0000 7f33dbfff700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33cc069210 0x7f33cc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:21:49.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.980+0000 7f33dbfff700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33cc069210 0x7f33cc06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000c00 tx=0x7f33c8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:21:49.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:49.984+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f33d0089030 con 0x7f33dc0703b0 2024-03-22T07:21:50.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.177+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f33dc04c710 con 0x7f33dc0703b0 2024-03-22T07:21:50.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.178+0000 7f33d97fa700 1 -- 172.21.15.134:0/2803008006 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f33d0056bf0 con 0x7f33dc0703b0 2024-03-22T07:21:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:# minimal ceph.conf for 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:21:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-03-22T07:21:50.178 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:21:50.179 INFO:teuthology.orchestra.run.smithi134.stdout: mon_host = [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2024-03-22T07:21:50.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33cc069210 msgr2=0x7f33cc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:50.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33cc069210 0x7f33cc06b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000c00 tx=0x7f33c8009e30 comp rx=0 tx=0).stop 2024-03-22T07:21:50.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 msgr2=0x7f33dc115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 0x7f33dc115b70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f33d0002a50 tx=0x7f33d00046b0 comp rx=0 tx=0).stop 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 shutdown_connections 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33dc0703b0 0x7f33dc115b70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33cc069210 0x7f33cc06b6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 --2- 172.21.15.134:0/2803008006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33dc070cc0 0x7f33dc1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 >> 172.21.15.134:0/2803008006 conn(0x7f33dc0f89b0 msgr2=0x7f33dc0f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 shutdown_connections 2024-03-22T07:21:50.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:21:50.180+0000 7f33e2b16700 1 -- 172.21.15.134:0/2803008006 wait complete. 2024-03-22T07:21:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: Reconfiguring mgr.smithi134.wtwqre (unknown last config time)... 2024-03-22T07:21:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:21:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:21:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: Reconfiguring daemon mgr.smithi134.wtwqre on smithi134 2024-03-22T07:21:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:50 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2803008006' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: Reconfiguring mgr.smithi134.wtwqre (unknown last config time)... 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: Reconfiguring daemon mgr.smithi134.wtwqre on smithi134 2024-03-22T07:21:50.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:50 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2803008006' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:51.219 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-22T07:21:51.219 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:21:51.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-03-22T07:21:51.250 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:21:51.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:21:51.319 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:21:51.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2024-03-22T07:21:51.350 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:21:51.350 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:21:51.419 INFO:tasks.cephadm:Deploying OSDs... 2024-03-22T07:21:51.419 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:21:51.419 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-03-22T07:21:51.435 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-22T07:21:51.435 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-03-22T07:21:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-22 07:21:07.077406650 +0000 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-22 07:14:37.779995538 +0000 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-22 07:14:37.779995538 +0000 2024-03-22T07:21:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-03-22 07:14:37.779995538 +0000 2024-03-22T07:21:51.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-22T07:21:51.555 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-22T07:21:51.555 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-22T07:21:51.555 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000209314 s, 2.4 MB/s 2024-03-22T07:21:51.557 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-22T07:21:51.612 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-03-22T07:21:51.667 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-22T07:21:51.667 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:51.667 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-22T07:21:51.667 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:51.668 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:51.668 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-22 07:21:07.077406650 +0000 2024-03-22T07:21:51.668 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-22 07:14:38.115987604 +0000 2024-03-22T07:21:51.668 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-22 07:14:38.115987604 +0000 2024-03-22T07:21:51.668 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-03-22 07:14:38.115987604 +0000 2024-03-22T07:21:51.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-22T07:21:51.733 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-22T07:21:51.734 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-22T07:21:51.734 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000224466 s, 2.3 MB/s 2024-03-22T07:21:51.735 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-22T07:21:51.790 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-22 07:21:07.077406650 +0000 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-22 07:14:38.447979765 +0000 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-22 07:14:38.447979765 +0000 2024-03-22T07:21:51.845 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-03-22 07:14:38.447979765 +0000 2024-03-22T07:21:51.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-22T07:21:51.910 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-22T07:21:51.910 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-22T07:21:51.911 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000196452 s, 2.6 MB/s 2024-03-22T07:21:51.912 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-22T07:21:51.970 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-03-22T07:21:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-22T07:21:52.025 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:52.025 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-22T07:21:52.025 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:52.025 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:52.025 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-22 07:21:07.078406626 +0000 2024-03-22T07:21:52.026 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-22 07:14:38.783971831 +0000 2024-03-22T07:21:52.026 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-22 07:14:38.783971831 +0000 2024-03-22T07:21:52.026 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-03-22 07:14:38.783971831 +0000 2024-03-22T07:21:52.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-22T07:21:52.091 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-22T07:21:52.091 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-22T07:21:52.091 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000186219 s, 2.7 MB/s 2024-03-22T07:21:52.092 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-22T07:21:52.147 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:21:52.147 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-03-22T07:21:52.162 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-22T07:21:52.162 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-03-22T07:21:52.217 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-22 07:21:38.022539219 +0000 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-22 07:14:37.746998038 +0000 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-22 07:14:37.746998038 +0000 2024-03-22T07:21:52.218 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-22 07:14:37.746998038 +0000 2024-03-22T07:21:52.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-22T07:21:52.283 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-22T07:21:52.283 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-22T07:21:52.283 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.3285e-05 s, 5.5 MB/s 2024-03-22T07:21:52.284 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-22T07:21:52.339 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-22 07:21:38.022539219 +0000 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-22 07:14:38.094991113 +0000 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-22 07:14:38.094991113 +0000 2024-03-22T07:21:52.395 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-22 07:14:38.094991113 +0000 2024-03-22T07:21:52.395 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-22T07:21:52.460 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-22T07:21:52.461 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-22T07:21:52.461 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000104722 s, 4.9 MB/s 2024-03-22T07:21:52.462 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-22T07:21:52.518 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-03-22T07:21:52.572 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-22 07:21:38.023539199 +0000 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-22 07:14:38.420984626 +0000 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-22 07:14:38.420984626 +0000 2024-03-22T07:21:52.573 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-22 07:14:38.420984626 +0000 2024-03-22T07:21:52.573 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-22T07:21:52.637 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-22T07:21:52.637 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-22T07:21:52.637 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.892e-05 s, 5.8 MB/s 2024-03-22T07:21:52.639 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-22T07:21:52.695 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-03-22T07:21:52.750 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-22T07:21:52.750 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-22T07:21:52.750 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-22T07:21:52.750 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:21:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-22T07:21:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-22 07:21:38.023539199 +0000 2024-03-22T07:21:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-22 07:14:38.776977541 +0000 2024-03-22T07:21:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-22 07:14:38.776977541 +0000 2024-03-22T07:21:52.751 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-22 07:14:38.776977541 +0000 2024-03-22T07:21:52.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-22T07:21:52.813 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:52.813 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:52.814 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:52.814 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: Reconfiguring crash.smithi134 (monmap changed)... 2024-03-22T07:21:52.814 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:21:52.814 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:52.814 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:52 smithi195 ceph-mon[36144]: Reconfiguring daemon crash.smithi134 on smithi134 2024-03-22T07:21:52.815 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-22T07:21:52.816 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-22T07:21:52.816 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000104196 s, 4.9 MB/s 2024-03-22T07:21:52.817 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-22T07:21:52.873 INFO:tasks.cephadm:Deploying osd.0 on smithi134 with /dev/vg_nvme/lv_4... 2024-03-22T07:21:52.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: Reconfiguring crash.smithi134 (monmap changed)... 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:21:52.978 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:52 smithi134 ceph-mon[29057]: Reconfiguring daemon crash.smithi134 on smithi134 2024-03-22T07:21:53.138 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:21:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:54 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:54 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:54 smithi134 ceph-mon[29057]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-03-22T07:21:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:54 smithi134 ceph-mon[29057]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-03-22T07:21:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:54 smithi134 ceph-mon[29057]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:54.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:54 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:54.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:54 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:21:54.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:54 smithi195 ceph-mon[36144]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-03-22T07:21:54.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:54 smithi195 ceph-mon[36144]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-03-22T07:21:54.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:54 smithi195 ceph-mon[36144]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:56.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:56 smithi134 ceph-mon[29057]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:56.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:56 smithi195 ceph-mon[36144]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:57.487 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-22T07:21:57.487 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-22T07:21:57.487 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-03-22T07:21:57.488 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-03-22T07:21:57.488 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011551 s, 908 MB/s 2024-03-22T07:21:57.488 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-03-22T07:21:58.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-03-22T07:21:58.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:21:58 smithi134 ceph-mon[29057]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:21:58.551 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:21:58.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:21:58 smithi195 ceph-mon[36144]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:00.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:00 smithi134 ceph-mon[29057]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:00.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:00.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:00.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:00.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:00 smithi195 ceph-mon[36144]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:00.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:00.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:00.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:00.760 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/2919394231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 msgr2=0x7fb1dc0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/2919394231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc0fd3e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc004940 tx=0x7fb1cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/2919394231 shutdown_connections 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/2919394231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc0fd3e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/2919394231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc0fbe00 0x7fb1dc0fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/2919394231 >> 172.21.15.134:0/2919394231 conn(0x7fb1dc0f74e0 msgr2=0x7fb1dc0f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/2919394231 shutdown_connections 2024-03-22T07:22:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.760+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/2919394231 wait complete. 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e3c4b700 1 Processor -- start 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e3c4b700 1 -- start start 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e3c4b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc0fbe00 0x7fb1dc110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e3c4b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e3c4b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc066cd0 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e3c4b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc066e10 con 0x7fb1dc0fbe00 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40138/0 (socket says 172.21.15.134:40138) 2024-03-22T07:22:00.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 -- 172.21.15.134:0/418751642 learned_addr learned my addr 172.21.15.134:0/418751642 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e19e7700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc0fbe00 0x7fb1dc110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 -- 172.21.15.134:0/418751642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc0fbe00 msgr2=0x7fb1dc110730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc0fbe00 0x7fb1dc110730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 -- 172.21.15.134:0/418751642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc005040 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.761+0000 7fb1e11e6700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc112c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00b3b0 tx=0x7fb1cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.762+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc00e040 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.762+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1cc00bbf0 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.762+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc1132b0 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.762+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc01c630 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.762+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc113870 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.763+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc05f5f0 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.763+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fb1cc00bd60 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.763+0000 7fb1d27fc700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb1c8069210 0x7fb1c806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:22:00.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.763+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb1cc086d30 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.763+0000 7fb1e19e7700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb1c8069210 0x7fb1c806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:22:00.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.764+0000 7fb1e19e7700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb1c8069210 0x7fb1c806b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0668c0 tx=0x7fb1d8009780 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:22:00.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.770+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb1cc054140 con 0x7fb1dc0fcf70 2024-03-22T07:22:00.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:00.975+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1dc101210 con 0x7fb1c8069210 2024-03-22T07:22:01.542 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:01 smithi134 ceph-mon[29057]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-03-22T07:22:01.542 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:01 smithi134 ceph-mon[29057]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-03-22T07:22:01.542 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:01 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:22:01.542 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:01 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:22:01.542 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:01 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:01.667 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:01 smithi195 ceph-mon[36144]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-03-22T07:22:01.668 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:01 smithi195 ceph-mon[36144]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-03-22T07:22:01.668 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:01 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:22:01.668 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:01 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:22:01.668 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:01 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:02 smithi195 ceph-mon[36144]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:22:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:02 smithi195 ceph-mon[36144]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:02.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:02 smithi134 ceph-mon[29057]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:22:02.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:02 smithi134 ceph-mon[29057]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:04.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:04 smithi195 ceph-mon[36144]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:04.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:04 smithi134 ceph-mon[29057]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:06.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:06 smithi134 ceph-mon[29057]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:06.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:06.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:06.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:06 smithi134 ceph-mon[29057]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-22T07:22:06.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:06 smithi134 ceph-mon[29057]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-22T07:22:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:06 smithi195 ceph-mon[36144]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:06 smithi195 ceph-mon[36144]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-22T07:22:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:06 smithi195 ceph-mon[36144]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-22T07:22:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:07 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1953747787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94cb408-7d62-4f5e-bdff-6f6ae36ddeae"}]: dispatch 2024-03-22T07:22:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:07 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1953747787' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d94cb408-7d62-4f5e-bdff-6f6ae36ddeae"}]': finished 2024-03-22T07:22:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:07 smithi195 ceph-mon[36144]: osdmap e6: 1 total, 0 up, 1 in 2024-03-22T07:22:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:07 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:07 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/4292288187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:22:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:07 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1953747787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94cb408-7d62-4f5e-bdff-6f6ae36ddeae"}]: dispatch 2024-03-22T07:22:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:07 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1953747787' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d94cb408-7d62-4f5e-bdff-6f6ae36ddeae"}]': finished 2024-03-22T07:22:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:07 smithi134 ceph-mon[29057]: osdmap e6: 1 total, 0 up, 1 in 2024-03-22T07:22:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:07 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:08.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:07 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/4292288187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:22:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:08 smithi134 ceph-mon[29057]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:08 smithi195 ceph-mon[36144]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:10 smithi134 ceph-mon[29057]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:10 smithi195 ceph-mon[36144]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:13.013 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:12 smithi134 ceph-mon[29057]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:13.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:12 smithi195 ceph-mon[36144]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:14 smithi134 ceph-mon[29057]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:15.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:14 smithi195 ceph-mon[36144]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:16.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:16.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:16.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:16 smithi134 ceph-mon[29057]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:16.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:16.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:16.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:22:16.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:17.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:16 smithi195 ceph-mon[36144]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:17.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:17.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:17.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:22:17.015 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:17 smithi134 ceph-mon[29057]: Reconfiguring crash.smithi195 (monmap changed)... 2024-03-22T07:22:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:17 smithi134 ceph-mon[29057]: Reconfiguring daemon crash.smithi195 on smithi195 2024-03-22T07:22:18.152 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:17 smithi195 ceph-mon[36144]: Reconfiguring crash.smithi195 (monmap changed)... 2024-03-22T07:22:18.153 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:17 smithi195 ceph-mon[36144]: Reconfiguring daemon crash.smithi195 on smithi195 2024-03-22T07:22:19.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:19.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:19.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:19.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: Reconfiguring mgr.smithi195.jxfsnc (monmap changed)... 2024-03-22T07:22:19.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:22:19.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:22:19.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:19.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: Reconfiguring daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:22:19.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-22T07:22:19.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:19.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:18 smithi134 ceph-mon[29057]: Deploying daemon osd.0 on smithi134 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: Reconfiguring mgr.smithi195.jxfsnc (monmap changed)... 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: Reconfiguring daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:22:19.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-22T07:22:19.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:19.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:18 smithi195 ceph-mon[36144]: Deploying daemon osd.0 on smithi134 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: Reconfiguring mon.smithi195 (monmap changed)... 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: Reconfiguring daemon mon.smithi195 on smithi195 2024-03-22T07:22:20.283 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:20 smithi195 ceph-mon[36144]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:20.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:20.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:20.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: Reconfiguring mon.smithi195 (monmap changed)... 2024-03-22T07:22:20.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:22:20.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:22:20.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:20.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: Reconfiguring daemon mon.smithi195 on smithi195 2024-03-22T07:22:20.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:20 smithi134 ceph-mon[29057]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:21.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-22T07:22:21.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.547 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi134.front.sepia.ceph.com:9093"}]: dispatch 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:22:21.646 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134.front.sepia.ceph.com:3000"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:21.647 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:22.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:22 smithi134 ceph-mon[29057]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:22.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:22.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:22.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:22 smithi195 ceph-mon[36144]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:22.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:22 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:22.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:22 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:24 smithi134 ceph-mon[29057]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:24.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:24 smithi195 ceph-mon[36144]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:25.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:25 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:25.520 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:25 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:25.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:25 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:25.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:25 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:26 smithi195 ceph-mon[36144]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:26.727 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:26 smithi134 ceph-mon[29057]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:28.178 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:28.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:28.217 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.217+0000 7fb1d27fc700 1 -- 172.21.15.134:0/418751642 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb1dc101210 con 0x7fb1c8069210 2024-03-22T07:22:28.218 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 0 on host 'smithi134' 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb1c8069210 msgr2=0x7fb1c806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb1c8069210 0x7fb1c806b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0668c0 tx=0x7fb1d8009780 comp rx=0 tx=0).stop 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 msgr2=0x7fb1dc112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc112c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00b3b0 tx=0x7fb1cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 shutdown_connections 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb1c8069210 0x7fb1c806b6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:28.220 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc0fbe00 0x7fb1dc110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:28.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 --2- 172.21.15.134:0/418751642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc0fcf70 0x7fb1dc112c80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:28.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 >> 172.21.15.134:0/418751642 conn(0x7fb1dc0f74e0 msgr2=0x7fb1dc0f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:22:28.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 shutdown_connections 2024-03-22T07:22:28.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:28.220+0000 7fb1e3c4b700 1 -- 172.21.15.134:0/418751642 wait complete. 2024-03-22T07:22:28.839 DEBUG:teuthology.orchestra.run.smithi134:osd.0> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.0.service 2024-03-22T07:22:28.841 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_3... 2024-03-22T07:22:28.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-22T07:22:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:29 smithi134 ceph-mon[29057]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-22T07:22:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.613 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:22:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:29 smithi195 ceph-mon[36144]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-22T07:22:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:30.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-mon[29057]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-22T07:22:30.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-mon[29057]: osdmap e7: 1 total, 0 up, 1 in 2024-03-22T07:22:30.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:30.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-mon[29057]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:22:30.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-mon[29057]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:30.393 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[47476]: 2024-03-22T07:22:30.218+0000 7febb26e5700 -1 osd.0 0 waiting for initial osdmap 2024-03-22T07:22:30.394 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:22:30 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[47476]: 2024-03-22T07:22:30.221+0000 7febaf4e4700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:22:30.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:30 smithi195 ceph-mon[36144]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-22T07:22:30.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:30 smithi195 ceph-mon[36144]: osdmap e7: 1 total, 0 up, 1 in 2024-03-22T07:22:30.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:30.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:30 smithi195 ceph-mon[36144]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:22:30.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:30 smithi195 ceph-mon[36144]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:31.349 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:31 smithi134 ceph-mon[29057]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-22T07:22:31.349 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:31 smithi134 ceph-mon[29057]: osdmap e8: 1 total, 0 up, 1 in 2024-03-22T07:22:31.349 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:31.350 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:31.350 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-22T07:22:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-22T07:22:31.457 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-03-22T07:22:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-03-22T07:22:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123527 s, 849 MB/s 2024-03-22T07:22:31.457 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-03-22T07:22:31.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:31 smithi195 ceph-mon[36144]: from='osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-22T07:22:31.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:31 smithi195 ceph-mon[36144]: osdmap e8: 1 total, 0 up, 1 in 2024-03-22T07:22:31.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:31 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:31.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:31 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:31.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:31 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:32.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-03-22T07:22:32.505 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:22:32.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:32 smithi134 ceph-mon[29057]: purged_snaps scrub starts 2024-03-22T07:22:32.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:32 smithi134 ceph-mon[29057]: purged_snaps scrub ok 2024-03-22T07:22:32.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:32 smithi134 ceph-mon[29057]: osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] boot 2024-03-22T07:22:32.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:32 smithi134 ceph-mon[29057]: osdmap e9: 1 total, 1 up, 1 in 2024-03-22T07:22:32.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:32.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:32 smithi134 ceph-mon[29057]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:32 smithi195 ceph-mon[36144]: purged_snaps scrub starts 2024-03-22T07:22:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:32 smithi195 ceph-mon[36144]: purged_snaps scrub ok 2024-03-22T07:22:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:32 smithi195 ceph-mon[36144]: osd.0 [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] boot 2024-03-22T07:22:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:32 smithi195 ceph-mon[36144]: osdmap e9: 1 total, 1 up, 1 in 2024-03-22T07:22:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:22:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:32 smithi195 ceph-mon[36144]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-22T07:22:33.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:33 smithi134 ceph-mon[29057]: osdmap e10: 1 total, 1 up, 1 in 2024-03-22T07:22:33.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:33 smithi195 ceph-mon[36144]: osdmap e10: 1 total, 1 up, 1 in 2024-03-22T07:22:34.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:34 smithi134 ceph-mon[29057]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:34.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:34 smithi195 ceph-mon[36144]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:35.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 -- 172.21.15.134:0/2795828572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe450 msgr2=0x7fd4340fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 --2- 172.21.15.134:0/2795828572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe450 0x7fd4340fe860 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009ce0 tx=0x7fd42c004d10 comp rx=0 tx=0).stop 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 -- 172.21.15.134:0/2795828572 shutdown_connections 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 --2- 172.21.15.134:0/2795828572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4340feda0 0x7fd4340faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 --2- 172.21.15.134:0/2795828572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe450 0x7fd4340fe860 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 -- 172.21.15.134:0/2795828572 >> 172.21.15.134:0/2795828572 conn(0x7fd4340f6c10 msgr2=0x7fd4340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 -- 172.21.15.134:0/2795828572 shutdown_connections 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.899+0000 7fd438fa1700 1 -- 172.21.15.134:0/2795828572 wait complete. 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd438fa1700 1 Processor -- start 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd438fa1700 1 -- start start 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd438fa1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4340fe450 0x7fd4340fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:22:35.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd438fa1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 0x7fd4340fc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd438fa1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340fe060 con 0x7fd4340feda0 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd438fa1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340fc650 con 0x7fd4340fe450 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd431d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 0x7fd4340fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd431d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 0x7fd4340fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53502/0 (socket says 172.21.15.134:53502) 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd431d9b700 1 -- 172.21.15.134:0/1414982126 learned_addr learned my addr 172.21.15.134:0/1414982126 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd43259c700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4340fe450 0x7fd4340fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd431d9b700 1 -- 172.21.15.134:0/1414982126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4340fe450 msgr2=0x7fd4340fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd431d9b700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4340fe450 0x7fd4340fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.900+0000 7fd431d9b700 1 -- 172.21.15.134:0/1414982126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009940 con 0x7fd4340feda0 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.901+0000 7fd431d9b700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 0x7fd4340fc110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd41c002a50 tx=0x7fd41c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:22:35.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.901+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41c007cc0 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.901+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd41c00f040 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.901+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41c00da30 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.901+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4340fc900 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.901+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4340fcec0 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.902+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43404c710 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.902+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fd41c00db90 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.903+0000 7fd42affd700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd420069210 0x7fd42006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.903+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fd41c086090 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.903+0000 7fd43259c700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd420069210 0x7fd42006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.903+0000 7fd43259c700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd420069210 0x7fd42006b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd42c015040 tx=0x7fd42c004d10 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:34.907+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd41c056c50 con 0x7fd4340feda0 2024-03-22T07:22:35.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:35.105+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd434102570 con 0x7fd420069210 2024-03-22T07:22:35.510 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:22:35.510 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:22:35.510 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:22:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:22:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:36.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:36 smithi134 ceph-mon[29057]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:22:36.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:36 smithi134 ceph-mon[29057]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:36.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:36.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:36.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:36 smithi195 ceph-mon[36144]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:22:36.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:36 smithi195 ceph-mon[36144]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:36.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:36.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:38.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:38 smithi134 ceph-mon[29057]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:38.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:38 smithi195 ceph-mon[36144]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2517072719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33128647-5aab-4f43-96e0-18c2a7d73b2f"}]: dispatch 2024-03-22T07:22:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2517072719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33128647-5aab-4f43-96e0-18c2a7d73b2f"}]': finished 2024-03-22T07:22:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:39 smithi195 ceph-mon[36144]: osdmap e11: 2 total, 1 up, 2 in 2024-03-22T07:22:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:22:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:39 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2517072719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33128647-5aab-4f43-96e0-18c2a7d73b2f"}]: dispatch 2024-03-22T07:22:39.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:39 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2517072719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33128647-5aab-4f43-96e0-18c2a7d73b2f"}]': finished 2024-03-22T07:22:39.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:39 smithi134 ceph-mon[29057]: osdmap e11: 2 total, 1 up, 2 in 2024-03-22T07:22:39.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:39 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:22:40.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:40 smithi195 ceph-mon[36144]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:40.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:40 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2100401161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:22:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:40 smithi134 ceph-mon[29057]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:40 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2100401161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:22:42.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:42 smithi195 ceph-mon[36144]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:42 smithi134 ceph-mon[29057]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:44.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:44 smithi134 ceph-mon[29057]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:44.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:44 smithi195 ceph-mon[36144]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:45.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:45.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:22:46.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: Detected new or changed devices on smithi134 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi134 to 12864M 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: Detected new or changed devices on smithi134 2024-03-22T07:22:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:22:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi134 to 12864M 2024-03-22T07:22:46.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:46.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:22:46.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:46.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:48 smithi134 ceph-mon[29057]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-22T07:22:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:48 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:48 smithi195 ceph-mon[36144]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:48.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-22T07:22:48.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:48 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:49.749 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:49 smithi134 ceph-mon[29057]: Deploying daemon osd.1 on smithi134 2024-03-22T07:22:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:49 smithi195 ceph-mon[36144]: Deploying daemon osd.1 on smithi134 2024-03-22T07:22:50.580 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:50 smithi134 ceph-mon[29057]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:50 smithi195 ceph-mon[36144]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:52 smithi134 ceph-mon[29057]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:22:52.726 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:52 smithi195 ceph-mon[36144]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:22:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:22:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:54 smithi134 ceph-mon[29057]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:54.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:54 smithi195 ceph-mon[36144]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:56.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:56 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:56.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:56 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:56.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:56 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:56.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:56 smithi195 ceph-mon[36144]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:56.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:56 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:56.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:56 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:22:56.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:56 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:22:56.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:56 smithi134 ceph-mon[29057]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:58.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:58 smithi134 ceph-mon[29057]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:58.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:58 smithi195 ceph-mon[36144]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:22:58.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.817+0000 7fd42affd700 1 -- 172.21.15.134:0/1414982126 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd434102570 con 0x7fd420069210 2024-03-22T07:22:58.819 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-03-22T07:22:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd420069210 msgr2=0x7fd42006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd420069210 0x7fd42006b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd42c015040 tx=0x7fd42c004d10 comp rx=0 tx=0).stop 2024-03-22T07:22:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 msgr2=0x7fd4340fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:22:58.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 0x7fd4340fc110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd41c002a50 tx=0x7fd41c0046b0 comp rx=0 tx=0).stop 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 shutdown_connections 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd420069210 0x7fd42006b6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4340fe450 0x7fd4340fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 --2- 172.21.15.134:0/1414982126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340feda0 0x7fd4340fc110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 >> 172.21.15.134:0/1414982126 conn(0x7fd4340f6c10 msgr2=0x7fd4340f8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 shutdown_connections 2024-03-22T07:22:58.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:22:58.820+0000 7fd438fa1700 1 -- 172.21.15.134:0/1414982126 wait complete. 2024-03-22T07:23:00.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:59 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:00.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:59 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:00.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:22:59 smithi134 ceph-mon[29057]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-22T07:23:00.078 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.1.service 2024-03-22T07:23:00.080 INFO:tasks.cephadm:Deploying osd.2 on smithi134 with /dev/vg_nvme/lv_2... 2024-03-22T07:23:00.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-22T07:23:00.108 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:59 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:00.109 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:59 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:00.109 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:22:59 smithi195 ceph-mon[36144]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-22T07:23:00.738 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:23:01.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-mon[29057]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:23:01.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-mon[29057]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-22T07:23:01.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-mon[29057]: osdmap e12: 2 total, 1 up, 2 in 2024-03-22T07:23:01.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:01.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-mon[29057]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:23:01.160 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:01.160 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[55534]: 2024-03-22T07:23:00.820+0000 7eff77801700 -1 osd.1 0 waiting for initial osdmap 2024-03-22T07:23:01.161 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:00 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[55534]: 2024-03-22T07:23:00.824+0000 7eff6edf5700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:23:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:00 smithi195 ceph-mon[36144]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:23:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:00 smithi195 ceph-mon[36144]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-22T07:23:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:00 smithi195 ceph-mon[36144]: osdmap e12: 2 total, 1 up, 2 in 2024-03-22T07:23:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:00 smithi195 ceph-mon[36144]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:23:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:01 smithi134 ceph-mon[29057]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-22T07:23:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:01 smithi134 ceph-mon[29057]: osdmap e13: 2 total, 1 up, 2 in 2024-03-22T07:23:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:01 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:01 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:02.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:01 smithi195 ceph-mon[36144]: from='osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-22T07:23:02.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:01 smithi195 ceph-mon[36144]: osdmap e13: 2 total, 1 up, 2 in 2024-03-22T07:23:02.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:01 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:02.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:01 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:02 smithi134 ceph-mon[29057]: purged_snaps scrub starts 2024-03-22T07:23:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:02 smithi134 ceph-mon[29057]: purged_snaps scrub ok 2024-03-22T07:23:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:02 smithi134 ceph-mon[29057]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:23:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:02 smithi134 ceph-mon[29057]: osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] boot 2024-03-22T07:23:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:02 smithi134 ceph-mon[29057]: osdmap e14: 2 total, 2 up, 2 in 2024-03-22T07:23:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:02 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:02 smithi195 ceph-mon[36144]: purged_snaps scrub starts 2024-03-22T07:23:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:02 smithi195 ceph-mon[36144]: purged_snaps scrub ok 2024-03-22T07:23:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:02 smithi195 ceph-mon[36144]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-22T07:23:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:02 smithi195 ceph-mon[36144]: osd.1 [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] boot 2024-03-22T07:23:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:02 smithi195 ceph-mon[36144]: osdmap e14: 2 total, 2 up, 2 in 2024-03-22T07:23:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:02 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:23:03.253 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-22T07:23:03.253 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-22T07:23:03.253 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-03-22T07:23:03.253 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-03-22T07:23:03.253 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114605 s, 915 MB/s 2024-03-22T07:23:03.253 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-03-22T07:23:03.851 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:03 smithi134 ceph-mon[29057]: osdmap e15: 2 total, 2 up, 2 in 2024-03-22T07:23:03.851 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:03 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:03.851 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:03 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:03.853 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-03-22T07:23:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:03 smithi195 ceph-mon[36144]: osdmap e15: 2 total, 2 up, 2 in 2024-03-22T07:23:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:03 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:03 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:04.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:04 smithi134 ceph-mon[29057]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:04 smithi195 ceph-mon[36144]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:05.241 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:07.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:07.085 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.085 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:07.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:07.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:07.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 -- 172.21.15.134:0/829458676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fdfe0 msgr2=0x7fa8940fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/829458676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fdfe0 0x7fa8940fe450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa890004940 tx=0x7fa890009e30 comp rx=0 tx=0).stop 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 -- 172.21.15.134:0/829458676 shutdown_connections 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/829458676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fdfe0 0x7fa8940fe450 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/829458676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8940fce70 0x7fa8940fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 -- 172.21.15.134:0/829458676 >> 172.21.15.134:0/829458676 conn(0x7fa8940f8550 msgr2=0x7fa8940fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:23:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.647+0000 7fa89b5d7700 1 -- 172.21.15.134:0/829458676 shutdown_connections 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 -- 172.21.15.134:0/829458676 wait complete. 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 Processor -- start 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 -- start start 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 0x7fa89410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8940fdfe0 0x7fa89410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89410e460 con 0x7fa8940fce70 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa89b5d7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89410e5d0 con 0x7fa8940fdfe0 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa899373700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 0x7fa89410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa899373700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 0x7fa89410d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55176/0 (socket says 172.21.15.134:55176) 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.648+0000 7fa899373700 1 -- 172.21.15.134:0/1709242578 learned_addr learned my addr 172.21.15.134:0/1709242578 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa899373700 1 -- 172.21.15.134:0/1709242578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8940fdfe0 msgr2=0x7fa89410de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa898b72700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8940fdfe0 0x7fa89410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa899373700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8940fdfe0 0x7fa89410de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa899373700 1 -- 172.21.15.134:0/1709242578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890005040 con 0x7fa8940fce70 2024-03-22T07:23:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa899373700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 0x7fa89410d920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa884002a50 tx=0x7fa8840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa884007cc0 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894112fd0 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa88400f040 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa884009640 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.649+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa894113560 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.650+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89404c710 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.651+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fa8840097a0 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.651+0000 7fa889ffb700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa880069210 0x7fa88006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.651+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa8840862a0 con 0x7fa8940fce70 2024-03-22T07:23:07.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.651+0000 7fa898b72700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa880069210 0x7fa88006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:07.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.651+0000 7fa898b72700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa880069210 0x7fa88006b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c00 tx=0x7fa890009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:23:07.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.656+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa884056cb0 con 0x7fa8940fce70 2024-03-22T07:23:07.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:07.857+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa894113780 con 0x7fa880069210 2024-03-22T07:23:07.987 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:07 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi134 to 6432M 2024-03-22T07:23:08.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:07 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi134 to 6432M 2024-03-22T07:23:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:08 smithi134 ceph-mon[29057]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:08 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:23:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:08 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:23:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:08 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:08 smithi195 ceph-mon[36144]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:08 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:23:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:08 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:23:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:08 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:09 smithi134 ceph-mon[29057]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:23:10.108 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:09 smithi195 ceph-mon[36144]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:23:11.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:10 smithi134 ceph-mon[29057]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:11.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:10 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/969750649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df340703-7826-485c-87d0-8bfb34d1b89c"}]: dispatch 2024-03-22T07:23:11.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:10 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/969750649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df340703-7826-485c-87d0-8bfb34d1b89c"}]': finished 2024-03-22T07:23:11.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:10 smithi134 ceph-mon[29057]: osdmap e16: 3 total, 2 up, 3 in 2024-03-22T07:23:11.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:10 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:10 smithi195 ceph-mon[36144]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:10 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/969750649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df340703-7826-485c-87d0-8bfb34d1b89c"}]: dispatch 2024-03-22T07:23:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:10 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/969750649' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df340703-7826-485c-87d0-8bfb34d1b89c"}]': finished 2024-03-22T07:23:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:10 smithi195 ceph-mon[36144]: osdmap e16: 3 total, 2 up, 3 in 2024-03-22T07:23:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:10 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:12.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:11 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2930564287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:23:12.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:11 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2930564287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:23:13.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:12 smithi195 ceph-mon[36144]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:13.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:12 smithi134 ceph-mon[29057]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:14.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:13 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:14.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:13 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:14.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:13 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:14.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:13 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:14.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:13 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:14.285 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:13 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:14.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:13 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:14.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:13 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:14.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:13 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:14.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:13 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:15.068 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:14 smithi134 ceph-mon[29057]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:15.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:14 smithi195 ceph-mon[36144]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:16.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:16.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:16 smithi134 ceph-mon[29057]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:16 smithi195 ceph-mon[36144]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:17 smithi134 ceph-mon[29057]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:17 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-22T07:23:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:17 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:17 smithi134 ceph-mon[29057]: Deploying daemon osd.2 on smithi134 2024-03-22T07:23:18.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:17 smithi195 ceph-mon[36144]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:18.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:17 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-22T07:23:18.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:17 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:18.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:17 smithi195 ceph-mon[36144]: Deploying daemon osd.2 on smithi134 2024-03-22T07:23:20.486 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:20 smithi134 ceph-mon[29057]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:20 smithi195 ceph-mon[36144]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:22.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:22 smithi134 ceph-mon[29057]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:22.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:22 smithi195 ceph-mon[36144]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:23 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:23 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:23 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:23 smithi195 ceph-mon[36144]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:23 smithi134 ceph-mon[29057]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:26 smithi195 ceph-mon[36144]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:26.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:26 smithi134 ceph-mon[29057]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:26.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.860+0000 7fa889ffb700 1 -- 172.21.15.134:0/1709242578 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa894113780 con 0x7fa880069210 2024-03-22T07:23:26.861 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 2 on host 'smithi134' 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa880069210 msgr2=0x7fa88006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa880069210 0x7fa88006b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c00 tx=0x7fa890009e30 comp rx=0 tx=0).stop 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 msgr2=0x7fa89410d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 0x7fa89410d920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa884002a50 tx=0x7fa8840046b0 comp rx=0 tx=0).stop 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 shutdown_connections 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8940fce70 0x7fa89410d920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:26.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa880069210 0x7fa88006b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 --2- 172.21.15.134:0/1709242578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8940fdfe0 0x7fa89410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 >> 172.21.15.134:0/1709242578 conn(0x7fa8940f8550 msgr2=0x7fa8940f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:23:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 shutdown_connections 2024-03-22T07:23:26.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:23:26.863+0000 7fa89b5d7700 1 -- 172.21.15.134:0/1709242578 wait complete. 2024-03-22T07:23:27.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:27 smithi134 ceph-mon[29057]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-22T07:23:27.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:27.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:27 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:27.443 DEBUG:teuthology.orchestra.run.smithi134:osd.2> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.2.service 2024-03-22T07:23:27.446 INFO:tasks.cephadm:Deploying osd.3 on smithi195 with /dev/vg_nvme/lv_4... 2024-03-22T07:23:27.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-22T07:23:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:27 smithi195 ceph-mon[36144]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-22T07:23:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:27 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:27.706 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:23:28.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-mon[29057]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:28.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-mon[29057]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-22T07:23:28.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-mon[29057]: osdmap e17: 3 total, 2 up, 3 in 2024-03-22T07:23:28.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:28.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-mon[29057]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:23:28.697 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[62862]: 2024-03-22T07:23:28.425+0000 7f6a5ad5c700 -1 osd.2 0 waiting for initial osdmap 2024-03-22T07:23:28.697 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:28 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[62862]: 2024-03-22T07:23:28.433+0000 7f6a53b53700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:23:28.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:28 smithi195 ceph-mon[36144]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:28.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:28 smithi195 ceph-mon[36144]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-22T07:23:28.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:28 smithi195 ceph-mon[36144]: osdmap e17: 3 total, 2 up, 3 in 2024-03-22T07:23:28.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:28 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:28.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:28 smithi195 ceph-mon[36144]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:23:29.344 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-22T07:23:29.344 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-22T07:23:29.344 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-03-22T07:23:29.344 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-03-22T07:23:29.344 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00833948 s, 1.3 GB/s 2024-03-22T07:23:29.344 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-03-22T07:23:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:29 smithi195 ceph-mon[36144]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-22T07:23:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:29 smithi195 ceph-mon[36144]: osdmap e18: 3 total, 2 up, 3 in 2024-03-22T07:23:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:29.659 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:29.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:29 smithi134 ceph-mon[29057]: from='osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-22T07:23:29.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:29 smithi134 ceph-mon[29057]: osdmap e18: 3 total, 2 up, 3 in 2024-03-22T07:23:29.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:29.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:29.968 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2024-03-22T07:23:30.221 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:23:30.612 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: purged_snaps scrub starts 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: purged_snaps scrub ok 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] boot 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: osdmap e19: 3 total, 3 up, 3 in 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:30.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:30.614 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: purged_snaps scrub starts 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: purged_snaps scrub ok 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: osd.2 [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] boot 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: osdmap e19: 3 total, 3 up, 3 in 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:30.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 -- 172.21.15.195:0/3029570527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 msgr2=0x7fbc5c0fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 --2- 172.21.15.195:0/3029570527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c0fe540 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbc58004970 tx=0x7fbc58009e30 comp rx=0 tx=0).stop 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 -- 172.21.15.195:0/3029570527 shutdown_connections 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 --2- 172.21.15.195:0/3029570527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c0fe540 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 --2- 172.21.15.195:0/3029570527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc5c0fcee0 0x7fbc5c0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 -- 172.21.15.195:0/3029570527 >> 172.21.15.195:0/3029570527 conn(0x7fbc5c0f8560 msgr2=0x7fbc5c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:23:31.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 -- 172.21.15.195:0/3029570527 shutdown_connections 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.756+0000 7fbc64505700 1 -- 172.21.15.195:0/3029570527 wait complete. 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc64505700 1 Processor -- start 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc64505700 1 -- start start 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc64505700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc5c0fcee0 0x7fbc5c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc64505700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc64505700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c0708c0 con 0x7fbc5c0fcee0 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc64505700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c070a30 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:53924/0 (socket says 172.21.15.195:53924) 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 -- 172.21.15.195:0/977461072 learned_addr learned my addr 172.21.15.195:0/977461072 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:23:31.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc622a1700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc5c0fcee0 0x7fbc5c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 -- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc5c0fcee0 msgr2=0x7fbc5c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc5c0fcee0 0x7fbc5c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 -- 172.21.15.195:0/977461072 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58005040 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc61aa0700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c070310 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005010 tx=0x7fbc58009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.757+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5800e040 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.758+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc5800b580 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.758+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5801c630 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.758+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c070cb0 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.758+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c1159c0 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.759+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c05f5f0 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.759+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fbc58013980 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.759+0000 7fbc52ffd700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fbc48069210 0x7fbc4806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:31.771 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.759+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7fbc58087350 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.772 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.759+0000 7fbc622a1700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fbc48069210 0x7fbc4806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:31.772 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.760+0000 7fbc622a1700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fbc48069210 0x7fbc4806b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c071bd0 tx=0x7fbc4c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:23:31.772 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.764+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fbc580540d0 con 0x7fbc5c0fe0d0 2024-03-22T07:23:31.955 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:31.954+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc5c1023f0 con 0x7fbc48069210 2024-03-22T07:23:31.998 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:31 smithi134 ceph-mon[29057]: osdmap e20: 3 total, 3 up, 3 in 2024-03-22T07:23:31.998 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:31 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-22T07:23:32.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:31 smithi195 ceph-mon[36144]: osdmap e20: 3 total, 3 up, 3 in 2024-03-22T07:23:32.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:31 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-22T07:23:32.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: pgmap v76: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:32.936 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-22T07:23:32.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: osdmap e21: 3 total, 3 up, 3 in 2024-03-22T07:23:32.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-22T07:23:32.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:23:32.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:23:32.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: pgmap v76: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: osdmap e21: 3 total, 3 up, 3 in 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:23:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:33.487 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67535]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-22T07:23:33.488 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67535]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:33.488 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67535]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:33.488 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67535]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:33.749 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67602]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-22T07:23:33.749 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67602]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:33.749 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67602]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:33.749 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67602]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:23:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-22T07:23:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: osdmap e22: 3 total, 3 up, 3 in 2024-03-22T07:23:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:33.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:33 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.016 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67605]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-22T07:23:34.017 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67605]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:34.017 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67605]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:34.017 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:33 smithi134 sudo[67605]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: osdmap e22: 3 total, 3 up, 3 in 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:34.017 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:33 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:34.275 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67608]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-22T07:23:34.275 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67608]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:34.276 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67608]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:34.276 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67608]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:34.276 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67611]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-22T07:23:34.276 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67611]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:34.276 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67611]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:34.276 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67611]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:34.545 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67614]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-22T07:23:34.545 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67614]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:34.545 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67614]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:34.545 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67614]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:35.020 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67617]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-22T07:23:35.020 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67617]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:35.020 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67617]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:35.020 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:34 smithi134 sudo[67617]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:35.031 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:35.030+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fbc580544a0 con 0x7fbc5c0fe0d0 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: Detected new or changed devices on smithi134 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi134 to 4288M 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: osdmap e23: 3 total, 3 up, 3 in 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/3207261484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "442688be-c820-422d-9d00-9a68a8b2c235"}]: dispatch 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "442688be-c820-422d-9d00-9a68a8b2c235"}]: dispatch 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "442688be-c820-422d-9d00-9a68a8b2c235"}]': finished 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: osdmap e24: 4 total, 3 up, 4 in 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 ceph-mon[36144]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39606]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-22T07:23:35.287 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39606]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:35.288 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39606]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:35.288 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39606]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:35.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 sudo[67620]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-22T07:23:35.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 sudo[67620]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:35.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 sudo[67620]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:35.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 sudo[67620]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: Detected new or changed devices on smithi134 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi134 to 4288M 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: osdmap e23: 3 total, 3 up, 3 in 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/3207261484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "442688be-c820-422d-9d00-9a68a8b2c235"}]: dispatch 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "442688be-c820-422d-9d00-9a68a8b2c235"}]: dispatch 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "442688be-c820-422d-9d00-9a68a8b2c235"}]': finished 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: osdmap e24: 4 total, 3 up, 4 in 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:35.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:35 smithi134 ceph-mon[29057]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-22T07:23:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39794]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-22T07:23:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39794]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-22T07:23:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39794]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-22T07:23:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:35 smithi195 sudo[39794]: pam_unix(sudo:session): session closed for user root 2024-03-22T07:23:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1611616774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:23:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-22T07:23:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:23:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:23:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-22T07:23:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: mgrmap e19: smithi134.wtwqre(active, since 2m), standbys: smithi195.jxfsnc 2024-03-22T07:23:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:23:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:23:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-22T07:23:36.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:36 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:36.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1611616774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:23:36.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-22T07:23:36.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:23:36.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:23:36.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-22T07:23:36.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: mgrmap e19: smithi134.wtwqre(active, since 2m), standbys: smithi195.jxfsnc 2024-03-22T07:23:36.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:23:36.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:23:36.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:36.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-22T07:23:36.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:36 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:38.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:38 smithi134 ceph-mon[29057]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:38.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:38 smithi195 ceph-mon[36144]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:40.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:40 smithi195 ceph-mon[36144]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:40 smithi134 ceph-mon[29057]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:41.670 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:41 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-22T07:23:41.671 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:41 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:41 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-22T07:23:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:41 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:42.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:42 smithi195 ceph-mon[36144]: Deploying daemon osd.3 on smithi195 2024-03-22T07:23:42.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:42 smithi195 ceph-mon[36144]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:42 smithi134 ceph-mon[29057]: Deploying daemon osd.3 on smithi195 2024-03-22T07:23:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:42 smithi134 ceph-mon[29057]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:44.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:44 smithi195 ceph-mon[36144]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:44.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:44 smithi134 ceph-mon[29057]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:45.612 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:23:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:46 smithi195 ceph-mon[36144]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:46 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:46 smithi134 ceph-mon[29057]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:46 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:48.912 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:48 smithi134 ceph-mon[29057]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:48 smithi195 ceph-mon[36144]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:49.316 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.315+0000 7fbc52ffd700 1 -- 172.21.15.195:0/977461072 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbc5c1023f0 con 0x7fbc48069210 2024-03-22T07:23:49.316 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 3 on host 'smithi195' 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fbc48069210 msgr2=0x7fbc4806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fbc48069210 0x7fbc4806b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c071bd0 tx=0x7fbc4c00b040 comp rx=0 tx=0).stop 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 msgr2=0x7fbc5c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c070310 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005010 tx=0x7fbc58009e30 comp rx=0 tx=0).stop 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 shutdown_connections 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc5c0fcee0 0x7fbc5c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fbc48069210 0x7fbc4806b6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 --2- 172.21.15.195:0/977461072 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc5c0fe0d0 0x7fbc5c070310 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 >> 172.21.15.195:0/977461072 conn(0x7fbc5c0f8560 msgr2=0x7fbc5c0f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 shutdown_connections 2024-03-22T07:23:49.318 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:49.317+0000 7fbc64505700 1 -- 172.21.15.195:0/977461072 wait complete. 2024-03-22T07:23:49.917 DEBUG:teuthology.orchestra.run.smithi195:osd.3> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.3.service 2024-03-22T07:23:49.919 INFO:tasks.cephadm:Deploying osd.4 on smithi195 with /dev/vg_nvme/lv_3... 2024-03-22T07:23:49.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-22T07:23:50.218 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:23:50.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.471 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:50.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: from='osd.3 [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:23:50.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:23:50.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.472 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:50 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: from='osd.3 [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:23:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:23:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:50 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:51.491 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-mon[36144]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-22T07:23:51.491 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-mon[36144]: osdmap e25: 4 total, 3 up, 4 in 2024-03-22T07:23:51.491 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:51.491 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-mon[36144]: from='osd.3 [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:23:51.491 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-mon[36144]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:23:51.491 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[41585]: 2024-03-22T07:23:51.315+0000 7fc97889b700 -1 osd.3 0 waiting for initial osdmap 2024-03-22T07:23:51.491 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:23:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[41585]: 2024-03-22T07:23:51.322+0000 7fc972694700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:23:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:51 smithi134 ceph-mon[29057]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-22T07:23:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:51 smithi134 ceph-mon[29057]: osdmap e25: 4 total, 3 up, 4 in 2024-03-22T07:23:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:51 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:51 smithi134 ceph-mon[29057]: from='osd.3 [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:23:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:51 smithi134 ceph-mon[29057]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:23:52.324 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-22T07:23:52.325 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-22T07:23:52.325 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-03-22T07:23:52.325 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-03-22T07:23:52.325 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0107606 s, 974 MB/s 2024-03-22T07:23:52.325 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-03-22T07:23:52.619 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:52 smithi195 ceph-mon[36144]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-03-22T07:23:52.620 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:52 smithi195 ceph-mon[36144]: osdmap e26: 4 total, 3 up, 4 in 2024-03-22T07:23:52.620 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:52.620 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:52 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:52.620 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:52 smithi195 ceph-mon[36144]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:52 smithi134 ceph-mon[29057]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-03-22T07:23:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:52 smithi134 ceph-mon[29057]: osdmap e26: 4 total, 3 up, 4 in 2024-03-22T07:23:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:52 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:52 smithi134 ceph-mon[29057]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-03-22T07:23:53.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2024-03-22T07:23:53.603 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:53 smithi195 ceph-mon[36144]: purged_snaps scrub starts 2024-03-22T07:23:53.603 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:53 smithi195 ceph-mon[36144]: purged_snaps scrub ok 2024-03-22T07:23:53.603 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:53.603 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:53 smithi195 ceph-mon[36144]: osd.3 [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] boot 2024-03-22T07:23:53.603 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:53 smithi195 ceph-mon[36144]: osdmap e27: 4 total, 4 up, 4 in 2024-03-22T07:23:53.603 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:53 smithi134 ceph-mon[29057]: purged_snaps scrub starts 2024-03-22T07:23:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:53 smithi134 ceph-mon[29057]: purged_snaps scrub ok 2024-03-22T07:23:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:53 smithi134 ceph-mon[29057]: osd.3 [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] boot 2024-03-22T07:23:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:53 smithi134 ceph-mon[29057]: osdmap e27: 4 total, 4 up, 4 in 2024-03-22T07:23:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:23:53.802 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:23:54.675 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:54 smithi195 ceph-mon[36144]: osdmap e28: 4 total, 4 up, 4 in 2024-03-22T07:23:54.675 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:54 smithi195 ceph-mon[36144]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:23:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:54 smithi134 ceph-mon[29057]: osdmap e28: 4 total, 4 up, 4 in 2024-03-22T07:23:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:54 smithi134 ceph-mon[29057]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:23:55.612 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: osdmap e29: 4 total, 4 up, 4 in 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:55.613 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:55 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: osdmap e29: 4 total, 4 up, 4 in 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:23:55.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:55 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:23:55.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- 172.21.15.195:0/1846652367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fcf80 msgr2=0x7f7d780fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:55.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/1846652367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fcf80 0x7f7d780fd3f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c004940 tx=0x7f7d6c009e30 comp rx=0 tx=0).stop 2024-03-22T07:23:55.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- 172.21.15.195:0/1846652367 shutdown_connections 2024-03-22T07:23:55.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/1846652367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fcf80 0x7f7d780fd3f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:55.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/1846652367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d780fbcd0 0x7f7d780fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:55.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- 172.21.15.195:0/1846652367 >> 172.21.15.195:0/1846652367 conn(0x7f7d780f7430 msgr2=0x7f7d780f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- 172.21.15.195:0/1846652367 shutdown_connections 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- 172.21.15.195:0/1846652367 wait complete. 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 Processor -- start 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- start start 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 0x7f7d780ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d780fcf80 0x7f7d780fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78100170 con 0x7f7d780fcf80 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7c88e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780fe800 con 0x7f7d780fbcd0 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.907+0000 7f7d7659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 0x7f7d780ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 0x7f7d780ffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:60056/0 (socket says 172.21.15.195:60056) 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7659c700 1 -- 172.21.15.195:0/891583491 learned_addr learned my addr 172.21.15.195:0/891583491 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d75d9b700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d780fcf80 0x7f7d780fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7659c700 1 -- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d780fcf80 msgr2=0x7f7d780fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7659c700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d780fcf80 0x7f7d780fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:23:55.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7659c700 1 -- 172.21.15.195:0/891583491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c005040 con 0x7f7d780fbcd0 2024-03-22T07:23:55.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7659c700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 0x7f7d780ffb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800c830 tx=0x7f7d68004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:23:55.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d6800a760 con 0x7f7d780fbcd0 2024-03-22T07:23:55.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d6800ad90 con 0x7f7d780fbcd0 2024-03-22T07:23:55.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d780feae0 con 0x7f7d780fbcd0 2024-03-22T07:23:55.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d680113a0 con 0x7f7d780fbcd0 2024-03-22T07:23:55.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.908+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d780ff0a0 con 0x7f7d780fbcd0 2024-03-22T07:23:55.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.909+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d78101b10 con 0x7f7d780fbcd0 2024-03-22T07:23:55.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.909+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7d6800a8c0 con 0x7f7d780fbcd0 2024-03-22T07:23:55.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.910+0000 7f7d66ffd700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f7d600692a0 0x7f7d6006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:23:55.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.910+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f7d68086a60 con 0x7f7d780fbcd0 2024-03-22T07:23:55.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.910+0000 7f7d75d9b700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f7d600692a0 0x7f7d6006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:23:55.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.910+0000 7f7d75d9b700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f7d600692a0 0x7f7d6006b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b3b0 tx=0x7f7d6c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:23:55.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:55.915+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7d68056f60 con 0x7f7d780fbcd0 2024-03-22T07:23:56.106 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:23:56.106+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d7802b340 con 0x7f7d600692a0 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: Detected new or changed devices on smithi195 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi195 to 15936M 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: osdmap e30: 4 total, 4 up, 4 in 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:56.608 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:56 smithi195 ceph-mon[36144]: osdmap e31: 4 total, 4 up, 4 in 2024-03-22T07:23:56.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: Detected new or changed devices on smithi195 2024-03-22T07:23:56.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi195 to 15936M 2024-03-22T07:23:56.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: osdmap e30: 4 total, 4 up, 4 in 2024-03-22T07:23:56.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:23:56.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:23:56.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:23:56.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:23:56.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:56 smithi134 ceph-mon[29057]: osdmap e31: 4 total, 4 up, 4 in 2024-03-22T07:23:57.580 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:57 smithi195 ceph-mon[36144]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:23:57.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:57 smithi134 ceph-mon[29057]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:23:58.695 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:58 smithi134 ceph-mon[29057]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:23:58.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:58 smithi195 ceph-mon[36144]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:23:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:59 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1886408343' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f01cda-18b0-49b6-ab64-cc3c2b2b1154"}]: dispatch 2024-03-22T07:23:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:59 smithi195 ceph-mon[36144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f01cda-18b0-49b6-ab64-cc3c2b2b1154"}]: dispatch 2024-03-22T07:23:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:59 smithi195 ceph-mon[36144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5f01cda-18b0-49b6-ab64-cc3c2b2b1154"}]': finished 2024-03-22T07:23:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:59 smithi195 ceph-mon[36144]: osdmap e32: 5 total, 4 up, 5 in 2024-03-22T07:23:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:59 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:23:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:23:59 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1174293825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:23:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:59 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1886408343' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f01cda-18b0-49b6-ab64-cc3c2b2b1154"}]: dispatch 2024-03-22T07:23:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:59 smithi134 ceph-mon[29057]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5f01cda-18b0-49b6-ab64-cc3c2b2b1154"}]: dispatch 2024-03-22T07:23:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:59 smithi134 ceph-mon[29057]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5f01cda-18b0-49b6-ab64-cc3c2b2b1154"}]': finished 2024-03-22T07:23:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:59 smithi134 ceph-mon[29057]: osdmap e32: 5 total, 4 up, 5 in 2024-03-22T07:23:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:59 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:23:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:23:59 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1174293825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:24:00.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:00 smithi195 ceph-mon[36144]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-03-22T07:24:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:00 smithi134 ceph-mon[29057]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-03-22T07:24:01.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:01 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:01 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:02.546 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:02 smithi195 ceph-mon[36144]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-22T07:24:02.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:02 smithi134 ceph-mon[29057]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-22T07:24:04.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:04 smithi195 ceph-mon[36144]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-22T07:24:04.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:04 smithi134 ceph-mon[29057]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-22T07:24:05.521 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:05 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-22T07:24:05.522 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:05 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:05 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-22T07:24:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:05 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:06.641 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:06 smithi195 ceph-mon[36144]: Deploying daemon osd.4 on smithi195 2024-03-22T07:24:06.641 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:06 smithi195 ceph-mon[36144]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-22T07:24:06.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:06 smithi134 ceph-mon[29057]: Deploying daemon osd.4 on smithi195 2024-03-22T07:24:06.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:06 smithi134 ceph-mon[29057]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-03-22T07:24:08.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:08 smithi134 ceph-mon[29057]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-22T07:24:08.701 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:08 smithi195 ceph-mon[36144]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-22T07:24:10.688 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:10 smithi195 ceph-mon[36144]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:10.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:10 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:10.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:10 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:10.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:10 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:10 smithi134 ceph-mon[29057]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:10 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:10 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:10 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:12.656 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:12 smithi195 ceph-mon[36144]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:12.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:12 smithi134 ceph-mon[29057]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:13.616 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.616+0000 7f7d66ffd700 1 -- 172.21.15.195:0/891583491 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7d7802b340 con 0x7f7d600692a0 2024-03-22T07:24:13.617 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 4 on host 'smithi195' 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f7d600692a0 msgr2=0x7f7d6006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f7d600692a0 0x7f7d6006b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b3b0 tx=0x7f7d6c009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 msgr2=0x7f7d780ffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 0x7f7d780ffb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800c830 tx=0x7f7d68004470 comp rx=0 tx=0).stop 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 shutdown_connections 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f7d600692a0 0x7f7d6006b750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:13.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d780fbcd0 0x7f7d780ffb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:13.620 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 --2- 172.21.15.195:0/891583491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d780fcf80 0x7f7d780fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:13.620 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 >> 172.21.15.195:0/891583491 conn(0x7f7d780f7430 msgr2=0x7f7d78066820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:13.620 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 shutdown_connections 2024-03-22T07:24:13.620 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:13.618+0000 7f7d7c88e700 1 -- 172.21.15.195:0/891583491 wait complete. 2024-03-22T07:24:14.548 DEBUG:teuthology.orchestra.run.smithi195:osd.4> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.4.service 2024-03-22T07:24:14.551 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_2... 2024-03-22T07:24:14.551 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-22T07:24:14.861 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:24:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:14 smithi195 ceph-mon[36144]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:14 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:14 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:14 smithi195 ceph-mon[36144]: from='osd.4 [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:24:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:14 smithi195 ceph-mon[36144]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:24:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:14 smithi134 ceph-mon[29057]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:14 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:14 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:14 smithi134 ceph-mon[29057]: from='osd.4 [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:24:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:14 smithi134 ceph-mon[29057]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:24:15.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-22T07:24:15.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: osdmap e33: 5 total, 4 up, 5 in 2024-03-22T07:24:15.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:15.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='osd.4 [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:15.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:15.690 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:15.690 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:15.690 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:15.690 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[48018]: 2024-03-22T07:24:15.610+0000 7f778a777700 -1 osd.4 0 waiting for initial osdmap 2024-03-22T07:24:15.690 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:24:15 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[48018]: 2024-03-22T07:24:15.617+0000 7f7785572700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: osdmap e33: 5 total, 4 up, 5 in 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='osd.4 [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:16.506 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-22T07:24:16.506 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-22T07:24:16.507 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2024-03-22T07:24:16.507 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2024-03-22T07:24:16.507 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00982724 s, 1.1 GB/s 2024-03-22T07:24:16.507 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2024-03-22T07:24:16.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:16 smithi195 ceph-mon[36144]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:16.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:16 smithi195 ceph-mon[36144]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-03-22T07:24:16.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:16 smithi195 ceph-mon[36144]: osdmap e34: 5 total, 4 up, 5 in 2024-03-22T07:24:16.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:16.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:16 smithi134 ceph-mon[29057]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-22T07:24:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:16 smithi134 ceph-mon[29057]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-03-22T07:24:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:16 smithi134 ceph-mon[29057]: osdmap e34: 5 total, 4 up, 5 in 2024-03-22T07:24:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:17.310 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2024-03-22T07:24:17.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:17 smithi195 ceph-mon[36144]: purged_snaps scrub starts 2024-03-22T07:24:17.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:17 smithi195 ceph-mon[36144]: purged_snaps scrub ok 2024-03-22T07:24:17.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:17 smithi195 ceph-mon[36144]: osd.4 [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] boot 2024-03-22T07:24:17.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:17 smithi195 ceph-mon[36144]: osdmap e35: 5 total, 5 up, 5 in 2024-03-22T07:24:17.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:17 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:17 smithi134 ceph-mon[29057]: purged_snaps scrub starts 2024-03-22T07:24:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:17 smithi134 ceph-mon[29057]: purged_snaps scrub ok 2024-03-22T07:24:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:17 smithi134 ceph-mon[29057]: osd.4 [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] boot 2024-03-22T07:24:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:17 smithi134 ceph-mon[29057]: osdmap e35: 5 total, 5 up, 5 in 2024-03-22T07:24:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:17 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:24:18.227 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:24:18.750 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:18 smithi195 ceph-mon[36144]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:18.750 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:18 smithi195 ceph-mon[36144]: osdmap e36: 5 total, 5 up, 5 in 2024-03-22T07:24:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:18 smithi134 ceph-mon[29057]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:18 smithi134 ceph-mon[29057]: osdmap e36: 5 total, 5 up, 5 in 2024-03-22T07:24:20.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 -- 172.21.15.195:0/1824155343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 msgr2=0x7efc0c0fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:20.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 --2- 172.21.15.195:0/1824155343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c0fc110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efbfc004940 tx=0x7efbfc009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 -- 172.21.15.195:0/1824155343 shutdown_connections 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 --2- 172.21.15.195:0/1824155343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0fcfb0 0x7efc0c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 --2- 172.21.15.195:0/1824155343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c0fc110 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 -- 172.21.15.195:0/1824155343 >> 172.21.15.195:0/1824155343 conn(0x7efc0c0f7440 msgr2=0x7efc0c0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 -- 172.21.15.195:0/1824155343 shutdown_connections 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.574+0000 7efc118e4700 1 -- 172.21.15.195:0/1824155343 wait complete. 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc118e4700 1 Processor -- start 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc118e4700 1 -- start start 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc118e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c10c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc118e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0fcfb0 0x7efc0c10cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc118e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c10d390 con 0x7efc0c0fcfb0 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc118e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c10d500 con 0x7efc0c0fbd00 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c10c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c10c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:43960/0 (socket says 172.21.15.195:43960) 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 -- 172.21.15.195:0/365277751 learned_addr learned my addr 172.21.15.195:0/365277751 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:24:20.580 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0a7fc700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0fcfb0 0x7efc0c10cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 -- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0fcfb0 msgr2=0x7efc0c10cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0fcfb0 0x7efc0c10cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 -- 172.21.15.195:0/365277751 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc005040 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.575+0000 7efc0affd700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c10c850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009150 tx=0x7efbfc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.576+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbfc00e040 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.576+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efbfc004290 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.576+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c111f00 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.576+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbfc01c630 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.576+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c112430 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.577+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c105020 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.577+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7efbfc026440 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.577+0000 7efbf37fe700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efbf40692a0 0x7efbf406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.578+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7efbfc0879b0 con 0x7efc0c0fbd00 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.578+0000 7efc0a7fc700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efbf40692a0 0x7efbf406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:20.581 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.578+0000 7efc0a7fc700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efbf40692a0 0x7efbf406b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc00004f60 tx=0x7efc0000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:20.582 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.582+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7efbfc057c60 con 0x7efc0c0fbd00 2024-03-22T07:24:20.786 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:20.785+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efc0c1012c0 con 0x7efbf40692a0 2024-03-22T07:24:20.786 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:20.786 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:20.786 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:20.787 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:21.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:21.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:21 smithi195 ceph-mon[36144]: Detected new or changed devices on smithi195 2024-03-22T07:24:21.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:21 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi195 to 7968M 2024-03-22T07:24:21.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:21 smithi195 ceph-mon[36144]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:24:21.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:24:21.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:24:21.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:21 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:21 smithi134 ceph-mon[29057]: Detected new or changed devices on smithi195 2024-03-22T07:24:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:21 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi195 to 7968M 2024-03-22T07:24:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:21 smithi134 ceph-mon[29057]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:24:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-22T07:24:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-22T07:24:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:21 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:22 smithi195 ceph-mon[36144]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:23.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:22 smithi134 ceph-mon[29057]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:23 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/1309257303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4539de25-fcab-4fd8-b9e2-e19009c1948c"}]: dispatch 2024-03-22T07:24:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:23 smithi195 ceph-mon[36144]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4539de25-fcab-4fd8-b9e2-e19009c1948c"}]: dispatch 2024-03-22T07:24:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:23 smithi195 ceph-mon[36144]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4539de25-fcab-4fd8-b9e2-e19009c1948c"}]': finished 2024-03-22T07:24:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:23 smithi195 ceph-mon[36144]: osdmap e37: 6 total, 5 up, 6 in 2024-03-22T07:24:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:23 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:23 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/1309257303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4539de25-fcab-4fd8-b9e2-e19009c1948c"}]: dispatch 2024-03-22T07:24:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:23 smithi134 ceph-mon[29057]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4539de25-fcab-4fd8-b9e2-e19009c1948c"}]: dispatch 2024-03-22T07:24:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:23 smithi134 ceph-mon[29057]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4539de25-fcab-4fd8-b9e2-e19009c1948c"}]': finished 2024-03-22T07:24:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:23 smithi134 ceph-mon[29057]: osdmap e37: 6 total, 5 up, 6 in 2024-03-22T07:24:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:23 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:24 smithi195 ceph-mon[36144]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:24 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/722247515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:24:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:24 smithi134 ceph-mon[29057]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:24 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/722247515' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-22T07:24:26.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:26 smithi195 ceph-mon[36144]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:27.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:26 smithi134 ceph-mon[29057]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:28.895 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:28 smithi195 ceph-mon[36144]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:29.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:28 smithi134 ceph-mon[29057]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:30.918 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:30 smithi195 ceph-mon[36144]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:30.918 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-22T07:24:30.918 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:30.918 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:30 smithi134 ceph-mon[29057]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-22T07:24:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:31.869 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:31 smithi195 ceph-mon[36144]: Deploying daemon osd.5 on smithi195 2024-03-22T07:24:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:31 smithi134 ceph-mon[29057]: Deploying daemon osd.5 on smithi195 2024-03-22T07:24:32.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:32 smithi195 ceph-mon[36144]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:32 smithi134 ceph-mon[29057]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:34.831 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:34 smithi195 ceph-mon[36144]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:34 smithi134 ceph-mon[29057]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:36.154 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:36.154 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:36.155 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:35 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:36.155 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:35 smithi195 ceph-mon[36144]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:35 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:35 smithi134 ceph-mon[29057]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:38.553 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2024-03-22T07:24:38.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.553+0000 7efbf37fe700 1 -- 172.21.15.195:0/365277751 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efc0c1012c0 con 0x7efbf40692a0 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efbf40692a0 msgr2=0x7efbf406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efbf40692a0 0x7efbf406b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc00004f60 tx=0x7efc0000b040 comp rx=0 tx=0).stop 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 msgr2=0x7efc0c10c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c10c850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009150 tx=0x7efbfc009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 shutdown_connections 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7efbf40692a0 0x7efbf406b750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efc0c0fbd00 0x7efc0c10c850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 --2- 172.21.15.195:0/365277751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc0c0fcfb0 0x7efc0c10cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 >> 172.21.15.195:0/365277751 conn(0x7efc0c0f7440 msgr2=0x7efc0c0f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 shutdown_connections 2024-03-22T07:24:38.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:38.555+0000 7efc118e4700 1 -- 172.21.15.195:0/365277751 wait complete. 2024-03-22T07:24:38.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:38 smithi134 ceph-mon[29057]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:38.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:38 smithi195 ceph-mon[36144]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:39.136 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5.service 2024-03-22T07:24:39.139 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-03-22T07:24:39.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-22T07:24:39.406 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:39 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:39 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:39 smithi134 ceph-mon[29057]: from='osd.5 [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:24:39.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:39 smithi134 ceph-mon[29057]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:24:39.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:39 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:39 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:39 smithi195 ceph-mon[36144]: from='osd.5 [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:24:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:39 smithi195 ceph-mon[36144]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:24:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:39 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:40.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-mon[36144]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:40.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-mon[36144]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-22T07:24:40.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-mon[36144]: osdmap e38: 6 total, 5 up, 6 in 2024-03-22T07:24:40.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:40.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-mon[36144]: from='osd.5 [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:40.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-mon[36144]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:40.706 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[54932]: 2024-03-22T07:24:40.555+0000 7f30c4f01700 -1 osd.5 0 waiting for initial osdmap 2024-03-22T07:24:40.706 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:24:40 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[54932]: 2024-03-22T07:24:40.563+0000 7f30c14ff700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:24:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:40 smithi134 ceph-mon[29057]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:40 smithi134 ceph-mon[29057]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-22T07:24:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:40 smithi134 ceph-mon[29057]: osdmap e38: 6 total, 5 up, 6 in 2024-03-22T07:24:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:40 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:40 smithi134 ceph-mon[29057]: from='osd.5 [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:40 smithi134 ceph-mon[29057]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:24:41.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 -- 172.21.15.134:0/222179591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fe060 msgr2=0x7ff3a40fe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:41.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 --2- 172.21.15.134:0/222179591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fe060 0x7ff3a40fe4d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff398004940 tx=0x7ff398009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:41.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 -- 172.21.15.134:0/222179591 shutdown_connections 2024-03-22T07:24:41.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 --2- 172.21.15.134:0/222179591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fe060 0x7ff3a40fe4d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:41.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 --2- 172.21.15.134:0/222179591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fcef0 0x7ff3a40fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:41.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 -- 172.21.15.134:0/222179591 >> 172.21.15.134:0/222179591 conn(0x7ff3a40f85b0 msgr2=0x7ff3a40fa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:41.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 -- 172.21.15.134:0/222179591 shutdown_connections 2024-03-22T07:24:41.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.162+0000 7ff3aa317700 1 -- 172.21.15.134:0/222179591 wait complete. 2024-03-22T07:24:41.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3aa317700 1 Processor -- start 2024-03-22T07:24:41.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3aa317700 1 -- start start 2024-03-22T07:24:41.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3aa317700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 0x7ff3a4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:41.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3aa317700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fe060 0x7ff3a4070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:41.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3aa317700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40708c0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3aa317700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4070a30 con 0x7ff3a40fe060 2024-03-22T07:24:41.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 0x7ff3a4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:41.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.163+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 0x7ff3a4071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38924/0 (socket says 172.21.15.134:38924) 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a3fff700 1 -- 172.21.15.134:0/3210911687 learned_addr learned my addr 172.21.15.134:0/3210911687 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a37fe700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fe060 0x7ff3a4070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a3fff700 1 -- 172.21.15.134:0/3210911687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fe060 msgr2=0x7ff3a4070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a3fff700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fe060 0x7ff3a4070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a3fff700 1 -- 172.21.15.134:0/3210911687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398005040 con 0x7ff3a40fcef0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a37fe700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fe060 0x7ff3a4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a3fff700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 0x7ff3a4071e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff39400eb40 tx=0x7ff39400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff394007cc0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff39400f040 con 0x7ff3a40fcef0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4070cb0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff394009620 con 0x7ff3a40fcef0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.164+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a41159f0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.165+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a405f5f0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.165+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff394009780 con 0x7ff3a40fcef0 2024-03-22T07:24:41.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.166+0000 7ff3a0ff9700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff38c0692b0 0x7ff38c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:41.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.166+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4354+0+0 (secure 0 0 0) 0x7ff394086a40 con 0x7ff3a40fcef0 2024-03-22T07:24:41.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.166+0000 7ff3a37fe700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff38c0692b0 0x7ff38c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:41.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.166+0000 7ff3a37fe700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff38c0692b0 0x7ff38c06b760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff398004560 tx=0x7ff398009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:41.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.171+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff3940531f0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.367+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff3a404bed0 con 0x7ff3a40fcef0 2024-03-22T07:24:41.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.368+0000 7ff3a0ff9700 1 -- 172.21.15.134:0/3210911687 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff394056810 con 0x7ff3a40fcef0 2024-03-22T07:24:41.368 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:24:41.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff38c0692b0 msgr2=0x7ff38c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:41.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff38c0692b0 0x7ff38c06b760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff398004560 tx=0x7ff398009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:41.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 msgr2=0x7ff3a4071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:41.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 0x7ff3a4071e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff39400eb40 tx=0x7ff39400b040 comp rx=0 tx=0).stop 2024-03-22T07:24:41.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 shutdown_connections 2024-03-22T07:24:41.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3a40fcef0 0x7ff3a4071e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:41.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff38c0692b0 0x7ff38c06b760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:41.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 --2- 172.21.15.134:0/3210911687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3a40fe060 0x7ff3a4070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:41.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 >> 172.21.15.134:0/3210911687 conn(0x7ff3a40f85b0 msgr2=0x7ff3a40f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:41.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 shutdown_connections 2024-03-22T07:24:41.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:41.370+0000 7ff3aa317700 1 -- 172.21.15.134:0/3210911687 wait complete. 2024-03-22T07:24:41.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:41 smithi134 ceph-mon[29057]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-03-22T07:24:41.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:41 smithi134 ceph-mon[29057]: osdmap e39: 6 total, 5 up, 6 in 2024-03-22T07:24:41.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:41 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:41.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:41 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:41.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:41 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3210911687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-22T07:24:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:41 smithi195 ceph-mon[36144]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2024-03-22T07:24:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:41 smithi195 ceph-mon[36144]: osdmap e39: 6 total, 5 up, 6 in 2024-03-22T07:24:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:41 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:41 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:41 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3210911687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-22T07:24:42.020 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1711092256,"num_in_osds":6,"osd_in_since":1711092263,"num_remapped_pgs":0} 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: purged_snaps scrub starts 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: purged_snaps scrub ok 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: osd.5 [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] boot 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: osdmap e40: 6 total, 6 up, 6 in 2024-03-22T07:24:42.894 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:42 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:43.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: purged_snaps scrub starts 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: purged_snaps scrub ok 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: osd.5 [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] boot 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: osdmap e40: 6 total, 6 up, 6 in 2024-03-22T07:24:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:42 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:24:43.287 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:43.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: osdmap e41: 6 total, 6 up, 6 in 2024-03-22T07:24:43.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.682 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:43.683 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:43 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: osdmap e41: 6 total, 6 up, 6 in 2024-03-22T07:24:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:24:43.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:43 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:24:44.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 -- 172.21.15.134:0/2288181617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b780fffa0 msgr2=0x7f3b78102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:44.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/2288181617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b780fffa0 0x7f3b78102380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b68004940 tx=0x7f3b68009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:44.821 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:44 smithi134 ceph-mon[29057]: Detected new or changed devices on smithi195 2024-03-22T07:24:44.821 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:44 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi195 to 5312M 2024-03-22T07:24:44.821 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:44 smithi134 ceph-mon[29057]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 -- 172.21.15.134:0/2288181617 shutdown_connections 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/2288181617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b780fffa0 0x7f3b78102380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/2288181617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b78066240 0x7f3b780ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 -- 172.21.15.134:0/2288181617 >> 172.21.15.134:0/2288181617 conn(0x7f3b780f7430 msgr2=0x7f3b780f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 -- 172.21.15.134:0/2288181617 shutdown_connections 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.820+0000 7f3b7fa03700 1 -- 172.21.15.134:0/2288181617 wait complete. 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7fa03700 1 Processor -- start 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7fa03700 1 -- start start 2024-03-22T07:24:44.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7fa03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 0x7f3b7810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7fa03700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b780fffa0 0x7f3b7810df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7fa03700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7810e580 con 0x7f3b78066240 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7fa03700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7810edd0 con 0x7f3b780fffa0 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7d79f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 0x7f3b7810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7d79f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 0x7f3b7810da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37842/0 (socket says 172.21.15.134:37842) 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7d79f700 1 -- 172.21.15.134:0/806514566 learned_addr learned my addr 172.21.15.134:0/806514566 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7cf9e700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b780fffa0 0x7f3b7810df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7d79f700 1 -- 172.21.15.134:0/806514566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b780fffa0 msgr2=0x7f3b7810df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7d79f700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b780fffa0 0x7f3b7810df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.821+0000 7f3b7d79f700 1 -- 172.21.15.134:0/806514566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68005040 con 0x7f3b78066240 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.822+0000 7f3b7d79f700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 0x7f3b7810da40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b70001ce0 tx=0x7f3b70009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.822+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7000db60 con 0x7f3b78066240 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.822+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7810f0b0 con 0x7f3b78066240 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.822+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b7000f040 con 0x7f3b78066240 2024-03-22T07:24:44.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.822+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b70009790 con 0x7f3b78066240 2024-03-22T07:24:44.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.822+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7810f5f0 con 0x7f3b78066240 2024-03-22T07:24:44.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.823+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3b70007920 con 0x7f3b78066240 2024-03-22T07:24:44.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.823+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7805f5f0 con 0x7f3b78066240 2024-03-22T07:24:44.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.824+0000 7f3b6dffb700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b640692b0 0x7f3b6406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:44.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.824+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3b700869e0 con 0x7f3b78066240 2024-03-22T07:24:44.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.824+0000 7f3b7cf9e700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b640692b0 0x7f3b6406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:44.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.824+0000 7f3b7cf9e700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b640692b0 0x7f3b6406b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b3b0 tx=0x7f3b68009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:44.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:44.828+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3b7004d190 con 0x7f3b78066240 2024-03-22T07:24:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:44 smithi195 ceph-mon[36144]: Detected new or changed devices on smithi195 2024-03-22T07:24:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:44 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi195 to 5312M 2024-03-22T07:24:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:44 smithi195 ceph-mon[36144]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:45.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.013+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f3b7804bed0 con 0x7f3b78066240 2024-03-22T07:24:45.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.014+0000 7f3b6dffb700 1 -- 172.21.15.134:0/806514566 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f3b70056af0 con 0x7f3b78066240 2024-03-22T07:24:45.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:24:45.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b640692b0 msgr2=0x7f3b6406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:45.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b640692b0 0x7f3b6406b760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800b3b0 tx=0x7f3b68009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:45.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 msgr2=0x7f3b7810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:45.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 0x7f3b7810da40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b70001ce0 tx=0x7f3b70009e60 comp rx=0 tx=0).stop 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 shutdown_connections 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b78066240 0x7f3b7810da40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b640692b0 0x7f3b6406b760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 --2- 172.21.15.134:0/806514566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b780fffa0 0x7f3b7810df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 >> 172.21.15.134:0/806514566 conn(0x7f3b780f7430 msgr2=0x7f3b780f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 shutdown_connections 2024-03-22T07:24:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:45.016+0000 7f3b7fa03700 1 -- 172.21.15.134:0/806514566 wait complete. 2024-03-22T07:24:45.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:45 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/806514566' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-22T07:24:45.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:45.716 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1711092281,"num_in_osds":6,"osd_in_since":1711092263,"num_remapped_pgs":0} 2024-03-22T07:24:45.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-22T07:24:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:45 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/806514566' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-22T07:24:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:24:46.012 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:46.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:46 smithi134 ceph-mon[29057]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:46 smithi195 ceph-mon[36144]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.589+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/3368640422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c40708a0 msgr2=0x7fa0c4070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.589+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/3368640422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c40708a0 0x7fa0c4070d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8004970 tx=0x7fa0b8009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.589+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/3368640422 shutdown_connections 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.589+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/3368640422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c40708a0 0x7fa0c4070d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/3368640422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0c4071f90 0x7fa0c4070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/3368640422 >> 172.21.15.134:0/3368640422 conn(0x7fa0c40f89b0 msgr2=0x7fa0c40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/3368640422 shutdown_connections 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/3368640422 wait complete. 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 Processor -- start 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 -- start start 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0c40708a0 0x7fa0c4119fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 0x7fa0c411a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:47.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c411ac00 con 0x7fa0c4071f90 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.590+0000 7fa0ca7ae700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c4114150 con 0x7fa0c40708a0 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 0x7fa0c411a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 0x7fa0c411a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37860/0 (socket says 172.21.15.134:37860) 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 -- 172.21.15.134:0/2341708228 learned_addr learned my addr 172.21.15.134:0/2341708228 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c3fff700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0c40708a0 0x7fa0c4119fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 -- 172.21.15.134:0/2341708228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0c40708a0 msgr2=0x7fa0c4119fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0c40708a0 0x7fa0c4119fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 -- 172.21.15.134:0/2341708228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8005040 con 0x7fa0c4071f90 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c37fe700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 0x7fa0c411a520 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b800e040 con 0x7fa0c4071f90 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c4114370 con 0x7fa0c4071f90 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0b800bce0 con 0x7fa0c4071f90 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0b801c630 con 0x7fa0c4071f90 2024-03-22T07:24:47.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.591+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c41148b0 con 0x7fa0c4071f90 2024-03-22T07:24:47.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.592+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c4071aa0 con 0x7fa0c4071f90 2024-03-22T07:24:47.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.593+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa0b8013980 con 0x7fa0c4071f90 2024-03-22T07:24:47.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.593+0000 7fa0c0ff9700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0ac0692a0 0x7fa0ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:47.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.593+0000 7fa0c3fff700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0ac0692a0 0x7fa0ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:47.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.593+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa0b80881b0 con 0x7fa0c4071f90 2024-03-22T07:24:47.594 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.594+0000 7fa0c3fff700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0ac0692a0 0x7fa0ac06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4006fd0 tx=0x7fa0b4008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:47.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.598+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa0b80582b0 con 0x7fa0c4071f90 2024-03-22T07:24:47.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.781+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0c404c710 con 0x7fa0c4071f90 2024-03-22T07:24:47.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.782+0000 7fa0c0ff9700 1 -- 172.21.15.134:0/2341708228 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11131 (secure 0 0 0) 0x7fa0b8057e40 con 0x7fa0c4071f90 2024-03-22T07:24:47.782 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:24:47.782 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":41,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:24:42.559195+0000","last_up_change":"2024-03-22T07:24:41.554325+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6803","nonce":565382143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6805","nonce":565382143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6809","nonce":565382143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6807","nonce":565382143}]},"public_addr":"172.21.15.134:6803/565382143","cluster_addr":"172.21.15.134:6805/565382143","heartbeat_back_addr":"172.21.15.134:6809/565382143","heartbeat_front_addr":"172.21.15.134:6807/565382143","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6811","nonce":3411767321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6813","nonce":3411767321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6817","nonce":3411767321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6815","nonce":3411767321}]},"public_addr":"172.21.15.134:6811/3411767321","cluster_addr":"172.21.15.134:6813/3411767321","heartbeat_back_addr":"172.21.15.134:6817/3411767321","heartbeat_front_addr":"172.21.15.134:6815/3411767321","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6819","nonce":3593450381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6821","nonce":3593450381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6825","nonce":3593450381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6823","nonce":3593450381}]},"public_addr":"172.21.15.134:6819/3593450381","cluster_addr":"172.21.15.134:6821/3593450381","heartbeat_back_addr":"172.21.15.134:6825/3593450381","heartbeat_front_addr":"172.21.15.134:6823/3593450381","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6801","nonce":2284673901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6803","nonce":2284673901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6807","nonce":2284673901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6805","nonce":2284673901}]},"public_addr":"172.21.15.195:6801/2284673901","cluster_addr":"172.21.15.195:6803/2284673901","heartbeat_back_addr":"172.21.15.195:6807/2284673901","heartbeat_front_addr":"172.21.15.195:6805/2284673901","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6809","nonce":2507607103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6811","nonce":2507607103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6815","nonce":2507607103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6813","nonce":2507607103}]},"public_addr":"172.21.15.195:6809/2507607103","cluster_addr":"172.21.15.195:6811/2507607103","heartbeat_back_addr":"172.21.15.195:6815/2507607103","heartbeat_front_addr":"172.21.15.195:6813/2507607103","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6817","nonce":1098061432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6819","nonce":1098061432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6823","nonce":1098061432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6821","nonce":1098061432}]},"public_addr":"172.21.15.195:6817/1098061432","cluster_addr":"172.21.15.195:6819/1098061432","heartbeat_back_addr":"172.21.15.195:6823/1098061432","heartbeat_front_addr":"172.21.15.195:6821/1098061432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:24:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0ac0692a0 msgr2=0x7fa0ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0ac0692a0 0x7fa0ac06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4006fd0 tx=0x7fa0b4008040 comp rx=0 tx=0).stop 2024-03-22T07:24:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 msgr2=0x7fa0c411a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 0x7fa0c411a520 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8000c00 tx=0x7fa0b8009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:47.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 shutdown_connections 2024-03-22T07:24:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0ac0692a0 0x7fa0ac06b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0c40708a0 0x7fa0c4119fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 --2- 172.21.15.134:0/2341708228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0c4071f90 0x7fa0c411a520 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 >> 172.21.15.134:0/2341708228 conn(0x7fa0c40f89b0 msgr2=0x7fa0c40f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 shutdown_connections 2024-03-22T07:24:47.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:47.784+0000 7fa0ca7ae700 1 -- 172.21.15.134:0/2341708228 wait complete. 2024-03-22T07:24:48.331 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-22T07:23:31.660944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-03-22T07:24:48.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-22T07:24:48.586 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:48 smithi134 ceph-mon[29057]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:48.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:48 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2341708228' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:24:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:48 smithi195 ceph-mon[36144]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:48 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2341708228' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 -- 172.21.15.134:0/772920033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 msgr2=0x7f56280fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 --2- 172.21.15.134:0/772920033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f56280fbb60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5620009ce0 tx=0x7f5620004d10 comp rx=0 tx=0).stop 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 -- 172.21.15.134:0/772920033 shutdown_connections 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 --2- 172.21.15.134:0/772920033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 0x7f562810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 --2- 172.21.15.134:0/772920033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f56280fbb60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 -- 172.21.15.134:0/772920033 >> 172.21.15.134:0/772920033 conn(0x7f5628071530 msgr2=0x7f5628071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 -- 172.21.15.134:0/772920033 shutdown_connections 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 -- 172.21.15.134:0/772920033 wait complete. 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 Processor -- start 2024-03-22T07:24:50.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.232+0000 7f562fcec700 1 -- start start 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562fcec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f562811a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562fcec700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 0x7f562811a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562fcec700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562811aca0 con 0x7f56280fb790 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562fcec700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56281142d0 con 0x7f56280fc0a0 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f562811a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f562811a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37880/0 (socket says 172.21.15.134:37880) 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 -- 172.21.15.134:0/4268094128 learned_addr learned my addr 172.21.15.134:0/4268094128 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562d287700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 0x7f562811a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 -- 172.21.15.134:0/4268094128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 msgr2=0x7f562811a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 0x7f562811a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 -- 172.21.15.134:0/4268094128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5620009940 con 0x7f56280fb790 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562d287700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 0x7f562811a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562da88700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f562811a110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f562000be90 tx=0x7f5620004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f562000e040 con 0x7f56280fb790 2024-03-22T07:24:50.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5628114550 con 0x7f56280fb790 2024-03-22T07:24:50.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5620008ea0 con 0x7f56280fb790 2024-03-22T07:24:50.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f562001c810 con 0x7f56280fb790 2024-03-22T07:24:50.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.233+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5628114a90 con 0x7f56280fb790 2024-03-22T07:24:50.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.234+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56280fe110 con 0x7f56280fb790 2024-03-22T07:24:50.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.235+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5620012c00 con 0x7f56280fb790 2024-03-22T07:24:50.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.235+0000 7f561e7fc700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f56140692a0 0x7f561406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:50.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.235+0000 7f562d287700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f56140692a0 0x7f561406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:50.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.235+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5620088ac0 con 0x7f56280fb790 2024-03-22T07:24:50.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.236+0000 7f562d287700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f56140692a0 0x7f561406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5618007fd0 tx=0x7f5618009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:50.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.240+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5620058b40 con 0x7f56280fb790 2024-03-22T07:24:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.426+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56280fc550 con 0x7f56280fb790 2024-03-22T07:24:50.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.426+0000 7f561e7fc700 1 -- 172.21.15.134:0/4268094128 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56280fc550 con 0x7f56280fb790 2024-03-22T07:24:50.427 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f56140692a0 msgr2=0x7f561406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f56140692a0 0x7f561406b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5618007fd0 tx=0x7f5618009040 comp rx=0 tx=0).stop 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 msgr2=0x7f562811a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f562811a110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f562000be90 tx=0x7f5620004d10 comp rx=0 tx=0).stop 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 shutdown_connections 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280fb790 0x7f562811a110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f56140692a0 0x7f561406b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 --2- 172.21.15.134:0/4268094128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56280fc0a0 0x7f562811a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.428+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 >> 172.21.15.134:0/4268094128 conn(0x7f5628071530 msgr2=0x7f5628101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.429+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 shutdown_connections 2024-03-22T07:24:50.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:50.429+0000 7f562fcec700 1 -- 172.21.15.134:0/4268094128 wait complete. 2024-03-22T07:24:50.734 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:50 smithi195 ceph-mon[36144]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:50.734 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:50 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/4268094128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:24:50.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:50 smithi134 ceph-mon[29057]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:50.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:50 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/4268094128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:24:51.174 INFO:tasks.cephadm:Setting up client nodes... 2024-03-22T07:24:51.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-22T07:24:51.434 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:52.761 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:52 smithi134 ceph-mon[29057]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:52 smithi195 ceph-mon[36144]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/434585746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fce80 msgr2=0x7f5fec0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/434585746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fce80 0x7f5fec0fd290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8004940 tx=0x7f5fe8009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/434585746 shutdown_connections 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/434585746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0fdff0 0x7f5fec0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/434585746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fce80 0x7f5fec0fd290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/434585746 >> 172.21.15.134:0/434585746 conn(0x7f5fec0f8540 msgr2=0x7f5fec0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/434585746 shutdown_connections 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/434585746 wait complete. 2024-03-22T07:24:52.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 Processor -- start 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.960+0000 7f5ff3b1f700 1 -- start start 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff3b1f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0fce80 0x7f5fec10d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff3b1f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 0x7f5fec10de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff3b1f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec10e490 con 0x7f5fec0fdff0 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff3b1f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec10e600 con 0x7f5fec0fce80 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 0x7f5fec10de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 0x7f5fec10de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37886/0 (socket says 172.21.15.134:37886) 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 -- 172.21.15.134:0/2874324447 learned_addr learned my addr 172.21.15.134:0/2874324447 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff18bb700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0fce80 0x7f5fec10d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 -- 172.21.15.134:0/2874324447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0fce80 msgr2=0x7f5fec10d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0fce80 0x7f5fec10d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 -- 172.21.15.134:0/2874324447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8005040 con 0x7f5fec0fdff0 2024-03-22T07:24:52.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.961+0000 7f5ff10ba700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 0x7f5fec10de90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc002a50 tx=0x7f5fdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.962+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fdc007cc0 con 0x7f5fec0fdff0 2024-03-22T07:24:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.962+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec113060 con 0x7f5fec0fdff0 2024-03-22T07:24:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.962+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fdc00f040 con 0x7f5fec0fdff0 2024-03-22T07:24:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.962+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fdc00da30 con 0x7f5fec0fdff0 2024-03-22T07:24:52.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.962+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec113620 con 0x7f5fec0fdff0 2024-03-22T07:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.963+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec04c710 con 0x7f5fec0fdff0 2024-03-22T07:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.963+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5fdc00db90 con 0x7f5fec0fdff0 2024-03-22T07:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.964+0000 7f5fe27fc700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5fd80692b0 0x7f5fd806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.964+0000 7f5ff18bb700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5fd80692b0 0x7f5fd806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.964+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5fdc086c00 con 0x7f5fec0fdff0 2024-03-22T07:24:52.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.964+0000 7f5ff18bb700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5fd80692b0 0x7f5fd806b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009fd0 tx=0x7f5fe8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:52.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:52.968+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5fdc08c020 con 0x7f5fec0fdff0 2024-03-22T07:24:53.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.231+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5fec113a50 con 0x7f5fec0fdff0 2024-03-22T07:24:53.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.236+0000 7f5fe27fc700 1 -- 172.21.15.134:0/2874324447 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5fdc0569f0 con 0x7f5fec0fdff0 2024-03-22T07:24:53.236 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-03-22T07:24:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQBFMv1lkrzlDRAAP+TUBRwXI6/5KNCMjpMM2g== 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5fd80692b0 msgr2=0x7f5fd806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5fd80692b0 0x7f5fd806b760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009fd0 tx=0x7f5fe8009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 msgr2=0x7f5fec10de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 0x7f5fec10de90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc002a50 tx=0x7f5fdc0046b0 comp rx=0 tx=0).stop 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 shutdown_connections 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5fd80692b0 0x7f5fd806b760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fec0fce80 0x7f5fec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 --2- 172.21.15.134:0/2874324447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fec0fdff0 0x7f5fec10de90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 >> 172.21.15.134:0/2874324447 conn(0x7f5fec0f8540 msgr2=0x7f5fec0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 shutdown_connections 2024-03-22T07:24:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:53.238+0000 7f5ff3b1f700 1 -- 172.21.15.134:0/2874324447 wait complete. 2024-03-22T07:24:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:53 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2874324447' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-22T07:24:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:53 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2874324447' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-22T07:24:53.850 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:24:53.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-22T07:24:53.850 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-22T07:24:53.892 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-22T07:24:53.924 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:53 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2874324447' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-22T07:24:53.924 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:53 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2874324447' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-22T07:24:54.156 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi195/config 2024-03-22T07:24:54.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:54 smithi195 ceph-mon[36144]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:55.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:54 smithi134 ceph-mon[29057]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- 172.21.15.195:0/1846063348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc0fff60 msgr2=0x7f3efc102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 --2- 172.21.15.195:0/1846063348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc0fff60 0x7f3efc102340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3eec004940 tx=0x7f3eec009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- 172.21.15.195:0/1846063348 shutdown_connections 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 --2- 172.21.15.195:0/1846063348 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc0fff60 0x7f3efc102340 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 --2- 172.21.15.195:0/1846063348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc066f30 0x7f3efc0ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- 172.21.15.195:0/1846063348 >> 172.21.15.195:0/1846063348 conn(0x7f3efc0f7430 msgr2=0x7f3efc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- 172.21.15.195:0/1846063348 shutdown_connections 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- 172.21.15.195:0/1846063348 wait complete. 2024-03-22T07:24:55.669 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 Processor -- start 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- start start 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 0x7f3efc10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0fff60 0x7f3efc10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc10e4d0 con 0x7f3efc0fff60 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.667+0000 7f3f03c47700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc10e640 con 0x7f3efc066f30 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 0x7f3efc10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 0x7f3efc10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:53774/0 (socket says 172.21.15.195:53774) 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 -- 172.21.15.195:0/2974215531 learned_addr learned my addr 172.21.15.195:0/2974215531 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f011e2700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0fff60 0x7f3efc10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 -- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0fff60 msgr2=0x7f3efc10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0fff60 0x7f3efc10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 -- 172.21.15.195:0/2974215531 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec005040 con 0x7f3efc066f30 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f019e3700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 0x7f3efc10d990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8002a80 tx=0x7f3ef8004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef8007cc0 con 0x7f3efc066f30 2024-03-22T07:24:55.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ef800f040 con 0x7f3efc066f30 2024-03-22T07:24:55.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc112ff0 con 0x7f3efc066f30 2024-03-22T07:24:55.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef800da30 con 0x7f3efc066f30 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.668+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc113580 con 0x7f3efc066f30 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.669+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc04c710 con 0x7f3efc066f30 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.670+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3ef800db90 con 0x7f3efc066f30 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.670+0000 7f3ef27fc700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3ee80692a0 0x7f3ee806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.670+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3ef8086b20 con 0x7f3efc066f30 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.670+0000 7f3f011e2700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3ee80692a0 0x7f3ee806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:55.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.671+0000 7f3f011e2700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3ee80692a0 0x7f3ee806b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00b970 tx=0x7f3eec009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:55.675 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.675+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3ef8056c20 con 0x7f3efc066f30 2024-03-22T07:24:55.935 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.934+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3efc113860 con 0x7f3efc066f30 2024-03-22T07:24:55.942 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.941+0000 7f3ef27fc700 1 -- 172.21.15.195:0/2974215531 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3ef80567b0 con 0x7f3efc066f30 2024-03-22T07:24:55.942 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-03-22T07:24:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBHMv1ly3DUNxAAdwbYJ5Y9MoKL1Vn32/sA7g== 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3ee80692a0 msgr2=0x7f3ee806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3ee80692a0 0x7f3ee806b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00b970 tx=0x7f3eec009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 msgr2=0x7f3efc10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 0x7f3efc10d990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8002a80 tx=0x7f3ef8004600 comp rx=0 tx=0).stop 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 shutdown_connections 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3ee80692a0 0x7f3ee806b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3efc066f30 0x7f3efc10d990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:55.944 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 --2- 172.21.15.195:0/2974215531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3efc0fff60 0x7f3efc10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:55.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 >> 172.21.15.195:0/2974215531 conn(0x7f3efc0f7430 msgr2=0x7f3efc0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:55.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 shutdown_connections 2024-03-22T07:24:55.945 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-22T07:24:55.943+0000 7f3f03c47700 1 -- 172.21.15.195:0/2974215531 wait complete. 2024-03-22T07:24:56.464 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:24:56.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-22T07:24:56.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-22T07:24:56.547 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-22T07:24:56.547 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-22T07:24:56.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph mgr dump --format=json 2024-03-22T07:24:56.813 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:56 smithi134 ceph-mon[29057]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:56 smithi134 ceph-mon[29057]: from='client.? 172.21.15.195:0/2974215531' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-22T07:24:56.934 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:56 smithi134 ceph-mon[29057]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-22T07:24:56.935 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:56 smithi134 ceph-mon[29057]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-22T07:24:56.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:56 smithi195 ceph-mon[36144]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:56.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:56 smithi195 ceph-mon[36144]: from='client.? 172.21.15.195:0/2974215531' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-22T07:24:56.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:56 smithi195 ceph-mon[36144]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-22T07:24:56.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:56 smithi195 ceph-mon[36144]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 -- 172.21.15.134:0/1868368362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8103780 msgr2=0x7f09d80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 --2- 172.21.15.134:0/1868368362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8103780 0x7f09d80fcdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f09c0004940 tx=0x7f09c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 -- 172.21.15.134:0/1868368362 shutdown_connections 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 --2- 172.21.15.134:0/1868368362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8103780 0x7f09d80fcdf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 --2- 172.21.15.134:0/1868368362 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8102de0 0x7f09d81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 -- 172.21.15.134:0/1868368362 >> 172.21.15.134:0/1868368362 conn(0x7f09d80f8970 msgr2=0x7f09d80fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 -- 172.21.15.134:0/1868368362 shutdown_connections 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.399+0000 7f09dd3df700 1 -- 172.21.15.134:0/1868368362 wait complete. 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09dd3df700 1 Processor -- start 2024-03-22T07:24:58.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09dd3df700 1 -- start start 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09dd3df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 0x7f09d80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09dd3df700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8103780 0x7f09d8070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09dd3df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8070dd0 con 0x7f09d8102de0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09dd3df700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8070f10 con 0x7f09d8103780 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 0x7f09d80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 0x7f09d80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46620/0 (socket says 172.21.15.134:46620) 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d6ffd700 1 -- 172.21.15.134:0/4212652246 learned_addr learned my addr 172.21.15.134:0/4212652246 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d67fc700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8103780 0x7f09d8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d6ffd700 1 -- 172.21.15.134:0/4212652246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8103780 msgr2=0x7f09d8070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d6ffd700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8103780 0x7f09d8070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d6ffd700 1 -- 172.21.15.134:0/4212652246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0005040 con 0x7f09d8102de0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.400+0000 7f09d67fc700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8103780 0x7f09d8070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.401+0000 7f09d6ffd700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 0x7f09d80702c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09c800b790 tx=0x7f09c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.401+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c800f770 con 0x7f09d8102de0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.401+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d8119ee0 con 0x7f09d8102de0 2024-03-22T07:24:58.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.401+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09c800fda0 con 0x7f09d8102de0 2024-03-22T07:24:58.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.401+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c800d310 con 0x7f09d8102de0 2024-03-22T07:24:58.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.401+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d811a3c0 con 0x7f09d8102de0 2024-03-22T07:24:58.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.402+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d81000f0 con 0x7f09d8102de0 2024-03-22T07:24:58.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.402+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f09c8010420 con 0x7f09d8102de0 2024-03-22T07:24:58.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.402+0000 7f09cf7fe700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f09c40692a0 0x7f09c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:24:58.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.403+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f09c8086e70 con 0x7f09d8102de0 2024-03-22T07:24:58.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.403+0000 7f09d67fc700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f09c40692a0 0x7f09c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:24:58.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.403+0000 7f09d67fc700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f09c40692a0 0x7f09c406b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009fd0 tx=0x7f09c0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:24:58.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.407+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f09c80534e0 con 0x7f09d8102de0 2024-03-22T07:24:58.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.646+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f09d804bed0 con 0x7f09d8102de0 2024-03-22T07:24:58.649 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.649+0000 7f09cf7fe700 1 -- 172.21.15.134:0/4212652246 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167176 (secure 0 0 0) 0x7f09c8056b00 con 0x7f09d8102de0 2024-03-22T07:24:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:24:58.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f09c40692a0 msgr2=0x7f09c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:58.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f09c40692a0 0x7f09c406b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009fd0 tx=0x7f09c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:24:58.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 msgr2=0x7f09d80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 0x7f09d80702c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f09c800b790 tx=0x7f09c8009250 comp rx=0 tx=0).stop 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 shutdown_connections 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102de0 0x7f09d80702c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f09c40692a0 0x7f09c406b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 --2- 172.21.15.134:0/4212652246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09d8103780 0x7f09d8070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.651+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 >> 172.21.15.134:0/4212652246 conn(0x7f09d80f8970 msgr2=0x7f09d8107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.652+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 shutdown_connections 2024-03-22T07:24:58.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:24:58.652+0000 7f09dd3df700 1 -- 172.21.15.134:0/4212652246 wait complete. 2024-03-22T07:24:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:58 smithi134 ceph-mon[29057]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:58 smithi195 ceph-mon[36144]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:24:59.357 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"active_gid":14210,"active_name":"smithi134.wtwqre","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1730667826},{"type":"v1","addr":"172.21.15.134:6801","nonce":1730667826}]},"active_addr":"172.21.15.134:6801/1730667826","active_change":"2024-03-22T07:21:15.331811+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14230,"name":"smithi195.jxfsnc","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.134:8443/","prometheus":"http://172.21.15.134:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2738175078}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3237607204}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":169043287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":114139606}]}]} 2024-03-22T07:24:59.360 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-22T07:24:59.360 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-22T07:24:59.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-22T07:24:59.619 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:24:59.924 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:24:59 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/4212652246' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-22T07:24:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:24:59 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/4212652246' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-22T07:25:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:00 smithi134 ceph-mon[29057]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:00 smithi195 ceph-mon[36144]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:01.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 -- 172.21.15.134:0/761035206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 msgr2=0x7f0ca4106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:01.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 --2- 172.21.15.134:0/761035206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4106e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c90004940 tx=0x7f0c90009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 -- 172.21.15.134:0/761035206 shutdown_connections 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 --2- 172.21.15.134:0/761035206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4106e20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 --2- 172.21.15.134:0/761035206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 0x7f0ca40fe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 -- 172.21.15.134:0/761035206 >> 172.21.15.134:0/761035206 conn(0x7f0ca40f7870 msgr2=0x7f0ca40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 -- 172.21.15.134:0/761035206 shutdown_connections 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.310+0000 7f0caacef700 1 -- 172.21.15.134:0/761035206 wait complete. 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0caacef700 1 Processor -- start 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0caacef700 1 -- start start 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0caacef700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 0x7f0ca41138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0caacef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0caacef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4114470 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0caacef700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca410da70 con 0x7f0ca40fde40 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46626/0 (socket says 172.21.15.134:46626) 2024-03-22T07:25:01.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca3fff700 1 -- 172.21.15.134:0/2595286169 learned_addr learned my addr 172.21.15.134:0/2595286169 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca8a8b700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 0x7f0ca41138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca3fff700 1 -- 172.21.15.134:0/2595286169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 msgr2=0x7f0ca41138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca3fff700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 0x7f0ca41138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca3fff700 1 -- 172.21.15.134:0/2595286169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90005040 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.311+0000 7f0ca8a8b700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 0x7f0ca41138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.312+0000 7f0ca3fff700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4113e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009380 tx=0x7f0c90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.312+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9000e040 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.312+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c90009af0 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.312+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca410dd50 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.312+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9001c630 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.312+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca410e290 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.313+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca4066b70 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.313+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f0c9000bbc0 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.314+0000 7f0ca17fa700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f0c940692a0 0x7f0c9406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.314+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0c90088110 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.314+0000 7f0ca8a8b700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f0c940692a0 0x7f0c9406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:01.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.314+0000 7f0ca8a8b700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f0c940692a0 0x7f0c9406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009fd0 tx=0x7f0c9800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:01.319 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.318+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0c90058210 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.504+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca410ef60 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.505+0000 7f0ca17fa700 1 -- 172.21.15.134:0/2595286169 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11131 (secure 0 0 0) 0x7f0c90057da0 con 0x7f0ca40fe7e0 2024-03-22T07:25:01.507 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:25:01.507 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":41,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:24:42.559195+0000","last_up_change":"2024-03-22T07:24:41.554325+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6803","nonce":565382143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6805","nonce":565382143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6809","nonce":565382143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6807","nonce":565382143}]},"public_addr":"172.21.15.134:6803/565382143","cluster_addr":"172.21.15.134:6805/565382143","heartbeat_back_addr":"172.21.15.134:6809/565382143","heartbeat_front_addr":"172.21.15.134:6807/565382143","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6811","nonce":3411767321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6813","nonce":3411767321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6817","nonce":3411767321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6815","nonce":3411767321}]},"public_addr":"172.21.15.134:6811/3411767321","cluster_addr":"172.21.15.134:6813/3411767321","heartbeat_back_addr":"172.21.15.134:6817/3411767321","heartbeat_front_addr":"172.21.15.134:6815/3411767321","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6819","nonce":3593450381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6821","nonce":3593450381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6825","nonce":3593450381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6823","nonce":3593450381}]},"public_addr":"172.21.15.134:6819/3593450381","cluster_addr":"172.21.15.134:6821/3593450381","heartbeat_back_addr":"172.21.15.134:6825/3593450381","heartbeat_front_addr":"172.21.15.134:6823/3593450381","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6801","nonce":2284673901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6803","nonce":2284673901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6807","nonce":2284673901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6805","nonce":2284673901}]},"public_addr":"172.21.15.195:6801/2284673901","cluster_addr":"172.21.15.195:6803/2284673901","heartbeat_back_addr":"172.21.15.195:6807/2284673901","heartbeat_front_addr":"172.21.15.195:6805/2284673901","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6809","nonce":2507607103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6811","nonce":2507607103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6815","nonce":2507607103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6813","nonce":2507607103}]},"public_addr":"172.21.15.195:6809/2507607103","cluster_addr":"172.21.15.195:6811/2507607103","heartbeat_back_addr":"172.21.15.195:6815/2507607103","heartbeat_front_addr":"172.21.15.195:6813/2507607103","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6817","nonce":1098061432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6819","nonce":1098061432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6823","nonce":1098061432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6821","nonce":1098061432}]},"public_addr":"172.21.15.195:6817/1098061432","cluster_addr":"172.21.15.195:6819/1098061432","heartbeat_back_addr":"172.21.15.195:6823/1098061432","heartbeat_front_addr":"172.21.15.195:6821/1098061432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f0c940692a0 msgr2=0x7f0c9406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f0c940692a0 0x7f0c9406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009fd0 tx=0x7f0c9800b040 comp rx=0 tx=0).stop 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 msgr2=0x7f0ca4113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4113e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009380 tx=0x7f0c90009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 shutdown_connections 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f0c940692a0 0x7f0c9406b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ca40fde40 0x7f0ca41138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 --2- 172.21.15.134:0/2595286169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca40fe7e0 0x7f0ca4113e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 >> 172.21.15.134:0/2595286169 conn(0x7f0ca40f7870 msgr2=0x7f0ca40f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 shutdown_connections 2024-03-22T07:25:01.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:01.507+0000 7f0caacef700 1 -- 172.21.15.134:0/2595286169 wait complete. 2024-03-22T07:25:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:01 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2595286169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:25:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:01 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2595286169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:25:02.101 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-22T07:25:02.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-22T07:25:02.356 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:02.779 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:02 smithi134 ceph-mon[29057]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:02 smithi195 ceph-mon[36144]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:04.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3945015381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fe820 msgr2=0x7fc2c0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:04.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3945015381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fe820 0x7fc2c0106e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0004940 tx=0x7fc2b0009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3945015381 shutdown_connections 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3945015381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fe820 0x7fc2c0106e60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3945015381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fde80 0x7fc2c00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3945015381 >> 172.21.15.134:0/3945015381 conn(0x7fc2c00f78b0 msgr2=0x7fc2c00f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3945015381 shutdown_connections 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3945015381 wait complete. 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 Processor -- start 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.031+0000 7fc2c74ff700 1 -- start start 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c74ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 0x7fc2c01138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c74ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fe820 0x7fc2c0113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c74ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0114480 con 0x7fc2c00fde80 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c74ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c010da80 con 0x7fc2c00fe820 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 0x7fc2c01138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 0x7fc2c01138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59270/0 (socket says 172.21.15.134:59270) 2024-03-22T07:25:04.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 -- 172.21.15.134:0/3727235989 learned_addr learned my addr 172.21.15.134:0/3727235989 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c4a9a700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fe820 0x7fc2c0113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 -- 172.21.15.134:0/3727235989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fe820 msgr2=0x7fc2c0113e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fe820 0x7fc2c0113e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 -- 172.21.15.134:0/3727235989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0005040 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c4a9a700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fe820 0x7fc2c0113e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c529b700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 0x7fc2c01138f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc002a50 tx=0x7fc2bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2bc007cc0 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c010dd60 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2bc00f040 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.032+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2bc009640 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.033+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c010e2a0 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.033+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c0066b10 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.034+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc2bc0097a0 con 0x7fc2c00fde80 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.034+0000 7fc2b5ffb700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc2ac0692a0 0x7fc2ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:04.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.034+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc2bc086c80 con 0x7fc2c00fde80 2024-03-22T07:25:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.034+0000 7fc2c4a9a700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc2ac0692a0 0x7fc2ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.035+0000 7fc2c4a9a700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc2ac0692a0 0x7fc2ac06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2c010ec40 tx=0x7fc2b0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:04.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.039+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc2bc056d00 con 0x7fc2c00fde80 2024-03-22T07:25:04.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.225+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2c0109e40 con 0x7fc2c00fde80 2024-03-22T07:25:04.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.226+0000 7fc2b5ffb700 1 -- 172.21.15.134:0/3727235989 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11131 (secure 0 0 0) 0x7fc2bc056890 con 0x7fc2c00fde80 2024-03-22T07:25:04.227 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:25:04.228 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":41,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:24:42.559195+0000","last_up_change":"2024-03-22T07:24:41.554325+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6803","nonce":565382143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6805","nonce":565382143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6809","nonce":565382143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6807","nonce":565382143}]},"public_addr":"172.21.15.134:6803/565382143","cluster_addr":"172.21.15.134:6805/565382143","heartbeat_back_addr":"172.21.15.134:6809/565382143","heartbeat_front_addr":"172.21.15.134:6807/565382143","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6811","nonce":3411767321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6813","nonce":3411767321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6817","nonce":3411767321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6815","nonce":3411767321}]},"public_addr":"172.21.15.134:6811/3411767321","cluster_addr":"172.21.15.134:6813/3411767321","heartbeat_back_addr":"172.21.15.134:6817/3411767321","heartbeat_front_addr":"172.21.15.134:6815/3411767321","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6819","nonce":3593450381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6821","nonce":3593450381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6825","nonce":3593450381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6823","nonce":3593450381}]},"public_addr":"172.21.15.134:6819/3593450381","cluster_addr":"172.21.15.134:6821/3593450381","heartbeat_back_addr":"172.21.15.134:6825/3593450381","heartbeat_front_addr":"172.21.15.134:6823/3593450381","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6801","nonce":2284673901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6803","nonce":2284673901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6807","nonce":2284673901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6805","nonce":2284673901}]},"public_addr":"172.21.15.195:6801/2284673901","cluster_addr":"172.21.15.195:6803/2284673901","heartbeat_back_addr":"172.21.15.195:6807/2284673901","heartbeat_front_addr":"172.21.15.195:6805/2284673901","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6809","nonce":2507607103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6811","nonce":2507607103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6815","nonce":2507607103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6813","nonce":2507607103}]},"public_addr":"172.21.15.195:6809/2507607103","cluster_addr":"172.21.15.195:6811/2507607103","heartbeat_back_addr":"172.21.15.195:6815/2507607103","heartbeat_front_addr":"172.21.15.195:6813/2507607103","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6817","nonce":1098061432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6819","nonce":1098061432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6823","nonce":1098061432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6821","nonce":1098061432}]},"public_addr":"172.21.15.195:6817/1098061432","cluster_addr":"172.21.15.195:6819/1098061432","heartbeat_back_addr":"172.21.15.195:6823/1098061432","heartbeat_front_addr":"172.21.15.195:6821/1098061432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.228+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc2ac0692a0 msgr2=0x7fc2ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.228+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc2ac0692a0 0x7fc2ac06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2c010ec40 tx=0x7fc2b0009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.228+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 msgr2=0x7fc2c01138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.228+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 0x7fc2c01138f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc002a50 tx=0x7fc2bc0046b0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 shutdown_connections 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2c00fde80 0x7fc2c01138f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc2ac0692a0 0x7fc2ac06b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 --2- 172.21.15.134:0/3727235989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2c00fe820 0x7fc2c0113e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 >> 172.21.15.134:0/3727235989 conn(0x7fc2c00f78b0 msgr2=0x7fc2c00f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 shutdown_connections 2024-03-22T07:25:04.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:04.229+0000 7fc2c74ff700 1 -- 172.21.15.134:0/3727235989 wait complete. 2024-03-22T07:25:04.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:04 smithi134 ceph-mon[29057]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:04.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:04 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3727235989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:25:04.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-22T07:25:04.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-22T07:25:04.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-22T07:25:04.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-22T07:25:04.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-22T07:25:04.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-22T07:25:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:04 smithi195 ceph-mon[36144]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:04 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3727235989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:25:05.145 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:05.147 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:06.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:06 smithi134 ceph-mon[29057]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:06.886 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:06.887 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:06.887 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:06.888 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:06 smithi195 ceph-mon[36144]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:08.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:08 smithi134 ceph-mon[29057]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:08.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:08 smithi195 ceph-mon[36144]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.050+0000 7f7468465700 1 -- 172.21.15.134:0/79771085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 msgr2=0x7f74600fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.050+0000 7f7468465700 1 --2- 172.21.15.134:0/79771085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f74600fbd20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7450004940 tx=0x7f7450009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- 172.21.15.134:0/79771085 shutdown_connections 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 --2- 172.21.15.134:0/79771085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f74600fbd20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 --2- 172.21.15.134:0/79771085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7460101d10 0x7f74601020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- 172.21.15.134:0/79771085 >> 172.21.15.134:0/79771085 conn(0x7f74600f7880 msgr2=0x7f74600f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- 172.21.15.134:0/79771085 shutdown_connections 2024-03-22T07:25:09.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- 172.21.15.134:0/79771085 wait complete. 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 Processor -- start 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- start start 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7460101d10 0x7f746010ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f746010f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746010fab0 con 0x7f74601026b0 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.051+0000 7f7468465700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746010fbf0 con 0x7f7460101d10 2024-03-22T07:25:09.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f746010f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f746010f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59288/0 (socket says 172.21.15.134:59288) 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 -- 172.21.15.134:0/1728290275 learned_addr learned my addr 172.21.15.134:0/1728290275 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 -- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7460101d10 msgr2=0x7f746010ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7466201700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7460101d10 0x7f746010ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7460101d10 0x7f746010ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 -- 172.21.15.134:0/1728290275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450005040 con 0x7f74601026b0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7465a00700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f746010f3d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7450009180 tx=0x7f7450009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745000e040 con 0x7f74601026b0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f745000bbc0 con 0x7f74601026b0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7460117f00 con 0x7f74601026b0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745001c3f0 con 0x7f74601026b0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.052+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7460118490 con 0x7f74601026b0 2024-03-22T07:25:09.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.053+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74600fd460 con 0x7f74601026b0 2024-03-22T07:25:09.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f745000bd30 con 0x7f74601026b0 2024-03-22T07:25:09.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7456ffd700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f744c0692a0 0x7f744c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:09.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7466201700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f744c0692a0 0x7f744c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7450088190 con 0x7f74601026b0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7456ffd700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] conn(0x7f744c06efc0 0x7f744c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 --> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f744c071a80 con 0x7f744c06efc0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f745008a780 con 0x7f74601026b0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.054+0000 7f7466201700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f744c0692a0 0x7f744c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f745c007f30 tx=0x7f745c007420 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.055+0000 7f7466a02700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] conn(0x7f744c06efc0 0x7f744c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.055+0000 7f7466a02700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] conn(0x7f744c06efc0 0x7f744c0713d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:09.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.056+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== osd.3 v2:172.21.15.195:6800/2284673901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f744c071a80 con 0x7f744c06efc0 2024-03-22T07:25:09.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.070+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 --> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f74600f9170 con 0x7f744c06efc0 2024-03-22T07:25:09.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7456ffd700 1 -- 172.21.15.134:0/1728290275 <== osd.3 v2:172.21.15.195:6800/2284673901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f74600f9170 con 0x7f744c06efc0 2024-03-22T07:25:09.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] conn(0x7f744c06efc0 msgr2=0x7f744c0713d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:09.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] conn(0x7f744c06efc0 0x7f744c0713d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f744c0692a0 msgr2=0x7f744c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:09.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f744c0692a0 0x7f744c06b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f745c007f30 tx=0x7f745c007420 comp rx=0 tx=0).stop 2024-03-22T07:25:09.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 msgr2=0x7f746010f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:09.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.071+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f746010f3d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7450009180 tx=0x7f7450009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 shutdown_connections 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:6800/2284673901,v1:172.21.15.195:6801/2284673901] conn(0x7f744c06efc0 0x7f744c0713d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f744c0692a0 0x7f744c06b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7460101d10 0x7f746010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 --2- 172.21.15.134:0/1728290275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74601026b0 0x7f746010f3d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 >> 172.21.15.134:0/1728290275 conn(0x7f74600f7880 msgr2=0x7f74600f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 shutdown_connections 2024-03-22T07:25:09.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:09.072+0000 7f7468465700 1 -- 172.21.15.134:0/1728290275 wait complete. 2024-03-22T07:25:10.752 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:10 smithi134 ceph-mon[29057]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:10 smithi195 ceph-mon[36144]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:11.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 -- 172.21.15.134:0/3642097903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b58102e10 msgr2=0x7f3b581031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:11.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 --2- 172.21.15.134:0/3642097903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b58102e10 0x7f3b581031e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b48004940 tx=0x7f3b48009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:11.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 -- 172.21.15.134:0/3642097903 shutdown_connections 2024-03-22T07:25:11.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 --2- 172.21.15.134:0/3642097903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b581037b0 0x7f3b580fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 --2- 172.21.15.134:0/3642097903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b58102e10 0x7f3b581031e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 -- 172.21.15.134:0/3642097903 >> 172.21.15.134:0/3642097903 conn(0x7f3b580f8980 msgr2=0x7f3b580fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:11.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 -- 172.21.15.134:0/3642097903 shutdown_connections 2024-03-22T07:25:11.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 -- 172.21.15.134:0/3642097903 wait complete. 2024-03-22T07:25:11.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.269+0000 7f3b5d398700 1 Processor -- start 2024-03-22T07:25:11.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 -- start start 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b58102e10 0x7f3b58113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 0x7f3b581140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58114730 con 0x7f3b581037b0 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5810db40 con 0x7f3b58102e10 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 0x7f3b581140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 0x7f3b581140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59304/0 (socket says 172.21.15.134:59304) 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 -- 172.21.15.134:0/4093354347 learned_addr learned my addr 172.21.15.134:0/4093354347 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b56ffd700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b58102e10 0x7f3b58113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 -- 172.21.15.134:0/4093354347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b58102e10 msgr2=0x7f3b58113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b58102e10 0x7f3b58113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 -- 172.21.15.134:0/4093354347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48005040 con 0x7f3b581037b0 2024-03-22T07:25:11.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b567fc700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 0x7f3b581140e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c002a50 tx=0x7f3b4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b4c007cc0 con 0x7f3b581037b0 2024-03-22T07:25:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b4c00f040 con 0x7f3b581037b0 2024-03-22T07:25:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5810de20 con 0x7f3b581037b0 2024-03-22T07:25:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b4c00daf0 con 0x7f3b581037b0 2024-03-22T07:25:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.270+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5810e3e0 con 0x7f3b581037b0 2024-03-22T07:25:11.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.271+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b5810e8c0 con 0x7f3b581037b0 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3b4c009810 con 0x7f3b581037b0 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b3f7fe700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b400692a0 0x7f3b4006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3b4c086bf0 con 0x7f3b581037b0 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b56ffd700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b400692a0 0x7f3b4006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b3f7fe700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] conn(0x7f3b4006ef70 0x7f3b40071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 --> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b40071a30 con 0x7f3b4006ef70 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.272+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b4c08b220 con 0x7f3b581037b0 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.273+0000 7f3b577fe700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] conn(0x7f3b4006ef70 0x7f3b40071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:11.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.273+0000 7f3b56ffd700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b400692a0 0x7f3b4006b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b48004f90 tx=0x7f3b48009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.273+0000 7f3b577fe700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] conn(0x7f3b4006ef70 0x7f3b40071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:11.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.274+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== osd.0 v2:172.21.15.134:6802/565382143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3b40071a30 con 0x7f3b4006ef70 2024-03-22T07:25:11.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.288+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 --> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b5805e6c0 con 0x7f3b4006ef70 2024-03-22T07:25:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.288+0000 7f3b3f7fe700 1 -- 172.21.15.134:0/4093354347 <== osd.0 v2:172.21.15.134:6802/565382143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b5805e6c0 con 0x7f3b4006ef70 2024-03-22T07:25:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] conn(0x7f3b4006ef70 msgr2=0x7f3b40071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:11.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] conn(0x7f3b4006ef70 0x7f3b40071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b400692a0 msgr2=0x7f3b4006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b400692a0 0x7f3b4006b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b48004f90 tx=0x7f3b48009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 msgr2=0x7f3b581140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 0x7f3b581140e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c002a50 tx=0x7f3b4c004600 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 shutdown_connections 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6802/565382143,v1:172.21.15.134:6803/565382143] conn(0x7f3b4006ef70 0x7f3b40071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3b400692a0 0x7f3b4006b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b58102e10 0x7f3b58113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 --2- 172.21.15.134:0/4093354347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b581037b0 0x7f3b581140e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 >> 172.21.15.134:0/4093354347 conn(0x7f3b580f8980 msgr2=0x7f3b58107400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 shutdown_connections 2024-03-22T07:25:11.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:11.289+0000 7f3b5d398700 1 -- 172.21.15.134:0/4093354347 wait complete. 2024-03-22T07:25:12.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:12 smithi134 ceph-mon[29057]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:12.821 INFO:teuthology.orchestra.run.smithi134.stdout:115964117011 2024-03-22T07:25:12.821 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-22T07:25:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:12 smithi195 ceph-mon[36144]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.017+0000 7fe9278ab700 1 -- 172.21.15.134:0/346863863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9200fb420 msgr2=0x7fe9200fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.017+0000 7fe9278ab700 1 --2- 172.21.15.134:0/346863863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9200fb420 0x7fe9200fb890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe910004940 tx=0x7fe910009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.017+0000 7fe9278ab700 1 -- 172.21.15.134:0/346863863 shutdown_connections 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.017+0000 7fe9278ab700 1 --2- 172.21.15.134:0/346863863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9200fb420 0x7fe9200fb890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.017+0000 7fe9278ab700 1 --2- 172.21.15.134:0/346863863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe920102ea0 0x7fe920103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.017+0000 7fe9278ab700 1 -- 172.21.15.134:0/346863863 >> 172.21.15.134:0/346863863 conn(0x7fe920072380 msgr2=0x7fe920072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 -- 172.21.15.134:0/346863863 shutdown_connections 2024-03-22T07:25:13.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 -- 172.21.15.134:0/346863863 wait complete. 2024-03-22T07:25:13.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 Processor -- start 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 -- start start 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9200fb420 0x7fe920113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 0x7fe920113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201144c0 con 0x7fe920102ea0 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe9278ab700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92010dac0 con 0x7fe9200fb420 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe924e46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 0x7fe920113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe924e46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 0x7fe920113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59310/0 (socket says 172.21.15.134:59310) 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.018+0000 7fe924e46700 1 -- 172.21.15.134:0/967057914 learned_addr learned my addr 172.21.15.134:0/967057914 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe925647700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9200fb420 0x7fe920113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe924e46700 1 -- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9200fb420 msgr2=0x7fe920113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe924e46700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9200fb420 0x7fe920113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe924e46700 1 -- 172.21.15.134:0/967057914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910005040 con 0x7fe920102ea0 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe924e46700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 0x7fe920113e70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe91000b8b0 tx=0x7fe910009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91000e040 con 0x7fe920102ea0 2024-03-22T07:25:13.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92010dd40 con 0x7fe920102ea0 2024-03-22T07:25:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe910004290 con 0x7fe920102ea0 2024-03-22T07:25:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91001c3f0 con 0x7fe920102ea0 2024-03-22T07:25:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.019+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92010e300 con 0x7fe920102ea0 2024-03-22T07:25:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.020+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe92010e8e0 con 0x7fe920102ea0 2024-03-22T07:25:13.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.021+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe91000baf0 con 0x7fe920102ea0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.021+0000 7fe915ffb700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe90c0692a0 0x7fe90c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.022+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe910088030 con 0x7fe920102ea0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.022+0000 7fe915ffb700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] conn(0x7fe90c06ef70 0x7fe90c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.022+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 --> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe90c071a30 con 0x7fe90c06ef70 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.022+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe91008a620 con 0x7fe920102ea0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.022+0000 7fe925647700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe90c0692a0 0x7fe90c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.022+0000 7fe925e48700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] conn(0x7fe90c06ef70 0x7fe90c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.023+0000 7fe925647700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe90c0692a0 0x7fe90c06b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe920065b90 tx=0x7fe91c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.023+0000 7fe925e48700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] conn(0x7fe90c06ef70 0x7fe90c071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:13.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.024+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== osd.4 v2:172.21.15.195:6808/2507607103 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe90c071a30 con 0x7fe90c06ef70 2024-03-22T07:25:13.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.039+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 --> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe92005e6c0 con 0x7fe90c06ef70 2024-03-22T07:25:13.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.039+0000 7fe915ffb700 1 -- 172.21.15.134:0/967057914 <== osd.4 v2:172.21.15.195:6808/2507607103 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe92005e6c0 con 0x7fe90c06ef70 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] conn(0x7fe90c06ef70 msgr2=0x7fe90c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] conn(0x7fe90c06ef70 0x7fe90c071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe90c0692a0 msgr2=0x7fe90c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe90c0692a0 0x7fe90c06b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe920065b90 tx=0x7fe91c009040 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 msgr2=0x7fe920113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 0x7fe920113e70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe91000b8b0 tx=0x7fe910009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 shutdown_connections 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:6808/2507607103,v1:172.21.15.195:6809/2507607103] conn(0x7fe90c06ef70 0x7fe90c071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe90c0692a0 0x7fe90c06b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9200fb420 0x7fe920113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 --2- 172.21.15.134:0/967057914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe920102ea0 0x7fe920113e70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 >> 172.21.15.134:0/967057914 conn(0x7fe920072380 msgr2=0x7fe9200fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 shutdown_connections 2024-03-22T07:25:13.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:13.040+0000 7fe9278ab700 1 -- 172.21.15.134:0/967057914 wait complete. 2024-03-22T07:25:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 -- 172.21.15.134:0/2989974450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e81026c0 msgr2=0x7fe6e80fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/2989974450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e81026c0 0x7fe6e80fbd30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4004940 tx=0x7fe6d4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 -- 172.21.15.134:0/2989974450 shutdown_connections 2024-03-22T07:25:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/2989974450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e81026c0 0x7fe6e80fbd30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/2989974450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6e8101d20 0x7fe6e81020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 -- 172.21.15.134:0/2989974450 >> 172.21.15.134:0/2989974450 conn(0x7fe6e80f7870 msgr2=0x7fe6e80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.475+0000 7fe6ef08d700 1 -- 172.21.15.134:0/2989974450 shutdown_connections 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 -- 172.21.15.134:0/2989974450 wait complete. 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 Processor -- start 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 -- start start 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 0x7fe6e8113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6e81026c0 0x7fe6e8113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81144f0 con 0x7fe6e8101d20 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ef08d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e810db40 con 0x7fe6e81026c0 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ece29700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 0x7fe6e8113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ece29700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 0x7fe6e8113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34758/0 (socket says 172.21.15.134:34758) 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.476+0000 7fe6ece29700 1 -- 172.21.15.134:0/1197183730 learned_addr learned my addr 172.21.15.134:0/1197183730 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6e7fff700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6e81026c0 0x7fe6e8113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:14.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6ece29700 1 -- 172.21.15.134:0/1197183730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6e81026c0 msgr2=0x7fe6e8113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6ece29700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6e81026c0 0x7fe6e8113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6ece29700 1 -- 172.21.15.134:0/1197183730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d4005040 con 0x7fe6e8101d20 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6ece29700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 0x7fe6e8113a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc002a50 tx=0x7fe6dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc007cc0 con 0x7fe6e8101d20 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6dc00f040 con 0x7fe6e8101d20 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e810de20 con 0x7fe6e8101d20 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc00da30 con 0x7fe6e8101d20 2024-03-22T07:25:14.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.477+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e810e3b0 con 0x7fe6e8101d20 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.478+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6e810e970 con 0x7fe6e8101d20 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.478+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe6dc00dbb0 con 0x7fe6e8101d20 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e57fa700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe6d80692a0 0x7fe6d806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe6dc086b40 con 0x7fe6e8101d20 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e7fff700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe6d80692a0 0x7fe6d806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e57fa700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] conn(0x7fe6d806ef70 0x7fe6d8071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:14.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 --> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6d8071a30 con 0x7fe6d806ef70 2024-03-22T07:25:14.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6dc08b220 con 0x7fe6e8101d20 2024-03-22T07:25:14.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6ed62a700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] conn(0x7fe6d806ef70 0x7fe6d8071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:14.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.479+0000 7fe6e7fff700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe6d80692a0 0x7fe6d806b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4004890 tx=0x7fe6d4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:14.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.480+0000 7fe6ed62a700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] conn(0x7fe6d806ef70 0x7fe6d8071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:14.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.480+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== osd.1 v2:172.21.15.134:6810/3411767321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe6d8071a30 con 0x7fe6d806ef70 2024-03-22T07:25:14.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.496+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 --> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6e810dfb0 con 0x7fe6d806ef70 2024-03-22T07:25:14.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6e57fa700 1 -- 172.21.15.134:0/1197183730 <== osd.1 v2:172.21.15.134:6810/3411767321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6e810dfb0 con 0x7fe6d806ef70 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] conn(0x7fe6d806ef70 msgr2=0x7fe6d8071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] conn(0x7fe6d806ef70 0x7fe6d8071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe6d80692a0 msgr2=0x7fe6d806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe6d80692a0 0x7fe6d806b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4004890 tx=0x7fe6d4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 msgr2=0x7fe6e8113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 0x7fe6e8113a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc002a50 tx=0x7fe6dc0046b0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 shutdown_connections 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6e8101d20 0x7fe6e8113a00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6810/3411767321,v1:172.21.15.134:6811/3411767321] conn(0x7fe6d806ef70 0x7fe6d8071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe6d80692a0 0x7fe6d806b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 --2- 172.21.15.134:0/1197183730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6e81026c0 0x7fe6e8113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 >> 172.21.15.134:0/1197183730 conn(0x7fe6e80f7870 msgr2=0x7fe6e8066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 shutdown_connections 2024-03-22T07:25:14.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:14.497+0000 7fe6ef08d700 1 -- 172.21.15.134:0/1197183730 wait complete. 2024-03-22T07:25:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:14 smithi134 ceph-mon[29057]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:14 smithi195 ceph-mon[36144]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:14.961 INFO:teuthology.orchestra.run.smithi134.stdout:38654705699 2024-03-22T07:25:14.962 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-22T07:25:15.648 INFO:teuthology.orchestra.run.smithi134.stdout:60129542174 2024-03-22T07:25:15.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-22T07:25:15.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 -- 172.21.15.134:0/176459181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528065620 msgr2=0x7f2528065a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:15.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 --2- 172.21.15.134:0/176459181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528065620 0x7f2528065a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2514004940 tx=0x7f2514009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:15.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 -- 172.21.15.134:0/176459181 shutdown_connections 2024-03-22T07:25:15.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 --2- 172.21.15.134:0/176459181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528065620 0x7f2528065a90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 --2- 172.21.15.134:0/176459181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2528102c40 0x7f2528103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 -- 172.21.15.134:0/176459181 >> 172.21.15.134:0/176459181 conn(0x7f2528071b70 msgr2=0x7f2528071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 -- 172.21.15.134:0/176459181 shutdown_connections 2024-03-22T07:25:15.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 -- 172.21.15.134:0/176459181 wait complete. 2024-03-22T07:25:15.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 Processor -- start 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.826+0000 7f252d9a2700 1 -- start start 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f252d9a2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2528065620 0x7f2528113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f252d9a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 0x7f2528113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f252d9a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25281145a0 con 0x7f2528102c40 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f252d9a2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252810d990 con 0x7f2528065620 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 0x7f2528113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 0x7f2528113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34778/0 (socket says 172.21.15.134:34778) 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f252c9a0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2528065620 0x7f2528113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 -- 172.21.15.134:0/1198663877 learned_addr learned my addr 172.21.15.134:0/1198663877 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 -- 172.21.15.134:0/1198663877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2528065620 msgr2=0x7f2528113a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:15.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2528065620 0x7f2528113a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 -- 172.21.15.134:0/1198663877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514005040 con 0x7f2528102c40 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.827+0000 7f2527fff700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 0x7f2528113f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f251400b3b0 tx=0x7f2514009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.828+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251400e040 con 0x7f2528102c40 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.828+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2514013420 con 0x7f2528102c40 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.828+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f251401c630 con 0x7f2528102c40 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.828+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252810dc10 con 0x7f2528102c40 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.828+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252810e150 con 0x7f2528102c40 2024-03-22T07:25:15.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.829+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f252810e660 con 0x7f2528102c40 2024-03-22T07:25:15.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.829+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2514013590 con 0x7f2528102c40 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f25257fa700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f25180692a0 0x7f251806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f25140889c0 con 0x7f2528102c40 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f252c9a0700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f25180692a0 0x7f251806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f25257fa700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] conn(0x7f251806ef70 0x7f2518071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 --> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2518071a30 con 0x7f251806ef70 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2514088dc0 con 0x7f2528102c40 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f252d1a1700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] conn(0x7f251806ef70 0x7f2518071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f252c9a0700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f25180692a0 0x7f251806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f251c004f40 tx=0x7f251c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.830+0000 7f252d1a1700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] conn(0x7f251806ef70 0x7f2518071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:15.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.831+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== osd.2 v2:172.21.15.134:6818/3593450381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2518071a30 con 0x7f251806ef70 2024-03-22T07:25:15.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.847+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 --> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2528107300 con 0x7f251806ef70 2024-03-22T07:25:15.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.847+0000 7f25257fa700 1 -- 172.21.15.134:0/1198663877 <== osd.2 v2:172.21.15.134:6818/3593450381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2528107300 con 0x7f251806ef70 2024-03-22T07:25:15.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] conn(0x7f251806ef70 msgr2=0x7f2518071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:15.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] conn(0x7f251806ef70 0x7f2518071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f25180692a0 msgr2=0x7f251806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f25180692a0 0x7f251806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f251c004f40 tx=0x7f251c00b040 comp rx=0 tx=0).stop 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 msgr2=0x7f2528113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 0x7f2528113f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f251400b3b0 tx=0x7f2514009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 shutdown_connections 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6818/3593450381,v1:172.21.15.134:6819/3593450381] conn(0x7f251806ef70 0x7f2518071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f25180692a0 0x7f251806b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2528065620 0x7f2528113a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 --2- 172.21.15.134:0/1198663877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2528102c40 0x7f2528113f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 >> 172.21.15.134:0/1198663877 conn(0x7f2528071b70 msgr2=0x7f25281059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 shutdown_connections 2024-03-22T07:25:15.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:15.848+0000 7f252d9a2700 1 -- 172.21.15.134:0/1198663877 wait complete. 2024-03-22T07:25:15.925 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.024+0000 7feef0665700 1 -- 172.21.15.134:0/127581921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 msgr2=0x7feee81031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.024+0000 7feef0665700 1 --2- 172.21.15.134:0/127581921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee81031e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feee4004940 tx=0x7feee4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.025+0000 7feef0665700 1 -- 172.21.15.134:0/127581921 shutdown_connections 2024-03-22T07:25:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.025+0000 7feef0665700 1 --2- 172.21.15.134:0/127581921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 0x7feee80fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.025+0000 7feef0665700 1 --2- 172.21.15.134:0/127581921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee81031e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.025 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.025+0000 7feef0665700 1 -- 172.21.15.134:0/127581921 >> 172.21.15.134:0/127581921 conn(0x7feee80f89a0 msgr2=0x7feee80fadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:16.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.025+0000 7feef0665700 1 -- 172.21.15.134:0/127581921 shutdown_connections 2024-03-22T07:25:16.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.025+0000 7feef0665700 1 -- 172.21.15.134:0/127581921 wait complete. 2024-03-22T07:25:16.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feef0665700 1 Processor -- start 2024-03-22T07:25:16.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feef0665700 1 -- start start 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feef0665700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee8113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feef0665700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 0x7feee81140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feef0665700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee81146f0 con 0x7feee8102e10 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feef0665700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee810dae0 con 0x7feee81037b0 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feeee401700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee8113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feeee401700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee8113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34782/0 (socket says 172.21.15.134:34782) 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feeee401700 1 -- 172.21.15.134:0/3652004450 learned_addr learned my addr 172.21.15.134:0/3652004450 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.026+0000 7feeedc00700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 0x7feee81140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feeee401700 1 -- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 msgr2=0x7feee81140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feeee401700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 0x7feee81140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feeee401700 1 -- 172.21.15.134:0/3652004450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4005040 con 0x7feee8102e10 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feeedc00700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 0x7feee81140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feeee401700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee8113b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feee4009b30 tx=0x7feee4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee400e070 con 0x7feee8102e10 2024-03-22T07:25:16.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee810dd60 con 0x7feee8102e10 2024-03-22T07:25:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feee4013cd0 con 0x7feee8102e10 2024-03-22T07:25:16.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.027+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee810e240 con 0x7feee8102e10 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.028+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee400b720 con 0x7feee8102e10 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.028+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feee810e830 con 0x7feee8102e10 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.028+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7feee401cab0 con 0x7feee8102e10 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feedeffd700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7feed40692a0 0x7feed406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7feee4089110 con 0x7feee8102e10 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feeedc00700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7feed40692a0 0x7feed406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feedeffd700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] conn(0x7feed406ef70 0x7feed4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:16.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 --> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feed4071a30 con 0x7feed406ef70 2024-03-22T07:25:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee4089510 con 0x7feee8102e10 2024-03-22T07:25:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feeedc00700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7feed40692a0 0x7feed406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feed8004600 tx=0x7feed800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.029+0000 7feeeec02700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] conn(0x7feed406ef70 0x7feed4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.030+0000 7feeeec02700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] conn(0x7feed406ef70 0x7feed4071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:16.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.031+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== osd.5 v2:172.21.15.195:6816/1098061432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7feed4071a30 con 0x7feed406ef70 2024-03-22T07:25:16.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.046+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 --> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feee805e670 con 0x7feed406ef70 2024-03-22T07:25:16.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feedeffd700 1 -- 172.21.15.134:0/3652004450 <== osd.5 v2:172.21.15.195:6816/1098061432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7feee805e670 con 0x7feed406ef70 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] conn(0x7feed406ef70 msgr2=0x7feed4071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] conn(0x7feed406ef70 0x7feed4071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7feed40692a0 msgr2=0x7feed406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7feed40692a0 0x7feed406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feed8004600 tx=0x7feed800b040 comp rx=0 tx=0).stop 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 msgr2=0x7feee8113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee8113b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feee4009b30 tx=0x7feee4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 shutdown_connections 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:6816/1098061432,v1:172.21.15.195:6817/1098061432] conn(0x7feed406ef70 0x7feed4071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feee8102e10 0x7feee8113b60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7feed40692a0 0x7feed406b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.047+0000 7feef0665700 1 --2- 172.21.15.134:0/3652004450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feee81037b0 0x7feee81140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.048+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 >> 172.21.15.134:0/3652004450 conn(0x7feee80f89a0 msgr2=0x7feee8107400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.048+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 shutdown_connections 2024-03-22T07:25:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:16.048+0000 7feef0665700 1 -- 172.21.15.134:0/3652004450 wait complete. 2024-03-22T07:25:16.496 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:16.496 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:16.889 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:16 smithi134 ceph-mon[29057]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:16.913 INFO:teuthology.orchestra.run.smithi134.stdout:150323855374 2024-03-22T07:25:16.913 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-22T07:25:16.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:16 smithi195 ceph-mon[36144]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:17.415 INFO:teuthology.orchestra.run.smithi134.stdout:81604378648 2024-03-22T07:25:17.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-22T07:25:17.857 INFO:teuthology.orchestra.run.smithi134.stdout:171798691849 2024-03-22T07:25:17.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-22T07:25:17.888 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:18.632 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:18.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:18 smithi195 ceph-mon[36144]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:18.999 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:18 smithi134 ceph-mon[29057]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:20.141 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:20.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:20 smithi134 ceph-mon[29057]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:20.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:20 smithi195 ceph-mon[36144]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 -- 172.21.15.134:0/1460560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 msgr2=0x7f33d81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 --2- 172.21.15.134:0/1460560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d81031d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009ce0 tx=0x7f33d0004d10 comp rx=0 tx=0).stop 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 -- 172.21.15.134:0/1460560474 shutdown_connections 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 --2- 172.21.15.134:0/1460560474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 0x7f33d80fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 --2- 172.21.15.134:0/1460560474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d81031d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 -- 172.21.15.134:0/1460560474 >> 172.21.15.134:0/1460560474 conn(0x7f33d80f89b0 msgr2=0x7f33d80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 -- 172.21.15.134:0/1460560474 shutdown_connections 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.620+0000 7f33dea9d700 1 -- 172.21.15.134:0/1460560474 wait complete. 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dea9d700 1 Processor -- start 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dea9d700 1 -- start start 2024-03-22T07:25:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dea9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d8113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dea9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 0x7f33d8113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dea9d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d81146c0 con 0x7f33d8102e00 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dea9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d810dc10 con 0x7f33d81037a0 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dc839700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d8113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dc839700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d8113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34806/0 (socket says 172.21.15.134:34806) 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dc839700 1 -- 172.21.15.134:0/3193161688 learned_addr learned my addr 172.21.15.134:0/3193161688 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33d7fff700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 0x7f33d8113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dc839700 1 -- 172.21.15.134:0/3193161688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 msgr2=0x7f33d8113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dc839700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 0x7f33d8113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33dc839700 1 -- 172.21.15.134:0/3193161688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0009940 con 0x7f33d8102e00 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.621+0000 7f33d7fff700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 0x7f33d8113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.622+0000 7f33dc839700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d8113aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f33d000be90 tx=0x7f33d0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.622+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d000e040 con 0x7f33d8102e00 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.622+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33d0008ea0 con 0x7f33d8102e00 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.622+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d810de30 con 0x7f33d8102e00 2024-03-22T07:25:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.622+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d001c810 con 0x7f33d8102e00 2024-03-22T07:25:22.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.622+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d810e3f0 con 0x7f33d8102e00 2024-03-22T07:25:22.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.623+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80fe550 con 0x7f33d8102e00 2024-03-22T07:25:22.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.623+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f33d0012c00 con 0x7f33d8102e00 2024-03-22T07:25:22.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.624+0000 7f33d57fa700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33c40692a0 0x7f33c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:22.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.624+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f33d0088ac0 con 0x7f33d8102e00 2024-03-22T07:25:22.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.624+0000 7f33d7fff700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33c40692a0 0x7f33c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:22.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.624+0000 7f33d7fff700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33c40692a0 0x7f33c406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006fd0 tx=0x7f33c8008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:22.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.628+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f33d0058b40 con 0x7f33d8102e00 2024-03-22T07:25:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.822+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33d810f120 con 0x7f33d8102e00 2024-03-22T07:25:22.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.822+0000 7f33d57fa700 1 -- 172.21.15.134:0/3193161688 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33d0004e10 con 0x7f33d8102e00 2024-03-22T07:25:22.823 INFO:teuthology.orchestra.run.smithi134.stdout:115964117013 2024-03-22T07:25:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.824+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33c40692a0 msgr2=0x7f33c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.824+0000 7f33dea9d700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33c40692a0 0x7f33c406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006fd0 tx=0x7f33c8008040 comp rx=0 tx=0).stop 2024-03-22T07:25:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.824+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 msgr2=0x7f33d8113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.824+0000 7f33dea9d700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d8113aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f33d000be90 tx=0x7f33d0004d10 comp rx=0 tx=0).stop 2024-03-22T07:25:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 shutdown_connections 2024-03-22T07:25:22.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33d8102e00 0x7f33d8113aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f33c40692a0 0x7f33c406b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 --2- 172.21.15.134:0/3193161688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33d81037a0 0x7f33d8113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 >> 172.21.15.134:0/3193161688 conn(0x7f33d80f89b0 msgr2=0x7f33d80f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 shutdown_connections 2024-03-22T07:25:22.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.825+0000 7f33dea9d700 1 -- 172.21.15.134:0/3193161688 wait complete. 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 -- 172.21.15.134:0/3420194907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b81026a0 msgr2=0x7fd6b80fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/3420194907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b81026a0 0x7fd6b80fbd10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4004940 tx=0x7fd6a4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 -- 172.21.15.134:0/3420194907 shutdown_connections 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/3420194907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b81026a0 0x7fd6b80fbd10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/3420194907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b8101d00 0x7fd6b81020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 -- 172.21.15.134:0/3420194907 >> 172.21.15.134:0/3420194907 conn(0x7fd6b80f78d0 msgr2=0x7fd6b80f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 -- 172.21.15.134:0/3420194907 shutdown_connections 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.848+0000 7fd6bed6c700 1 -- 172.21.15.134:0/3420194907 wait complete. 2024-03-22T07:25:22.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bed6c700 1 Processor -- start 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bed6c700 1 -- start start 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bed6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 0x7fd6b8113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bed6c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b81026a0 0x7fd6b81140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bed6c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8114730 con 0x7fd6b8101d00 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bed6c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b810db20 con 0x7fd6b81026a0 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bcb08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 0x7fd6b8113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bcb08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 0x7fd6b8113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34828/0 (socket says 172.21.15.134:34828) 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.849+0000 7fd6bcb08700 1 -- 172.21.15.134:0/2876483205 learned_addr learned my addr 172.21.15.134:0/2876483205 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6b7fff700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b81026a0 0x7fd6b81140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6bcb08700 1 -- 172.21.15.134:0/2876483205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b81026a0 msgr2=0x7fd6b81140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6bcb08700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b81026a0 0x7fd6b81140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6bcb08700 1 -- 172.21.15.134:0/2876483205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4005040 con 0x7fd6b8101d00 2024-03-22T07:25:22.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6b7fff700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b81026a0 0x7fd6b81140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6bcb08700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 0x7fd6b8113ba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c8c0 tx=0x7fd6ac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac00a980 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6ac00ce60 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac0115e0 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b810de00 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.850+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b810e360 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.852+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b80fd450 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.852+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd6ac012400 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.852+0000 7fd6b57fa700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6a80692a0 0x7fd6a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.852+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd6ac086e50 con 0x7fd6b8101d00 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.852+0000 7fd6b7fff700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6a80692a0 0x7fd6a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:22.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.853+0000 7fd6b7fff700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6a80692a0 0x7fd6a806b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b3b0 tx=0x7fd6a4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:22.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:22.857+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd6ac056ff0 con 0x7fd6b8101d00 2024-03-22T07:25:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:22 smithi195 ceph-mon[36144]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:23.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:22 smithi134 ceph-mon[29057]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:23.048 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.048+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6b8108de0 con 0x7fd6b8101d00 2024-03-22T07:25:23.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.048+0000 7fd6b57fa700 1 -- 172.21.15.134:0/2876483205 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6ac0126b0 con 0x7fd6b8101d00 2024-03-22T07:25:23.049 INFO:teuthology.orchestra.run.smithi134.stdout:60129542175 2024-03-22T07:25:23.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6a80692a0 msgr2=0x7fd6a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:23.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6a80692a0 0x7fd6a806b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b3b0 tx=0x7fd6a4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:23.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 msgr2=0x7fd6b8113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:23.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 0x7fd6b8113ba0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c8c0 tx=0x7fd6ac0044c0 comp rx=0 tx=0).stop 2024-03-22T07:25:23.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 shutdown_connections 2024-03-22T07:25:23.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b8101d00 0x7fd6b8113ba0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:23.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6a80692a0 0x7fd6a806b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:23.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 --2- 172.21.15.134:0/2876483205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b81026a0 0x7fd6b81140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:23.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 >> 172.21.15.134:0/2876483205 conn(0x7fd6b80f78d0 msgr2=0x7fd6b80f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:23.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 shutdown_connections 2024-03-22T07:25:23.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:23.051+0000 7fd6bed6c700 1 -- 172.21.15.134:0/2876483205 wait complete. 2024-03-22T07:25:23.486 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-03-22T07:25:23.486 DEBUG:teuthology.parallel:result is None 2024-03-22T07:25:23.779 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:23 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3193161688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-22T07:25:23.779 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:23 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2876483205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-22T07:25:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:23 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3193161688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-22T07:25:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:23 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2876483205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-22T07:25:24.937 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:24 smithi134 ceph-mon[29057]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:24 smithi195 ceph-mon[36144]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:25.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 -- 172.21.15.134:0/62233894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4102710 msgr2=0x7fa9b40fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:25.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 --2- 172.21.15.134:0/62233894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4102710 0x7fa9b40fbd80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa99c004940 tx=0x7fa99c009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:25.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 -- 172.21.15.134:0/62233894 shutdown_connections 2024-03-22T07:25:25.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 --2- 172.21.15.134:0/62233894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4102710 0x7fa9b40fbd80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 --2- 172.21.15.134:0/62233894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b4101d70 0x7fa9b4102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 -- 172.21.15.134:0/62233894 >> 172.21.15.134:0/62233894 conn(0x7fa9b4072bc0 msgr2=0x7fa9b4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 -- 172.21.15.134:0/62233894 shutdown_connections 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.415+0000 7fa9b9822700 1 -- 172.21.15.134:0/62233894 wait complete. 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b9822700 1 Processor -- start 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b9822700 1 -- start start 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b9822700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 0x7fa9b4113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b9822700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b4102710 0x7fa9b41140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b9822700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4114710 con 0x7fa9b4101d70 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b9822700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b410db20 con 0x7fa9b4102710 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 0x7fa9b4113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 0x7fa9b4113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59822/0 (socket says 172.21.15.134:59822) 2024-03-22T07:25:25.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b2ffd700 1 -- 172.21.15.134:0/3756582268 learned_addr learned my addr 172.21.15.134:0/3756582268 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9aa7fc700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b4102710 0x7fa9b41140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b2ffd700 1 -- 172.21.15.134:0/3756582268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b4102710 msgr2=0x7fa9b41140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b2ffd700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b4102710 0x7fa9b41140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.416+0000 7fa9b2ffd700 1 -- 172.21.15.134:0/3756582268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c005040 con 0x7fa9b4101d70 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.417+0000 7fa9b2ffd700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 0x7fa9b4113b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c830 tx=0x7fa9a4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.417+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9a400a760 con 0x7fa9b4101d70 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.417+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b410de00 con 0x7fa9b4101d70 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.417+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9a400ad90 con 0x7fa9b4101d70 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.417+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9a40113a0 con 0x7fa9b4101d70 2024-03-22T07:25:25.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.417+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b410e3c0 con 0x7fa9b4101d70 2024-03-22T07:25:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.418+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b40fd4c0 con 0x7fa9b4101d70 2024-03-22T07:25:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.418+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa9a4012400 con 0x7fa9b4101d70 2024-03-22T07:25:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.419+0000 7fa9abfff700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa9a00692a0 0x7fa9a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.419+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa9a4086f10 con 0x7fa9b4101d70 2024-03-22T07:25:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.419+0000 7fa9aa7fc700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa9a00692a0 0x7fa9a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:25.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.419+0000 7fa9aa7fc700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa9a00692a0 0x7fa9a006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b3b0 tx=0x7fa99c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:25.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.423+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa9a4053580 con 0x7fa9b4101d70 2024-03-22T07:25:25.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.614+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa9b405f5f0 con 0x7fa9b4101d70 2024-03-22T07:25:25.615 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.615+0000 7fa9abfff700 1 -- 172.21.15.134:0/3756582268 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9a4056ba0 con 0x7fa9b4101d70 2024-03-22T07:25:25.615 INFO:teuthology.orchestra.run.smithi134.stdout:171798691851 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa9a00692a0 msgr2=0x7fa9a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa9a00692a0 0x7fa9a006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00b3b0 tx=0x7fa99c009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 msgr2=0x7fa9b4113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 0x7fa9b4113b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c830 tx=0x7fa9a4004470 comp rx=0 tx=0).stop 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 shutdown_connections 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9b4101d70 0x7fa9b4113b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:25.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa9a00692a0 0x7fa9a006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:25.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 --2- 172.21.15.134:0/3756582268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa9b4102710 0x7fa9b41140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:25.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 >> 172.21.15.134:0/3756582268 conn(0x7fa9b4072bc0 msgr2=0x7fa9b40659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:25.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 shutdown_connections 2024-03-22T07:25:25.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:25.617+0000 7fa9b9822700 1 -- 172.21.15.134:0/3756582268 wait complete. 2024-03-22T07:25:25.885 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:25 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3756582268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-22T07:25:25.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542175 for osd.1 2024-03-22T07:25:25.909 DEBUG:teuthology.parallel:result is None 2024-03-22T07:25:25.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:25 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3756582268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-22T07:25:26.767 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:26 smithi134 ceph-mon[29057]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:26.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:26 smithi195 ceph-mon[36144]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:27.062 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691851 for osd.5 2024-03-22T07:25:27.062 DEBUG:teuthology.parallel:result is None 2024-03-22T07:25:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 -- 172.21.15.134:0/2284664446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 msgr2=0x7f086c106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 --2- 172.21.15.134:0/2284664446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c106f00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0854004940 tx=0x7f0854009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 -- 172.21.15.134:0/2284664446 shutdown_connections 2024-03-22T07:25:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 --2- 172.21.15.134:0/2284664446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c106f00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:28.293 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 --2- 172.21.15.134:0/2284664446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 0x7f086c0fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 -- 172.21.15.134:0/2284664446 >> 172.21.15.134:0/2284664446 conn(0x7f086c072bc0 msgr2=0x7f086c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 -- 172.21.15.134:0/2284664446 shutdown_connections 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 -- 172.21.15.134:0/2284664446 wait complete. 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.274+0000 7f0871a64700 1 Processor -- start 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 -- start start 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 0x7f086c113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c114180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1147d0 con 0x7f086c0fe830 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c10dba0 con 0x7f086c0fde90 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c114180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c114180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59846/0 (socket says 172.21.15.134:59846) 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 -- 172.21.15.134:0/1203774380 learned_addr learned my addr 172.21.15.134:0/1203774380 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f086b7fe700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 0x7f086c113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 -- 172.21.15.134:0/1203774380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 msgr2=0x7f086c113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:28.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 0x7f086c113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 -- 172.21.15.134:0/1203774380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854005040 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f086b7fe700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 0x7f086c113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0862ffd700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c114180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f085400b3b0 tx=0x7f0854009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085400e040 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0854013420 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c10de20 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085401c610 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.275+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c10e360 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.276+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c065e30 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.277+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f0854013590 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.277+0000 7f0868ff9700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f08580692a0 0x7f085806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.277+0000 7f086b7fe700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f08580692a0 0x7f085806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.277+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f08540880d0 con 0x7f086c0fe830 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.278+0000 7f086b7fe700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f08580692a0 0x7f085806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f085c009fd0 tx=0x7f085c009f20 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:28.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.282+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f08540581d0 con 0x7f086c0fe830 2024-03-22T07:25:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.476+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f086c05f5f0 con 0x7f086c0fe830 2024-03-22T07:25:28.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.476+0000 7f0868ff9700 1 -- 172.21.15.134:0/1203774380 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0854013840 con 0x7f086c0fe830 2024-03-22T07:25:28.477 INFO:teuthology.orchestra.run.smithi134.stdout:81604378650 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f08580692a0 msgr2=0x7f085806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f08580692a0 0x7f085806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f085c009fd0 tx=0x7f085c009f20 comp rx=0 tx=0).stop 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 msgr2=0x7f086c114180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c114180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f085400b3b0 tx=0x7f0854009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 shutdown_connections 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f08580692a0 0x7f085806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f086c0fde90 0x7f086c113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 --2- 172.21.15.134:0/1203774380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f086c0fe830 0x7f086c114180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.478+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 >> 172.21.15.134:0/1203774380 conn(0x7f086c072bc0 msgr2=0x7f086c103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.479+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 shutdown_connections 2024-03-22T07:25:28.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:28.479+0000 7f0871a64700 1 -- 172.21.15.134:0/1203774380 wait complete. 2024-03-22T07:25:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:28 smithi134 ceph-mon[29057]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:28 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1203774380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-22T07:25:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:28 smithi195 ceph-mon[36144]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:28 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1203774380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-22T07:25:29.156 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-03-22T07:25:29.157 DEBUG:teuthology.parallel:result is None 2024-03-22T07:25:29.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- 172.21.15.134:0/1943092071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 msgr2=0x7f30040fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 --2- 172.21.15.134:0/1943092071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f30040fe1f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4004940 tx=0x7f2ff4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- 172.21.15.134:0/1943092071 shutdown_connections 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 --2- 172.21.15.134:0/1943092071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe7c0 0x7f3004106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 --2- 172.21.15.134:0/1943092071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f30040fe1f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- 172.21.15.134:0/1943092071 >> 172.21.15.134:0/1943092071 conn(0x7f30040f7870 msgr2=0x7f30040f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- 172.21.15.134:0/1943092071 shutdown_connections 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- 172.21.15.134:0/1943092071 wait complete. 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 Processor -- start 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- start start 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f3004115b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe7c0 0x7f30041160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004116720 con 0x7f30040fde20 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.324+0000 7f3008808700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300410fd00 con 0x7f30040fe7c0 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f3004115b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f3004115b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59872/0 (socket says 172.21.15.134:59872) 2024-03-22T07:25:29.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 -- 172.21.15.134:0/3831314566 learned_addr learned my addr 172.21.15.134:0/3831314566 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f3001d9b700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe7c0 0x7f30041160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 -- 172.21.15.134:0/3831314566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe7c0 msgr2=0x7f30041160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe7c0 0x7f30041160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 -- 172.21.15.134:0/3831314566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4005040 con 0x7f30040fde20 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f300259c700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f3004115b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4004890 tx=0x7f2ff4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff400e040 con 0x7f30040fde20 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ff4009af0 con 0x7f30040fde20 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300410ff80 con 0x7f30040fde20 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff401c630 con 0x7f30040fde20 2024-03-22T07:25:29.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.325+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30041104c0 con 0x7f30040fde20 2024-03-22T07:25:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.326+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3004066b50 con 0x7f30040fde20 2024-03-22T07:25:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.327+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2ff400bbc0 con 0x7f30040fde20 2024-03-22T07:25:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.327+0000 7f2ff2ffd700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fec0692a0 0x7f2fec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.327+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2ff4088140 con 0x7f30040fde20 2024-03-22T07:25:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.327+0000 7f3001d9b700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fec0692a0 0x7f2fec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:29.328 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.328+0000 7f3001d9b700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fec0692a0 0x7f2fec06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8007fd0 tx=0x7f2ff8009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:29.332 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.332+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2ff4058240 con 0x7f30040fde20 2024-03-22T07:25:29.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.523+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3004109eb0 con 0x7f30040fde20 2024-03-22T07:25:29.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.523+0000 7f2ff2ffd700 1 -- 172.21.15.134:0/3831314566 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ff4057dd0 con 0x7f30040fde20 2024-03-22T07:25:29.524 INFO:teuthology.orchestra.run.smithi134.stdout:38654705703 2024-03-22T07:25:29.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fec0692a0 msgr2=0x7f2fec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fec0692a0 0x7f2fec06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8007fd0 tx=0x7f2ff8009040 comp rx=0 tx=0).stop 2024-03-22T07:25:29.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 msgr2=0x7f3004115b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f3004115b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4004890 tx=0x7f2ff4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:29.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 shutdown_connections 2024-03-22T07:25:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fde20 0x7f3004115b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fec0692a0 0x7f2fec06b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 --2- 172.21.15.134:0/3831314566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe7c0 0x7f30041160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 >> 172.21.15.134:0/3831314566 conn(0x7f30040f7870 msgr2=0x7f30040f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 shutdown_connections 2024-03-22T07:25:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.526+0000 7f3008808700 1 -- 172.21.15.134:0/3831314566 wait complete. 2024-03-22T07:25:29.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- 172.21.15.134:0/3073721413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 msgr2=0x7fc5140fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3073721413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc5140fb990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc504004940 tx=0x7fc504009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:29.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- 172.21.15.134:0/3073721413 shutdown_connections 2024-03-22T07:25:29.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3073721413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc5140fb990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3073721413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc514102fd0 0x7fc5141033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- 172.21.15.134:0/3073721413 >> 172.21.15.134:0/3073721413 conn(0x7fc514071530 msgr2=0x7fc514071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- 172.21.15.134:0/3073721413 shutdown_connections 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- 172.21.15.134:0/3073721413 wait complete. 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 Processor -- start 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- start start 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc514113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc514102fd0 0x7fc514113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141145b0 con 0x7fc5140fb540 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc51bd04700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51410db40 con 0x7fc514102fd0 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.574+0000 7fc519aa0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc514113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc519aa0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc514113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59886/0 (socket says 172.21.15.134:59886) 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc519aa0700 1 -- 172.21.15.134:0/3404226527 learned_addr learned my addr 172.21.15.134:0/3404226527 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc51929f700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc514102fd0 0x7fc514113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc519aa0700 1 -- 172.21.15.134:0/3404226527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc514102fd0 msgr2=0x7fc514113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc519aa0700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc514102fd0 0x7fc514113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc519aa0700 1 -- 172.21.15.134:0/3404226527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504005040 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc519aa0700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc514113990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b790 tx=0x7fc510009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc51000f770 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc51000fda0 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc51000d310 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51410de20 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.575+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51410e360 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.576+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514100270 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.576+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc510010420 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.577+0000 7fc50a7fc700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc5000692a0 0x7fc50006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.577+0000 7fc51929f700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc5000692a0 0x7fc50006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.577+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc510086ed0 con 0x7fc5140fb540 2024-03-22T07:25:29.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.577+0000 7fc51929f700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc5000692a0 0x7fc50006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc504000c00 tx=0x7fc504009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:29.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.582+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc5100534e0 con 0x7fc5140fb540 2024-03-22T07:25:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.772+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc5140fe860 con 0x7fc5140fb540 2024-03-22T07:25:29.773 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:29 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3831314566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-22T07:25:29.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.773+0000 7fc50a7fc700 1 -- 172.21.15.134:0/3404226527 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc510056b00 con 0x7fc5140fb540 2024-03-22T07:25:29.774 INFO:teuthology.orchestra.run.smithi134.stdout:150323855377 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc5000692a0 msgr2=0x7fc50006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc5000692a0 0x7fc50006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc504000c00 tx=0x7fc504009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 msgr2=0x7fc514113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc514113990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b790 tx=0x7fc510009250 comp rx=0 tx=0).stop 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 shutdown_connections 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5140fb540 0x7fc514113990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fc5000692a0 0x7fc50006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 --2- 172.21.15.134:0/3404226527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc514102fd0 0x7fc514113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.775+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 >> 172.21.15.134:0/3404226527 conn(0x7fc514071530 msgr2=0x7fc5140fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.776+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 shutdown_connections 2024-03-22T07:25:29.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:29.776+0000 7fc51bd04700 1 -- 172.21.15.134:0/3404226527 wait complete. 2024-03-22T07:25:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:29 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3831314566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-22T07:25:30.265 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705703 for osd.0 2024-03-22T07:25:30.265 DEBUG:teuthology.parallel:result is None 2024-03-22T07:25:30.927 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:30 smithi134 ceph-mon[29057]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:30.927 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:30 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3404226527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-22T07:25:30.927 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:30 smithi195 ceph-mon[36144]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:30.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:30 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3404226527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-22T07:25:30.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:30.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855374 got 150323855377 for osd.4 2024-03-22T07:25:30.956 DEBUG:teuthology.parallel:result is None 2024-03-22T07:25:30.956 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-22T07:25:30.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph pg dump --format=json 2024-03-22T07:25:31.217 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.842+0000 7f2e68d1a700 1 -- 172.21.15.134:0/1474764059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e640702e0 msgr2=0x7f2e640706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.842+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/1474764059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e640702e0 0x7f2e640706b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004940 tx=0x7f2e54009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- 172.21.15.134:0/1474764059 shutdown_connections 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/1474764059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e64070bf0 0x7f2e64109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/1474764059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e640702e0 0x7f2e640706b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- 172.21.15.134:0/1474764059 >> 172.21.15.134:0/1474764059 conn(0x7f2e640f89b0 msgr2=0x7f2e640fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- 172.21.15.134:0/1474764059 shutdown_connections 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- 172.21.15.134:0/1474764059 wait complete. 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 Processor -- start 2024-03-22T07:25:32.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- start start 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e640702e0 0x7f2e64115b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 0x7f2e64116040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e64116690 con 0x7f2e64070bf0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e68d1a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6410fc70 con 0x7f2e640702e0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e61d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 0x7f2e64116040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e61d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 0x7f2e64116040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:59904/0 (socket says 172.21.15.134:59904) 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.843+0000 7f2e61d9b700 1 -- 172.21.15.134:0/3592982244 learned_addr learned my addr 172.21.15.134:0/3592982244 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e6259c700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e640702e0 0x7f2e64115b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e61d9b700 1 -- 172.21.15.134:0/3592982244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e640702e0 msgr2=0x7f2e64115b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e61d9b700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e640702e0 0x7f2e64115b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e61d9b700 1 -- 172.21.15.134:0/3592982244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54005040 con 0x7f2e64070bf0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e61d9b700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 0x7f2e64116040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e58002a80 tx=0x7f2e580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e58007cc0 con 0x7f2e64070bf0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6410ff50 con 0x7f2e64070bf0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e5800f040 con 0x7f2e64070bf0 2024-03-22T07:25:32.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e5800dac0 con 0x7f2e64070bf0 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.844+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e64110490 con 0x7f2e64070bf0 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.845+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e64071a20 con 0x7f2e64070bf0 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.846+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2e5800dc20 con 0x7f2e64070bf0 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.846+0000 7f2e52ffd700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2e4c0692a0 0x7f2e4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.846+0000 7f2e6259c700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2e4c0692a0 0x7f2e4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.846+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2e58086a90 con 0x7f2e64070bf0 2024-03-22T07:25:32.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.846+0000 7f2e6259c700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2e4c0692a0 0x7f2e4c06b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004f90 tx=0x7f2e54009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:32.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:32.850+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2e58056b10 con 0x7f2e64070bf0 2024-03-22T07:25:32.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:32 smithi195 ceph-mon[36144]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:33.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.031+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e6410c150 con 0x7f2e4c0692a0 2024-03-22T07:25:33.032 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:32 smithi134 ceph-mon[29057]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:33.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.032+0000 7f2e52ffd700 1 -- 172.21.15.134:0/3592982244 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28328 (secure 0 0 0) 0x7f2e6410c150 con 0x7f2e4c0692a0 2024-03-22T07:25:33.033 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:25:33.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2e4c0692a0 msgr2=0x7f2e4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2e4c0692a0 0x7f2e4c06b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004f90 tx=0x7f2e54009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 msgr2=0x7f2e64116040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 0x7f2e64116040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e58002a80 tx=0x7f2e580046b0 comp rx=0 tx=0).stop 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 shutdown_connections 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2e4c0692a0 0x7f2e4c06b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e640702e0 0x7f2e64115b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 --2- 172.21.15.134:0/3592982244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e64070bf0 0x7f2e64116040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:33.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 >> 172.21.15.134:0/3592982244 conn(0x7f2e640f89b0 msgr2=0x7f2e640f9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:33.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 shutdown_connections 2024-03-22T07:25:33.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:33.035+0000 7f2e68d1a700 1 -- 172.21.15.134:0/3592982244 wait complete. 2024-03-22T07:25:33.037 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-03-22T07:25:33.641 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-03-22T07:25:31.378937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002387"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-22T07:24:41.560314+0000","last_change":"2024-03-22T07:24:16.609847+0000","last_active":"2024-03-22T07:24:41.560314+0000","last_peered":"2024-03-22T07:24:41.560314+0000","last_clean":"2024-03-22T07:24:41.560314+0000","last_became_active":"2024-03-22T07:24:16.609583+0000","last_became_peered":"2024-03-22T07:24:16.609583+0000","last_unstale":"2024-03-22T07:24:41.560314+0000","last_undegraded":"2024-03-22T07:24:41.560314+0000","last_fullsized":"2024-03-22T07:24:41.560314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-22T07:23:31.737130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-22T07:23:31.737130+0000","last_clean_scrub_stamp":"2024-03-22T07:23:31.737130+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-23T14:30:32.142674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.495},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Mar 22 07:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.23200000000000001}]},{"osd":1,"last update":"Fri Mar 22 07:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Mar 22 07:24:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 22 07:25:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.318,"15min":0.314},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.316},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.37}]},{"osd":2,"last update":"Fri Mar 22 07:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Mar 22 07:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.22900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.32400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Mar 22 07:24:30 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Mar 22 07:24:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66400000000000003}]},{"osd":4,"last update":"Fri Mar 22 07:25:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-22T07:25:33.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph pg dump --format=json 2024-03-22T07:25:33.899 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:34.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:34 smithi195 ceph-mon[36144]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-22T07:25:34.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:34 smithi195 ceph-mon[36144]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:34.982 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:34 smithi134 ceph-mon[29057]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-22T07:25:34.982 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:34 smithi134 ceph-mon[29057]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 -- 172.21.15.134:0/4229213648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fc0a0 msgr2=0x7f374410d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 --2- 172.21.15.134:0/4229213648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fc0a0 0x7f374410d490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3734004940 tx=0x7f3734009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 -- 172.21.15.134:0/4229213648 shutdown_connections 2024-03-22T07:25:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 --2- 172.21.15.134:0/4229213648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fc0a0 0x7f374410d490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 --2- 172.21.15.134:0/4229213648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440fb790 0x7f37440fbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 -- 172.21.15.134:0/4229213648 >> 172.21.15.134:0/4229213648 conn(0x7f3744071530 msgr2=0x7f3744071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 -- 172.21.15.134:0/4229213648 shutdown_connections 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 -- 172.21.15.134:0/4229213648 wait complete. 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 Processor -- start 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.482+0000 7f374bd46700 1 -- start start 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f374bd46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 0x7f3744119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f374bd46700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440fc0a0 0x7f374411a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f374bd46700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374411ab50 con 0x7f37440fb790 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f374bd46700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3744114180 con 0x7f37440fc0a0 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 0x7f3744119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 0x7f3744119fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40652/0 (socket says 172.21.15.134:40652) 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 -- 172.21.15.134:0/2231206934 learned_addr learned my addr 172.21.15.134:0/2231206934 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:35.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f37492e1700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440fc0a0 0x7f374411a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 -- 172.21.15.134:0/2231206934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440fc0a0 msgr2=0x7f374411a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440fc0a0 0x7f374411a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 -- 172.21.15.134:0/2231206934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734005040 con 0x7f37440fb790 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f3749ae2700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 0x7f3744119fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3740002a50 tx=0x7f37400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3740007cc0 con 0x7f37440fb790 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f374000f040 con 0x7f37440fb790 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3744114460 con 0x7f37440fb790 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f374000da70 con 0x7f37440fb790 2024-03-22T07:25:35.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.483+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37441149a0 con 0x7f37440fb790 2024-03-22T07:25:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.485+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37440fe110 con 0x7f37440fb790 2024-03-22T07:25:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.485+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f374000dbf0 con 0x7f37440fb790 2024-03-22T07:25:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.485+0000 7f373a7fc700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f37300692a0 0x7f373006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.485+0000 7f37492e1700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f37300692a0 0x7f373006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.485+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f37400864e0 con 0x7f37440fb790 2024-03-22T07:25:35.487 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.486+0000 7f37492e1700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f37300692a0 0x7f373006b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3744115860 tx=0x7f3734009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:35.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.490+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3740056560 con 0x7f37440fb790 2024-03-22T07:25:35.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.672+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3744110670 con 0x7f37300692a0 2024-03-22T07:25:35.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.674+0000 7f373a7fc700 1 -- 172.21.15.134:0/2231206934 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28299 (secure 0 0 0) 0x7f3744110670 con 0x7f37300692a0 2024-03-22T07:25:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f37300692a0 msgr2=0x7f373006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f37300692a0 0x7f373006b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3744115860 tx=0x7f3734009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 msgr2=0x7f3744119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 0x7f3744119fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3740002a50 tx=0x7f37400046b0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 shutdown_connections 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37440fb790 0x7f3744119fc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f37300692a0 0x7f373006b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 --2- 172.21.15.134:0/2231206934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37440fc0a0 0x7f374411a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 >> 172.21.15.134:0/2231206934 conn(0x7f3744071530 msgr2=0x7f3744101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 shutdown_connections 2024-03-22T07:25:35.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:35.676+0000 7f374bd46700 1 -- 172.21.15.134:0/2231206934 wait complete. 2024-03-22T07:25:35.678 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2024-03-22T07:25:36.424 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-03-22T07:25:35.379587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787652,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683260,"statfs":{"total":575970213888,"available":574139658240,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002199"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-22T07:24:41.560314+0000","last_change":"2024-03-22T07:24:16.609847+0000","last_active":"2024-03-22T07:24:41.560314+0000","last_peered":"2024-03-22T07:24:41.560314+0000","last_clean":"2024-03-22T07:24:41.560314+0000","last_became_active":"2024-03-22T07:24:16.609583+0000","last_became_peered":"2024-03-22T07:24:16.609583+0000","last_unstale":"2024-03-22T07:24:41.560314+0000","last_undegraded":"2024-03-22T07:24:41.560314+0000","last_fullsized":"2024-03-22T07:24:41.560314+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-22T07:23:31.737130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-22T07:23:31.737130+0000","last_clean_scrub_stamp":"2024-03-22T07:23:31.737130+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-23T14:30:32.142674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.622}]},{"osd":2,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.626}]},{"osd":2,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Mar 22 07:25:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.316},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.23200000000000001}]},{"osd":1,"last update":"Fri Mar 22 07:24:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Mar 22 07:24:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Mar 22 07:25:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 22 07:25:09 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.318,"15min":0.314},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.51300000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Mar 22 07:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Mar 22 07:24:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Mar 22 07:25:16 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 22 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.22900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.377},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.32400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Mar 22 07:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.495,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.39700000000000002,"15min":0.40000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Mar 22 07:24:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57299999999999995}]},{"osd":4,"last update":"Fri Mar 22 07:25:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-22T07:25:36.425 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-22T07:25:36.425 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-22T07:25:36.425 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-22T07:25:36.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph health --format=json 2024-03-22T07:25:36.682 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:36 smithi195 ceph-mon[36144]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:36 smithi195 ceph-mon[36144]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-22T07:25:36.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:36 smithi134 ceph-mon[29057]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:36.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:36 smithi134 ceph-mon[29057]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- 172.21.15.134:0/2010081538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 msgr2=0x7fe8c81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/2010081538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81031d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4004940 tx=0x7fe8c4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- 172.21.15.134:0/2010081538 shutdown_connections 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/2010081538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 0x7fe8c80fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/2010081538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81031d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- 172.21.15.134:0/2010081538 >> 172.21.15.134:0/2010081538 conn(0x7fe8c80f89b0 msgr2=0x7fe8c80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- 172.21.15.134:0/2010081538 shutdown_connections 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- 172.21.15.134:0/2010081538 wait complete. 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 Processor -- start 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- start start 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 0x7fe8c8113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:38.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8114460 con 0x7fe8c8102e00 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.279+0000 7fe8cf26d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c810dab0 con 0x7fe8c81037a0 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40670/0 (socket says 172.21.15.134:40670) 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 -- 172.21.15.134:0/1949764341 learned_addr learned my addr 172.21.15.134:0/1949764341 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cc808700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 0x7fe8c8113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 -- 172.21.15.134:0/1949764341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 msgr2=0x7fe8c8113e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 0x7fe8c8113e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 -- 172.21.15.134:0/1949764341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4005040 con 0x7fe8c8102e00 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cc808700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 0x7fe8c8113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cd009700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81138d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400b8b0 tx=0x7fe8c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c400e040 con 0x7fe8c8102e00 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8c4004290 con 0x7fe8c8102e00 2024-03-22T07:25:38.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c810dd30 con 0x7fe8c8102e00 2024-03-22T07:25:38.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c401c3f0 con 0x7fe8c8102e00 2024-03-22T07:25:38.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.280+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c810e2f0 con 0x7fe8c8102e00 2024-03-22T07:25:38.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.281+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c8100110 con 0x7fe8c8102e00 2024-03-22T07:25:38.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.282+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe8c40137b0 con 0x7fe8c8102e00 2024-03-22T07:25:38.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.282+0000 7fe8bdffb700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe8b40692a0 0x7fe8b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:38.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.282+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe8c40881b0 con 0x7fe8c8102e00 2024-03-22T07:25:38.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.282+0000 7fe8cc808700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe8b40692a0 0x7fe8b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:38.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.283+0000 7fe8cc808700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe8b40692a0 0x7fe8b406b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8009f60 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:38.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.287+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe8c40582b0 con 0x7fe8c8102e00 2024-03-22T07:25:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.512+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe8c810ef20 con 0x7fe8c8102e00 2024-03-22T07:25:38.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.512+0000 7fe8bdffb700 1 -- 172.21.15.134:0/1949764341 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe8c4057e40 con 0x7fe8c8102e00 2024-03-22T07:25:38.513 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:25:38.513 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe8b40692a0 msgr2=0x7fe8b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe8b40692a0 0x7fe8b406b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8009f60 comp rx=0 tx=0).stop 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 msgr2=0x7fe8c81138d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81138d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400b8b0 tx=0x7fe8c4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 shutdown_connections 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8c8102e00 0x7fe8c81138d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe8b40692a0 0x7fe8b406b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 --2- 172.21.15.134:0/1949764341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8c81037a0 0x7fe8c8113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 >> 172.21.15.134:0/1949764341 conn(0x7fe8c80f89b0 msgr2=0x7fe8c80fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 shutdown_connections 2024-03-22T07:25:38.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:38.514+0000 7fe8cf26d700 1 -- 172.21.15.134:0/1949764341 wait complete. 2024-03-22T07:25:38.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:38 smithi134 ceph-mon[29057]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:38.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:38 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1949764341' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-22T07:25:38.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:38 smithi195 ceph-mon[36144]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:38.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:38 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1949764341' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-22T07:25:39.230 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-22T07:25:39.230 INFO:tasks.cephadm:Setup complete, yielding 2024-03-22T07:25:39.230 INFO:teuthology.run_tasks:Running task print... 2024-03-22T07:25:39.239 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-03-22T07:25:39.239 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:25:39.268 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:25:39.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-03-22T07:25:39.526 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:40.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:40 smithi195 ceph-mon[36144]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:40.973 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:40 smithi134 ceph-mon[29057]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:41.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 -- 172.21.15.134:0/3085960809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 msgr2=0x7f43940fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:41.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 --2- 172.21.15.134:0/3085960809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f43940fc0e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4384004940 tx=0x7f4384009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:41.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 -- 172.21.15.134:0/3085960809 shutdown_connections 2024-03-22T07:25:41.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 --2- 172.21.15.134:0/3085960809 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 0x7f43940fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 --2- 172.21.15.134:0/3085960809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f43940fc0e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 -- 172.21.15.134:0/3085960809 >> 172.21.15.134:0/3085960809 conn(0x7f43940f7430 msgr2=0x7f43940f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:41.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 -- 172.21.15.134:0/3085960809 shutdown_connections 2024-03-22T07:25:41.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 -- 172.21.15.134:0/3085960809 wait complete. 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.311+0000 7f4399d7d700 1 Processor -- start 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4399d7d700 1 -- start start 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4399d7d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f439410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4399d7d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 0x7f439410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4399d7d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439410e440 con 0x7f43940fbcd0 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4399d7d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439410e5b0 con 0x7f43940fcf80 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f439410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f439410d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40688/0 (socket says 172.21.15.134:40688) 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 -- 172.21.15.134:0/164181870 learned_addr learned my addr 172.21.15.134:0/164181870 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4392ffd700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 0x7f439410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:41.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 -- 172.21.15.134:0/164181870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 msgr2=0x7f439410de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 0x7f439410de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 -- 172.21.15.134:0/164181870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4384005040 con 0x7f43940fbcd0 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f4392ffd700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 0x7f439410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.312+0000 7f43937fe700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f439410d900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f438400b3b0 tx=0x7f4384009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.313+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438400e040 con 0x7f43940fbcd0 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.313+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f438400bcc0 con 0x7f43940fbcd0 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.313+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438401c630 con 0x7f43940fbcd0 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.313+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4394112fb0 con 0x7f43940fbcd0 2024-03-22T07:25:41.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.313+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394113490 con 0x7f43940fbcd0 2024-03-22T07:25:41.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.314+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4394101b10 con 0x7f43940fbcd0 2024-03-22T07:25:41.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.314+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4384013980 con 0x7f43940fbcd0 2024-03-22T07:25:41.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.315+0000 7f437bfff700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f437c0692a0 0x7f437c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:41.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.315+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4384087c60 con 0x7f43940fbcd0 2024-03-22T07:25:41.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.315+0000 7f4392ffd700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f437c0692a0 0x7f437c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:41.318 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.315+0000 7f4392ffd700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f437c0692a0 0x7f437c06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4388009fd0 tx=0x7f4388009ee0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:41.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.319+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4384057ce0 con 0x7f43940fbcd0 2024-03-22T07:25:41.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.521+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f439402b3a0 con 0x7f43940fbcd0 2024-03-22T07:25:41.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.525+0000 7f437bfff700 1 -- 172.21.15.134:0/164181870 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f4384057870 con 0x7f43940fbcd0 2024-03-22T07:25:41.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f437c0692a0 msgr2=0x7f437c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:41.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f437c0692a0 0x7f437c06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4388009fd0 tx=0x7f4388009ee0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 msgr2=0x7f439410d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:41.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f439410d900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f438400b3b0 tx=0x7f4384009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 shutdown_connections 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43940fbcd0 0x7f439410d900 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f437c0692a0 0x7f437c06b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 --2- 172.21.15.134:0/164181870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43940fcf80 0x7f439410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.528+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 >> 172.21.15.134:0/164181870 conn(0x7f43940f7430 msgr2=0x7f4394066810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.529+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 shutdown_connections 2024-03-22T07:25:41.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:41.529+0000 7f4399d7d700 1 -- 172.21.15.134:0/164181870 wait complete. 2024-03-22T07:25:42.395 INFO:teuthology.run_tasks:Running task print... 2024-03-22T07:25:42.404 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-03-22T07:25:42.404 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:25:42.448 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:25:42.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph orch status' 2024-03-22T07:25:42.709 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:42 smithi134 ceph-mon[29057]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:42 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/164181870' entity='client.admin' 2024-03-22T07:25:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:42 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:25:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:42 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:25:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:42 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:25:42.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:42 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:25:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:42 smithi195 ceph-mon[36144]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:42 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/164181870' entity='client.admin' 2024-03-22T07:25:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:42 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:25:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:42 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:25:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:42 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:25:42.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:42 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:25:44.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 -- 172.21.15.134:0/1103735968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fcc60 msgr2=0x7faaa00fd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/1103735968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fcc60 0x7faaa00fd0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faa94004940 tx=0x7faa94009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 -- 172.21.15.134:0/1103735968 shutdown_connections 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/1103735968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fcc60 0x7faaa00fd0d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/1103735968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa00fc310 0x7faaa00fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 -- 172.21.15.134:0/1103735968 >> 172.21.15.134:0/1103735968 conn(0x7faaa00f6be0 msgr2=0x7faaa00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 -- 172.21.15.134:0/1103735968 shutdown_connections 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 -- 172.21.15.134:0/1103735968 wait complete. 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 Processor -- start 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.353+0000 7faaa4d6f700 1 -- start start 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faaa4d6f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 0x7faaa00fba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faaa4d6f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa00fcc60 0x7faaa01126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faaa4d6f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0112c80 con 0x7faaa00fc310 2024-03-22T07:25:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faaa4d6f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0112dc0 con 0x7faaa00fcc60 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 0x7faaa00fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 0x7faaa00fba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37338/0 (socket says 172.21.15.134:37338) 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 -- 172.21.15.134:0/2973850506 learned_addr learned my addr 172.21.15.134:0/2973850506 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9dd9b700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa00fcc60 0x7faaa01126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 -- 172.21.15.134:0/2973850506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa00fcc60 msgr2=0x7faaa01126b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa00fcc60 0x7faaa01126b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 -- 172.21.15.134:0/2973850506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94005040 con 0x7faaa00fc310 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa9e59c700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 0x7faaa00fba70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b790 tx=0x7faa98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9800f770 con 0x7faaa00fc310 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa9800fda0 con 0x7faaa00fc310 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa01130a0 con 0x7faaa00fc310 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9800d310 con 0x7faaa00fc310 2024-03-22T07:25:44.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.354+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa0113660 con 0x7faaa00fc310 2024-03-22T07:25:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.355+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa004c710 con 0x7faaa00fc310 2024-03-22T07:25:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.356+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7faa98010420 con 0x7faaa00fc310 2024-03-22T07:25:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.356+0000 7faa8effd700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7faa880692a0 0x7faa8806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:44.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.356+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa98086e70 con 0x7faaa00fc310 2024-03-22T07:25:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.356+0000 7faa9dd9b700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7faa880692a0 0x7faa8806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:44.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.357+0000 7faa9dd9b700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7faa880692a0 0x7faa8806b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa94004f90 tx=0x7faa94009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:44.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.361+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7faa98056f70 con 0x7faaa00fc310 2024-03-22T07:25:44.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.563+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa0101370 con 0x7faa880692a0 2024-03-22T07:25:44.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.564+0000 7faa8effd700 1 -- 172.21.15.134:0/2973850506 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7faaa0101370 con 0x7faa880692a0 2024-03-22T07:25:44.566 INFO:teuthology.orchestra.run.smithi134.stdout:Backend: cephadm 2024-03-22T07:25:44.566 INFO:teuthology.orchestra.run.smithi134.stdout:Available: Yes 2024-03-22T07:25:44.566 INFO:teuthology.orchestra.run.smithi134.stdout:Paused: No 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.566+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7faa880692a0 msgr2=0x7faa8806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.566+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7faa880692a0 0x7faa8806b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa94004f90 tx=0x7faa94009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.566+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 msgr2=0x7faaa00fba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.566+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 0x7faaa00fba70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa9800b790 tx=0x7faa98009250 comp rx=0 tx=0).stop 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 shutdown_connections 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaa00fc310 0x7faaa00fba70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7faa880692a0 0x7faa8806b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 --2- 172.21.15.134:0/2973850506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaa00fcc60 0x7faaa01126b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:44.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 >> 172.21.15.134:0/2973850506 conn(0x7faaa00f6be0 msgr2=0x7faaa00f81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:44.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 shutdown_connections 2024-03-22T07:25:44.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:44.567+0000 7faaa4d6f700 1 -- 172.21.15.134:0/2973850506 wait complete. 2024-03-22T07:25:44.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:44 smithi134 ceph-mon[29057]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:44 smithi195 ceph-mon[36144]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:45.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-22T07:25:45.442 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:45 smithi134 ceph-mon[29057]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:45 smithi195 ceph-mon[36144]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:25:46.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:46 smithi134 ceph-mon[29057]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:46 smithi195 ceph-mon[36144]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/1389567629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 msgr2=0x7fd6a00fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/1389567629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a00fe450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd694004940 tx=0x7fd694009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/1389567629 shutdown_connections 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/1389567629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a00fe450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/1389567629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6a00fce70 0x7fd6a00fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/1389567629 >> 172.21.15.134:0/1389567629 conn(0x7fd6a00f8550 msgr2=0x7fd6a00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/1389567629 shutdown_connections 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/1389567629 wait complete. 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 Processor -- start 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.034+0000 7fd6a5eb4700 1 -- start start 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd6a5eb4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6a00fce70 0x7fd6a0071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:47.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd6a5eb4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd6a5eb4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0070850 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd6a5eb4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00709c0 con 0x7fd6a00fce70 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a0070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37356/0 (socket says 172.21.15.134:37356) 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 -- 172.21.15.134:0/3245111403 learned_addr learned my addr 172.21.15.134:0/3245111403 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69f7fe700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6a00fce70 0x7fd6a0071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 -- 172.21.15.134:0/3245111403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6a00fce70 msgr2=0x7fd6a0071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6a00fce70 0x7fd6a0071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 -- 172.21.15.134:0/3245111403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694005040 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd69effd700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a0070310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd69400b3b0 tx=0x7fd694009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd69400e040 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a0070c40 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd69400bcc0 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd69401c630 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.035+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a0115a20 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.036+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a004c710 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.037+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd694013980 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.037+0000 7fd687fff700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6880692a0 0x7fd68806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.037+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd694087c80 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.037+0000 7fd69f7fe700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6880692a0 0x7fd68806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:47.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.037+0000 7fd69f7fe700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6880692a0 0x7fd68806b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd690006fd0 tx=0x7fd690008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:47.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.041+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd694057d00 con 0x7fd6a00fdfe0 2024-03-22T07:25:47.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.235+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6a0102280 con 0x7fd6880692a0 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.243+0000 7fd687fff700 1 -- 172.21.15.134:0/3245111403 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7fd6a0102280 con 0x7fd6880692a0 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 2m ago 5m 26.3M - 0.25.0 c8568f914cd2 0ce3f68acd2f 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 2m ago 5m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (4m) 67s ago 4m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 2m ago 4m 81.9M - 9.4.7 954c08fa6188 8cd534e3bc25 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (6m) 2m ago 6m 470M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (4m) 67s ago 4m 431M - 17.2.7-726-g9c4e0c34 837124da804f 26e2fe2a8479 2024-03-22T07:25:47.244 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (6m) 2m ago 6m 40.8M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (4m) 67s ago 4m 37.5M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 2m ago 5m 15.9M - 1.5.0 0da6a335fe13 645fc1dfbabe 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 67s ago 4m 17.1M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 2m ago 3m 35.7M 4288M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 2m ago 2m 36.3M 4288M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 2m ago 2m 10.3M 4288M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (2m) 67s ago 2m 41.6M 5312M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (97s) 67s ago 96s 38.9M 5312M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (72s) 67s ago 72s 13.2M 5312M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:25:47.245 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 2m ago 4m 36.1M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6880692a0 msgr2=0x7fd68806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6880692a0 0x7fd68806b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd690006fd0 tx=0x7fd690008040 comp rx=0 tx=0).stop 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 msgr2=0x7fd6a0070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a0070310 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd69400b3b0 tx=0x7fd694009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 shutdown_connections 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6880692a0 0x7fd68806b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6a00fce70 0x7fd6a0071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 --2- 172.21.15.134:0/3245111403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6a00fdfe0 0x7fd6a0070310 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 >> 172.21.15.134:0/3245111403 conn(0x7fd6a00f8550 msgr2=0x7fd6a00f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 shutdown_connections 2024-03-22T07:25:47.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:47.245+0000 7fd6a5eb4700 1 -- 172.21.15.134:0/3245111403 wait complete. 2024-03-22T07:25:47.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-22T07:25:48.114 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:48 smithi134 ceph-mon[29057]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:48 smithi134 ceph-mon[29057]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:48 smithi195 ceph-mon[36144]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:48 smithi195 ceph-mon[36144]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 -- 172.21.15.134:0/2497643098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fce80 msgr2=0x7fdefc0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2497643098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fce80 0x7fdefc0fd290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdeec004940 tx=0x7fdeec009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 -- 172.21.15.134:0/2497643098 shutdown_connections 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2497643098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fdff0 0x7fdefc0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2497643098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fce80 0x7fdefc0fd290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 -- 172.21.15.134:0/2497643098 >> 172.21.15.134:0/2497643098 conn(0x7fdefc0f8580 msgr2=0x7fdefc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 -- 172.21.15.134:0/2497643098 shutdown_connections 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.749+0000 7fdf021ca700 1 -- 172.21.15.134:0/2497643098 wait complete. 2024-03-22T07:25:49.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdf021ca700 1 Processor -- start 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdf021ca700 1 -- start start 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdf021ca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fce80 0x7fdefc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdf021ca700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 0x7fdefc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdf021ca700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc070950 con 0x7fdefc0fdff0 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdf021ca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc070ac0 con 0x7fdefc0fce80 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 0x7fdefc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 0x7fdefc070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37372/0 (socket says 172.21.15.134:37372) 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 -- 172.21.15.134:0/2655229817 learned_addr learned my addr 172.21.15.134:0/2655229817 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdefb7fe700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fce80 0x7fdefc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 -- 172.21.15.134:0/2655229817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fce80 msgr2=0x7fdefc071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fce80 0x7fdefc071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 -- 172.21.15.134:0/2655229817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec005040 con 0x7fdefc0fdff0 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdefb7fe700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fce80 0x7fdefc071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.750+0000 7fdef3fff700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 0x7fdefc070310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdee400b790 tx=0x7fdee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.751+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee400f770 con 0x7fdefc0fdff0 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.751+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc070da0 con 0x7fdefc0fdff0 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.751+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdee400fda0 con 0x7fdefc0fdff0 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.751+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee400d310 con 0x7fdefc0fdff0 2024-03-22T07:25:49.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.751+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc115b10 con 0x7fdefc0fdff0 2024-03-22T07:25:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.752+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc05f5f0 con 0x7fdefc0fdff0 2024-03-22T07:25:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.752+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdee4010420 con 0x7fdefc0fdff0 2024-03-22T07:25:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.752+0000 7fdef8ff9700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdee80692a0 0x7fdee806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.752+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdee4086e70 con 0x7fdefc0fdff0 2024-03-22T07:25:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.752+0000 7fdefb7fe700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdee80692a0 0x7fdee806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:49.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.753+0000 7fdefb7fe700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdee80692a0 0x7fdee806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009fd0 tx=0x7fdeec009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:49.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.757+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdee40534e0 con 0x7fdefc0fdff0 2024-03-22T07:25:49.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.950+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdefc102310 con 0x7fdee80692a0 2024-03-22T07:25:49.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.954+0000 7fdef8ff9700 1 -- 172.21.15.134:0/2655229817 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fdefc102310 con 0x7fdee80692a0 2024-03-22T07:25:49.955 INFO:teuthology.orchestra.run.smithi134.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:crash 2/2 2m ago 5m * 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:mgr 2/2 2m ago 5m count:2 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:mon 2/2 2m ago 5m smithi134:172.21.15.134=smithi134;smithi195:172.21.15.195=smithi195;count:2 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:osd 6 2m ago - 2024-03-22T07:25:49.956 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdee80692a0 msgr2=0x7fdee806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdee80692a0 0x7fdee806b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009fd0 tx=0x7fdeec009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 msgr2=0x7fdefc070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 0x7fdefc070310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdee400b790 tx=0x7fdee4009250 comp rx=0 tx=0).stop 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 shutdown_connections 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdee80692a0 0x7fdee806b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdefc0fce80 0x7fdefc071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 --2- 172.21.15.134:0/2655229817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdefc0fdff0 0x7fdefc070310 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:49.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 >> 172.21.15.134:0/2655229817 conn(0x7fdefc0f8580 msgr2=0x7fdefc0f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:49.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 shutdown_connections 2024-03-22T07:25:49.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:49.956+0000 7fdf021ca700 1 -- 172.21.15.134:0/2655229817 wait complete. 2024-03-22T07:25:50.589 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:50 smithi134 ceph-mon[29057]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:50.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-22T07:25:50.873 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:50 smithi195 ceph-mon[36144]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:51.672 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:51 smithi134 ceph-mon[29057]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:51 smithi195 ceph-mon[36144]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:52.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 -- 172.21.15.134:0/1126881731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 msgr2=0x7f12740fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 --2- 172.21.15.134:0/1126881731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f12740fd3f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f125c004940 tx=0x7f125c009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 -- 172.21.15.134:0/1126881731 shutdown_connections 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 --2- 172.21.15.134:0/1126881731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f12740fd3f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 --2- 172.21.15.134:0/1126881731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fbcd0 0x7f12740fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 -- 172.21.15.134:0/1126881731 >> 172.21.15.134:0/1126881731 conn(0x7f12740f7430 msgr2=0x7f12740f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 -- 172.21.15.134:0/1126881731 shutdown_connections 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 -- 172.21.15.134:0/1126881731 wait complete. 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 Processor -- start 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.469+0000 7f127a566700 1 -- start start 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f127a566700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fbcd0 0x7f127410c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f127a566700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f127410ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:52.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f127a566700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127410d440 con 0x7f12740fcf80 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f127a566700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127410dc90 con 0x7f12740fbcd0 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f127410ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f127410ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37398/0 (socket says 172.21.15.134:37398) 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 -- 172.21.15.134:0/1395703641 learned_addr learned my addr 172.21.15.134:0/1395703641 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f1273fff700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fbcd0 0x7f127410c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 -- 172.21.15.134:0/1395703641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fbcd0 msgr2=0x7f127410c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fbcd0 0x7f127410c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 -- 172.21.15.134:0/1395703641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c005040 con 0x7f12740fcf80 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f126bfff700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f127410ce40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f125c009150 tx=0x7f125c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125c00e040 con 0x7f12740fcf80 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127410df10 con 0x7f12740fcf80 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f125c00bcc0 con 0x7f12740fcf80 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125c01c630 con 0x7f12740fcf80 2024-03-22T07:25:52.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.470+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127410e450 con 0x7f12740fcf80 2024-03-22T07:25:52.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.471+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127405f5f0 con 0x7f12740fcf80 2024-03-22T07:25:52.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.472+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f125c013420 con 0x7f12740fcf80 2024-03-22T07:25:52.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.472+0000 7f12717fa700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12600692a0 0x7f126006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:52.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.472+0000 7f1273fff700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12600692a0 0x7f126006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:52.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.473+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f125c087c20 con 0x7f12740fcf80 2024-03-22T07:25:52.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.473+0000 7f1273fff700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12600692a0 0x7f126006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12640041d0 tx=0x7f1264009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:52.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.477+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f125c057d20 con 0x7f12740fcf80 2024-03-22T07:25:52.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.673+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f127410e780 con 0x7f12600692a0 2024-03-22T07:25:52.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.674+0000 7f12717fa700 1 -- 172.21.15.134:0/1395703641 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f127410e780 con 0x7f12600692a0 2024-03-22T07:25:52.675 INFO:teuthology.orchestra.run.smithi134.stdout:HOST ADDR LABELS STATUS 2024-03-22T07:25:52.675 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 172.21.15.134 2024-03-22T07:25:52.676 INFO:teuthology.orchestra.run.smithi134.stdout:smithi195 172.21.15.195 2024-03-22T07:25:52.676 INFO:teuthology.orchestra.run.smithi134.stdout:2 hosts in cluster 2024-03-22T07:25:52.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12600692a0 msgr2=0x7f126006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:52.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12600692a0 0x7f126006b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12640041d0 tx=0x7f1264009040 comp rx=0 tx=0).stop 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 msgr2=0x7f127410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f127410ce40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f125c009150 tx=0x7f125c009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 shutdown_connections 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12600692a0 0x7f126006b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12740fbcd0 0x7f127410c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 --2- 172.21.15.134:0/1395703641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12740fcf80 0x7f127410ce40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 >> 172.21.15.134:0/1395703641 conn(0x7f12740f7430 msgr2=0x7f12740f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 shutdown_connections 2024-03-22T07:25:52.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:52.676+0000 7f127a566700 1 -- 172.21.15.134:0/1395703641 wait complete. 2024-03-22T07:25:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:52 smithi195 ceph-mon[36144]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:53.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:52 smithi134 ceph-mon[29057]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:53.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-22T07:25:53.561 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:53.680 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:53 smithi134 ceph-mon[29057]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:53.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:53 smithi195 ceph-mon[36144]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:54.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:54 smithi134 ceph-mon[29057]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:54.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:54 smithi195 ceph-mon[36144]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 -- 172.21.15.134:0/2655624904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fe060 msgr2=0x7f03740fe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 --2- 172.21.15.134:0/2655624904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fe060 0x7f03740fe4d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0368004940 tx=0x7f0368009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 -- 172.21.15.134:0/2655624904 shutdown_connections 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 --2- 172.21.15.134:0/2655624904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fe060 0x7f03740fe4d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 --2- 172.21.15.134:0/2655624904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03740fcef0 0x7f03740fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 -- 172.21.15.134:0/2655624904 >> 172.21.15.134:0/2655624904 conn(0x7f03740f85b0 msgr2=0x7f03740fa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 -- 172.21.15.134:0/2655624904 shutdown_connections 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 -- 172.21.15.134:0/2655624904 wait complete. 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.062+0000 7f037a14e700 1 Processor -- start 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f037a14e700 1 -- start start 2024-03-22T07:25:55.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f037a14e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 0x7f037410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f037a14e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03740fe060 0x7f037410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f037a14e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037410e5e0 con 0x7f03740fcef0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f037a14e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037410edd0 con 0x7f03740fe060 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 0x7f037410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 0x7f037410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42968/0 (socket says 172.21.15.134:42968) 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 -- 172.21.15.134:0/4137850808 learned_addr learned my addr 172.21.15.134:0/4137850808 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f0372ffd700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03740fe060 0x7f037410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 -- 172.21.15.134:0/4137850808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03740fe060 msgr2=0x7f037410df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03740fe060 0x7f037410df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 -- 172.21.15.134:0/4137850808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368005040 con 0x7f03740fcef0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f03737fe700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 0x7f037410da10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f036c00bbb0 tx=0x7f036c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.063+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c0092e0 con 0x7f03740fcef0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.064+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f036c00cbd0 con 0x7f03740fcef0 2024-03-22T07:25:55.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.064+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037410f0b0 con 0x7f03740fcef0 2024-03-22T07:25:55.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.064+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c007400 con 0x7f03740fcef0 2024-03-22T07:25:55.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.064+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037410f670 con 0x7f03740fcef0 2024-03-22T07:25:55.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.065+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037405f5f0 con 0x7f03740fcef0 2024-03-22T07:25:55.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.065+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f036c012070 con 0x7f03740fcef0 2024-03-22T07:25:55.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.065+0000 7f035bfff700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f035c0692a0 0x7f035c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:55.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.066+0000 7f0372ffd700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f035c0692a0 0x7f035c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:55.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.066+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f036c086c50 con 0x7f03740fcef0 2024-03-22T07:25:55.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.066+0000 7f0372ffd700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f035c0692a0 0x7f035c06b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f036800b3b0 tx=0x7f0368009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:55.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.071+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f036c056cd0 con 0x7f03740fcef0 2024-03-22T07:25:55.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.266+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f037410f950 con 0x7f035c0692a0 2024-03-22T07:25:55.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.267+0000 7f035bfff700 1 -- 172.21.15.134:0/4137850808 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f037410f950 con 0x7f035c0692a0 2024-03-22T07:25:55.268 INFO:teuthology.orchestra.run.smithi134.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-22T07:25:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-22T07:25:55.269 INFO:teuthology.orchestra.run.smithi134.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 72s ago Has a FileSystem, LVM detected 2024-03-22T07:25:55.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f035c0692a0 msgr2=0x7f035c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:55.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f035c0692a0 0x7f035c06b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f036800b3b0 tx=0x7f0368009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:55.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 msgr2=0x7f037410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:55.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 0x7f037410da10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f036c00bbb0 tx=0x7f036c009840 comp rx=0 tx=0).stop 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 shutdown_connections 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03740fcef0 0x7f037410da10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f035c0692a0 0x7f035c06b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 --2- 172.21.15.134:0/4137850808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f03740fe060 0x7f037410df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 >> 172.21.15.134:0/4137850808 conn(0x7f03740f85b0 msgr2=0x7f03740f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 shutdown_connections 2024-03-22T07:25:55.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:55.270+0000 7f037a14e700 1 -- 172.21.15.134:0/4137850808 wait complete. 2024-03-22T07:25:55.977 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:25:55.985 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:25:55.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-03-22T07:25:56.240 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:25:56.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:56 smithi134 ceph-mon[29057]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:56.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:56 smithi134 ceph-mon[29057]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:56.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:56 smithi195 ceph-mon[36144]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:56.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:56 smithi195 ceph-mon[36144]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:58.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 -- 172.21.15.134:0/3886851716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fed80 msgr2=0x7fe9a80faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 --2- 172.21.15.134:0/3886851716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fed80 0x7fe9a80faec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4004940 tx=0x7fe9a4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 -- 172.21.15.134:0/3886851716 shutdown_connections 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 --2- 172.21.15.134:0/3886851716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fed80 0x7fe9a80faec0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 --2- 172.21.15.134:0/3886851716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80fe430 0x7fe9a80fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 -- 172.21.15.134:0/3886851716 >> 172.21.15.134:0/3886851716 conn(0x7fe9a80f6bd0 msgr2=0x7fe9a80f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 -- 172.21.15.134:0/3886851716 shutdown_connections 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.005+0000 7fe9b0771700 1 -- 172.21.15.134:0/3886851716 wait complete. 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9b0771700 1 Processor -- start 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9b0771700 1 -- start start 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9b0771700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 0x7fe9a810d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9b0771700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80fed80 0x7fe9a810ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:58.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9b0771700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810e3c0 con 0x7fe9a80fe430 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9b0771700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810e530 con 0x7fe9a80fed80 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9ae50d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 0x7fe9a810d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9ae50d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 0x7fe9a810d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42992/0 (socket says 172.21.15.134:42992) 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9ae50d700 1 -- 172.21.15.134:0/1891587878 learned_addr learned my addr 172.21.15.134:0/1891587878 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9add0c700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80fed80 0x7fe9a810ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9ae50d700 1 -- 172.21.15.134:0/1891587878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80fed80 msgr2=0x7fe9a810ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9ae50d700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80fed80 0x7fe9a810ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.006+0000 7fe9ae50d700 1 -- 172.21.15.134:0/1891587878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4005040 con 0x7fe9a80fe430 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.007+0000 7fe9ae50d700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 0x7fe9a810d880 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe998002a80 tx=0x7fe9980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.007+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe998007cc0 con 0x7fe9a80fe430 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.007+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe99800f040 con 0x7fe9a80fe430 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.007+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8112f90 con 0x7fe9a80fe430 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.007+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99800dac0 con 0x7fe9a80fe430 2024-03-22T07:25:58.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.007+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a81134c0 con 0x7fe9a80fe430 2024-03-22T07:25:58.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.008+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a804c710 con 0x7fe9a80fe430 2024-03-22T07:25:58.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.008+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe99800dc20 con 0x7fe9a80fe430 2024-03-22T07:25:58.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.009+0000 7fe99effd700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe9940692a0 0x7fe99406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:25:58.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.009+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe998086a90 con 0x7fe9a80fe430 2024-03-22T07:25:58.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.009+0000 7fe9add0c700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe9940692a0 0x7fe99406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:25:58.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.009+0000 7fe9add0c700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe9940692a0 0x7fe99406b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400b3b0 tx=0x7fe9a4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:25:58.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.013+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe998056b10 con 0x7fe9a80fe430 2024-03-22T07:25:58.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:58.229+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9a81136b0 con 0x7fe9940692a0 2024-03-22T07:25:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:58 smithi195 ceph-mon[36144]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:58 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-03-22T07:25:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:58 smithi134 ceph-mon[29057]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:25:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:58 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-03-22T07:25:59.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.597+0000 7fe99effd700 1 -- 172.21.15.134:0/1891587878 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe9a81136b0 con 0x7fe9940692a0 2024-03-22T07:25:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe9940692a0 msgr2=0x7fe99406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe9940692a0 0x7fe99406b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400b3b0 tx=0x7fe9a4009e30 comp rx=0 tx=0).stop 2024-03-22T07:25:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 msgr2=0x7fe9a810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:25:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 0x7fe9a810d880 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe998002a80 tx=0x7fe9980046b0 comp rx=0 tx=0).stop 2024-03-22T07:25:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 shutdown_connections 2024-03-22T07:25:59.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9a80fe430 0x7fe9a810d880 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe9940692a0 0x7fe99406b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 --2- 172.21.15.134:0/1891587878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9a80fed80 0x7fe9a810ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:25:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 >> 172.21.15.134:0/1891587878 conn(0x7fe9a80f6bd0 msgr2=0x7fe9a80f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:25:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 shutdown_connections 2024-03-22T07:25:59.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:25:59.601+0000 7fe9b0771700 1 -- 172.21.15.134:0/1891587878 wait complete. 2024-03-22T07:25:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:59 smithi195 ceph-mon[36144]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:59.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:59 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-03-22T07:25:59.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:59 smithi195 ceph-mon[36144]: osdmap e42: 6 total, 6 up, 6 in 2024-03-22T07:25:59.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:25:59 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-03-22T07:25:59.992 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:59 smithi134 ceph-mon[29057]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:25:59.992 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:59 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-03-22T07:25:59.992 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:59 smithi134 ceph-mon[29057]: osdmap e42: 6 total, 6 up, 6 in 2024-03-22T07:25:59.992 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:59 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-03-22T07:25:59.992 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:25:59 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[29053]: 2024-03-22T07:25:59.579+0000 7f29d8342700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:26:00.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: pgmap v172: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: osdmap e43: 6 total, 6 up, 6 in 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: osdmap e44: 6 total, 6 up, 6 in 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: fsmap cephfs:0 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: Saving service mds.cephfs spec with placement count:4 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:00.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: Deploying daemon mds.cephfs.smithi134.yxdtlb on smithi134 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:00.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: pgmap v172: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: osdmap e43: 6 total, 6 up, 6 in 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: osdmap e44: 6 total, 6 up, 6 in 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: fsmap cephfs:0 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: Saving service mds.cephfs spec with placement count:4 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:01.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:01.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: Deploying daemon mds.cephfs.smithi134.yxdtlb on smithi134 2024-03-22T07:26:01.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:01.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:01.526 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:01 smithi134 ceph-mon[29057]: osdmap e45: 6 total, 6 up, 6 in 2024-03-22T07:26:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:01 smithi195 ceph-mon[36144]: osdmap e45: 6 total, 6 up, 6 in 2024-03-22T07:26:02.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:02 smithi134 ceph-mon[29057]: pgmap v176: 65 pgs: 55 unknown, 10 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:02.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:02 smithi134 ceph-mon[29057]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-22T07:26:02.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:02 smithi134 ceph-mon[29057]: osdmap e46: 6 total, 6 up, 6 in 2024-03-22T07:26:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:02 smithi195 ceph-mon[36144]: pgmap v176: 65 pgs: 55 unknown, 10 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:02 smithi195 ceph-mon[36144]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-22T07:26:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:02 smithi195 ceph-mon[36144]: osdmap e46: 6 total, 6 up, 6 in 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.093+0000 7f97ba9f3700 1 -- 172.21.15.134:0/4237984021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40feda0 msgr2=0x7f97b40faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.093+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/4237984021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40feda0 0x7f97b40faee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97a8004940 tx=0x7f97a8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 -- 172.21.15.134:0/4237984021 shutdown_connections 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/4237984021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40feda0 0x7f97b40faee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/4237984021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40fe450 0x7f97b40fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 -- 172.21.15.134:0/4237984021 >> 172.21.15.134:0/4237984021 conn(0x7f97b40f6c10 msgr2=0x7f97b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 -- 172.21.15.134:0/4237984021 shutdown_connections 2024-03-22T07:26:03.094 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 -- 172.21.15.134:0/4237984021 wait complete. 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.094+0000 7f97ba9f3700 1 Processor -- start 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97ba9f3700 1 -- start start 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97ba9f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 0x7f97b410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97ba9f3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40feda0 0x7f97b410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97ba9f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b410e470 con 0x7f97b40fe450 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97ba9f3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b410e5e0 con 0x7f97b40feda0 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 0x7f97b410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:03.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 0x7f97b410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43000/0 (socket says 172.21.15.134:43000) 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 -- 172.21.15.134:0/3436542679 learned_addr learned my addr 172.21.15.134:0/3436542679 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b37fe700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40feda0 0x7f97b410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 -- 172.21.15.134:0/3436542679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40feda0 msgr2=0x7f97b410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40feda0 0x7f97b410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 -- 172.21.15.134:0/3436542679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8005040 con 0x7f97b40fe450 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b37fe700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40feda0 0x7f97b410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b3fff700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 0x7f97b410d930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c830 tx=0x7f97a4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a400a760 con 0x7f97b40fe450 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.095+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97a400ad90 con 0x7f97b40fe450 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.096+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b4112fe0 con 0x7f97b40fe450 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.096+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a40113a0 con 0x7f97b40fe450 2024-03-22T07:26:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.096+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b4113570 con 0x7f97b40fe450 2024-03-22T07:26:03.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.097+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b404c710 con 0x7f97b40fe450 2024-03-22T07:26:03.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.097+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f97a4012400 con 0x7f97b40fe450 2024-03-22T07:26:03.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.097+0000 7f97b0ff9700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f979c0692a0 0x7f979c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:03.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.098+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f97a4087120 con 0x7f97b40fe450 2024-03-22T07:26:03.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.098+0000 7f97b37fe700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f979c0692a0 0x7f979c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:03.099 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.098+0000 7f97b37fe700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f979c0692a0 0x7f979c06b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f97a800b3b0 tx=0x7f97a8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:03.106 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.106+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f97a4056f80 con 0x7f97b40fe450 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.344+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f97b4113840 con 0x7f97b40fe450 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.345+0000 7f97b0ff9700 1 -- 172.21.15.134:0/3436542679 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f97a4056b10 con 0x7f97b40fe450 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stdout:e2 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:03.345 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 2 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:25:59.580113+0000 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 0 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:in 2024-03-22T07:26:03.346 INFO:teuthology.orchestra.run.smithi134.stdout:up {} 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 0 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:03.347 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f979c0692a0 msgr2=0x7f979c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f979c0692a0 0x7f979c06b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f97a800b3b0 tx=0x7f97a8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 msgr2=0x7f97b410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 0x7f97b410d930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c830 tx=0x7f97a4004470 comp rx=0 tx=0).stop 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 shutdown_connections 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97b40fe450 0x7f97b410d930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f979c0692a0 0x7f979c06b750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 --2- 172.21.15.134:0/3436542679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40feda0 0x7f97b410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 >> 172.21.15.134:0/3436542679 conn(0x7f97b40f6c10 msgr2=0x7f97b40f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 shutdown_connections 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:03.347+0000 7f97ba9f3700 1 -- 172.21.15.134:0/3436542679 wait complete. 2024-03-22T07:26:03.348 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 2 2024-03-22T07:26:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:03 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3436542679' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:26:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:03 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3436542679' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:26:04.178 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:26:04.187 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:04.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-03-22T07:26:04.446 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:04.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: pgmap v178: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6826/189976344,v1:172.21.15.134:6827/189976344] up:boot 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: daemon mds.cephfs.smithi134.yxdtlb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: Cluster is now healthy 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: fsmap cephfs:0 1 up:standby 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:creating} 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: daemon mds.cephfs.smithi134.yxdtlb is now active in filesystem cephfs as rank 0 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:04.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:04.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:04.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:04 smithi195 ceph-mon[36144]: Deploying daemon mds.cephfs.smithi195.dayrmo on smithi195 2024-03-22T07:26:04.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: pgmap v178: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:04.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6826/189976344,v1:172.21.15.134:6827/189976344] up:boot 2024-03-22T07:26:04.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: daemon mds.cephfs.smithi134.yxdtlb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-03-22T07:26:04.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:26:04.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-22T07:26:04.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: Cluster is now healthy 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: fsmap cephfs:0 1 up:standby 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:creating} 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: daemon mds.cephfs.smithi134.yxdtlb is now active in filesystem cephfs as rank 0 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:04.850 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:04 smithi134 ceph-mon[29057]: Deploying daemon mds.cephfs.smithi195.dayrmo on smithi195 2024-03-22T07:26:05.900 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:05 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6826/189976344,v1:172.21.15.134:6827/189976344] up:active 2024-03-22T07:26:05.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:05 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 2024-03-22T07:26:05.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:05 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6826/189976344,v1:172.21.15.134:6827/189976344] up:active 2024-03-22T07:26:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:05 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 2024-03-22T07:26:06.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 -- 172.21.15.134:0/2769146717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fe040 msgr2=0x7f30040fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:06.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 --2- 172.21.15.134:0/2769146717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fe040 0x7f30040fe4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4004940 tx=0x7f2ff4009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:06.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 -- 172.21.15.134:0/2769146717 shutdown_connections 2024-03-22T07:26:06.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 --2- 172.21.15.134:0/2769146717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fe040 0x7f30040fe4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:06.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 --2- 172.21.15.134:0/2769146717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fce40 0x7f30040fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:06.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 -- 172.21.15.134:0/2769146717 >> 172.21.15.134:0/2769146717 conn(0x7f30040f8510 msgr2=0x7f30040fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 -- 172.21.15.134:0/2769146717 shutdown_connections 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 -- 172.21.15.134:0/2769146717 wait complete. 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 Processor -- start 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.122+0000 7f300b65c700 1 -- start start 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f300b65c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 0x7f3004071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f300b65c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe040 0x7f3004070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f300b65c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004070950 con 0x7f30040fce40 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f300b65c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004070ac0 con 0x7f30040fe040 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 0x7f3004071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 0x7f3004071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52128/0 (socket says 172.21.15.134:52128) 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 -- 172.21.15.134:0/1451048929 learned_addr learned my addr 172.21.15.134:0/1451048929 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:06.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f3008bf7700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe040 0x7f3004070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 -- 172.21.15.134:0/1451048929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe040 msgr2=0x7f3004070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe040 0x7f3004070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 -- 172.21.15.134:0/1451048929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4005040 con 0x7f30040fce40 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f30093f8700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 0x7f3004071e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f300000b790 tx=0x7f3000009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300000f6f0 con 0x7f30040fce40 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f300000fd20 con 0x7f30040fce40 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3004070da0 con 0x7f30040fce40 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.123+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30000103a0 con 0x7f30040fce40 2024-03-22T07:26:06.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.124+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3004115ac0 con 0x7f30040fce40 2024-03-22T07:26:06.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.125+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300405f5f0 con 0x7f30040fce40 2024-03-22T07:26:06.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.125+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3000011400 con 0x7f30040fce40 2024-03-22T07:26:06.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.125+0000 7f2ff9ffb700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ff00692a0 0x7f2ff006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:06.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.126+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3000086f40 con 0x7f30040fce40 2024-03-22T07:26:06.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.126+0000 7f3008bf7700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ff00692a0 0x7f2ff006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:06.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.126+0000 7f3008bf7700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ff00692a0 0x7f2ff006b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400b970 tx=0x7f2ff4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:06.130 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.130+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3000053270 con 0x7f30040fce40 2024-03-22T07:26:06.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.374+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f3004105970 con 0x7f30040fce40 2024-03-22T07:26:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.627+0000 7f2ff9ffb700 1 -- 172.21.15.134:0/1451048929 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3000056890 con 0x7f30040fce40 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:06.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:06 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1451048929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ff00692a0 msgr2=0x7f2ff006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ff00692a0 0x7f2ff006b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400b970 tx=0x7f2ff4009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 msgr2=0x7f3004071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 0x7f3004071e40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f300000b790 tx=0x7f3000009220 comp rx=0 tx=0).stop 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 shutdown_connections 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30040fce40 0x7f3004071e40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:06.631 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ff00692a0 0x7f2ff006b750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:06.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 --2- 172.21.15.134:0/1451048929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30040fe040 0x7f3004070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:06.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.630+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 >> 172.21.15.134:0/1451048929 conn(0x7f30040f8510 msgr2=0x7f30040f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:06.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.631+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 shutdown_connections 2024-03-22T07:26:06.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:06.631+0000 7f300b65c700 1 -- 172.21.15.134:0/1451048929 wait complete. 2024-03-22T07:26:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:06.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:06.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:06.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:06.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:06 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1451048929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-03-22T07:26:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:07 smithi134 ceph-mon[29057]: Deploying daemon mds.cephfs.smithi134.dexlss on smithi134 2024-03-22T07:26:07.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:07 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:boot 2024-03-22T07:26:07.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:07 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1451048929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-03-22T07:26:07.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:07 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 1 up:standby 2024-03-22T07:26:07.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:07 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:26:07.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:07 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 1 up:standby 2024-03-22T07:26:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:07 smithi195 ceph-mon[36144]: Deploying daemon mds.cephfs.smithi134.dexlss on smithi134 2024-03-22T07:26:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:07 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:boot 2024-03-22T07:26:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:07 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1451048929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-03-22T07:26:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:07 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 1 up:standby 2024-03-22T07:26:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:07 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:26:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:07 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 1 up:standby 2024-03-22T07:26:08.282 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:26:08.292 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:08.292 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-03-22T07:26:08.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:08 smithi134 ceph-mon[29057]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s wr, 3 op/s 2024-03-22T07:26:08.928 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:08.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:08 smithi195 ceph-mon[36144]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s wr, 3 op/s 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:09.997 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: Deploying daemon mds.cephfs.smithi195.jursxo on smithi195 2024-03-22T07:26:09.998 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-03-22T07:26:09.998 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:boot 2024-03-22T07:26:09.998 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 2 up:standby 2024-03-22T07:26:09.998 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:09 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:26:10.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:10.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:10.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:10.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:26:10.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-22T07:26:10.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:10.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: Deploying daemon mds.cephfs.smithi195.jursxo on smithi195 2024-03-22T07:26:10.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-03-22T07:26:10.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:boot 2024-03-22T07:26:10.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 2 up:standby 2024-03-22T07:26:10.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:09 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 -- 172.21.15.134:0/3192399569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 msgr2=0x7fd6b0070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 --2- 172.21.15.134:0/3192399569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b0070ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4004940 tx=0x7fd6a4009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 -- 172.21.15.134:0/3192399569 shutdown_connections 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 --2- 172.21.15.134:0/3192399569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b0070ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 --2- 172.21.15.134:0/3192399569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b0071e20 0x7fd6b0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 -- 172.21.15.134:0/3192399569 >> 172.21.15.134:0/3192399569 conn(0x7fd6b00f8550 msgr2=0x7fd6b00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 -- 172.21.15.134:0/3192399569 shutdown_connections 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 -- 172.21.15.134:0/3192399569 wait complete. 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 Processor -- start 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.535+0000 7fd6b63df700 1 -- start start 2024-03-22T07:26:10.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6b63df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6b63df700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b0071e20 0x7fd6b0110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6b63df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0110670 con 0x7fd6b0070870 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6b63df700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b01107e0 con 0x7fd6b0071e20 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b010fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52178/0 (socket says 172.21.15.134:52178) 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 -- 172.21.15.134:0/710936707 learned_addr learned my addr 172.21.15.134:0/710936707 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6af7fe700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b0071e20 0x7fd6b0110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 -- 172.21.15.134:0/710936707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b0071e20 msgr2=0x7fd6b0110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b0071e20 0x7fd6b0110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 -- 172.21.15.134:0/710936707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4005040 con 0x7fd6b0070870 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6affff700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b010fb30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c8b0 tx=0x7fd6a0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:10.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a00106f0 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6a0010d20 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b0115240 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6a0012e90 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.536+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b0115800 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.537+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b004c710 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.538+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd6a0010850 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.538+0000 7fd6acff9700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6980692a0 0x7fd69806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.538+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd6a00870c0 con 0x7fd6b0070870 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.538+0000 7fd6af7fe700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6980692a0 0x7fd69806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.538+0000 7fd6af7fe700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6980692a0 0x7fd69806b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b970 tx=0x7fd6a4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:10.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.543+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd6a0056e80 con 0x7fd6b0070870 2024-03-22T07:26:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:10.772+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd6b0107ad0 con 0x7fd6b0070870 2024-03-22T07:26:11.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.430+0000 7fd6acff9700 1 -- 172.21.15.134:0/710936707 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6a0056a10 con 0x7fd6b0070870 2024-03-22T07:26:11.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6980692a0 msgr2=0x7fd69806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6980692a0 0x7fd69806b750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b970 tx=0x7fd6a4009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 msgr2=0x7fd6b010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b010fb30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000c8b0 tx=0x7fd6a0004470 comp rx=0 tx=0).stop 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 shutdown_connections 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd6b0070870 0x7fd6b010fb30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd6980692a0 0x7fd69806b750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 --2- 172.21.15.134:0/710936707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6b0071e20 0x7fd6b0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 >> 172.21.15.134:0/710936707 conn(0x7fd6b00f8550 msgr2=0x7fd6b00f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 shutdown_connections 2024-03-22T07:26:11.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:11.433+0000 7fd6b63df700 1 -- 172.21.15.134:0/710936707 wait complete. 2024-03-22T07:26:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:11 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:11 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/710936707' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-22T07:26:11.762 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:11 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:11.762 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:11 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/710936707' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-22T07:26:12.087 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:26:12.096 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:12.096 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-03-22T07:26:12.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-22T07:26:12.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/710936707' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-22T07:26:12.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:boot 2024-03-22T07:26:12.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 3 up:standby 2024-03-22T07:26:12.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:26:12.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:12 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:12.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-22T07:26:12.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/710936707' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-22T07:26:12.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:boot 2024-03-22T07:26:12.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 3 up:standby 2024-03-22T07:26:12.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:26:12.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:12.781 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:12 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:13.073 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:standby 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: Dropping low affinity active daemon mds.cephfs.smithi134.yxdtlb in favor of higher affinity standby. 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: Replacing daemon mds.cephfs.smithi134.yxdtlb as rank 0 with standby daemon mds.cephfs.smithi134.dexlss 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 3 up:standby 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: osdmap e47: 6 total, 6 up, 6 in 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: fsmap cephfs:1/1 {0=cephfs.smithi134.dexlss=up:replay} 2 up:standby 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:14.541 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:14 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:14.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-03-22T07:26:14.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:standby 2024-03-22T07:26:14.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: Dropping low affinity active daemon mds.cephfs.smithi134.yxdtlb in favor of higher affinity standby. 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: Replacing daemon mds.cephfs.smithi134.yxdtlb as rank 0 with standby daemon mds.cephfs.smithi134.dexlss 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 3 up:standby 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: osdmap e47: 6 total, 6 up, 6 in 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: fsmap cephfs:1/1 {0=cephfs.smithi134.dexlss=up:replay} 2 up:standby 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:14.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:14 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:15.695 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:reconnect 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] up:boot 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:standby 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: fsmap cephfs:1/1 {0=cephfs.smithi134.dexlss=up:reconnect} 3 up:standby 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:15.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.621+0000 7fcb877ae700 1 -- 172.21.15.134:0/803068096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 msgr2=0x7fcb800fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.621+0000 7fcb877ae700 1 --2- 172.21.15.134:0/803068096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb800fd420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb70004940 tx=0x7fcb70009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 -- 172.21.15.134:0/803068096 shutdown_connections 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 --2- 172.21.15.134:0/803068096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb800fd420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 --2- 172.21.15.134:0/803068096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 0x7fcb800fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 -- 172.21.15.134:0/803068096 >> 172.21.15.134:0/803068096 conn(0x7fcb800f7480 msgr2=0x7fcb800f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 -- 172.21.15.134:0/803068096 shutdown_connections 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 -- 172.21.15.134:0/803068096 wait complete. 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 Processor -- start 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.622+0000 7fcb877ae700 1 -- start start 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb877ae700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 0x7fcb80066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:15.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb877ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb80112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb877ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80112c60 con 0x7fcb800fcfb0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb877ae700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80112dd0 con 0x7fcb800fbd00 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb80112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb80112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42754/0 (socket says 172.21.15.134:42754) 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 -- 172.21.15.134:0/1812814141 learned_addr learned my addr 172.21.15.134:0/1812814141 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb8554a700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 0x7fcb80066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 -- 172.21.15.134:0/1812814141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 msgr2=0x7fcb80066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 0x7fcb80066cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 -- 172.21.15.134:0/1812814141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb70005040 con 0x7fcb800fcfb0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb8554a700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 0x7fcb80066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb84d49700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb80112720 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009150 tx=0x7fcb70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7000e040 con 0x7fcb800fcfb0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb80113050 con 0x7fcb800fcfb0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb7000bcc0 con 0x7fcb800fcfb0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.623+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7001c630 con 0x7fcb800fcfb0 2024-03-22T07:26:15.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.624+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb80113610 con 0x7fcb800fcfb0 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.625+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8004c710 con 0x7fcb800fcfb0 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.625+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcb70013420 con 0x7fcb800fcfb0 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.625+0000 7fcb75ffb700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcb6c0692a0 0x7fcb6c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.626+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcb70088000 con 0x7fcb800fcfb0 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.626+0000 7fcb8554a700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcb6c0692a0 0x7fcb6c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.626+0000 7fcb8554a700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcb6c0692a0 0x7fcb6c06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009b10 tx=0x7fcb7c008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:15.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.634+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcb70057d70 con 0x7fcb800fcfb0 2024-03-22T07:26:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:reconnect 2024-03-22T07:26:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] up:boot 2024-03-22T07:26:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:standby 2024-03-22T07:26:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: fsmap cephfs:1/1 {0=cephfs.smithi134.dexlss=up:reconnect} 3 up:standby 2024-03-22T07:26:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:26:15.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:15.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:15.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:15.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:15.878+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fcb80113a10 con 0x7fcb800fcfb0 2024-03-22T07:26:16.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.452+0000 7fcb75ffb700 1 -- 172.21.15.134:0/1812814141 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v14) v1 ==== 133+0+0 (secure 0 0 0) 0x7fcb70057900 con 0x7fcb800fcfb0 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcb6c0692a0 msgr2=0x7fcb6c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcb6c0692a0 0x7fcb6c06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009b10 tx=0x7fcb7c008040 comp rx=0 tx=0).stop 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 msgr2=0x7fcb80112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb80112720 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009150 tx=0x7fcb70009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 shutdown_connections 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcb6c0692a0 0x7fcb6c06b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:16.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb800fbd00 0x7fcb80066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:16.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 --2- 172.21.15.134:0/1812814141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb800fcfb0 0x7fcb80112720 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:16.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 >> 172.21.15.134:0/1812814141 conn(0x7fcb800f7480 msgr2=0x7fcb800f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:16.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 shutdown_connections 2024-03-22T07:26:16.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:16.454+0000 7fcb877ae700 1 -- 172.21.15.134:0/1812814141 wait complete. 2024-03-22T07:26:16.456 INFO:teuthology.orchestra.run.smithi134.stderr:inline data disabled 2024-03-22T07:26:16.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:16 smithi134 ceph-mon[29057]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-22T07:26:16.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:16 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:rejoin 2024-03-22T07:26:16.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:16 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:standby 2024-03-22T07:26:16.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:16 smithi134 ceph-mon[29057]: fsmap cephfs:1/1 {0=cephfs.smithi134.dexlss=up:rejoin} 3 up:standby 2024-03-22T07:26:16.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:16 smithi134 ceph-mon[29057]: daemon mds.cephfs.smithi134.dexlss is now active in filesystem cephfs as rank 0 2024-03-22T07:26:16.671 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:16 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1812814141' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-03-22T07:26:16.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:16 smithi195 ceph-mon[36144]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-03-22T07:26:16.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:16 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:rejoin 2024-03-22T07:26:16.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:16 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:standby 2024-03-22T07:26:16.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:16 smithi195 ceph-mon[36144]: fsmap cephfs:1/1 {0=cephfs.smithi134.dexlss=up:rejoin} 3 up:standby 2024-03-22T07:26:16.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:16 smithi195 ceph-mon[36144]: daemon mds.cephfs.smithi134.dexlss is now active in filesystem cephfs as rank 0 2024-03-22T07:26:16.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:16 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1812814141' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-03-22T07:26:17.348 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:26:17.358 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:17.358 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-22T07:26:17.611 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:17 smithi134 ceph-mon[29057]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:26:17.611 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:17 smithi134 ceph-mon[29057]: Cluster is now healthy 2024-03-22T07:26:17.611 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:17 smithi134 ceph-mon[29057]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:active 2024-03-22T07:26:17.611 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:17 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1812814141' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-03-22T07:26:17.611 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:17 smithi134 ceph-mon[29057]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:26:17.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:17 smithi195 ceph-mon[36144]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:26:17.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:17 smithi195 ceph-mon[36144]: Cluster is now healthy 2024-03-22T07:26:17.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:17 smithi195 ceph-mon[36144]: mds.? [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] up:active 2024-03-22T07:26:17.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:17 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1812814141' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-03-22T07:26:17.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:17 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:26:18.099 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:18.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:18 smithi134 ceph-mon[29057]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-22T07:26:18.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:18 smithi195 ceph-mon[36144]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-03-22T07:26:19.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 -- 172.21.15.134:0/2312242184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fcf80 msgr2=0x7f58180fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 --2- 172.21.15.134:0/2312242184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fcf80 0x7f58180fd3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5800004940 tx=0x7f5800009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 -- 172.21.15.134:0/2312242184 shutdown_connections 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 --2- 172.21.15.134:0/2312242184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fcf80 0x7f58180fd3f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 --2- 172.21.15.134:0/2312242184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58180fbcd0 0x7f58180fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 -- 172.21.15.134:0/2312242184 >> 172.21.15.134:0/2312242184 conn(0x7f58180f7430 msgr2=0x7f58180f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 -- 172.21.15.134:0/2312242184 shutdown_connections 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.631+0000 7f581d5de700 1 -- 172.21.15.134:0/2312242184 wait complete. 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f581d5de700 1 Processor -- start 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f581d5de700 1 -- start start 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f581d5de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 0x7f5818112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f581d5de700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58180fcf80 0x7f5818114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f581d5de700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818066240 con 0x7f58180fbcd0 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f581d5de700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818066380 con 0x7f58180fcf80 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 0x7f5818112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:19.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 0x7f5818112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42766/0 (socket says 172.21.15.134:42766) 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f5816ffd700 1 -- 172.21.15.134:0/1934099731 learned_addr learned my addr 172.21.15.134:0/1934099731 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f580ffff700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58180fcf80 0x7f5818114ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f5816ffd700 1 -- 172.21.15.134:0/1934099731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58180fcf80 msgr2=0x7f5818114ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f5816ffd700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58180fcf80 0x7f5818114ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.632+0000 7f5816ffd700 1 -- 172.21.15.134:0/1934099731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800005040 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.633+0000 7f5816ffd700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 0x7f5818112aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f580800eb40 tx=0x7f580800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.633+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5808007cc0 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.633+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5818115530 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.633+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f580800f040 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.633+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580800ca10 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.633+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5818115880 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.634+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581805f5f0 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.634+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f580800cb70 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.635+0000 7f580f7fe700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f58040692a0 0x7f580406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.635+0000 7f580ffff700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f58040692a0 0x7f580406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.635+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5808086d60 con 0x7f58180fbcd0 2024-03-22T07:26:19.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.635+0000 7f580ffff700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f58040692a0 0x7f580406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5800009b30 tx=0x7f5800009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:19.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.639+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f580804e190 con 0x7f58180fbcd0 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.889+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5818115bc0 con 0x7f58180fbcd0 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.890+0000 7f580f7fe700 1 -- 172.21.15.134:0/1934099731 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f580808b070 con 0x7f58180fbcd0 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:26:19.890 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:26:19.891 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:19.892 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f58040692a0 msgr2=0x7f580406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f58040692a0 0x7f580406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5800009b30 tx=0x7f5800009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 msgr2=0x7f5818112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 0x7f5818112aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f580800eb40 tx=0x7f580800b040 comp rx=0 tx=0).stop 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 shutdown_connections 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58180fbcd0 0x7f5818112aa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f58040692a0 0x7f580406b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 --2- 172.21.15.134:0/1934099731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58180fcf80 0x7f5818114ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 >> 172.21.15.134:0/1934099731 conn(0x7f58180f7430 msgr2=0x7f58180f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 shutdown_connections 2024-03-22T07:26:19.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:19.892+0000 7f581d5de700 1 -- 172.21.15.134:0/1934099731 wait complete. 2024-03-22T07:26:19.894 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:26:20.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-03-22T07:26:20.595 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:20.596 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:20 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1934099731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:20.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:20 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1934099731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:26:21.244 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.944+0000 7fdbeec7c700 1 -- 172.21.15.134:0/4164994068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fcf90 msgr2=0x7fdbe80fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.944+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/4164994068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fcf90 0x7fdbe80fd400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4004940 tx=0x7fdbd4009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 -- 172.21.15.134:0/4164994068 shutdown_connections 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/4164994068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fcf90 0x7fdbe80fd400 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/4164994068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fbce0 0x7fdbe80fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 -- 172.21.15.134:0/4164994068 >> 172.21.15.134:0/4164994068 conn(0x7fdbe80f7440 msgr2=0x7fdbe80f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 -- 172.21.15.134:0/4164994068 shutdown_connections 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 -- 172.21.15.134:0/4164994068 wait complete. 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 Processor -- start 2024-03-22T07:26:22.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.945+0000 7fdbeec7c700 1 -- start start 2024-03-22T07:26:22.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:22 smithi134 ceph-mon[29057]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:22.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:22.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:22 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeec7c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 0x7fdbe8066d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeec7c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fcf90 0x7fdbe8114ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeec7c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe810e4c0 con 0x7fdbe80fbce0 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeec7c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8115020 con 0x7fdbe80fcf90 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 0x7fdbe8066d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 0x7fdbe8066d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42786/0 (socket says 172.21.15.134:42786) 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 -- 172.21.15.134:0/863943150 learned_addr learned my addr 172.21.15.134:0/863943150 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbe7fff700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fcf90 0x7fdbe8114ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 -- 172.21.15.134:0/863943150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fcf90 msgr2=0x7fdbe8114ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fcf90 0x7fdbe8114ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 -- 172.21.15.134:0/863943150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4005040 con 0x7fdbe80fbce0 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeca18700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 0x7fdbe8066d70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc002a50 tx=0x7fdbdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:22.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbdc007cc0 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbdc00f040 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbdc009640 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.946+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe8115220 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.947+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe81157e0 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.948+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe804c710 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.948+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdbdc0097c0 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.948+0000 7fdbe57fa700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdbd80692a0 0x7fdbd806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.949+0000 7fdbe7fff700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdbd80692a0 0x7fdbd806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.949+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdbdc086ef0 con 0x7fdbe80fbce0 2024-03-22T07:26:22.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.949+0000 7fdbe7fff700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdbd80692a0 0x7fdbd806b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400b3b0 tx=0x7fdbd4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:22.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:22.953+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdbdc056c60 con 0x7fdbe80fbce0 2024-03-22T07:26:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:22 smithi195 ceph-mon[36144]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:22 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:22 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.209+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbe81047d0 con 0x7fdbe80fbce0 2024-03-22T07:26:23.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.209+0000 7fdbe57fa700 1 -- 172.21.15.134:0/863943150 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4700 (secure 0 0 0) 0x7fdbdc0567f0 con 0x7fdbe80fbce0 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdbd80692a0 msgr2=0x7fdbd806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdbd80692a0 0x7fdbd806b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400b3b0 tx=0x7fdbd4009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 msgr2=0x7fdbe8066d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 0x7fdbe8066d70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc002a50 tx=0x7fdbdc0046b0 comp rx=0 tx=0).stop 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 shutdown_connections 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe80fbce0 0x7fdbe8066d70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdbd80692a0 0x7fdbd806b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 --2- 172.21.15.134:0/863943150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdbe80fcf90 0x7fdbe8114ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.211+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 >> 172.21.15.134:0/863943150 conn(0x7fdbe80f7440 msgr2=0x7fdbe80f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:23.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.212+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 shutdown_connections 2024-03-22T07:26:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:23.212+0000 7fdbeec7c700 1 -- 172.21.15.134:0/863943150 wait complete. 2024-03-22T07:26:23.213 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:26:23.222 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:26:23.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:23 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/863943150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-22T07:26:23.859 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-03-22T07:26:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:23 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/863943150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-22T07:26:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:24 smithi195 ceph-mon[36144]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:25.032 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:24 smithi134 ceph-mon[29057]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:26.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:26 smithi195 ceph-mon[36144]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:27.011 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:26 smithi134 ceph-mon[29057]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:27.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 -- 172.21.15.134:0/606376176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 msgr2=0x7fdf480fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 --2- 172.21.15.134:0/606376176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf480fe4e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c004940 tx=0x7fdf3c009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 -- 172.21.15.134:0/606376176 shutdown_connections 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 --2- 172.21.15.134:0/606376176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf480fe4e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 --2- 172.21.15.134:0/606376176 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf480fcf00 0x7fdf480fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 -- 172.21.15.134:0/606376176 >> 172.21.15.134:0/606376176 conn(0x7fdf480f85a0 msgr2=0x7fdf480fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 -- 172.21.15.134:0/606376176 shutdown_connections 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 -- 172.21.15.134:0/606376176 wait complete. 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.025+0000 7fdf4e471700 1 Processor -- start 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf4e471700 1 -- start start 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf4e471700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf480fcf00 0x7fdf4810da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf4e471700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf4810df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf4e471700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4810e590 con 0x7fdf480fe070 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf4e471700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4810ede0 con 0x7fdf480fcf00 2024-03-22T07:26:27.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf4810df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf4810df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52822/0 (socket says 172.21.15.134:52822) 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 -- 172.21.15.134:0/2179702316 learned_addr learned my addr 172.21.15.134:0/2179702316 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf47fff700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf480fcf00 0x7fdf4810da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 -- 172.21.15.134:0/2179702316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf480fcf00 msgr2=0x7fdf4810da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf480fcf00 0x7fdf4810da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 -- 172.21.15.134:0/2179702316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c005040 con 0x7fdf480fe070 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf477fe700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf4810df90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009150 tx=0x7fdf3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3c00e040 con 0x7fdf480fe070 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4810f060 con 0x7fdf480fe070 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf3c004290 con 0x7fdf480fe070 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.026+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3c01c630 con 0x7fdf480fe070 2024-03-22T07:26:27.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.027+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4810f5a0 con 0x7fdf480fe070 2024-03-22T07:26:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.027+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4805f5f0 con 0x7fdf480fe070 2024-03-22T07:26:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.028+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fdf3c00bbf0 con 0x7fdf480fe070 2024-03-22T07:26:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.028+0000 7fdf44ff9700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdf300692a0 0x7fdf3006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:27.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.028+0000 7fdf47fff700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdf300692a0 0x7fdf3006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.028+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdf3c087ea0 con 0x7fdf480fe070 2024-03-22T07:26:27.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.029+0000 7fdf47fff700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdf300692a0 0x7fdf3006b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf38004f40 tx=0x7fdf3800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:27.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.033+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fdf3c057c10 con 0x7fdf480fe070 2024-03-22T07:26:27.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.303+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fdf4804bed0 con 0x7fdf480fe070 2024-03-22T07:26:27.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.304+0000 7fdf44ff9700 1 -- 172.21.15.134:0/2179702316 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7fdf3c0577a0 con 0x7fdf480fe070 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdf300692a0 msgr2=0x7fdf3006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdf300692a0 0x7fdf3006b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf38004f40 tx=0x7fdf3800b040 comp rx=0 tx=0).stop 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 msgr2=0x7fdf4810df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf4810df90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009150 tx=0x7fdf3c009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 shutdown_connections 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fdf300692a0 0x7fdf3006b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf480fcf00 0x7fdf4810da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 --2- 172.21.15.134:0/2179702316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf480fe070 0x7fdf4810df90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 >> 172.21.15.134:0/2179702316 conn(0x7fdf480f85a0 msgr2=0x7fdf480f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:27.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.306+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 shutdown_connections 2024-03-22T07:26:27.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:27.307+0000 7fdf4e471700 1 -- 172.21.15.134:0/2179702316 wait complete. 2024-03-22T07:26:27.318 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:26:27.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:27 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2179702316' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-03-22T07:26:27.966 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:27 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2179702316' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-03-22T07:26:28.602 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-03-22T07:26:28.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-22T07:26:28.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 -- 172.21.15.134:0/360554165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc066250 msgr2=0x7f2bbc0fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 --2- 172.21.15.134:0/360554165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc066250 0x7f2bbc0fedc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0048d0 tx=0x7f2bac009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 -- 172.21.15.134:0/360554165 shutdown_connections 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 --2- 172.21.15.134:0/360554165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc1016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 --2- 172.21.15.134:0/360554165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc066250 0x7f2bbc0fedc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 -- 172.21.15.134:0/360554165 >> 172.21.15.134:0/360554165 conn(0x7f2bbc0f6850 msgr2=0x7f2bbc0f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 -- 172.21.15.134:0/360554165 shutdown_connections 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.741+0000 7f2bc2814640 1 -- 172.21.15.134:0/360554165 wait complete. 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bc2814640 1 Processor -- start 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bc2814640 1 -- start start 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bc2814640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bbc066250 0x7f2bbc10cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bc2814640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc10d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bc2814640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc10d8c0 con 0x7f2bbc0ff300 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bc2814640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc112230 con 0x7f2bbc066250 2024-03-22T07:26:28.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bbb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc10d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bbb7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc10d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52842/0 (socket says 172.21.15.134:52842) 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bbc066250 0x7f2bbc10cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.742+0000 7f2bbb7fe640 1 -- 172.21.15.134:0/2653343967 learned_addr learned my addr 172.21.15.134:0/2653343967 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bbb7fe640 1 -- 172.21.15.134:0/2653343967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bbc066250 msgr2=0x7f2bbc10cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bbb7fe640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bbc066250 0x7f2bbc10cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bbb7fe640 1 -- 172.21.15.134:0/2653343967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac005040 con 0x7f2bbc0ff300 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bbb7fe640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc10d240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0002a80 tx=0x7f2bb0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb0007c30 con 0x7f2bbc0ff300 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2bb000f040 con 0x7f2bbc0ff300 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc1123d0 con 0x7f2bbc0ff300 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb000dbd0 con 0x7f2bbc0ff300 2024-03-22T07:26:28.746 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.743+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc1128c0 con 0x7f2bbc0ff300 2024-03-22T07:26:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.744+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc04bcc0 con 0x7f2bbc0ff300 2024-03-22T07:26:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.745+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2bb001c400 con 0x7f2bbc0ff300 2024-03-22T07:26:28.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.745+0000 7f2bb8ff9640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ba4069210 0x7f2ba406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.745+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2bb0086fe0 con 0x7f2bbc0ff300 2024-03-22T07:26:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.745+0000 7f2bbbfff640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ba4069210 0x7f2ba406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:28.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.746+0000 7f2bbbfff640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ba4069210 0x7f2ba406b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bac02bda0 tx=0x7f2bac009da0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:28.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.750+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2bb0053300 con 0x7f2bbc0ff300 2024-03-22T07:26:28.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.931+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bbc104d00 con 0x7f2bbc0ff300 2024-03-22T07:26:28.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.932+0000 7f2bb8ff9640 1 -- 172.21.15.134:0/2653343967 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14446 (secure 0 0 0) 0x7f2bb0056920 con 0x7f2bbc0ff300 2024-03-22T07:26:28.933 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:28.933 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":47,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:26:13.436042+0000","last_up_change":"2024-03-22T07:24:41.554325+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-22T07:25:58.466557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-22T07:25:58.807715+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6803","nonce":565382143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6805","nonce":565382143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6809","nonce":565382143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":565382143},{"type":"v1","addr":"172.21.15.134:6807","nonce":565382143}]},"public_addr":"172.21.15.134:6803/565382143","cluster_addr":"172.21.15.134:6805/565382143","heartbeat_back_addr":"172.21.15.134:6809/565382143","heartbeat_front_addr":"172.21.15.134:6807/565382143","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6811","nonce":3411767321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6813","nonce":3411767321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6817","nonce":3411767321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3411767321},{"type":"v1","addr":"172.21.15.134:6815","nonce":3411767321}]},"public_addr":"172.21.15.134:6811/3411767321","cluster_addr":"172.21.15.134:6813/3411767321","heartbeat_back_addr":"172.21.15.134:6817/3411767321","heartbeat_front_addr":"172.21.15.134:6815/3411767321","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6819","nonce":3593450381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6821","nonce":3593450381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6825","nonce":3593450381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3593450381},{"type":"v1","addr":"172.21.15.134:6823","nonce":3593450381}]},"public_addr":"172.21.15.134:6819/3593450381","cluster_addr":"172.21.15.134:6821/3593450381","heartbeat_back_addr":"172.21.15.134:6825/3593450381","heartbeat_front_addr":"172.21.15.134:6823/3593450381","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6801","nonce":2284673901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6803","nonce":2284673901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6807","nonce":2284673901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2284673901},{"type":"v1","addr":"172.21.15.195:6805","nonce":2284673901}]},"public_addr":"172.21.15.195:6801/2284673901","cluster_addr":"172.21.15.195:6803/2284673901","heartbeat_back_addr":"172.21.15.195:6807/2284673901","heartbeat_front_addr":"172.21.15.195:6805/2284673901","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6809","nonce":2507607103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6811","nonce":2507607103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6815","nonce":2507607103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2507607103},{"type":"v1","addr":"172.21.15.195:6813","nonce":2507607103}]},"public_addr":"172.21.15.195:6809/2507607103","cluster_addr":"172.21.15.195:6811/2507607103","heartbeat_back_addr":"172.21.15.195:6815/2507607103","heartbeat_front_addr":"172.21.15.195:6813/2507607103","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6817","nonce":1098061432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6819","nonce":1098061432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6823","nonce":1098061432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1098061432},{"type":"v1","addr":"172.21.15.195:6821","nonce":1098061432}]},"public_addr":"172.21.15.195:6817/1098061432","cluster_addr":"172.21.15.195:6819/1098061432","heartbeat_back_addr":"172.21.15.195:6823/1098061432","heartbeat_front_addr":"172.21.15.195:6821/1098061432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6826/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6827/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ba4069210 msgr2=0x7f2ba406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ba4069210 0x7f2ba406b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bac02bda0 tx=0x7f2bac009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 msgr2=0x7f2bbc10d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc10d240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0002a80 tx=0x7f2bb0004600 comp rx=0 tx=0).stop 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 shutdown_connections 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2ba4069210 0x7f2ba406b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bbc0ff300 0x7f2bbc10d240 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 --2- 172.21.15.134:0/2653343967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bbc066250 0x7f2bbc10cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:28.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 >> 172.21.15.134:0/2653343967 conn(0x7f2bbc0f6850 msgr2=0x7f2bbc0f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 shutdown_connections 2024-03-22T07:26:28.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:28.934+0000 7f2bc2814640 1 -- 172.21.15.134:0/2653343967 wait complete. 2024-03-22T07:26:28.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:28 smithi134 ceph-mon[29057]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:28.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-22T07:23:31.660944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-22T07:25:58.466557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-22T07:25:58.807715+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-22T07:26:28.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-22T07:26:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:28 smithi195 ceph-mon[36144]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-03-22T07:26:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 -- 172.21.15.134:0/2441503538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fb090 msgr2=0x7ff7300fb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 --2- 172.21.15.134:0/2441503538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fb090 0x7ff7300fb4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff7200048d0 tx=0x7ff720009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 -- 172.21.15.134:0/2441503538 shutdown_connections 2024-03-22T07:26:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 --2- 172.21.15.134:0/2441503538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7300fc360 0x7ff7300fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 --2- 172.21.15.134:0/2441503538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fb090 0x7ff7300fb4a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 -- 172.21.15.134:0/2441503538 >> 172.21.15.134:0/2441503538 conn(0x7ff7300f6850 msgr2=0x7ff7300f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 -- 172.21.15.134:0/2441503538 shutdown_connections 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 -- 172.21.15.134:0/2441503538 wait complete. 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 Processor -- start 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.046+0000 7ff7360ae640 1 -- start start 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff7360ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7300fb090 0x7ff730065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff7360ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 0x7ff730111ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff7360ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730111ff0 con 0x7ff7300fc360 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff7360ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730112130 con 0x7ff7300fb090 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 0x7ff730111ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 0x7ff730111ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52860/0 (socket says 172.21.15.134:52860) 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 -- 172.21.15.134:0/3036604729 learned_addr learned my addr 172.21.15.134:0/3036604729 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:29.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 -- 172.21.15.134:0/3036604729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7300fb090 msgr2=0x7ff730065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7300fb090 0x7ff730065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 -- 172.21.15.134:0/3036604729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720005040 con 0x7ff7300fc360 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff726ffd640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 0x7ff730111ab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff71800c830 tx=0x7ff718004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff71800a850 con 0x7ff7300fc360 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff730112390 con 0x7ff7300fc360 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff71800ae80 con 0x7ff7300fc360 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff718012ea0 con 0x7ff7300fc360 2024-03-22T07:26:29.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.047+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff730112880 con 0x7ff7300fc360 2024-03-22T07:26:29.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.048+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730105570 con 0x7ff7300fc360 2024-03-22T07:26:29.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.049+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff718012400 con 0x7ff7300fc360 2024-03-22T07:26:29.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.049+0000 7ff72cff9640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff71c069210 0x7ff71c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.049+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff718087450 con 0x7ff7300fc360 2024-03-22T07:26:29.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.049+0000 7ff72f7fe640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff71c069210 0x7ff71c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.049+0000 7ff72f7fe640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff71c069210 0x7ff71c06b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff720009040 tx=0x7ff720009da0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.053+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff718053730 con 0x7ff7300fc360 2024-03-22T07:26:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.218+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff730103be0 con 0x7ff7300fc360 2024-03-22T07:26:29.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.218+0000 7ff72cff9640 1 -- 172.21.15.134:0/3036604729 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff730103be0 con 0x7ff7300fc360 2024-03-22T07:26:29.220 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff71c069210 msgr2=0x7ff71c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff71c069210 0x7ff71c06b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff720009040 tx=0x7ff720009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 msgr2=0x7ff730111ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 0x7ff730111ab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff71800c830 tx=0x7ff718004430 comp rx=0 tx=0).stop 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 shutdown_connections 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff71c069210 0x7ff71c06b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7300fc360 0x7ff730111ab0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 --2- 172.21.15.134:0/3036604729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7300fb090 0x7ff730065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 >> 172.21.15.134:0/3036604729 conn(0x7ff7300f6850 msgr2=0x7ff7300ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 shutdown_connections 2024-03-22T07:26:29.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.220+0000 7ff7360ae640 1 -- 172.21.15.134:0/3036604729 wait complete. 2024-03-22T07:26:29.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-22T07:26:29.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 -- 172.21.15.134:0/4135281138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fb090 msgr2=0x7f75c40fb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 --2- 172.21.15.134:0/4135281138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fb090 0x7f75c40fb4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f75b40048d0 tx=0x7f75b4009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 -- 172.21.15.134:0/4135281138 shutdown_connections 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 --2- 172.21.15.134:0/4135281138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c40fc360 0x7f75c40fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 --2- 172.21.15.134:0/4135281138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fb090 0x7f75c40fb4a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 -- 172.21.15.134:0/4135281138 >> 172.21.15.134:0/4135281138 conn(0x7f75c40f6870 msgr2=0x7f75c40f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 -- 172.21.15.134:0/4135281138 shutdown_connections 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.331+0000 7f75ca79d640 1 -- 172.21.15.134:0/4135281138 wait complete. 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75ca79d640 1 Processor -- start 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75ca79d640 1 -- start start 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75ca79d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c40fb090 0x7f75c40fefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75ca79d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 0x7f75c40fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75ca79d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40ff620 con 0x7f75c40fc360 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75ca79d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40fdbe0 con 0x7f75c40fb090 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 0x7f75c40fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c37fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 0x7f75c40fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52884/0 (socket says 172.21.15.134:52884) 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c37fe640 1 -- 172.21.15.134:0/1289974294 learned_addr learned my addr 172.21.15.134:0/1289974294 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:29.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c3fff640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c40fb090 0x7f75c40fefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c37fe640 1 -- 172.21.15.134:0/1289974294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c40fb090 msgr2=0x7f75c40fefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c37fe640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c40fb090 0x7f75c40fefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.332+0000 7f75c37fe640 1 -- 172.21.15.134:0/1289974294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4005040 con 0x7f75c40fc360 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.333+0000 7f75c37fe640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 0x7f75c40fd6a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f75b8002a50 tx=0x7f75b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.333+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b8007c30 con 0x7f75c40fc360 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.333+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75b800f040 con 0x7f75c40fc360 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.333+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c40fdec0 con 0x7f75c40fc360 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.333+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b800db50 con 0x7f75c40fc360 2024-03-22T07:26:29.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.333+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c40fe3e0 con 0x7f75c40fc360 2024-03-22T07:26:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.334+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c404bcc0 con 0x7f75c40fc360 2024-03-22T07:26:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.334+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f75b800dcf0 con 0x7f75c40fc360 2024-03-22T07:26:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.335+0000 7f75c0ff9640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f75ac069210 0x7f75ac06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.335+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f75b8086a40 con 0x7f75c40fc360 2024-03-22T07:26:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.335+0000 7f75c3fff640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f75ac069210 0x7f75ac06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.337 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.335+0000 7f75c3fff640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f75ac069210 0x7f75ac06b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75b40317e0 tx=0x7f75b4009da0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.339+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f75b804d190 con 0x7f75c40fc360 2024-03-22T07:26:29.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.504+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f75c4103c00 con 0x7f75c40fc360 2024-03-22T07:26:29.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.505+0000 7f75c0ff9640 1 -- 172.21.15.134:0/1289974294 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f75b8052e90 con 0x7f75c40fc360 2024-03-22T07:26:29.506 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.506+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f75ac069210 msgr2=0x7f75ac06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.506+0000 7f75ca79d640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f75ac069210 0x7f75ac06b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75b40317e0 tx=0x7f75b4009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.506+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 msgr2=0x7f75c40fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.506+0000 7f75ca79d640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 0x7f75c40fd6a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f75b8002a50 tx=0x7f75b8004600 comp rx=0 tx=0).stop 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 shutdown_connections 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f75ac069210 0x7f75ac06b6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75c40fc360 0x7f75c40fd6a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.508 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 --2- 172.21.15.134:0/1289974294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75c40fb090 0x7f75c40fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 >> 172.21.15.134:0/1289974294 conn(0x7f75c40f6870 msgr2=0x7f75c4064370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 shutdown_connections 2024-03-22T07:26:29.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.507+0000 7f75ca79d640 1 -- 172.21.15.134:0/1289974294 wait complete. 2024-03-22T07:26:29.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-22T07:26:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 -- 172.21.15.134:0/2846994423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 msgr2=0x7f91b40fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 --2- 172.21.15.134:0/2846994423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b40fc7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91a80048d0 tx=0x7f91a8009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 -- 172.21.15.134:0/2846994423 shutdown_connections 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 --2- 172.21.15.134:0/2846994423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b40fc7d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 --2- 172.21.15.134:0/2846994423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b40fb090 0x7f91b40fb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 -- 172.21.15.134:0/2846994423 >> 172.21.15.134:0/2846994423 conn(0x7f91b40f6850 msgr2=0x7f91b40f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 -- 172.21.15.134:0/2846994423 shutdown_connections 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.617+0000 7f91bb02e640 1 -- 172.21.15.134:0/2846994423 wait complete. 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91bb02e640 1 Processor -- start 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91bb02e640 1 -- start start 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91bb02e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b40fb090 0x7f91b410bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91bb02e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91bb02e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b410c770 con 0x7f91b40fc360 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91bb02e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4111170 con 0x7f91b40fb090 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91b3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91b3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b410c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52900/0 (socket says 172.21.15.134:52900) 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.618+0000 7f91b3fff640 1 -- 172.21.15.134:0/4175347912 learned_addr learned my addr 172.21.15.134:0/4175347912 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b8dca640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b40fb090 0x7f91b410bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b3fff640 1 -- 172.21.15.134:0/4175347912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b40fb090 msgr2=0x7f91b410bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b3fff640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b40fb090 0x7f91b410bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b3fff640 1 -- 172.21.15.134:0/4175347912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8005040 con 0x7f91b40fc360 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b3fff640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b410c120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f91a8007da0 tx=0x7f91a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a80094c0 con 0x7f91b40fc360 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91a8009620 con 0x7f91b40fc360 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b41112b0 con 0x7f91b40fc360 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91a803b620 con 0x7f91b40fc360 2024-03-22T07:26:29.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.619+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b41117a0 con 0x7f91b40fc360 2024-03-22T07:26:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.620+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b4105590 con 0x7f91b40fc360 2024-03-22T07:26:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.620+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f91a802f070 con 0x7f91b40fc360 2024-03-22T07:26:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.621+0000 7f91b17fa640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f919c069210 0x7f919c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.621+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f91a80a97c0 con 0x7f91b40fc360 2024-03-22T07:26:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.621+0000 7f91b8dca640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f919c069210 0x7f919c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.621+0000 7f91b8dca640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f919c069210 0x7f919c06b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91a4007fd0 tx=0x7f91a4009e90 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.625+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f91a8075a20 con 0x7f91b40fc360 2024-03-22T07:26:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.791+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f91b4103c00 con 0x7f91b40fc360 2024-03-22T07:26:29.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.792+0000 7f91b17fa640 1 -- 172.21.15.134:0/4175347912 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f91a8079040 con 0x7f91b40fc360 2024-03-22T07:26:29.793 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:26:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f919c069210 msgr2=0x7f919c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f919c069210 0x7f919c06b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91a4007fd0 tx=0x7f91a4009e90 comp rx=0 tx=0).stop 2024-03-22T07:26:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 msgr2=0x7f91b410c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b410c120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f91a8007da0 tx=0x7f91a8009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 shutdown_connections 2024-03-22T07:26:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f919c069210 0x7f919c06b6c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91b40fc360 0x7f91b410c120 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 --2- 172.21.15.134:0/4175347912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91b40fb090 0x7f91b410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 >> 172.21.15.134:0/4175347912 conn(0x7f91b40f6850 msgr2=0x7f91b40ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 shutdown_connections 2024-03-22T07:26:29.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.794+0000 7f91bb02e640 1 -- 172.21.15.134:0/4175347912 wait complete. 2024-03-22T07:26:29.806 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-22T07:26:29.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.902+0000 7fed90a6e640 1 -- 172.21.15.134:0/3443815578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fc370 msgr2=0x7fed8c0fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.902+0000 7fed90a6e640 1 --2- 172.21.15.134:0/3443815578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fc370 0x7fed8c0fc7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed740048d0 tx=0x7fed74009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- 172.21.15.134:0/3443815578 shutdown_connections 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 --2- 172.21.15.134:0/3443815578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fc370 0x7fed8c0fc7e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 --2- 172.21.15.134:0/3443815578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c0fb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- 172.21.15.134:0/3443815578 >> 172.21.15.134:0/3443815578 conn(0x7fed8c0f6840 msgr2=0x7fed8c0f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- 172.21.15.134:0/3443815578 shutdown_connections 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- 172.21.15.134:0/3443815578 wait complete. 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 Processor -- start 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- start start 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c10bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fc370 0x7fed8c10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c10c730 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed90a6e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c111130 con 0x7fed8c0fc370 2024-03-22T07:26:29.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c10bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c10bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52906/0 (socket says 172.21.15.134:52906) 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed8a59c640 1 -- 172.21.15.134:0/2278232657 learned_addr learned my addr 172.21.15.134:0/2278232657 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed8a59c640 1 -- 172.21.15.134:0/2278232657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fc370 msgr2=0x7fed8c10c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.903+0000 7fed8a59c640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fc370 0x7fed8c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed8a59c640 1 -- 172.21.15.134:0/2278232657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74005040 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed8a59c640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c10bba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00eb70 tx=0x7fed7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c007c30 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed7c00f040 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed7c0095b0 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c111270 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.904+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c111760 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.905+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c1055a0 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.905+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fed7c009730 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.906+0000 7fed82ffd640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed78069210 0x7fed7806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:29.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.906+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fed7c086f60 con 0x7fed8c0fb0a0 2024-03-22T07:26:29.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.906+0000 7fed83fff640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed78069210 0x7fed7806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:29.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.906+0000 7fed83fff640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed78069210 0x7fed7806b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed7402be70 tx=0x7fed74009da0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:29.911 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:29.910+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fed7c0531c0 con 0x7fed8c0fb0a0 2024-03-22T07:26:30.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.112+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed8c111a30 con 0x7fed8c0fb0a0 2024-03-22T07:26:30.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.112+0000 7fed82ffd640 1 -- 172.21.15.134:0/2278232657 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4700 (secure 0 0 0) 0x7fed7c0567e0 con 0x7fed8c0fb0a0 2024-03-22T07:26:30.114 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:30.114 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/1210336512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1210336512},{"type":"v1","addr":"172.21.15.134:6827","nonce":1210336512}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:26:16.446375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi134.dexlss","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/2483774939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2483774939},{"type":"v1","addr":"172.21.15.134:6829","nonce":2483774939}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-03-22T07:26:30.114 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed78069210 msgr2=0x7fed7806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed78069210 0x7fed7806b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed7402be70 tx=0x7fed74009da0 comp rx=0 tx=0).stop 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 msgr2=0x7fed8c10bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c10bba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00eb70 tx=0x7fed7c00b040 comp rx=0 tx=0).stop 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 shutdown_connections 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fed78069210 0x7fed7806b6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed8c0fc370 0x7fed8c10c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 --2- 172.21.15.134:0/2278232657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed8c0fb0a0 0x7fed8c10bba0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.114+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 >> 172.21.15.134:0/2278232657 conn(0x7fed8c0f6840 msgr2=0x7fed8c0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.115+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 shutdown_connections 2024-03-22T07:26:30.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:30.115+0000 7fed90a6e640 1 -- 172.21.15.134:0/2278232657 wait complete. 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2653343967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3036604729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1289974294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:26:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:29 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/4175347912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:26:30.127 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-03-22T07:26:30.127 INFO:teuthology.run_tasks:Running task kclient... 2024-03-22T07:26:30.152 INFO:tasks.kclient:Mounting kernel clients... 2024-03-22T07:26:30.153 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-03-22T07:26:30.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:30.153 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-03-22T07:26:30.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:30.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2653343967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:26:30.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3036604729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:26:30.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-03-22T07:26:30.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1289974294' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:26:30.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:29 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/4175347912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:26:30.237 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-03-22T07:26:30.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:26:30.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:30.238 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-03-22T07:26:30.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:30.257 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-03-22T07:26:30.334 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-03-22T07:26:30.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:26:30.336 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-22T07:26:30.336 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-22T07:26:30.336 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:30.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph fs ls 2024-03-22T07:26:30.608 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:30 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2278232657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-22T07:26:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:31.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:30 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2278232657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-22T07:26:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:31.992 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:31 smithi134 ceph-mon[29057]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-22T07:26:32.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1222687673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8102710 msgr2=0x7f9bf80fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:32.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1222687673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8102710 0x7f9bf80fbd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9be8004940 tx=0x7f9be8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:32.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1222687673 shutdown_connections 2024-03-22T07:26:32.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1222687673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8102710 0x7f9bf80fbd80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:32.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1222687673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8101d70 0x7f9bf8102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:32.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1222687673 >> 172.21.15.134:0/1222687673 conn(0x7f9bf8072bc0 msgr2=0x7f9bf8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1222687673 shutdown_connections 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1222687673 wait complete. 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 Processor -- start 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.200+0000 7f9bff0cc700 1 -- start start 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bff0cc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 0x7f9bf8113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bff0cc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8102710 0x7f9bf8114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bff0cc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf8114750 con 0x7f9bf8101d70 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bff0cc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf810daf0 con 0x7f9bf8102710 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 0x7f9bf8113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 0x7f9bf8113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52932/0 (socket says 172.21.15.134:52932) 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 -- 172.21.15.134:0/1647078289 learned_addr learned my addr 172.21.15.134:0/1647078289 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:32.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9beffff700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8102710 0x7f9bf8114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 -- 172.21.15.134:0/1647078289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8102710 msgr2=0x7f9bf8114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8102710 0x7f9bf8114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 -- 172.21.15.134:0/1647078289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8005040 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.201+0000 7f9bfce68700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 0x7f9bf8113b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400bbb0 tx=0x7f9bf4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.202+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf40092e0 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.202+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf810ddd0 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.202+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bf400cb20 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.202+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf4015d70 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.202+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf810e360 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.203+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf80fd4c0 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.203+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f9bf4012070 con 0x7f9bf8101d70 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.203+0000 7f9bed7fa700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f9be00692a0 0x7f9be006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:32.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.204+0000 7f9beffff700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f9be00692a0 0x7f9be006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:32.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.204+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9bf4086f20 con 0x7f9bf8101d70 2024-03-22T07:26:32.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.204+0000 7f9beffff700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f9be00692a0 0x7f9be006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bf810f410 tx=0x7f9be8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:32.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:31 smithi195 ceph-mon[36144]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-03-22T07:26:32.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.208+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9bf4056c10 con 0x7f9bf8101d70 2024-03-22T07:26:32.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.439+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9bf804bed0 con 0x7f9bf8101d70 2024-03-22T07:26:32.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.439+0000 7f9bed7fa700 1 -- 172.21.15.134:0/1647078289 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f9bf40567a0 con 0x7f9bf8101d70 2024-03-22T07:26:32.441 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-03-22T07:26:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.441+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f9be00692a0 msgr2=0x7f9be006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.441+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f9be00692a0 0x7f9be006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bf810f410 tx=0x7f9be8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.441+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 msgr2=0x7f9bf8113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.441+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 0x7f9bf8113b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400bbb0 tx=0x7f9bf4009840 comp rx=0 tx=0).stop 2024-03-22T07:26:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 shutdown_connections 2024-03-22T07:26:32.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9bf8101d70 0x7f9bf8113b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:32.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f9be00692a0 0x7f9be006b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:32.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 --2- 172.21.15.134:0/1647078289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8102710 0x7f9bf8114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:32.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 >> 172.21.15.134:0/1647078289 conn(0x7f9bf8072bc0 msgr2=0x7f9bf8065940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:32.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 shutdown_connections 2024-03-22T07:26:32.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:32.442+0000 7f9bff0cc700 1 -- 172.21.15.134:0/1647078289 wait complete. 2024-03-22T07:26:33.041 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-22T07:26:33.041 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-22T07:26:33.041 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-03-22T07:26:33.042 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-22T07:26:33.042 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:33.042 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-22T07:26:33.042 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-22T07:26:33.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-22T07:26:33.042 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-22T07:26:33.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.042 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-03-22T07:26:33.058 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42217sec preferred_lft 42217sec 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-03-22T07:26:33.059 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-03-22T07:26:33.060 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-22T07:26:33.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-22T07:26:33.060 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-22T07:26:33.123 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:32 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1647078289' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-22T07:26:33.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:32 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1647078289' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-22T07:26:33.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.235 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-22T07:26:33.302 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-03-22T07:26:33.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.304 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-03-22T07:26:33.371 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-03-22T07:26:33.371 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-22T07:26:33.371 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-22T07:26:33.371 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-22T07:26:33.372 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-22T07:26:33.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.372 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-22T07:26:33.372 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-22T07:26:33.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-22T07:26:33.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-22T07:26:33.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-22T07:26:33.372 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-22T07:26:33.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.673 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-03-22T07:26:33.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.688 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-03-22T07:26:33.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.743 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-22T07:26:33.743 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-22T07:26:33.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-22T07:26:33.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-22T07:26:33.743 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-22T07:26:33.827 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-22T07:26:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-22T07:26:33.827 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-22T07:26:33.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:33.965 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-22T07:26:33.965 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-22T07:26:33.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-03-22T07:26:33.965 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-03-22T07:26:33.965 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-22T07:26:34.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-22T07:26:34.007 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:34.061 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-22T07:26:34.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-22T07:26:34.061 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:34.116 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-22T07:26:34.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:34.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-22T07:26:34.179 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:33 smithi134 ceph-mon[29057]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-22T07:26:34.204 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-22T07:26:34.205 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-22T07:26:34.205 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-03-22T07:26:34.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:33 smithi195 ceph-mon[36144]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-22T07:26:34.310 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-22T07:26:34.310 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-22T07:26:34.310 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-03-22T07:26:34.310 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.195:3300" 2024-03-22T07:26:34.311 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.195:3300" 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.195:6789" 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.195:6789:/ 2024-03-22T07:26:34.319 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5a05dc38-e81c-11ee-95cd-87774f69a715" will pass to kernel 2024-03-22T07:26:34.325 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-22T07:26:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-03-22T07:26:34.325 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-22T07:26:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-03-22T07:26:34.326 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-22T07:26:34.327 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-22T07:26:34.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:34.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:34.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:34.395 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-22T07:26:34.455 INFO:teuthology.orchestra.run.smithi134.stdout:client14526 2024-03-22T07:26:34.455 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:26:34.455 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-22T07:26:34.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:34.512 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-22T07:26:34.572 INFO:teuthology.orchestra.run.smithi134.stdout:client14526 2024-03-22T07:26:34.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:34.572 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-22T07:26:34.631 INFO:teuthology.orchestra.run.smithi134.stdout:client14526 2024-03-22T07:26:34.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:34.632 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715.client14526/status') 2024-03-22T07:26:34.702 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.14526 (3)192.168.0.1:0/3944219376 2024-03-22T07:26:34.702 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-03-22T07:26:34.702 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-03-22T07:26:34.702 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-03-22T07:26:34.702 INFO:teuthology.orchestra.run.smithi134.stderr:70 bytes copied, 2.1384e-05 s, 3.3 MB/s 2024-03-22T07:26:34.703 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-22T07:26:34.703 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-22T07:26:34.703 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:34.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- ceph fs ls 2024-03-22T07:26:35.000 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:36.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 -- 172.21.15.134:0/362550492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 msgr2=0x7fa0880fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:36.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 --2- 172.21.15.134:0/362550492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa0880fce10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa078004940 tx=0x7fa078009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:36.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 -- 172.21.15.134:0/362550492 shutdown_connections 2024-03-22T07:26:36.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 --2- 172.21.15.134:0/362550492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa0880fce10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:36.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 --2- 172.21.15.134:0/362550492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 0x7fa0881031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:36.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 -- 172.21.15.134:0/362550492 >> 172.21.15.134:0/362550492 conn(0x7fa0880f89b0 msgr2=0x7fa0880fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:36.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 -- 172.21.15.134:0/362550492 shutdown_connections 2024-03-22T07:26:36.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 -- 172.21.15.134:0/362550492 wait complete. 2024-03-22T07:26:36.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:36 smithi134 ceph-mon[29057]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:36.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 Processor -- start 2024-03-22T07:26:36.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.661+0000 7fa090539700 1 -- start start 2024-03-22T07:26:36.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa090539700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 0x7fa088113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:36.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa090539700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa088113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:36.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa090539700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0881144a0 con 0x7fa0881037a0 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa090539700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08810daf0 con 0x7fa088102e00 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa088113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa088113e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37852/0 (socket says 172.21.15.134:37852) 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 -- 172.21.15.134:0/1211229094 learned_addr learned my addr 172.21.15.134:0/1211229094 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08e2d5700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 0x7fa088113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 -- 172.21.15.134:0/1211229094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 msgr2=0x7fa088113910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 0x7fa088113910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 -- 172.21.15.134:0/1211229094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078005040 con 0x7fa0881037a0 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08e2d5700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 0x7fa088113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa08dad4700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa088113e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa078000c00 tx=0x7fa078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:36.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa078021070 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08810dd70 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.662+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa078013cd0 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.663+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07800e070 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.663+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08810e250 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.664+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa07801c400 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.664+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0881052d0 con 0x7fa0881037a0 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.664+0000 7fa07effd700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0740692a0 0x7fa07406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:36.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.664+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa078088580 con 0x7fa0881037a0 2024-03-22T07:26:36.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.664+0000 7fa08e2d5700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0740692a0 0x7fa07406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:36.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.665+0000 7fa08e2d5700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0740692a0 0x7fa07406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa084004600 tx=0x7fa08400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:36.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.669+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa078058390 con 0x7fa0881037a0 2024-03-22T07:26:36.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:36 smithi195 ceph-mon[36144]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:36.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.895+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa08810ef60 con 0x7fa0881037a0 2024-03-22T07:26:36.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.895+0000 7fa07effd700 1 -- 172.21.15.134:0/1211229094 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa078057f20 con 0x7fa0881037a0 2024-03-22T07:26:36.897 INFO:teuthology.orchestra.run.smithi134.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0740692a0 msgr2=0x7fa07406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0740692a0 0x7fa07406b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa084004600 tx=0x7fa08400b040 comp rx=0 tx=0).stop 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 msgr2=0x7fa088113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa088113e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa078000c00 tx=0x7fa078009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 shutdown_connections 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa0740692a0 0x7fa07406b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa088102e00 0x7fa088113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 --2- 172.21.15.134:0/1211229094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0881037a0 0x7fa088113e50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 >> 172.21.15.134:0/1211229094 conn(0x7fa0880f89b0 msgr2=0x7fa0881021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.897+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 shutdown_connections 2024-03-22T07:26:36.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:36.898+0000 7fa090539700 1 -- 172.21.15.134:0/1211229094 wait complete. 2024-03-22T07:26:37.507 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:37 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1211229094' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-22T07:26:37.531 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-22T07:26:37.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:37.532 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-03-22T07:26:37.550 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-22T07:26:37.550 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-22T07:26:37.550 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-03-22T07:26:37.550 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f0 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: altname enp7s0f1 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42208sec preferred_lft 42208sec 2024-03-22T07:26:37.551 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-03-22T07:26:37.552 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-03-22T07:26:37.552 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-22T07:26:37.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-22T07:26:37.552 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-03-22T07:26:37.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:37 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1211229094' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-22T07:26:37.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:37.966 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-22T07:26:37.995 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-03-22T07:26:37.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:37.996 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-03-22T07:26:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-03-22T07:26:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-22T07:26:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-22T07:26:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-22T07:26:38.067 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-22T07:26:38.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.068 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-03-22T07:26:38.068 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-03-22T07:26:38.068 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-22T07:26:38.068 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-22T07:26:38.068 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-22T07:26:38.068 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-03-22T07:26:38.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.340 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-03-22T07:26:38.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.355 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-03-22T07:26:38.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.409 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-03-22T07:26:38.409 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-03-22T07:26:38.409 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-22T07:26:38.409 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-22T07:26:38.409 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-03-22T07:26:38.474 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:38 smithi195 ceph-mon[36144]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:38.493 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-22T07:26:38.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-22T07:26:38.494 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-03-22T07:26:38.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.635 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-03-22T07:26:38.635 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-03-22T07:26:38.636 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-03-22T07:26:38.636 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-03-22T07:26:38.636 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-03-22T07:26:38.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-22T07:26:38.679 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:38.734 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-22T07:26:38.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-22T07:26:38.734 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:38.789 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-22T07:26:38.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:38.789 DEBUG:teuthology.orchestra.run.smithi195:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-22T07:26:38.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:38 smithi134 ceph-mon[29057]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:26:38.920 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-22T07:26:38.920 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-22T07:26:38.920 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-03-22T07:26:39.022 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-22T07:26:39.022 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-22T07:26:39.022 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-03-22T07:26:39.022 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.195:3300" 2024-03-22T07:26:39.022 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-22T07:26:39.040 INFO:teuthology.orchestra.run.smithi195.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-22T07:26:39.040 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:invalid new device string format 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.134:3300,172.21.15.195:3300" 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: resolved to: "172.21.15.134:6789,172.21.15.195:6789" 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.134:6789,172.21.15.195:6789:/ 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5a05dc38-e81c-11ee-95cd-87774f69a715" will pass to kernel 2024-03-22T07:26:39.041 INFO:teuthology.orchestra.run.smithi195.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-22T07:26:39.042 INFO:teuthology.orchestra.run.smithi195.stdout: You just mounted a file system that supports labels which does not 2024-03-22T07:26:39.042 INFO:teuthology.orchestra.run.smithi195.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-22T07:26:39.042 INFO:teuthology.orchestra.run.smithi195.stdout: applications will generate AVC messages and not be allowed access to 2024-03-22T07:26:39.042 INFO:teuthology.orchestra.run.smithi195.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-22T07:26:39.043 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-22T07:26:39.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:39.044 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:39.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:39.071 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-22T07:26:39.128 INFO:teuthology.orchestra.run.smithi195.stdout:client24319 2024-03-22T07:26:39.128 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:26:39.128 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-22T07:26:39.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:39.184 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-22T07:26:39.241 INFO:teuthology.orchestra.run.smithi195.stdout:client24319 2024-03-22T07:26:39.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:39.242 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-22T07:26:39.297 INFO:teuthology.orchestra.run.smithi195.stdout:client24319 2024-03-22T07:26:39.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:26:39.298 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715.client24319/status') 2024-03-22T07:26:39.364 INFO:teuthology.orchestra.run.smithi195.stdout:instance: client.24319 (3)192.168.0.1:0/439064909 2024-03-22T07:26:39.364 INFO:teuthology.orchestra.run.smithi195.stdout:blocklisted: false 2024-03-22T07:26:39.364 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2024-03-22T07:26:39.364 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2024-03-22T07:26:39.364 INFO:teuthology.orchestra.run.smithi195.stderr:69 bytes copied, 2.0576e-05 s, 3.4 MB/s 2024-03-22T07:26:39.365 INFO:teuthology.run_tasks:Running task print... 2024-03-22T07:26:39.376 INFO:teuthology.task.print:**** done client 2024-03-22T07:26:39.376 INFO:teuthology.run_tasks:Running task parallel... 2024-03-22T07:26:39.429 INFO:teuthology.task.parallel:starting parallel... 2024-03-22T07:26:39.429 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-22T07:26:39.429 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-22T07:26:39.430 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:39.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-03-22T07:26:39.430 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-22T07:26:39.430 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-03-22T07:26:39.434 INFO:tasks.workunit:Pulling workunits from ref 768f6cd6e95d0c7a626042719c230df59bdba9d3 2024-03-22T07:26:39.434 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-22T07:26:39.434 INFO:tasks.workunit:timeout=3h 2024-03-22T07:26:39.434 INFO:tasks.workunit:cleanup=True 2024-03-22T07:26:39.434 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 94h/148d Inode: 1 Links: 2 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-22 07:26:03.602392556 +0000 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-22 07:26:34.392823097 +0000 2024-03-22T07:26:39.455 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-03-22 07:26:03.602392556 +0000 2024-03-22T07:26:39.455 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-22T07:26:39.456 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-22T07:26:39.530 DEBUG:teuthology.orchestra.run.smithi195:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-22 07:26:39.525704003 +0000 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-22 07:26:39.525704003 +0000 2024-03-22T07:26:39.545 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-22 07:26:03.602392556 +0000 2024-03-22T07:26:39.546 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-22T07:26:39.546 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-22T07:26:39.617 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 768f6cd6e95d0c7a626042719c230df59bdba9d3 2024-03-22T07:26:39.618 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 768f6cd6e95d0c7a626042719c230df59bdba9d3 2024-03-22T07:26:39.634 INFO:tasks.workunit.client.0.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-22T07:26:39.673 INFO:tasks.workunit.client.1.smithi195.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-22T07:26:39.711 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:40.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:40 smithi195 ceph-mon[36144]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:26:40.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:40 smithi134 ceph-mon[29057]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.254+0000 7f4f0afbc700 1 -- 172.21.15.134:0/631770660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fce50 msgr2=0x7f4f040fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.254+0000 7f4f0afbc700 1 --2- 172.21.15.134:0/631770660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fce50 0x7f4f040fd260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8004940 tx=0x7f4ef8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.254+0000 7f4f0afbc700 1 -- 172.21.15.134:0/631770660 shutdown_connections 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.254+0000 7f4f0afbc700 1 --2- 172.21.15.134:0/631770660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f040fe050 0x7f4f040fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.254+0000 7f4f0afbc700 1 --2- 172.21.15.134:0/631770660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fce50 0x7f4f040fd260 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.254+0000 7f4f0afbc700 1 -- 172.21.15.134:0/631770660 >> 172.21.15.134:0/631770660 conn(0x7f4f040f8580 msgr2=0x7f4f040fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 -- 172.21.15.134:0/631770660 shutdown_connections 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 -- 172.21.15.134:0/631770660 wait complete. 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 Processor -- start 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 -- start start 2024-03-22T07:26:41.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f040fce50 0x7f4f0410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fe050 0x7f4f0410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0410e4a0 con 0x7f4f040fe050 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.255+0000 7f4f0afbc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0410e610 con 0x7f4f040fce50 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fe050 0x7f4f0410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fe050 0x7f4f0410dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37868/0 (socket says 172.21.15.134:37868) 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 -- 172.21.15.134:0/1270146711 learned_addr learned my addr 172.21.15.134:0/1270146711 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f08d58700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f040fce50 0x7f4f0410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 -- 172.21.15.134:0/1270146711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f040fce50 msgr2=0x7f4f0410d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f040fce50 0x7f4f0410d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 -- 172.21.15.134:0/1270146711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8005040 con 0x7f4f040fe050 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f08d58700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f040fce50 0x7f4f0410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f03fff700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f040fe050 0x7f4f0410dea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0002a50 tx=0x7f4ef00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef0007cc0 con 0x7f4f040fe050 2024-03-22T07:26:41.258 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ef000f040 con 0x7f4f040fe050 2024-03-22T07:26:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f0afbc700 1 -- 172.21.15.134:0/1270146711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f04113070 con 0x7f4f040fe050 2024-03-22T07:26:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef0009640 con 0x7f4f040fe050 2024-03-22T07:26:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.256+0000 7f4f0afbc700 1 -- 172.21.15.134:0/1270146711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f04113630 con 0x7f4f040fe050 2024-03-22T07:26:41.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.257+0000 7f4f0afbc700 1 -- 172.21.15.134:0/1270146711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0404c710 con 0x7f4f040fe050 2024-03-22T07:26:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.258+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4ef00097c0 con 0x7f4f040fe050 2024-03-22T07:26:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.258+0000 7f4f017fa700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4ef40692a0 0x7f4ef406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.258+0000 7f4f08d58700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4ef40692a0 0x7f4ef406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.258+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4ef0086f00 con 0x7f4f040fe050 2024-03-22T07:26:41.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.258+0000 7f4f08d58700 1 --2- 172.21.15.134:0/1270146711 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4ef40692a0 0x7f4ef406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009fd0 tx=0x7f4ef8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:41.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.263+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4ef0056c70 con 0x7f4f040fe050 2024-03-22T07:26:41.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.450+0000 7f4f0afbc700 1 -- 172.21.15.134:0/1270146711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f4f041058e0 con 0x7f4f040fe050 2024-03-22T07:26:41.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:41.451+0000 7f4f017fa700 1 -- 172.21.15.134:0/1270146711 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f4ef0056800 con 0x7f4f040fe050 2024-03-22T07:26:41.453 INFO:teuthology.orchestra.run.smithi134.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-03-22T07:26:42.112 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-22T07:26:42.113 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:42.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-03-22T07:26:42.411 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:42.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:42 smithi195 ceph-mon[36144]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:26:42.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:42 smithi134 ceph-mon[29057]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:26:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 -- 172.21.15.134:0/1854462098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 msgr2=0x7f54a00fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1854462098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a00fc0e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f549c004940 tx=0x7f549c009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 -- 172.21.15.134:0/1854462098 shutdown_connections 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1854462098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54a00fcf80 0x7f54a00fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1854462098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a00fc0e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 -- 172.21.15.134:0/1854462098 >> 172.21.15.134:0/1854462098 conn(0x7f54a00f7430 msgr2=0x7f54a00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 -- 172.21.15.134:0/1854462098 shutdown_connections 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.033+0000 7f54a86e3700 1 -- 172.21.15.134:0/1854462098 wait complete. 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a86e3700 1 Processor -- start 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a86e3700 1 -- start start 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a86e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a010fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a86e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54a00fcf80 0x7f54a01101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a86e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01107d0 con 0x7f54a00fbcd0 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a86e3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0110fd0 con 0x7f54a00fcf80 2024-03-22T07:26:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a647f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a010fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a647f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a010fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54582/0 (socket says 172.21.15.134:54582) 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a647f700 1 -- 172.21.15.134:0/1029273403 learned_addr learned my addr 172.21.15.134:0/1029273403 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a5c7e700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54a00fcf80 0x7f54a01101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a647f700 1 -- 172.21.15.134:0/1029273403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54a00fcf80 msgr2=0x7f54a01101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a647f700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54a00fcf80 0x7f54a01101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.034+0000 7f54a647f700 1 -- 172.21.15.134:0/1029273403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c005040 con 0x7f54a00fbcd0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.035+0000 7f54a647f700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a010fc90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f549c00b3b0 tx=0x7f549c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.035+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549c00e040 con 0x7f54a00fbcd0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.035+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f549c00bbf0 con 0x7f54a00fbcd0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.035+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549c01c630 con 0x7f54a00fbcd0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.035+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0111250 con 0x7f54a00fbcd0 2024-03-22T07:26:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.035+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0111790 con 0x7f54a00fbcd0 2024-03-22T07:26:44.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.036+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a0101910 con 0x7f54a00fbcd0 2024-03-22T07:26:44.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.036+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f549c00bd60 con 0x7f54a00fbcd0 2024-03-22T07:26:44.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.037+0000 7f5496ffd700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f548c0692a0 0x7f548c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:44.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.037+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f549c087dc0 con 0x7f54a00fbcd0 2024-03-22T07:26:44.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.037+0000 7f54a5c7e700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f548c0692a0 0x7f548c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:44.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.037+0000 7f54a5c7e700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f548c0692a0 0x7f548c06b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5490004f40 tx=0x7f549000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:44.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.041+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f549c057bd0 con 0x7f54a00fbcd0 2024-03-22T07:26:44.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.225+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f54a005f5f0 con 0x7f54a00fbcd0 2024-03-22T07:26:44.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.226+0000 7f5496ffd700 1 -- 172.21.15.134:0/1029273403 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f549c057760 con 0x7f54a00fbcd0 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.227+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f548c0692a0 msgr2=0x7f548c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.227+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f548c0692a0 0x7f548c06b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5490004f40 tx=0x7f549000b040 comp rx=0 tx=0).stop 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.227+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 msgr2=0x7f54a010fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.227+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a010fc90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f549c00b3b0 tx=0x7f549c009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 shutdown_connections 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54a00fbcd0 0x7f54a010fc90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:44.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f548c0692a0 0x7f548c06b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:44.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 --2- 172.21.15.134:0/1029273403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54a00fcf80 0x7f54a01101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:44.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 >> 172.21.15.134:0/1029273403 conn(0x7f54a00f7430 msgr2=0x7f54a0065b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:44.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 shutdown_connections 2024-03-22T07:26:44.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:44.228+0000 7f54a86e3700 1 -- 172.21.15.134:0/1029273403 wait complete. 2024-03-22T07:26:44.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:44 smithi134 ceph-mon[29057]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-22T07:26:44.918 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-03-22T07:26:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:44 smithi195 ceph-mon[36144]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-22T07:26:45.177 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:45.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:26:46.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:46 smithi134 ceph-mon[29057]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-22T07:26:46.797 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 -- 172.21.15.134:0/824199002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 msgr2=0x7f2ff00faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 --2- 172.21.15.134:0/824199002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff00faee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0004940 tx=0x7f2fe0009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 -- 172.21.15.134:0/824199002 shutdown_connections 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 --2- 172.21.15.134:0/824199002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff00faee0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 --2- 172.21.15.134:0/824199002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 0x7f2ff00fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 -- 172.21.15.134:0/824199002 >> 172.21.15.134:0/824199002 conn(0x7f2ff00f6c10 msgr2=0x7f2ff00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 -- 172.21.15.134:0/824199002 shutdown_connections 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 -- 172.21.15.134:0/824199002 wait complete. 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 Processor -- start 2024-03-22T07:26:46.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.797+0000 7f2ff7036700 1 -- start start 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2ff7036700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 0x7f2ff010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2ff7036700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff0110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2ff7036700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0110700 con 0x7f2ff00feda0 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2ff7036700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01150a0 con 0x7f2ff00fe450 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff0110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff0110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54604/0 (socket says 172.21.15.134:54604) 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 -- 172.21.15.134:0/1523791587 learned_addr learned my addr 172.21.15.134:0/1523791587 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2ff4dd2700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 0x7f2ff010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:46.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 -- 172.21.15.134:0/1523791587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 msgr2=0x7f2ff010fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 0x7f2ff010fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 -- 172.21.15.134:0/1523791587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0005040 con 0x7f2ff00feda0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2ff4dd2700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 0x7f2ff010fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.798+0000 7f2fe7fff700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff0110070 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b3b0 tx=0x7f2fe0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.799+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe000e040 con 0x7f2ff00feda0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.799+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff01152a0 con 0x7f2ff00feda0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.799+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fe000bcc0 con 0x7f2ff00feda0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.799+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe001c630 con 0x7f2ff00feda0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.799+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff0115810 con 0x7f2ff00feda0 2024-03-22T07:26:46.801 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.800+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff0101b90 con 0x7f2ff00feda0 2024-03-22T07:26:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.800+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2fe0013980 con 0x7f2ff00feda0 2024-03-22T07:26:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.801+0000 7f2fe57fa700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fd80692a0 0x7f2fd806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.801+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2fe0088000 con 0x7f2ff00feda0 2024-03-22T07:26:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.801+0000 7f2ff4dd2700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fd80692a0 0x7f2fd806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:46.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.801+0000 7f2ff4dd2700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fd80692a0 0x7f2fd806b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009b10 tx=0x7f2fec008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:46.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.805+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2fe0057cf0 con 0x7f2ff00feda0 2024-03-22T07:26:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:46 smithi195 ceph-mon[36144]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-22T07:26:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.989+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f2ff002b400 con 0x7f2ff00feda0 2024-03-22T07:26:46.989 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.989+0000 7f2fe57fa700 1 -- 172.21.15.134:0/1523791587 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2fe0057880 con 0x7f2ff00feda0 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fd80692a0 msgr2=0x7f2fd806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fd80692a0 0x7f2fd806b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009b10 tx=0x7f2fec008040 comp rx=0 tx=0).stop 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 msgr2=0x7f2ff0110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff0110070 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b3b0 tx=0x7f2fe0009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 shutdown_connections 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f2fd80692a0 0x7f2fd806b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ff00fe450 0x7f2ff010fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 --2- 172.21.15.134:0/1523791587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff00feda0 0x7f2ff0110070 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 >> 172.21.15.134:0/1523791587 conn(0x7f2ff00f6c10 msgr2=0x7f2ff00f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 shutdown_connections 2024-03-22T07:26:46.992 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:46.991+0000 7f2ff7036700 1 -- 172.21.15.134:0/1523791587 wait complete. 2024-03-22T07:26:47.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-22T07:26:48.057 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:48 smithi134 ceph-mon[29057]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-22T07:26:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:48 smithi195 ceph-mon[36144]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-22T07:26:49.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 -- 172.21.15.134:0/2912591665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 msgr2=0x7f12a80fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:49.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 --2- 172.21.15.134:0/2912591665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a80fd3f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1298004940 tx=0x7f1298009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:49.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 -- 172.21.15.134:0/2912591665 shutdown_connections 2024-03-22T07:26:49.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 --2- 172.21.15.134:0/2912591665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a80fd3f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 --2- 172.21.15.134:0/2912591665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80fbcd0 0x7f12a80fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 -- 172.21.15.134:0/2912591665 >> 172.21.15.134:0/2912591665 conn(0x7f12a80f7450 msgr2=0x7f12a80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 -- 172.21.15.134:0/2912591665 shutdown_connections 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 -- 172.21.15.134:0/2912591665 wait complete. 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 Processor -- start 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.745+0000 7f12afea8700 1 -- start start 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12afea8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80fbcd0 0x7f12a8066d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12afea8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a81126e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12afea8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8112cb0 con 0x7f12a80fcf80 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12afea8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8112df0 con 0x7f12a80fbcd0 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a81126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a81126e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54620/0 (socket says 172.21.15.134:54620) 2024-03-22T07:26:49.748 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 -- 172.21.15.134:0/403892960 learned_addr learned my addr 172.21.15.134:0/403892960 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12adc44700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80fbcd0 0x7f12a8066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 -- 172.21.15.134:0/403892960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80fbcd0 msgr2=0x7f12a8066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80fbcd0 0x7f12a8066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 -- 172.21.15.134:0/403892960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298005040 con 0x7f12a80fcf80 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12ad443700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a81126e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f129800b3b0 tx=0x7f1298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129800e040 con 0x7f12a80fcf80 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8113070 con 0x7f12a80fcf80 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f129800bbf0 con 0x7f12a80fcf80 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129801c630 con 0x7f12a80fcf80 2024-03-22T07:26:49.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.746+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a8113630 con 0x7f12a80fcf80 2024-03-22T07:26:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.747+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a804c710 con 0x7f12a80fcf80 2024-03-22T07:26:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.748+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f129800bd60 con 0x7f12a80fcf80 2024-03-22T07:26:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.748+0000 7f129e7fc700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12940692a0 0x7f129406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.748+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1298087e90 con 0x7f12a80fcf80 2024-03-22T07:26:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.748+0000 7f12adc44700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12940692a0 0x7f129406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:49.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.748+0000 7f12adc44700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12940692a0 0x7f129406b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009bf0 tx=0x7f12a40091a0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:49.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.753+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1298057c00 con 0x7f12a80fcf80 2024-03-22T07:26:49.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.939+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f12a8104840 con 0x7f12a80fcf80 2024-03-22T07:26:49.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.939+0000 7f129e7fc700 1 -- 172.21.15.134:0/403892960 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f1298057790 con 0x7f12a80fcf80 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12940692a0 msgr2=0x7f129406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12940692a0 0x7f129406b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009bf0 tx=0x7f12a40091a0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 msgr2=0x7f12a81126e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a81126e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f129800b3b0 tx=0x7f1298009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 shutdown_connections 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f12940692a0 0x7f129406b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80fbcd0 0x7f12a8066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.941+0000 7f12afea8700 1 --2- 172.21.15.134:0/403892960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12a80fcf80 0x7f12a81126e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.942+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 >> 172.21.15.134:0/403892960 conn(0x7f12a80f7450 msgr2=0x7f12a80f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.942+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 shutdown_connections 2024-03-22T07:26:49.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:49.942+0000 7f12afea8700 1 -- 172.21.15.134:0/403892960 wait complete. 2024-03-22T07:26:50.680 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:50 smithi134 ceph-mon[29057]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-22T07:26:50.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-22T07:26:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:50 smithi195 ceph-mon[36144]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-22T07:26:50.971 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:52.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 -- 172.21.15.134:0/2320715573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 msgr2=0x7f859c0faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:52.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 --2- 172.21.15.134:0/2320715573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0faee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8588004940 tx=0x7f8588009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 -- 172.21.15.134:0/2320715573 shutdown_connections 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 --2- 172.21.15.134:0/2320715573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0faee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 --2- 172.21.15.134:0/2320715573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 0x7f859c0fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 -- 172.21.15.134:0/2320715573 >> 172.21.15.134:0/2320715573 conn(0x7f859c0f6c10 msgr2=0x7f859c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 -- 172.21.15.134:0/2320715573 shutdown_connections 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.583+0000 7f85a2b50700 1 -- 172.21.15.134:0/2320715573 wait complete. 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a2b50700 1 Processor -- start 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a2b50700 1 -- start start 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a2b50700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 0x7f859c0fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a2b50700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0fc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a2b50700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c0fe060 con 0x7f859c0feda0 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a2b50700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c0fc650 con 0x7f859c0fe450 2024-03-22T07:26:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f859bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f859bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54626/0 (socket says 172.21.15.134:54626) 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f859bfff700 1 -- 172.21.15.134:0/4135229562 learned_addr learned my addr 172.21.15.134:0/4135229562 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.584+0000 7f85a08ec700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 0x7f859c0fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f859bfff700 1 -- 172.21.15.134:0/4135229562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 msgr2=0x7f859c0fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f859bfff700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 0x7f859c0fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f859bfff700 1 -- 172.21.15.134:0/4135229562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588005040 con 0x7f859c0feda0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f85a08ec700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 0x7f859c0fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f859bfff700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0fc110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8588013870 tx=0x7f8588009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8588021070 con 0x7f859c0feda0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c0fc8a0 con 0x7f859c0feda0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8588009430 con 0x7f859c0feda0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858800e070 con 0x7f859c0feda0 2024-03-22T07:26:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.585+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c0fcd80 con 0x7f859c0feda0 2024-03-22T07:26:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.586+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c106110 con 0x7f859c0feda0 2024-03-22T07:26:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.587+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f858801c400 con 0x7f859c0feda0 2024-03-22T07:26:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.587+0000 7f85997fa700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f858c0692a0 0x7f858c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.587+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8588088520 con 0x7f859c0feda0 2024-03-22T07:26:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.587+0000 7f85a08ec700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f858c0692a0 0x7f858c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.587+0000 7f85a08ec700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f858c0692a0 0x7f858c06b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8590009b80 tx=0x7f859000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:52.591 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.591+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8588058230 con 0x7f859c0feda0 2024-03-22T07:26:52.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.794+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69", "target": ["mon-mgr", ""]}) v1 -- 0x7f859c1025c0 con 0x7f858c0692a0 2024-03-22T07:26:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:52 smithi134 ceph-mon[29057]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-22T07:26:52.799 INFO:teuthology.orchestra.run.smithi134.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:26:52.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.799+0000 7f85997fa700 1 -- 172.21.15.134:0/4135229562 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f859c1025c0 con 0x7f858c0692a0 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f858c0692a0 msgr2=0x7f858c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f858c0692a0 0x7f858c06b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8590009b80 tx=0x7f859000b040 comp rx=0 tx=0).stop 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 msgr2=0x7f859c0fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0fc110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8588013870 tx=0x7f8588009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 shutdown_connections 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f858c0692a0 0x7f858c06b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f859c0fe450 0x7f859c0fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 --2- 172.21.15.134:0/4135229562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0feda0 0x7f859c0fc110 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.801+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 >> 172.21.15.134:0/4135229562 conn(0x7f859c0f6c10 msgr2=0x7f859c0f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.802+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 shutdown_connections 2024-03-22T07:26:52.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:52.802+0000 7f85a2b50700 1 -- 172.21.15.134:0/4135229562 wait complete. 2024-03-22T07:26:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:52 smithi195 ceph-mon[36144]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-22T07:26:53.587 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-22T07:26:53.587 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:26:53.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-03-22T07:26:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:26:53.988 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:53.988 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:26:53.988 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:53.989 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:53.989 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:53.989 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:53.989 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:53 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:54.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:54.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:26:54.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:54.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:26:54.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:26:54.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:26:54.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:53 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:26:55.179 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:54 smithi134 ceph-mon[29057]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:26:55.179 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:54 smithi134 ceph-mon[29057]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-22T07:26:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:54 smithi195 ceph-mon[36144]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 2024-03-22T07:26:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:54 smithi195 ceph-mon[36144]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-22T07:26:55.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.736+0000 7ff1a854a700 1 -- 172.21.15.134:0/3039023304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 msgr2=0x7ff1a00fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.736+0000 7ff1a854a700 1 --2- 172.21.15.134:0/3039023304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a00fd410 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff190004940 tx=0x7ff190009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.736+0000 7ff1a854a700 1 -- 172.21.15.134:0/3039023304 shutdown_connections 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.736+0000 7ff1a854a700 1 --2- 172.21.15.134:0/3039023304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a00fd410 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.736+0000 7ff1a854a700 1 --2- 172.21.15.134:0/3039023304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00fbcf0 0x7ff1a00fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.736+0000 7ff1a854a700 1 -- 172.21.15.134:0/3039023304 >> 172.21.15.134:0/3039023304 conn(0x7ff1a00f7450 msgr2=0x7ff1a00f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 -- 172.21.15.134:0/3039023304 shutdown_connections 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 -- 172.21.15.134:0/3039023304 wait complete. 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 Processor -- start 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 -- start start 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00fbcf0 0x7ff1a010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:55.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:55.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a010e5e0 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.737+0000 7ff1a854a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a010ede0 con 0x7ff1a00fbcf0 2024-03-22T07:26:55.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:55.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48894/0 (socket says 172.21.15.134:48894) 2024-03-22T07:26:55.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 -- 172.21.15.134:0/1084438887 learned_addr learned my addr 172.21.15.134:0/1084438887 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:55.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a62e6700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00fbcf0 0x7ff1a010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:55.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 -- 172.21.15.134:0/1084438887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00fbcf0 msgr2=0x7ff1a010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:55.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00fbcf0 0x7ff1a010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 -- 172.21.15.134:0/1084438887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190005040 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a5ae5700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a010dfe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff190009150 tx=0x7ff190009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff19000e040 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff19000bcc0 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff19001c630 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a010f060 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.738+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a010f500 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.739+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a0101b30 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.740+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff190013420 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.740+0000 7ff196ffd700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff18c0692a0 0x7ff18c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.740+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff190087fe0 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.740+0000 7ff1a62e6700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff18c0692a0 0x7ff18c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:55.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.741+0000 7ff1a62e6700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff18c0692a0 0x7ff18c06b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007fd0 tx=0x7ff19c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:55.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.745+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff190057d50 con 0x7ff1a00fcfa0 2024-03-22T07:26:55.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.969+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1a010f770 con 0x7ff18c0692a0 2024-03-22T07:26:55.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.971+0000 7ff196ffd700 1 -- 172.21.15.134:0/1084438887 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff1a010f770 con 0x7ff18c0692a0 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff18c0692a0 msgr2=0x7ff18c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff18c0692a0 0x7ff18c06b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007fd0 tx=0x7ff19c009040 comp rx=0 tx=0).stop 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 msgr2=0x7ff1a010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a010dfe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff190009150 tx=0x7ff190009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 shutdown_connections 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ff18c0692a0 0x7ff18c06b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1a00fbcf0 0x7ff1a010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 --2- 172.21.15.134:0/1084438887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1a00fcfa0 0x7ff1a010dfe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 >> 172.21.15.134:0/1084438887 conn(0x7ff1a00f7450 msgr2=0x7ff1a00663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:55.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 shutdown_connections 2024-03-22T07:26:55.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:55.973+0000 7ff1a854a700 1 -- 172.21.15.134:0/1084438887 wait complete. 2024-03-22T07:26:55.984 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 -- 172.21.15.134:0/2481183393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40fff80 msgr2=0x7fcaf4102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/2481183393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40fff80 0x7fcaf4102360 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004940 tx=0x7fcae8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 -- 172.21.15.134:0/2481183393 shutdown_connections 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/2481183393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf40fff80 0x7fcaf4102360 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/2481183393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf4066260 0x7fcaf40ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 -- 172.21.15.134:0/2481183393 >> 172.21.15.134:0/2481183393 conn(0x7fcaf40f7430 msgr2=0x7fcaf40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 -- 172.21.15.134:0/2481183393 shutdown_connections 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.083+0000 7fcaf9b40700 1 -- 172.21.15.134:0/2481183393 wait complete. 2024-03-22T07:26:56.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf9b40700 1 Processor -- start 2024-03-22T07:26:56.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf9b40700 1 -- start start 2024-03-22T07:26:56.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf9b40700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 0x7fcaf40fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf9b40700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf40fff80 0x7fcaf40fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf9b40700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40fbef0 con 0x7fcaf4066260 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf9b40700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf40fc060 con 0x7fcaf40fff80 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.084+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 0x7fcaf40fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 0x7fcaf40fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48912/0 (socket says 172.21.15.134:48912) 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf37fe700 1 -- 172.21.15.134:0/3887061391 learned_addr learned my addr 172.21.15.134:0/3887061391 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf2ffd700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf40fff80 0x7fcaf40fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf37fe700 1 -- 172.21.15.134:0/3887061391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf40fff80 msgr2=0x7fcaf40fb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf37fe700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf40fff80 0x7fcaf40fb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf37fe700 1 -- 172.21.15.134:0/3887061391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8005040 con 0x7fcaf4066260 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf2ffd700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf40fff80 0x7fcaf40fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf37fe700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 0x7fcaf40fd470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c8e0 tx=0x7fcae40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:56.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae400a940 con 0x7fcaf4066260 2024-03-22T07:26:56.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcae400ce80 con 0x7fcaf4066260 2024-03-22T07:26:56.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf40fc340 con 0x7fcaf4066260 2024-03-22T07:26:56.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae40113a0 con 0x7fcaf4066260 2024-03-22T07:26:56.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.085+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4115a60 con 0x7fcaf4066260 2024-03-22T07:26:56.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.086+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf405f5f0 con 0x7fcaf4066260 2024-03-22T07:26:56.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.087+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcae4012400 con 0x7fcaf4066260 2024-03-22T07:26:56.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.087+0000 7fcadbfff700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcadc0692a0 0x7fcadc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.087+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcae40871c0 con 0x7fcaf4066260 2024-03-22T07:26:56.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.087+0000 7fcaf2ffd700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcadc0692a0 0x7fcadc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.088+0000 7fcaf2ffd700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcadc0692a0 0x7fcadc06b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcae8000c00 tx=0x7fcae8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:56.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.092+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcae4053540 con 0x7fcaf4066260 2024-03-22T07:26:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.321+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaf40f8f70 con 0x7fcadc0692a0 2024-03-22T07:26:56.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.322+0000 7fcadbfff700 1 -- 172.21.15.134:0/3887061391 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fcaf40f8f70 con 0x7fcadc0692a0 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcadc0692a0 msgr2=0x7fcadc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcadc0692a0 0x7fcadc06b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcae8000c00 tx=0x7fcae8009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 msgr2=0x7fcaf40fd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 0x7fcaf40fd470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c8e0 tx=0x7fcae40044c0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 shutdown_connections 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcaf4066260 0x7fcaf40fd470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcadc0692a0 0x7fcadc06b750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 --2- 172.21.15.134:0/3887061391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcaf40fff80 0x7fcaf40fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 >> 172.21.15.134:0/3887061391 conn(0x7fcaf40f7430 msgr2=0x7fcaf40f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:56.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 shutdown_connections 2024-03-22T07:26:56.327 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.325+0000 7fcaf9b40700 1 -- 172.21.15.134:0/3887061391 wait complete. 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 -- 172.21.15.134:0/2727650105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 msgr2=0x7f6ce40fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 --2- 172.21.15.134:0/2727650105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce40fc0e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0004940 tx=0x7f6ce0009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 -- 172.21.15.134:0/2727650105 shutdown_connections 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 --2- 172.21.15.134:0/2727650105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 0x7f6ce40fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 --2- 172.21.15.134:0/2727650105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce40fc0e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 -- 172.21.15.134:0/2727650105 >> 172.21.15.134:0/2727650105 conn(0x7f6ce40f7430 msgr2=0x7f6ce40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 -- 172.21.15.134:0/2727650105 shutdown_connections 2024-03-22T07:26:56.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.435+0000 7f6cebf57700 1 -- 172.21.15.134:0/2727650105 wait complete. 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6cebf57700 1 Processor -- start 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6cebf57700 1 -- start start 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6cebf57700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce4110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6cebf57700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 0x7f6ce4112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6cebf57700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4066400 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6cebf57700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4066540 con 0x7f6ce40fcf80 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6ce9cf3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce4110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.436+0000 7f6ce9cf3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce4110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48934/0 (socket says 172.21.15.134:48934) 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce9cf3700 1 -- 172.21.15.134:0/192761105 learned_addr learned my addr 172.21.15.134:0/192761105 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce9cf3700 1 -- 172.21.15.134:0/192761105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 msgr2=0x7f6ce4112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce94f2700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 0x7f6ce4112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce9cf3700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 0x7f6ce4112c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce9cf3700 1 -- 172.21.15.134:0/192761105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0005040 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce94f2700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 0x7f6ce4112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6ce9cf3700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce4110710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009380 tx=0x7f6ce0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce000e040 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ce000bcc0 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce4113260 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce001c5f0 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.437+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce410c570 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.438+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce405f5f0 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.439+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6ce0013a80 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.439+0000 7f6cda7fc700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6cd00692a0 0x7f6cd006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.439+0000 7f6ce94f2700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6cd00692a0 0x7f6cd006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.439+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6ce0087f80 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.440+0000 7f6ce94f2700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6cd00692a0 0x7f6cd006b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4006fd0 tx=0x7f6cd4008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:56.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.444+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6ce0054260 con 0x7f6ce40fbcd0 2024-03-22T07:26:56.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.662+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ce4101220 con 0x7f6cd00692a0 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.673+0000 7f6cda7fc700 1 -- 172.21.15.134:0/192761105 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f6ce4101220 con 0x7f6cd00692a0 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (4m) 27s ago 6m 25.0M - 0.25.0 c8568f914cd2 0ce3f68acd2f 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (6m) 27s ago 6m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (5m) 34s ago 5m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 27s ago 5m 85.2M - 9.4.7 954c08fa6188 8cd534e3bc25 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (48s) 27s ago 47s 15.7M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:26:56.674 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (53s) 27s ago 53s 10.4M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (51s) 34s ago 50s 12.1M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (45s) 34s ago 45s 11.1M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (7m) 27s ago 7m 481M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (5m) 34s ago 5m 432M - 17.2.7-726-g9c4e0c34 837124da804f 26e2fe2a8479 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (7m) 27s ago 7m 46.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (5m) 34s ago 5m 31.5M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 27s ago 6m 15.4M - 1.5.0 0da6a335fe13 645fc1dfbabe 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 34s ago 5m 16.5M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (4m) 27s ago 4m 46.4M 4288M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 27s ago 4m 46.2M 4288M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (3m) 27s ago 3m 44.1M 4288M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (3m) 34s ago 3m 47.0M 5312M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (2m) 34s ago 2m 44.1M 5312M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (2m) 34s ago 2m 43.8M 5312M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:26:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 27s ago 5m 52.4M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:26:56.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.675+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6cd00692a0 msgr2=0x7f6cd006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.675+0000 7f6cebf57700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6cd00692a0 0x7f6cd006b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4006fd0 tx=0x7f6cd4008040 comp rx=0 tx=0).stop 2024-03-22T07:26:56.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.675+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 msgr2=0x7f6ce4110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.675+0000 7f6cebf57700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce4110710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009380 tx=0x7f6ce0009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:56.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 shutdown_connections 2024-03-22T07:26:56.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce40fbcd0 0x7f6ce4110710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6cd00692a0 0x7f6cd006b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 --2- 172.21.15.134:0/192761105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ce40fcf80 0x7f6ce4112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 >> 172.21.15.134:0/192761105 conn(0x7f6ce40f7430 msgr2=0x7f6ce40f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:56.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 shutdown_connections 2024-03-22T07:26:56.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.676+0000 7f6cebf57700 1 -- 172.21.15.134:0/192761105 wait complete. 2024-03-22T07:26:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.784+0000 7f64d74ac700 1 -- 172.21.15.134:0/3106525438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 msgr2=0x7f64d0102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.784+0000 7f64d74ac700 1 --2- 172.21.15.134:0/3106525438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d0102340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f64c0004940 tx=0x7f64c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.785+0000 7f64d74ac700 1 -- 172.21.15.134:0/3106525438 shutdown_connections 2024-03-22T07:26:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.785+0000 7f64d74ac700 1 --2- 172.21.15.134:0/3106525438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d0102340 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.785+0000 7f64d74ac700 1 --2- 172.21.15.134:0/3106525438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d0066280 0x7f64d00ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.785+0000 7f64d74ac700 1 -- 172.21.15.134:0/3106525438 >> 172.21.15.134:0/3106525438 conn(0x7f64d00f7430 msgr2=0x7f64d00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.785+0000 7f64d74ac700 1 -- 172.21.15.134:0/3106525438 shutdown_connections 2024-03-22T07:26:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.785+0000 7f64d74ac700 1 -- 172.21.15.134:0/3106525438 wait complete. 2024-03-22T07:26:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d74ac700 1 Processor -- start 2024-03-22T07:26:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d74ac700 1 -- start start 2024-03-22T07:26:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d74ac700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d0066280 0x7f64d00fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d74ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d00fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d74ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00fbed0 con 0x7f64d00fff60 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d74ac700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00fc040 con 0x7f64d0066280 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d4a47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d00fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d4a47700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d00fb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48952/0 (socket says 172.21.15.134:48952) 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d4a47700 1 -- 172.21.15.134:0/1951165445 learned_addr learned my addr 172.21.15.134:0/1951165445 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d5248700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d0066280 0x7f64d00fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d4a47700 1 -- 172.21.15.134:0/1951165445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d0066280 msgr2=0x7f64d00fd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d4a47700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d0066280 0x7f64d00fd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.786+0000 7f64d4a47700 1 -- 172.21.15.134:0/1951165445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0005040 con 0x7f64d00fff60 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.787+0000 7f64d4a47700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d00fb920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64c000b3b0 tx=0x7f64c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.787+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c000e040 con 0x7f64d00fff60 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.787+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d00fc2c0 con 0x7f64d00fff60 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.787+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64c000bbf0 con 0x7f64d00fff60 2024-03-22T07:26:56.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.787+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c001c630 con 0x7f64d00fff60 2024-03-22T07:26:56.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.787+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d0115a60 con 0x7f64d00fff60 2024-03-22T07:26:56.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.788+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d005f5f0 con 0x7f64d00fff60 2024-03-22T07:26:56.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.789+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f64c0013420 con 0x7f64d00fff60 2024-03-22T07:26:56.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.789+0000 7f64c5ffb700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f64bc0692a0 0x7f64bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:56.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.789+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f64c0087eb0 con 0x7f64d00fff60 2024-03-22T07:26:56.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.789+0000 7f64d5248700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f64bc0692a0 0x7f64bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:56.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.790+0000 7f64d5248700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f64bc0692a0 0x7f64bc06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f64d00fd1e0 tx=0x7f64cc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:56.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:56.794+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f64c0054190 con 0x7f64d00fff60 2024-03-22T07:26:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:56 smithi134 ceph-mon[29057]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:26:57.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.085+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f64d004bed0 con 0x7f64d00fff60 2024-03-22T07:26:57.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.085+0000 7f64c5ffb700 1 -- 172.21.15.134:0/1951165445 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f64c00577b0 con 0x7f64d00fff60 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:26:57.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:26:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:26:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 14 2024-03-22T07:26:57.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:26:57.087 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:26:57.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f64bc0692a0 msgr2=0x7f64bc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f64bc0692a0 0x7f64bc06b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f64d00fd1e0 tx=0x7f64cc00b040 comp rx=0 tx=0).stop 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 msgr2=0x7f64d00fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d00fb920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f64c000b3b0 tx=0x7f64c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 shutdown_connections 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f64bc0692a0 0x7f64bc06b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d0066280 0x7f64d00fd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 --2- 172.21.15.134:0/1951165445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d00fff60 0x7f64d00fb920 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 >> 172.21.15.134:0/1951165445 conn(0x7f64d00f7430 msgr2=0x7f64d00f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 shutdown_connections 2024-03-22T07:26:57.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.088+0000 7f64d74ac700 1 -- 172.21.15.134:0/1951165445 wait complete. 2024-03-22T07:26:57.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 -- 172.21.15.134:0/3578320422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fce40 msgr2=0x7fe1b80fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/3578320422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fce40 0x7fe1b80fd250 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac004940 tx=0x7fe1ac009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 -- 172.21.15.134:0/3578320422 shutdown_connections 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/3578320422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fe040 0x7fe1b80fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/3578320422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fce40 0x7fe1b80fd250 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 -- 172.21.15.134:0/3578320422 >> 172.21.15.134:0/3578320422 conn(0x7fe1b80f8570 msgr2=0x7fe1b80fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 -- 172.21.15.134:0/3578320422 shutdown_connections 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 -- 172.21.15.134:0/3578320422 wait complete. 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 Processor -- start 2024-03-22T07:26:57.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.194+0000 7fe1bea9f700 1 -- start start 2024-03-22T07:26:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1bea9f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fce40 0x7fe1b810d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1bea9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 0x7fe1b810dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1bea9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b810e4e0 con 0x7fe1b80fe040 2024-03-22T07:26:57.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1bea9f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b810ed30 con 0x7fe1b80fce40 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 0x7fe1b810dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 0x7fe1b810dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48978/0 (socket says 172.21.15.134:48978) 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1b7fff700 1 -- 172.21.15.134:0/2395649658 learned_addr learned my addr 172.21.15.134:0/2395649658 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1bc83b700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fce40 0x7fe1b810d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1b7fff700 1 -- 172.21.15.134:0/2395649658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fce40 msgr2=0x7fe1b810d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1b7fff700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fce40 0x7fe1b810d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1b7fff700 1 -- 172.21.15.134:0/2395649658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac005040 con 0x7fe1b80fe040 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.195+0000 7fe1bc83b700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fce40 0x7fe1b810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.196+0000 7fe1b7fff700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 0x7fe1b810dee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4002a80 tx=0x7fe1a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.196+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a4007cc0 con 0x7fe1b80fe040 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.196+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1a400f040 con 0x7fe1b80fe040 2024-03-22T07:26:57.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.196+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a40096f0 con 0x7fe1b80fe040 2024-03-22T07:26:57.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.196+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b810f010 con 0x7fe1b80fe040 2024-03-22T07:26:57.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.196+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b810f550 con 0x7fe1b80fe040 2024-03-22T07:26:57.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.197+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b805f5f0 con 0x7fe1b80fe040 2024-03-22T07:26:57.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.198+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe1a400d690 con 0x7fe1b80fe040 2024-03-22T07:26:57.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.198+0000 7fe1b57fa700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1a80692a0 0x7fe1a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.198+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe1a40868b0 con 0x7fe1b80fe040 2024-03-22T07:26:57.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.198+0000 7fe1bc83b700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1a80692a0 0x7fe1a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.199+0000 7fe1bc83b700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1a80692a0 0x7fe1a806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00b970 tx=0x7fe1ac009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:57.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.203+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe1a404d190 con 0x7fe1b80fe040 2024-03-22T07:26:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:56 smithi195 ceph-mon[36144]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:26:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.454+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1b810f8c0 con 0x7fe1b80fe040 2024-03-22T07:26:57.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.454+0000 7fe1b57fa700 1 -- 172.21.15.134:0/2395649658 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7fe1a4056620 con 0x7fe1b80fe040 2024-03-22T07:26:57.454 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:26:57.455 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:26:57.456 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:57.457 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.457+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1a80692a0 msgr2=0x7fe1a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.457+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1a80692a0 0x7fe1a806b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00b970 tx=0x7fe1ac009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.457+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 msgr2=0x7fe1b810dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.457+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 0x7fe1b810dee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4002a80 tx=0x7fe1a40046b0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 shutdown_connections 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1a80692a0 0x7fe1a806b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1b80fce40 0x7fe1b810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 --2- 172.21.15.134:0/2395649658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1b80fe040 0x7fe1b810dee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 >> 172.21.15.134:0/2395649658 conn(0x7fe1b80f8570 msgr2=0x7fe1b80f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 shutdown_connections 2024-03-22T07:26:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.458+0000 7fe1bea9f700 1 -- 172.21.15.134:0/2395649658 wait complete. 2024-03-22T07:26:57.459 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 -- 172.21.15.134:0/905118341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fcf80 msgr2=0x7f85680fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 --2- 172.21.15.134:0/905118341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fcf80 0x7f85680fd3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f855c004940 tx=0x7f855c009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 -- 172.21.15.134:0/905118341 shutdown_connections 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 --2- 172.21.15.134:0/905118341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fcf80 0x7f85680fd3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 --2- 172.21.15.134:0/905118341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85680fbcd0 0x7f85680fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 -- 172.21.15.134:0/905118341 >> 172.21.15.134:0/905118341 conn(0x7f85680f7450 msgr2=0x7f85680f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 -- 172.21.15.134:0/905118341 shutdown_connections 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.573+0000 7f856c84f700 1 -- 172.21.15.134:0/905118341 wait complete. 2024-03-22T07:26:57.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856c84f700 1 Processor -- start 2024-03-22T07:26:57.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856c84f700 1 -- start start 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856c84f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 0x7f856806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856c84f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85680fcf80 0x7f85680663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856c84f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8568066980 con 0x7f85680fbcd0 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856c84f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8568066af0 con 0x7f85680fcf80 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 0x7f856806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 0x7f856806fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49006/0 (socket says 172.21.15.134:49006) 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856659c700 1 -- 172.21.15.134:0/1928252077 learned_addr learned my addr 172.21.15.134:0/1928252077 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f8565d9b700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85680fcf80 0x7f85680663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856659c700 1 -- 172.21.15.134:0/1928252077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85680fcf80 msgr2=0x7f85680663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856659c700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85680fcf80 0x7f85680663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.574+0000 7f856659c700 1 -- 172.21.15.134:0/1928252077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c005040 con 0x7f85680fbcd0 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.575+0000 7f856659c700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 0x7f856806fc30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8558002a50 tx=0x7f85580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.575+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8558007cc0 con 0x7f85680fbcd0 2024-03-22T07:26:57.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.575+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f855800f040 con 0x7f85680fbcd0 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.575+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8568066dd0 con 0x7f85680fbcd0 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.575+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f855800da30 con 0x7f85680fbcd0 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.575+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856806e2e0 con 0x7f85680fbcd0 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.576+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856804c710 con 0x7f85680fbcd0 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.577+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f855800db90 con 0x7f85680fbcd0 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.577+0000 7f8556ffd700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f855006d770 0x7f855006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.577+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8558086dd0 con 0x7f85680fbcd0 2024-03-22T07:26:57.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.577+0000 7f8565d9b700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f855006d770 0x7f855006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.578+0000 7f8565d9b700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f855006d770 0x7f855006fc20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f855c004890 tx=0x7f855c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:57.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.582+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8558056be0 con 0x7f85680fbcd0 2024-03-22T07:26:57.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.813+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8568101290 con 0x7f855006d770 2024-03-22T07:26:57.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.814+0000 7f8556ffd700 1 -- 172.21.15.134:0/1928252077 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8568101290 con 0x7f855006d770 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69", 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "", 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 image", 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:26:57.815 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.816+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f855006d770 msgr2=0x7f855006fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.816+0000 7f856c84f700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f855006d770 0x7f855006fc20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f855c004890 tx=0x7f855c009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.816+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 msgr2=0x7f856806fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.816+0000 7f856c84f700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 0x7f856806fc30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8558002a50 tx=0x7f85580046b0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 shutdown_connections 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85680fbcd0 0x7f856806fc30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f855006d770 0x7f855006fc20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 --2- 172.21.15.134:0/1928252077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85680fcf80 0x7f85680663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 >> 172.21.15.134:0/1928252077 conn(0x7f85680f7450 msgr2=0x7f85680f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 shutdown_connections 2024-03-22T07:26:57.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.817+0000 7f856c84f700 1 -- 172.21.15.134:0/1928252077 wait complete. 2024-03-22T07:26:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 -- 172.21.15.134:0/3098740838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400662e0 msgr2=0x7f88400ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3098740838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400662e0 0x7f88400ff9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8834004940 tx=0x7f8834009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 -- 172.21.15.134:0/3098740838 shutdown_connections 2024-03-22T07:26:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3098740838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400fff00 0x7f8840102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3098740838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400662e0 0x7f88400ff9c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 -- 172.21.15.134:0/3098740838 >> 172.21.15.134:0/3098740838 conn(0x7f88400f7430 msgr2=0x7f88400f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:57.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 -- 172.21.15.134:0/3098740838 shutdown_connections 2024-03-22T07:26:57.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.930+0000 7f8846fb2700 1 -- 172.21.15.134:0/3098740838 wait complete. 2024-03-22T07:26:57.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8846fb2700 1 Processor -- start 2024-03-22T07:26:57.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8846fb2700 1 -- start start 2024-03-22T07:26:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8846fb2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400662e0 0x7f884010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8846fb2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 0x7f884010df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8846fb2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884010e540 con 0x7f88400fff00 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8846fb2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884010ed40 con 0x7f88400662e0 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f883ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 0x7f884010df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f883ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 0x7f884010df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49024/0 (socket says 172.21.15.134:49024) 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f883ffff700 1 -- 172.21.15.134:0/3736286631 learned_addr learned my addr 172.21.15.134:0/3736286631 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.931+0000 7f8844d4e700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400662e0 0x7f884010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883ffff700 1 -- 172.21.15.134:0/3736286631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400662e0 msgr2=0x7f884010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883ffff700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400662e0 0x7f884010da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883ffff700 1 -- 172.21.15.134:0/3736286631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834005040 con 0x7f88400fff00 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f8844d4e700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400662e0 0x7f884010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883ffff700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 0x7f884010df40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f882c00eb40 tx=0x7f882c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882c007cc0 con 0x7f88400fff00 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f882c00f040 con 0x7f88400fff00 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884010efc0 con 0x7f88400fff00 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882c00ca10 con 0x7f88400fff00 2024-03-22T07:26:57.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.932+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884010f500 con 0x7f88400fff00 2024-03-22T07:26:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.933+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884005f5f0 con 0x7f88400fff00 2024-03-22T07:26:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.934+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f882c00cc80 con 0x7f88400fff00 2024-03-22T07:26:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.934+0000 7f883d7fa700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f883006d6c0 0x7f883006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:26:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.934+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f882c086dd0 con 0x7f88400fff00 2024-03-22T07:26:57.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.934+0000 7f8844d4e700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f883006d6c0 0x7f883006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:26:57.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.935+0000 7f8844d4e700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f883006d6c0 0x7f883006fb70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8834013870 tx=0x7f8834009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:26:57.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:57.939+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f882c04e190 con 0x7f88400fff00 2024-03-22T07:26:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:57 smithi134 ceph-mon[29057]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:57 smithi134 ceph-mon[29057]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:57 smithi134 ceph-mon[29057]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:57 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1951165445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:26:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:57 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2395649658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:26:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:57 smithi195 ceph-mon[36144]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:57 smithi195 ceph-mon[36144]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:57 smithi195 ceph-mon[36144]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:57 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1951165445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:26:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:57 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2395649658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:26:58.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.223+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f884004bed0 con 0x7f88400fff00 2024-03-22T07:26:58.223 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.223+0000 7f883d7fa700 1 -- 172.21.15.134:0/3736286631 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f882c056b70 con 0x7f88400fff00 2024-03-22T07:26:58.224 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:26:58.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f883006d6c0 msgr2=0x7f883006fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f883006d6c0 0x7f883006fb70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8834013870 tx=0x7f8834009e30 comp rx=0 tx=0).stop 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 msgr2=0x7f884010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 0x7f884010df40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f882c00eb40 tx=0x7f882c00b040 comp rx=0 tx=0).stop 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 shutdown_connections 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f883006d6c0 0x7f883006fb70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88400662e0 0x7f884010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 --2- 172.21.15.134:0/3736286631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88400fff00 0x7f884010df40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 >> 172.21.15.134:0/3736286631 conn(0x7f88400f7430 msgr2=0x7f88400f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 shutdown_connections 2024-03-22T07:26:58.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:26:58.225+0000 7f8846fb2700 1 -- 172.21.15.134:0/3736286631 wait complete. 2024-03-22T07:26:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:58 smithi134 ceph-mon[29057]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:26:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:58 smithi134 ceph-mon[29057]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:26:58 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3736286631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:26:59.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:58 smithi195 ceph-mon[36144]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:26:59.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:58 smithi195 ceph-mon[36144]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:26:59.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:26:58 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3736286631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:27:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:00 smithi195 ceph-mon[36144]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:27:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:00 smithi134 ceph-mon[29057]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:27:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:02 smithi195 ceph-mon[36144]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:02 smithi134 ceph-mon[29057]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:04 smithi195 ceph-mon[36144]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:05.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:04 smithi134 ceph-mon[29057]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:06 smithi195 ceph-mon[36144]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:06 smithi134 ceph-mon[29057]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:08 smithi134 ceph-mon[29057]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:08 smithi195 ceph-mon[36144]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:10 smithi195 ceph-mon[36144]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:10 smithi134 ceph-mon[29057]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:13.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:12 smithi195 ceph-mon[36144]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:13.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:12 smithi134 ceph-mon[29057]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:15.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:14 smithi195 ceph-mon[36144]: pgmap v214: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-22T07:27:15.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:14 smithi134 ceph-mon[29057]: pgmap v214: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-22T07:27:16.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:16.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:16 smithi195 ceph-mon[36144]: pgmap v215: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-22T07:27:17.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:16 smithi134 ceph-mon[29057]: pgmap v215: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-22T07:27:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:18 smithi134 ceph-mon[29057]: pgmap v216: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-22T07:27:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:18 smithi195 ceph-mon[36144]: pgmap v216: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-22T07:27:21.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:20 smithi195 ceph-mon[36144]: pgmap v217: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-22T07:27:21.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:20 smithi134 ceph-mon[29057]: pgmap v217: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-22T07:27:23.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:22 smithi195 ceph-mon[36144]: pgmap v218: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-22T07:27:23.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:22 smithi134 ceph-mon[29057]: pgmap v218: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-22T07:27:25.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:24 smithi195 ceph-mon[36144]: pgmap v219: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-22T07:27:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:24 smithi134 ceph-mon[29057]: pgmap v219: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-22T07:27:26.967 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:26 smithi134 ceph-mon[29057]: pgmap v220: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:27:27.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:26 smithi195 ceph-mon[36144]: pgmap v220: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:27:28.385 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.385+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3217048690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734070870 msgr2=0x7fa734070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:28.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.385+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3217048690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734070870 0x7fa734070ce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa724004940 tx=0x7fa724009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:28.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.385+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3217048690 shutdown_connections 2024-03-22T07:27:28.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.385+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3217048690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734070870 0x7fa734070ce0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.385+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3217048690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734071e20 0x7fa734070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.385+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3217048690 >> 172.21.15.134:0/3217048690 conn(0x7fa7340f8580 msgr2=0x7fa7340fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.386+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3217048690 shutdown_connections 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.386+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3217048690 wait complete. 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.386+0000 7fa73b5b8700 1 Processor -- start 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.386+0000 7fa73b5b8700 1 -- start start 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa73b5b8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 0x7fa73410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa73b5b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734071e20 0x7fa7341100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa73b5b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7341106c0 con 0x7fa734071e20 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa73b5b8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa734110f10 con 0x7fa734070870 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 0x7fa73410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 0x7fa73410fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:49144/0 (socket says 172.21.15.134:49144) 2024-03-22T07:27:28.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 -- 172.21.15.134:0/3463678577 learned_addr learned my addr 172.21.15.134:0/3463678577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:28.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa738b53700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734071e20 0x7fa7341100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 -- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734071e20 msgr2=0x7fa7341100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734071e20 0x7fa7341100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 -- 172.21.15.134:0/3463678577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724005040 con 0x7fa734070870 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.387+0000 7fa739354700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 0x7fa73410fb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa730002a80 tx=0x7fa7300046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.388+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa730007cc0 con 0x7fa734070870 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.388+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7341111f0 con 0x7fa734070870 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.388+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa73000f040 con 0x7fa734070870 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.388+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa730009630 con 0x7fa734070870 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.388+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa734111730 con 0x7fa734070870 2024-03-22T07:27:28.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.389+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73405f5f0 con 0x7fa734070870 2024-03-22T07:27:28.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.390+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa730009790 con 0x7fa734070870 2024-03-22T07:27:28.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.390+0000 7fa729ffb700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa7200692a0 0x7fa72006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:28.390 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.390+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa730086e20 con 0x7fa734070870 2024-03-22T07:27:28.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.390+0000 7fa738b53700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa7200692a0 0x7fa72006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:28.391 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.391+0000 7fa738b53700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa7200692a0 0x7fa72006b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b3b0 tx=0x7fa724009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:28.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.399+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa730056b90 con 0x7fa734070870 2024-03-22T07:27:28.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.669+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa734111b10 con 0x7fa7200692a0 2024-03-22T07:27:28.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.670+0000 7fa729ffb700 1 -- 172.21.15.134:0/3463678577 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fa734111b10 con 0x7fa7200692a0 2024-03-22T07:27:28.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.672+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa7200692a0 msgr2=0x7fa72006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:28.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.672+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa7200692a0 0x7fa72006b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b3b0 tx=0x7fa724009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:28.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.672+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 msgr2=0x7fa73410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:28.673 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 0x7fa73410fb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa730002a80 tx=0x7fa7300046b0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 shutdown_connections 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fa7200692a0 0x7fa72006b750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa734070870 0x7fa73410fb80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 --2- 172.21.15.134:0/3463678577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa734071e20 0x7fa7341100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 >> 172.21.15.134:0/3463678577 conn(0x7fa7340f8580 msgr2=0x7fa7340f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 shutdown_connections 2024-03-22T07:27:28.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.673+0000 7fa73b5b8700 1 -- 172.21.15.134:0/3463678577 wait complete. 2024-03-22T07:27:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:27:28.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 -- 172.21.15.134:0/3557475181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fdd80 msgr2=0x7f6ee41046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 --2- 172.21.15.134:0/3557475181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fdd80 0x7f6ee41046d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8004940 tx=0x7f6ed8009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 -- 172.21.15.134:0/3557475181 shutdown_connections 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 --2- 172.21.15.134:0/3557475181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fdd80 0x7f6ee41046d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 --2- 172.21.15.134:0/3557475181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fd430 0x7f6ee40fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 -- 172.21.15.134:0/3557475181 >> 172.21.15.134:0/3557475181 conn(0x7f6ee40f6be0 msgr2=0x7f6ee40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 -- 172.21.15.134:0/3557475181 shutdown_connections 2024-03-22T07:27:28.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.782+0000 7f6ee9432700 1 -- 172.21.15.134:0/3557475181 wait complete. 2024-03-22T07:27:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.783+0000 7f6ee9432700 1 Processor -- start 2024-03-22T07:27:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.783+0000 7f6ee9432700 1 -- start start 2024-03-22T07:27:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee9432700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fd430 0x7f6ee410fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee9432700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 0x7f6ee4110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee9432700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4110610 con 0x7f6ee40fd430 2024-03-22T07:27:28.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee9432700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4110780 con 0x7f6ee40fdd80 2024-03-22T07:27:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 0x7f6ee4110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:28.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 0x7f6ee4110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:49158/0 (socket says 172.21.15.134:49158) 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee27fc700 1 -- 172.21.15.134:0/109740487 learned_addr learned my addr 172.21.15.134:0/109740487 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee2ffd700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fd430 0x7f6ee410fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee27fc700 1 -- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fd430 msgr2=0x7f6ee410fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee27fc700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fd430 0x7f6ee410fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee27fc700 1 -- 172.21.15.134:0/109740487 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8005040 con 0x7f6ee40fdd80 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.784+0000 7f6ee2ffd700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fd430 0x7f6ee410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.785+0000 7f6ee27fc700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 0x7f6ee4110010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8013870 tx=0x7f6ed8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.785+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed800e070 con 0x7f6ee40fdd80 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.785+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ed801c400 con 0x7f6ee40fdd80 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.785+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed800b650 con 0x7f6ee40fdd80 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.785+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee4115130 con 0x7f6ee40fdd80 2024-03-22T07:27:28.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.785+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee4115550 con 0x7f6ee40fdd80 2024-03-22T07:27:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.787+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee404c710 con 0x7f6ee40fdd80 2024-03-22T07:27:28.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.787+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6ed801c570 con 0x7f6ee40fdd80 2024-03-22T07:27:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.788+0000 7f6ecb7fe700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6ecc0692a0 0x7f6ecc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.788+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6ed8088950 con 0x7f6ee40fdd80 2024-03-22T07:27:28.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.788+0000 7f6ee2ffd700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6ecc0692a0 0x7f6ecc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:28.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.789+0000 7f6ee2ffd700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6ecc0692a0 0x7f6ecc06b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009fd0 tx=0x7f6ed400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:28.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:28.796+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6ed80586a0 con 0x7f6ee40fdd80 2024-03-22T07:27:29.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.024+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ee40f8720 con 0x7f6ecc0692a0 2024-03-22T07:27:29.025 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:28 smithi134 ceph-mon[29057]: pgmap v221: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:27:29.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.026+0000 7f6ecb7fe700 1 -- 172.21.15.134:0/109740487 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6ee40f8720 con 0x7f6ecc0692a0 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6ecc0692a0 msgr2=0x7f6ecc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6ecc0692a0 0x7f6ecc06b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009fd0 tx=0x7f6ed400b040 comp rx=0 tx=0).stop 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 msgr2=0x7f6ee4110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 0x7f6ee4110010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8013870 tx=0x7f6ed8009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 shutdown_connections 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ee40fd430 0x7f6ee410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f6ecc0692a0 0x7f6ecc06b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 --2- 172.21.15.134:0/109740487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ee40fdd80 0x7f6ee4110010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 >> 172.21.15.134:0/109740487 conn(0x7f6ee40f6be0 msgr2=0x7f6ee40f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 shutdown_connections 2024-03-22T07:27:29.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.029+0000 7f6ee9432700 1 -- 172.21.15.134:0/109740487 wait complete. 2024-03-22T07:27:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.186+0000 7f5e26bbb700 1 -- 172.21.15.134:0/603055581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fb440 msgr2=0x7f5e200fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.186+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/603055581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fb440 0x7f5e200fb850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5e14004940 tx=0x7f5e14009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.186+0000 7f5e26bbb700 1 -- 172.21.15.134:0/603055581 shutdown_connections 2024-03-22T07:27:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.186+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/603055581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200fc6f0 0x7f5e200fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.186+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/603055581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fb440 0x7f5e200fb850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.187+0000 7f5e26bbb700 1 -- 172.21.15.134:0/603055581 >> 172.21.15.134:0/603055581 conn(0x7f5e200f6ba0 msgr2=0x7f5e200f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:29.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.187+0000 7f5e26bbb700 1 -- 172.21.15.134:0/603055581 shutdown_connections 2024-03-22T07:27:29.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.187+0000 7f5e26bbb700 1 -- 172.21.15.134:0/603055581 wait complete. 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e26bbb700 1 Processor -- start 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e26bbb700 1 -- start start 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e26bbb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200fb440 0x7f5e2010d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e26bbb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 0x7f5e2010dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e26bbb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2010e4e0 con 0x7f5e200fc6f0 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 0x7f5e2010dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 0x7f5e2010dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50078/0 (socket says 172.21.15.134:50078) 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e1ffff700 1 -- 172.21.15.134:0/2205389991 learned_addr learned my addr 172.21.15.134:0/2205389991 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.188+0000 7f5e26bbb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2010ed30 con 0x7f5e200fb440 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.189+0000 7f5e24957700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200fb440 0x7f5e2010d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.189+0000 7f5e1ffff700 1 -- 172.21.15.134:0/2205389991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200fb440 msgr2=0x7f5e2010d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.189+0000 7f5e1ffff700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200fb440 0x7f5e2010d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.189+0000 7f5e1ffff700 1 -- 172.21.15.134:0/2205389991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14005040 con 0x7f5e200fc6f0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.189+0000 7f5e1ffff700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 0x7f5e2010dee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00eb40 tx=0x7f5e0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.190+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0c007cc0 con 0x7f5e200fc6f0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.190+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e0c00f040 con 0x7f5e200fc6f0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.190+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2010efb0 con 0x7f5e200fc6f0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.191+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0c009620 con 0x7f5e200fc6f0 2024-03-22T07:27:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.191+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2010f4f0 con 0x7f5e200fc6f0 2024-03-22T07:27:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.192+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5e0c009780 con 0x7f5e200fc6f0 2024-03-22T07:27:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.192+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2005f5f0 con 0x7f5e200fc6f0 2024-03-22T07:27:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.193+0000 7f5e1d7fa700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5e100692b0 0x7f5e1006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.193+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5e0c08b170 con 0x7f5e200fc6f0 2024-03-22T07:27:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.193+0000 7f5e24957700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5e100692b0 0x7f5e1006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.193+0000 7f5e24957700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5e100692b0 0x7f5e1006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400b0d0 tx=0x7f5e14009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:29.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.201+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5e0c08c060 con 0x7f5e200fc6f0 2024-03-22T07:27:29.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:28 smithi195 ceph-mon[36144]: pgmap v221: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:27:29.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.528+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e2010f8d0 con 0x7f5e100692b0 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.545+0000 7f5e1d7fa700 1 -- 172.21.15.134:0/2205389991 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f5e2010f8d0 con 0x7f5e100692b0 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 60s ago 6m 25.0M - 0.25.0 c8568f914cd2 0ce3f68acd2f 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 60s ago 7m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (6m) 67s ago 6m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 60s ago 6m 85.2M - 9.4.7 954c08fa6188 8cd534e3bc25 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (81s) 60s ago 80s 15.7M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (86s) 60s ago 85s 10.4M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:27:29.546 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (84s) 67s ago 83s 12.1M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (78s) 67s ago 78s 11.1M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (8m) 60s ago 8m 481M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (5m) 67s ago 5m 432M - 17.2.7-726-g9c4e0c34 837124da804f 26e2fe2a8479 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (8m) 60s ago 8m 46.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (5m) 67s ago 5m 31.5M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 60s ago 6m 15.4M - 1.5.0 0da6a335fe13 645fc1dfbabe 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 67s ago 5m 16.5M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 60s ago 5m 46.4M 4288M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 60s ago 4m 46.2M 4288M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 60s ago 4m 44.1M 4288M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (3m) 67s ago 3m 47.0M 5312M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (3m) 67s ago 3m 44.1M 5312M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (2m) 67s ago 2m 43.8M 5312M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:27:29.547 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 60s ago 6m 52.4M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:27:29.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5e100692b0 msgr2=0x7f5e1006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.549 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5e100692b0 0x7f5e1006b760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400b0d0 tx=0x7f5e14009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 msgr2=0x7f5e2010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 0x7f5e2010dee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00eb40 tx=0x7f5e0c00b040 comp rx=0 tx=0).stop 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 shutdown_connections 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f5e100692b0 0x7f5e1006b760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e200fb440 0x7f5e2010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 --2- 172.21.15.134:0/2205389991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5e200fc6f0 0x7f5e2010dee0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.548+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 >> 172.21.15.134:0/2205389991 conn(0x7f5e200f6ba0 msgr2=0x7f5e20100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.549+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 shutdown_connections 2024-03-22T07:27:29.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.549+0000 7f5e26bbb700 1 -- 172.21.15.134:0/2205389991 wait complete. 2024-03-22T07:27:29.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 -- 172.21.15.134:0/2911640585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 msgr2=0x7fb8dc0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/2911640585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc0ffa40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc004940 tx=0x7fb8cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 -- 172.21.15.134:0/2911640585 shutdown_connections 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/2911640585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8dc0fff80 0x7fb8dc102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/2911640585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc0ffa40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 -- 172.21.15.134:0/2911640585 >> 172.21.15.134:0/2911640585 conn(0x7fb8dc0f7430 msgr2=0x7fb8dc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 -- 172.21.15.134:0/2911640585 shutdown_connections 2024-03-22T07:27:29.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.655+0000 7fb8e23a7700 1 -- 172.21.15.134:0/2911640585 wait complete. 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.656+0000 7fb8e23a7700 1 Processor -- start 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.656+0000 7fb8e23a7700 1 -- start start 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.656+0000 7fb8e23a7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc06e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.656+0000 7fb8e23a7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8dc0fff80 0x7fb8dc06e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.656+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc06e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50098/0 (socket says 172.21.15.134:50098) 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8dbfff700 1 -- 172.21.15.134:0/71729149 learned_addr learned my addr 172.21.15.134:0/71729149 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc070040 con 0x7fb8dc066260 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8db7fe700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8dc0fff80 0x7fb8dc06e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc06eed0 con 0x7fb8dc0fff80 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8dbfff700 1 -- 172.21.15.134:0/71729149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8dc0fff80 msgr2=0x7fb8dc06e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8dbfff700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8dc0fff80 0x7fb8dc06e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.657+0000 7fb8dbfff700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc005040 con 0x7fb8dc066260 2024-03-22T07:27:29.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.658+0000 7fb8dbfff700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc06e450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc004090 tx=0x7fb8cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:29.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.658+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8cc021070 con 0x7fb8dc066260 2024-03-22T07:27:29.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.658+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8cc01c400 con 0x7fb8dc066260 2024-03-22T07:27:29.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.658+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc06f150 con 0x7fb8dc066260 2024-03-22T07:27:29.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.658+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc11bf30 con 0x7fb8dc066260 2024-03-22T07:27:29.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.659+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8cc00e070 con 0x7fb8dc066260 2024-03-22T07:27:29.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.659+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc05f5f0 con 0x7fb8dc066260 2024-03-22T07:27:29.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.660+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb8cc01ca90 con 0x7fb8dc066260 2024-03-22T07:27:29.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.661+0000 7fb8d8ff9700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb8c40692b0 0x7fb8c406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:29.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.661+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb8cc088000 con 0x7fb8dc066260 2024-03-22T07:27:29.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.661+0000 7fb8db7fe700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb8c40692b0 0x7fb8c406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:29.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.662+0000 7fb8db7fe700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb8c40692b0 0x7fb8c406b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009b80 tx=0x7fb8d000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:29.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.669+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb8cc0542e0 con 0x7fb8dc066260 2024-03-22T07:27:29.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.961+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8dc11c230 con 0x7fb8dc066260 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.962+0000 7fb8d8ff9700 1 -- 172.21.15.134:0/71729149 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fb8cc057900 con 0x7fb8dc066260 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:27:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 14 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:27:29.963 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:27:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb8c40692b0 msgr2=0x7fb8c406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb8c40692b0 0x7fb8c406b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009b80 tx=0x7fb8d000b040 comp rx=0 tx=0).stop 2024-03-22T07:27:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 msgr2=0x7fb8dc06e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc06e450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc004090 tx=0x7fb8cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 shutdown_connections 2024-03-22T07:27:29.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8dc066260 0x7fb8dc06e450 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fb8c40692b0 0x7fb8c406b760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 --2- 172.21.15.134:0/71729149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8dc0fff80 0x7fb8dc06e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 >> 172.21.15.134:0/71729149 conn(0x7fb8dc0f7430 msgr2=0x7fb8dc0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 shutdown_connections 2024-03-22T07:27:29.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:29.964+0000 7fb8e23a7700 1 -- 172.21.15.134:0/71729149 wait complete. 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.077+0000 7f23a2ae9700 1 -- 172.21.15.134:0/1028541285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 msgr2=0x7f239c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.077+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/1028541285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 0x7f239c0ff9c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2390004940 tx=0x7f2390009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.077+0000 7f23a2ae9700 1 -- 172.21.15.134:0/1028541285 shutdown_connections 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.077+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/1028541285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.077+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/1028541285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 0x7f239c0ff9c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.077+0000 7f23a2ae9700 1 -- 172.21.15.134:0/1028541285 >> 172.21.15.134:0/1028541285 conn(0x7f239c0f7430 msgr2=0x7f239c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.078+0000 7f23a2ae9700 1 -- 172.21.15.134:0/1028541285 shutdown_connections 2024-03-22T07:27:30.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.078+0000 7f23a2ae9700 1 -- 172.21.15.134:0/1028541285 wait complete. 2024-03-22T07:27:30.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.078+0000 7f23a2ae9700 1 Processor -- start 2024-03-22T07:27:30.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.078+0000 7f23a2ae9700 1 -- start start 2024-03-22T07:27:30.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f23a2ae9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 0x7f239c0fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:30.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f23a2ae9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c0fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f23a2ae9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0fbe50 con 0x7f239c0662e0 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f23a2ae9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0fbf90 con 0x7f239c0fff00 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f239bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c0fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f239bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c0fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:49216/0 (socket says 172.21.15.134:49216) 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f239bfff700 1 -- 172.21.15.134:0/521560640 learned_addr learned my addr 172.21.15.134:0/521560640 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f23a0885700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 0x7f239c0fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f239bfff700 1 -- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 msgr2=0x7f239c0fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f239bfff700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 0x7f239c0fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.079+0000 7f239bfff700 1 -- 172.21.15.134:0/521560640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390005040 con 0x7f239c0fff00 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.080+0000 7f239bfff700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c0fb8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f238800eb40 tx=0x7f238800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.080+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2388007cc0 con 0x7f239c0fff00 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.080+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f238800f040 con 0x7f239c0fff00 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.080+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238800ca00 con 0x7f239c0fff00 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.080+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c0fc210 con 0x7f239c0fff00 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.080+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c0fc690 con 0x7f239c0fff00 2024-03-22T07:27:30.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.081+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23800052e0 con 0x7f239c0fff00 2024-03-22T07:27:30.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.081+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f238800cc70 con 0x7f239c0fff00 2024-03-22T07:27:30.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.082+0000 7f23997fa700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f238c0692a0 0x7f238c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:30.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.082+0000 7f23a0885700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f238c0692a0 0x7f238c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:30.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.083+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2388086c40 con 0x7f239c0fff00 2024-03-22T07:27:30.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.083+0000 7f23a0885700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f238c0692a0 0x7f238c06b750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2390013740 tx=0x7f2390009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:30.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.090+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f238804e190 con 0x7f239c0fff00 2024-03-22T07:27:30.109 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:29 smithi195 ceph-mon[36144]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:30.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:29 smithi134 ceph-mon[29057]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:30.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.557+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2380005da0 con 0x7f239c0fff00 2024-03-22T07:27:30.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.558+0000 7f23997fa700 1 -- 172.21.15.134:0/521560640 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f2388019730 con 0x7f239c0fff00 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:27:30.559 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:27:30.560 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:27:30.561 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:27:30.562 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:27:30.562 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:27:30.562 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:27:30.562 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:27:30.562 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.560+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f238c0692a0 msgr2=0x7f238c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.560+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f238c0692a0 0x7f238c06b750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2390013740 tx=0x7f2390009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.560+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 msgr2=0x7f239c0fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.560+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c0fb8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f238800eb40 tx=0x7f238800b040 comp rx=0 tx=0).stop 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 shutdown_connections 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f239c0662e0 0x7f239c0fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.563 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f238c0692a0 0x7f238c06b750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 --2- 172.21.15.134:0/521560640 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f239c0fff00 0x7f239c0fb8c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 >> 172.21.15.134:0/521560640 conn(0x7f239c0f7430 msgr2=0x7f239c0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:30.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 shutdown_connections 2024-03-22T07:27:30.564 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.561+0000 7f23a2ae9700 1 -- 172.21.15.134:0/521560640 wait complete. 2024-03-22T07:27:30.564 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:27:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.723+0000 7f4183fec700 1 -- 172.21.15.134:0/959166864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fcf80 msgr2=0x7f417c0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.723+0000 7f4183fec700 1 --2- 172.21.15.134:0/959166864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fcf80 0x7f417c0fd3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f416c004940 tx=0x7f416c009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:30.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.723+0000 7f4183fec700 1 -- 172.21.15.134:0/959166864 shutdown_connections 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.723+0000 7f4183fec700 1 --2- 172.21.15.134:0/959166864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fcf80 0x7f417c0fd3f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.723+0000 7f4183fec700 1 --2- 172.21.15.134:0/959166864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fbcd0 0x7f417c0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.723+0000 7f4183fec700 1 -- 172.21.15.134:0/959166864 >> 172.21.15.134:0/959166864 conn(0x7f417c0f7430 msgr2=0x7f417c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.724+0000 7f4183fec700 1 -- 172.21.15.134:0/959166864 shutdown_connections 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.724+0000 7f4183fec700 1 -- 172.21.15.134:0/959166864 wait complete. 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.724+0000 7f4183fec700 1 Processor -- start 2024-03-22T07:27:30.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.724+0000 7f4183fec700 1 -- start start 2024-03-22T07:27:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.724+0000 7f4183fec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fbcd0 0x7f417c112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4183fec700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 0x7f417c114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:30.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4183fec700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0662a0 con 0x7f417c0fbcd0 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4183fec700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0663e0 con 0x7f417c0fcf80 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181d88700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fbcd0 0x7f417c112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181587700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 0x7f417c114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181587700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 0x7f417c114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:49224/0 (socket says 172.21.15.134:49224) 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181587700 1 -- 172.21.15.134:0/1718650441 learned_addr learned my addr 172.21.15.134:0/1718650441 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181587700 1 -- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fbcd0 msgr2=0x7f417c112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181587700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fbcd0 0x7f417c112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.725+0000 7f4181587700 1 -- 172.21.15.134:0/1718650441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c005040 con 0x7f417c0fcf80 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.726+0000 7f4181587700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 0x7f417c114f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f416c013870 tx=0x7f416c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.726+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f416c021070 con 0x7f417c0fcf80 2024-03-22T07:27:30.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.726+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c1154d0 con 0x7f417c0fcf80 2024-03-22T07:27:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.726+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c115870 con 0x7f417c0fcf80 2024-03-22T07:27:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.727+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f416c009430 con 0x7f417c0fcf80 2024-03-22T07:27:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.727+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f416c00e070 con 0x7f417c0fcf80 2024-03-22T07:27:30.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.728+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c05f5f0 con 0x7f417c0fcf80 2024-03-22T07:27:30.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.729+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f416c01c670 con 0x7f417c0fcf80 2024-03-22T07:27:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.730+0000 7f41727fc700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f41680692a0 0x7f416806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.730+0000 7f4181d88700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f41680692a0 0x7f416806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.730+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f416c088470 con 0x7f417c0fcf80 2024-03-22T07:27:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.730+0000 7f4181d88700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f41680692a0 0x7f416806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f417c066030 tx=0x7f417800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:30.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:30.738+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f416c054730 con 0x7f417c0fcf80 2024-03-22T07:27:31.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.146+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f417c1012a0 con 0x7f41680692a0 2024-03-22T07:27:31.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:30 smithi134 ceph-mon[29057]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:31.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:30 smithi134 ceph-mon[29057]: pgmap v222: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:27:31.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:30 smithi134 ceph-mon[29057]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:31.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:30 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/71729149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:27:31.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:31.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:30 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/521560640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.148+0000 7f41727fc700 1 -- 172.21.15.134:0/1718650441 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f417c1012a0 con 0x7f41680692a0 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69", 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "", 2024-03-22T07:27:31.148 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:db0330b1e4e2470d52b750e251e55a522b4f7d69 image", 2024-03-22T07:27:31.149 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:27:31.149 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:27:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.150+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f41680692a0 msgr2=0x7f416806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.150+0000 7f4183fec700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f41680692a0 0x7f416806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f417c066030 tx=0x7f417800b040 comp rx=0 tx=0).stop 2024-03-22T07:27:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.150+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 msgr2=0x7f417c114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.150+0000 7f4183fec700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 0x7f417c114f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f416c013870 tx=0x7f416c009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 shutdown_connections 2024-03-22T07:27:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f417c0fbcd0 0x7f417c112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f41680692a0 0x7f416806b750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 --2- 172.21.15.134:0/1718650441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f417c0fcf80 0x7f417c114f90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 >> 172.21.15.134:0/1718650441 conn(0x7f417c0f7430 msgr2=0x7f417c0f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:31.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 shutdown_connections 2024-03-22T07:27:31.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.151+0000 7f4183fec700 1 -- 172.21.15.134:0/1718650441 wait complete. 2024-03-22T07:27:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:30 smithi195 ceph-mon[36144]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:30 smithi195 ceph-mon[36144]: pgmap v222: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-22T07:27:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:30 smithi195 ceph-mon[36144]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:30 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/71729149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:27:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:30 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/521560640' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:27:31.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 -- 172.21.15.134:0/1600539147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fdc60 msgr2=0x7fe17c0fc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:31.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 --2- 172.21.15.134:0/1600539147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fdc60 0x7fe17c0fc070 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe16c004940 tx=0x7fe16c009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:31.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 -- 172.21.15.134:0/1600539147 shutdown_connections 2024-03-22T07:27:31.310 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 --2- 172.21.15.134:0/1600539147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fdc60 0x7fe17c0fc070 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 --2- 172.21.15.134:0/1600539147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fd310 0x7fe17c0fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 -- 172.21.15.134:0/1600539147 >> 172.21.15.134:0/1600539147 conn(0x7fe17c0f6c10 msgr2=0x7fe17c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:31.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 -- 172.21.15.134:0/1600539147 shutdown_connections 2024-03-22T07:27:31.311 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.309+0000 7fe183d9f700 1 -- 172.21.15.134:0/1600539147 wait complete. 2024-03-22T07:27:31.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe183d9f700 1 Processor -- start 2024-03-22T07:27:31.313 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe183d9f700 1 -- start start 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe183d9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fd310 0x7fe17c10d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe183d9f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 0x7fe17c10de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe183d9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c10e410 con 0x7fe17c0fd310 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe183d9f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c10e580 con 0x7fe17c0fdc60 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.310+0000 7fe18133a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 0x7fe17c10de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe18133a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 0x7fe17c10de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:49256/0 (socket says 172.21.15.134:49256) 2024-03-22T07:27:31.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe18133a700 1 -- 172.21.15.134:0/593186822 learned_addr learned my addr 172.21.15.134:0/593186822 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe181b3b700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fd310 0x7fe17c10d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe18133a700 1 -- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fd310 msgr2=0x7fe17c10d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe18133a700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fd310 0x7fe17c10d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe18133a700 1 -- 172.21.15.134:0/593186822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c005040 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe18133a700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 0x7fe17c10de10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe16c004090 tx=0x7fe16c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16c021070 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe16c01c400 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16c00e030 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.311+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c112f80 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.312+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1133d0 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.313+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c101c10 con 0x7fe17c0fdc60 2024-03-22T07:27:31.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.313+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe16c01ca20 con 0x7fe17c0fdc60 2024-03-22T07:27:31.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.314+0000 7fe1727fc700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1680692a0 0x7fe16806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:27:31.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.314+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe16c088540 con 0x7fe17c0fdc60 2024-03-22T07:27:31.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.314+0000 7fe181b3b700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1680692a0 0x7fe16806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:27:31.316 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.315+0000 7fe181b3b700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1680692a0 0x7fe16806b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe178004600 tx=0x7fe17800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:27:31.322 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.322+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe16c058290 con 0x7fe17c0fdc60 2024-03-22T07:27:31.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.866+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe17c104810 con 0x7fe17c0fdc60 2024-03-22T07:27:31.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.867+0000 7fe1727fc700 1 -- 172.21.15.134:0/593186822 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe16c057e20 con 0x7fe17c0fdc60 2024-03-22T07:27:31.867 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:27:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1680692a0 msgr2=0x7fe16806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1680692a0 0x7fe16806b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe178004600 tx=0x7fe17800b040 comp rx=0 tx=0).stop 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 msgr2=0x7fe17c10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 0x7fe17c10de10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe16c004090 tx=0x7fe16c009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 shutdown_connections 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe17c0fd310 0x7fe17c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fe1680692a0 0x7fe16806b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 --2- 172.21.15.134:0/593186822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe17c0fdc60 0x7fe17c10de10 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe16c004090 tx=0x7fe16c009e30 comp rx=0 tx=0).stop 2024-03-22T07:27:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.869+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 >> 172.21.15.134:0/593186822 conn(0x7fe17c0f6c10 msgr2=0x7fe17c0f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:27:31.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.872+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 shutdown_connections 2024-03-22T07:27:31.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:27:31.872+0000 7fe183d9f700 1 -- 172.21.15.134:0/593186822 wait complete. 2024-03-22T07:27:33.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:33.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: pgmap v223: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:27:33.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:27:33.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: Upgrade: Target is version 19.0.0-1667-gdb0330b1 (unknown) 2024-03-22T07:27:33.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10'] 2024-03-22T07:27:33.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:27:33.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:27:33.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: Upgrade: Need to upgrade myself (mgr.smithi134.wtwqre) 2024-03-22T07:27:33.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:32 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/593186822' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:27:33.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:27:33.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: pgmap v223: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:27:33.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:27:33.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: Upgrade: Target is version 19.0.0-1667-gdb0330b1 (unknown) 2024-03-22T07:27:33.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10'] 2024-03-22T07:27:33.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:27:33.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:27:33.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: Upgrade: Need to upgrade myself (mgr.smithi134.wtwqre) 2024-03-22T07:27:33.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:32 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/593186822' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:27:34.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:33 smithi195 ceph-mon[36144]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 on smithi195 2024-03-22T07:27:34.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:33 smithi134 ceph-mon[29057]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 on smithi195 2024-03-22T07:27:35.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:34 smithi195 ceph-mon[36144]: pgmap v224: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:27:35.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:34 smithi134 ceph-mon[29057]: pgmap v224: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-03-22T07:27:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:36 smithi195 ceph-mon[36144]: pgmap v225: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:37.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:36 smithi134 ceph-mon[29057]: pgmap v225: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:39.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:38 smithi134 ceph-mon[29057]: pgmap v226: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:38 smithi195 ceph-mon[36144]: pgmap v226: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:41.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:40 smithi195 ceph-mon[36144]: pgmap v227: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:41.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:40 smithi134 ceph-mon[29057]: pgmap v227: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:43.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:42 smithi195 ceph-mon[36144]: pgmap v228: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:43.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:42 smithi134 ceph-mon[29057]: pgmap v228: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:44 smithi195 ceph-mon[36144]: pgmap v229: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:45.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:44 smithi134 ceph-mon[29057]: pgmap v229: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:46.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:45 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:45 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:27:46.325 INFO:tasks.workunit.client.1.smithi195.stderr:Note: switching to '768f6cd6e95d0c7a626042719c230df59bdba9d3'. 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr:state without impacting any branches by switching back to a branch. 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr: git switch -c 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.326 INFO:tasks.workunit.client.1.smithi195.stderr:Or undo this operation with: 2024-03-22T07:27:46.327 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.327 INFO:tasks.workunit.client.1.smithi195.stderr: git switch - 2024-03-22T07:27:46.327 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.327 INFO:tasks.workunit.client.1.smithi195.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-22T07:27:46.327 INFO:tasks.workunit.client.1.smithi195.stderr: 2024-03-22T07:27:46.327 INFO:tasks.workunit.client.1.smithi195.stderr:HEAD is now at 768f6cd6e95 Merge pull request #56339 from zdover23/wip-doc-2024-03-20-backport-56333-to-squid 2024-03-22T07:27:46.329 DEBUG:teuthology.orchestra.run.smithi195:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-22T07:27:46.392 INFO:tasks.workunit.client.1.smithi195.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-22T07:27:46.395 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-22T07:27:46.395 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr:Note: switching to '768f6cd6e95d0c7a626042719c230df59bdba9d3'. 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr:state without impacting any branches by switching back to a branch. 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.901 INFO:tasks.workunit.client.0.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: git switch -c 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr:Or undo this operation with: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: git switch - 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr: 2024-03-22T07:27:46.902 INFO:tasks.workunit.client.0.smithi134.stderr:HEAD is now at 768f6cd6e95 Merge pull request #56339 from zdover23/wip-doc-2024-03-20-backport-56333-to-squid 2024-03-22T07:27:46.904 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-22T07:27:46.944 INFO:tasks.workunit.client.0.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-22T07:27:46.945 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-22T07:27:46.946 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-22T07:27:47.155 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-22T07:27:47.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:46 smithi195 ceph-mon[36144]: pgmap v230: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:47.207 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-22T07:27:47.249 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-22T07:27:47.250 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-22T07:27:47.250 INFO:tasks.workunit.client.1.smithi195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-22T07:27:47.290 INFO:tasks.workunit.client.1.smithi195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-22T07:27:47.292 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:27:47.293 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-22T07:27:47.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:46 smithi134 ceph-mon[29057]: pgmap v230: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:47.352 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-03-22T07:27:47.354 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-22T07:27:47.354 DEBUG:teuthology.orchestra.run.smithi195:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-03-22T07:27:47.413 INFO:tasks.workunit.client.1.smithi195.stderr:+ mkdir -p fsstress 2024-03-22T07:27:47.415 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd fsstress 2024-03-22T07:27:47.415 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-22T07:27:47.415 INFO:tasks.workunit.client.1.smithi195.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-22T07:27:47.725 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-22T07:27:47.786 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-22T07:27:47.826 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-22T07:27:47.827 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-22T07:27:47.827 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-22T07:27:47.866 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-22T07:27:47.870 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:27:47.870 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-22T07:27:47.926 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-22T07:27:47.927 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-22T07:27:47.927 DEBUG:teuthology.orchestra.run.smithi134:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-22T07:27:47.954 INFO:tasks.workunit.client.1.smithi195.stderr:+ tar xzf ltp-full.tgz 2024-03-22T07:27:47.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ mkdir -p fsstress 2024-03-22T07:27:47.989 INFO:tasks.workunit.client.0.smithi134.stderr:+ pushd fsstress 2024-03-22T07:27:47.990 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-22T07:27:47.990 INFO:tasks.workunit.client.0.smithi134.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-22T07:27:48.802 INFO:tasks.workunit.client.0.smithi134.stderr:+ tar xzf ltp-full.tgz 2024-03-22T07:27:49.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:48 smithi134 ceph-mon[29057]: pgmap v231: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:48 smithi195 ceph-mon[36144]: pgmap v231: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:27:51.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:50 smithi195 ceph-mon[36144]: pgmap v232: 65 pgs: 65 active+clean; 1.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 111 KiB/s wr, 0 op/s 2024-03-22T07:27:51.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:50 smithi134 ceph-mon[29057]: pgmap v232: 65 pgs: 65 active+clean; 1.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 111 KiB/s wr, 0 op/s 2024-03-22T07:27:53.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:52 smithi195 ceph-mon[36144]: pgmap v233: 65 pgs: 65 active+clean; 1.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 111 KiB/s wr, 0 op/s 2024-03-22T07:27:53.300 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:52 smithi134 ceph-mon[29057]: pgmap v233: 65 pgs: 65 active+clean; 1.9 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 111 KiB/s wr, 0 op/s 2024-03-22T07:27:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:54 smithi195 ceph-mon[36144]: pgmap v234: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 44 op/s 2024-03-22T07:27:55.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:54 smithi134 ceph-mon[29057]: pgmap v234: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 44 op/s 2024-03-22T07:27:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:56 smithi195 ceph-mon[36144]: pgmap v235: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 44 op/s 2024-03-22T07:27:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:56 smithi134 ceph-mon[29057]: pgmap v235: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 44 op/s 2024-03-22T07:27:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:27:58 smithi134 ceph-mon[29057]: pgmap v236: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s wr, 253 op/s 2024-03-22T07:27:59.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:27:58 smithi195 ceph-mon[36144]: pgmap v236: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s wr, 253 op/s 2024-03-22T07:28:01.180 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:00 smithi195 ceph-mon[36144]: pgmap v237: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 512 op/s 2024-03-22T07:28:01.180 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:00 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:00 smithi134 ceph-mon[29057]: pgmap v237: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 512 op/s 2024-03-22T07:28:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:00 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 -- 172.21.15.134:0/39108203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fcc40 msgr2=0x7facc80fd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 --2- 172.21.15.134:0/39108203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fcc40 0x7facc80fd0b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7facb8004940 tx=0x7facb8009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 -- 172.21.15.134:0/39108203 shutdown_connections 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 --2- 172.21.15.134:0/39108203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fcc40 0x7facc80fd0b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 --2- 172.21.15.134:0/39108203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fc2f0 0x7facc80fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 -- 172.21.15.134:0/39108203 >> 172.21.15.134:0/39108203 conn(0x7facc80f6ba0 msgr2=0x7facc80f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 -- 172.21.15.134:0/39108203 shutdown_connections 2024-03-22T07:28:02.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.029+0000 7faccf2d7700 1 -- 172.21.15.134:0/39108203 wait complete. 2024-03-22T07:28:02.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccf2d7700 1 Processor -- start 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccf2d7700 1 -- start start 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccf2d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fc2f0 0x7facc8112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccf2d7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fcc40 0x7facc8114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccf2d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80fbbd0 con 0x7facc80fc2f0 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccf2d7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80fbd10 con 0x7facc80fcc40 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccd073700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fc2f0 0x7facc8112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccd073700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fc2f0 0x7facc8112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45746/0 (socket says 172.21.15.134:45746) 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccd073700 1 -- 172.21.15.134:0/3377301253 learned_addr learned my addr 172.21.15.134:0/3377301253 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.030+0000 7faccc872700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fcc40 0x7facc8114ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7faccc872700 1 -- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fc2f0 msgr2=0x7facc8112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7faccc872700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fc2f0 0x7facc8112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7faccc872700 1 -- 172.21.15.134:0/3377301253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8005040 con 0x7facc80fcc40 2024-03-22T07:28:02.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7faccc872700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fcc40 0x7facc8114ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facb8009fd0 tx=0x7facb8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb8021070 con 0x7facc80fcc40 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facb801c400 con 0x7facc80fcc40 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb800e070 con 0x7facc80fcc40 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc8115530 con 0x7facc80fcc40 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.031+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8115880 con 0x7facc80fcc40 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.033+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc805f5f0 con 0x7facc80fcc40 2024-03-22T07:28:02.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.033+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7facb801ca20 con 0x7facc80fcc40 2024-03-22T07:28:02.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.034+0000 7facbdffb700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facb40692b0 0x7facb406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.034+0000 7faccd073700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facb40692b0 0x7facb406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.034+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7facb80882b0 con 0x7facc80fcc40 2024-03-22T07:28:02.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.034+0000 7faccd073700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facb40692b0 0x7facb406b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facc4008fd0 tx=0x7facc400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:02.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.038+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7facb8054630 con 0x7facc80fcc40 2024-03-22T07:28:02.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.284+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7facc8101390 con 0x7facb40692b0 2024-03-22T07:28:02.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.285+0000 7facbdffb700 1 -- 172.21.15.134:0/3377301253 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7facc8101390 con 0x7facb40692b0 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facb40692b0 msgr2=0x7facb406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facb40692b0 0x7facb406b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7facc4008fd0 tx=0x7facc400b040 comp rx=0 tx=0).stop 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fcc40 msgr2=0x7facc8114ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fcc40 0x7facc8114ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7facb8009fd0 tx=0x7facb8009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 shutdown_connections 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc80fc2f0 0x7facc8112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7facb40692b0 0x7facb406b760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 --2- 172.21.15.134:0/3377301253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc80fcc40 0x7facc8114ff0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 >> 172.21.15.134:0/3377301253 conn(0x7facc80f6ba0 msgr2=0x7facc80f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.287+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 shutdown_connections 2024-03-22T07:28:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.288+0000 7faccf2d7700 1 -- 172.21.15.134:0/3377301253 wait complete. 2024-03-22T07:28:02.299 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:28:02.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 -- 172.21.15.134:0/1766439425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 msgr2=0x7fd1680ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 --2- 172.21.15.134:0/1766439425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680ff9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd164004940 tx=0x7fd164009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:02.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 -- 172.21.15.134:0/1766439425 shutdown_connections 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 --2- 172.21.15.134:0/1766439425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1680fff00 0x7fd168102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 --2- 172.21.15.134:0/1766439425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680ff9c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 -- 172.21.15.134:0/1766439425 >> 172.21.15.134:0/1766439425 conn(0x7fd1680f7430 msgr2=0x7fd1680f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 -- 172.21.15.134:0/1766439425 shutdown_connections 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.434+0000 7fd170766700 1 -- 172.21.15.134:0/1766439425 wait complete. 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd170766700 1 Processor -- start 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd170766700 1 -- start start 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd170766700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd170766700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1680fff00 0x7fd1680fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd170766700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680fbe70 con 0x7fd1680662e0 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd170766700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680fbfe0 con 0x7fd1680fff00 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16e502700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16e502700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680fd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45762/0 (socket says 172.21.15.134:45762) 2024-03-22T07:28:02.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16e502700 1 -- 172.21.15.134:0/1284878705 learned_addr learned my addr 172.21.15.134:0/1284878705 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:02.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16dd01700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1680fff00 0x7fd1680fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16e502700 1 -- 172.21.15.134:0/1284878705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1680fff00 msgr2=0x7fd1680fb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16e502700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1680fff00 0x7fd1680fb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.435+0000 7fd16e502700 1 -- 172.21.15.134:0/1284878705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164005040 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.436+0000 7fd16e502700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680fd3f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b3b0 tx=0x7fd164009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.436+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd16400e040 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.436+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1680fc260 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.436+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd16400bbf0 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.436+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd16401c630 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.436+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd168115a60 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.437+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16805f5f0 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.438+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd16400bd60 con 0x7fd1680662e0 2024-03-22T07:28:02.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.438+0000 7fd15effd700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd1540692a0 0x7fd15406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.438+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd164087df0 con 0x7fd1680662e0 2024-03-22T07:28:02.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.438+0000 7fd16dd01700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd1540692a0 0x7fd15406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.440 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.439+0000 7fd16dd01700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd1540692a0 0x7fd15406b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1580102e0 tx=0x7fd15800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:02.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.443+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd164054170 con 0x7fd1680662e0 2024-03-22T07:28:02.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.702+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1680f8f70 con 0x7fd1540692a0 2024-03-22T07:28:02.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.703+0000 7fd15effd700 1 -- 172.21.15.134:0/1284878705 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fd1680f8f70 con 0x7fd1540692a0 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd1540692a0 msgr2=0x7fd15406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd1540692a0 0x7fd15406b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1580102e0 tx=0x7fd15800b040 comp rx=0 tx=0).stop 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 msgr2=0x7fd1680fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680fd3f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd16400b3b0 tx=0x7fd164009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 shutdown_connections 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1680662e0 0x7fd1680fd3f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fd1540692a0 0x7fd15406b750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 --2- 172.21.15.134:0/1284878705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1680fff00 0x7fd1680fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.706+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 >> 172.21.15.134:0/1284878705 conn(0x7fd1680f7430 msgr2=0x7fd1680f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.707+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 shutdown_connections 2024-03-22T07:28:02.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.707+0000 7fd170766700 1 -- 172.21.15.134:0/1284878705 wait complete. 2024-03-22T07:28:02.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 -- 172.21.15.134:0/3131749463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 msgr2=0x7ffa880fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3131749463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa880fc6e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffa78004940 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:02.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 -- 172.21.15.134:0/3131749463 shutdown_connections 2024-03-22T07:28:02.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3131749463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 0x7ffa880fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3131749463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa880fc6e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 -- 172.21.15.134:0/3131749463 >> 172.21.15.134:0/3131749463 conn(0x7ffa880f6ba0 msgr2=0x7ffa880f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:02.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 -- 172.21.15.134:0/3131749463 shutdown_connections 2024-03-22T07:28:02.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.816+0000 7ffa8d651700 1 -- 172.21.15.134:0/3131749463 wait complete. 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa8d651700 1 Processor -- start 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa8d651700 1 -- start start 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa8d651700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa88110670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa8d651700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 0x7ffa88112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa8d651700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880fbd20 con 0x7ffa880fc2d0 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa8d651700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880fbe60 con 0x7ffa880fcc20 2024-03-22T07:28:02.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa86ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa88110670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa86ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa88110670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45770/0 (socket says 172.21.15.134:45770) 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa86ffd700 1 -- 172.21.15.134:0/3629585517 learned_addr learned my addr 172.21.15.134:0/3629585517 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa867fc700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 0x7ffa88112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa86ffd700 1 -- 172.21.15.134:0/3629585517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 msgr2=0x7ffa88112bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa86ffd700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 0x7ffa88112bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.817+0000 7ffa86ffd700 1 -- 172.21.15.134:0/3629585517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78005040 con 0x7ffa880fc2d0 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa867fc700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 0x7ffa88112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa86ffd700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa88110670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009150 tx=0x7ffa78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:02.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7800e040 con 0x7ffa880fc2d0 2024-03-22T07:28:02.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa7800bcc0 con 0x7ffa880fc2d0 2024-03-22T07:28:02.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa88113160 con 0x7ffa880fc2d0 2024-03-22T07:28:02.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7801c630 con 0x7ffa880fc2d0 2024-03-22T07:28:02.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.818+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa88113720 con 0x7ffa880fc2d0 2024-03-22T07:28:02.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.819+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8805f5f0 con 0x7ffa880fc2d0 2024-03-22T07:28:02.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.820+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ffa78013420 con 0x7ffa880fc2d0 2024-03-22T07:28:02.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.820+0000 7ffa6f7fe700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ffa700692a0 0x7ffa7006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:02.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.821+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffa78087eb0 con 0x7ffa880fc2d0 2024-03-22T07:28:02.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.821+0000 7ffa867fc700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ffa700692a0 0x7ffa7006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:02.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.821+0000 7ffa867fc700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ffa700692a0 0x7ffa7006b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c007fd0 tx=0x7ffa7c009f60 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:02.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:02.828+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ffa78054230 con 0x7ffa880fc2d0 2024-03-22T07:28:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:02 smithi195 ceph-mon[36144]: pgmap v238: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 513 op/s 2024-03-22T07:28:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:02 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:02 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:28:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:02 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:28:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:02 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:28:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:02 smithi134 ceph-mon[29057]: pgmap v238: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 513 op/s 2024-03-22T07:28:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:02 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:02 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:28:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:02 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:28:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:02 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:28:03.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.110+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa88101380 con 0x7ffa700692a0 2024-03-22T07:28:03.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.120+0000 7ffa6f7fe700 1 -- 172.21.15.134:0/3629585517 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ffa88101380 con 0x7ffa700692a0 2024-03-22T07:28:03.121 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:28:03.121 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 94s ago 7m 25.0M - 0.25.0 c8568f914cd2 0ce3f68acd2f 2024-03-22T07:28:03.121 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 94s ago 7m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:28:03.121 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (6m) 101s ago 6m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:28:03.121 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 94s ago 7m 85.2M - 9.4.7 954c08fa6188 8cd534e3bc25 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (114s) 94s ago 114s 15.7M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (2m) 94s ago 119s 10.4M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (117s) 101s ago 117s 12.1M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (112s) 101s ago 111s 11.1M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (8m) 94s ago 8m 481M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (6m) 101s ago 6m 432M - 17.2.7-726-g9c4e0c34 837124da804f 26e2fe2a8479 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (8m) 94s ago 8m 46.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (6m) 101s ago 6m 31.5M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 94s ago 7m 15.4M - 1.5.0 0da6a335fe13 645fc1dfbabe 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 101s ago 6m 16.5M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 94s ago 5m 46.4M 4288M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 94s ago 5m 46.2M 4288M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:28:03.122 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 94s ago 4m 44.1M 4288M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:28:03.123 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (4m) 101s ago 4m 47.0M 5312M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:28:03.123 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (3m) 101s ago 3m 44.1M 5312M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:28:03.123 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (3m) 101s ago 3m 43.8M 5312M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:28:03.123 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 94s ago 6m 52.4M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ffa700692a0 msgr2=0x7ffa7006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ffa700692a0 0x7ffa7006b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c007fd0 tx=0x7ffa7c009f60 comp rx=0 tx=0).stop 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 msgr2=0x7ffa88110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa88110670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009150 tx=0x7ffa78009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 shutdown_connections 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa880fc2d0 0x7ffa88110670 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7ffa700692a0 0x7ffa7006b750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 --2- 172.21.15.134:0/3629585517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa880fcc20 0x7ffa88112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.122+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 >> 172.21.15.134:0/3629585517 conn(0x7ffa880f6ba0 msgr2=0x7ffa880f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:03.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.123+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 shutdown_connections 2024-03-22T07:28:03.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.123+0000 7ffa8d651700 1 -- 172.21.15.134:0/3629585517 wait complete. 2024-03-22T07:28:03.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 -- 172.21.15.134:0/4014400657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf980fff60 msgr2=0x7fcf98102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/4014400657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf980fff60 0x7fcf98102340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcf88004940 tx=0x7fcf88009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 -- 172.21.15.134:0/4014400657 shutdown_connections 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/4014400657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf980fff60 0x7fcf98102340 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/4014400657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf98066280 0x7fcf980ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 -- 172.21.15.134:0/4014400657 >> 172.21.15.134:0/4014400657 conn(0x7fcf980f7430 msgr2=0x7fcf980f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 -- 172.21.15.134:0/4014400657 shutdown_connections 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.233+0000 7fcfa04c3700 1 -- 172.21.15.134:0/4014400657 wait complete. 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcfa04c3700 1 Processor -- start 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcfa04c3700 1 -- start start 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcfa04c3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 0x7fcf9810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcfa04c3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf980fff60 0x7fcf9810def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcfa04c3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9810e4f0 con 0x7fcf98066280 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcfa04c3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9810ed40 con 0x7fcf980fff60 2024-03-22T07:28:03.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcf9e25f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 0x7fcf9810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:03.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcf9e25f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 0x7fcf9810d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45796/0 (socket says 172.21.15.134:45796) 2024-03-22T07:28:03.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcf9e25f700 1 -- 172.21.15.134:0/3356948200 learned_addr learned my addr 172.21.15.134:0/3356948200 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:03.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.234+0000 7fcf9da5e700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf980fff60 0x7fcf9810def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:03.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf9e25f700 1 -- 172.21.15.134:0/3356948200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf980fff60 msgr2=0x7fcf9810def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf9e25f700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf980fff60 0x7fcf9810def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf9e25f700 1 -- 172.21.15.134:0/3356948200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88005040 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf9e25f700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 0x7fcf9810d9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcf94002a80 tx=0x7fcf940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf94007cc0 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9810f020 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9810f560 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf9400f040 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.235+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9400db30 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.236+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c0052e0 con 0x7fcf98066280 2024-03-22T07:28:03.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.237+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcf940097a0 con 0x7fcf98066280 2024-03-22T07:28:03.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.237+0000 7fcf8effd700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcf840692a0 0x7fcf8406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:03.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.238+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcf94086860 con 0x7fcf98066280 2024-03-22T07:28:03.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.238+0000 7fcf9da5e700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcf840692a0 0x7fcf8406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:03.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.238+0000 7fcf9da5e700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcf840692a0 0x7fcf8406b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800b3b0 tx=0x7fcf88009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:03.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.242+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcf9404d190 con 0x7fcf98066280 2024-03-22T07:28:03.565 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.563+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf7c005da0 con 0x7fcf98066280 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.565+0000 7fcf8effd700 1 -- 172.21.15.134:0/3356948200 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fcf940565d0 con 0x7fcf98066280 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:28:03.566 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 14 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:28:03.567 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:28:03.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcf840692a0 msgr2=0x7fcf8406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcf840692a0 0x7fcf8406b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800b3b0 tx=0x7fcf88009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:03.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 msgr2=0x7fcf9810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 0x7fcf9810d9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcf94002a80 tx=0x7fcf940046b0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 shutdown_connections 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf98066280 0x7fcf9810d9b0 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcf94002a80 tx=0x7fcf940046b0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7fcf840692a0 0x7fcf8406b750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 --2- 172.21.15.134:0/3356948200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf980fff60 0x7fcf9810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.572+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 >> 172.21.15.134:0/3356948200 conn(0x7fcf980f7430 msgr2=0x7fcf980f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.573+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 shutdown_connections 2024-03-22T07:28:03.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.573+0000 7fcfa04c3700 1 -- 172.21.15.134:0/3356948200 wait complete. 2024-03-22T07:28:03.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.763+0000 7f4bd7fff700 1 -- 172.21.15.134:0/2132676421 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc00be70 con 0x7f4be00fce40 2024-03-22T07:28:03.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.763+0000 7f4be7483700 1 -- 172.21.15.134:0/2132676421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 msgr2=0x7f4be00fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.763+0000 7f4be7483700 1 --2- 172.21.15.134:0/2132676421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be00fd250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc004a90 tx=0x7f4bdc009dd0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 -- 172.21.15.134:0/2132676421 shutdown_connections 2024-03-22T07:28:03.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 --2- 172.21.15.134:0/2132676421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4be00fe040 0x7f4be00fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 --2- 172.21.15.134:0/2132676421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be00fd250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 -- 172.21.15.134:0/2132676421 >> 172.21.15.134:0/2132676421 conn(0x7f4be00f8570 msgr2=0x7f4be00fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 -- 172.21.15.134:0/2132676421 shutdown_connections 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 -- 172.21.15.134:0/2132676421 wait complete. 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.764+0000 7f4be7483700 1 Processor -- start 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be7483700 1 -- start start 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be7483700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be010b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be7483700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4be00fe040 0x7f4be010bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be7483700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be010c490 con 0x7f4be00fce40 2024-03-22T07:28:03.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be7483700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be010cc50 con 0x7f4be00fe040 2024-03-22T07:28:03.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be521f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be010b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:03.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be521f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be010b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40138/0 (socket says 172.21.15.134:40138) 2024-03-22T07:28:03.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.765+0000 7f4be521f700 1 -- 172.21.15.134:0/3685607405 learned_addr learned my addr 172.21.15.134:0/3685607405 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:03.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.767+0000 7f4be4a1e700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4be00fe040 0x7f4be010bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:03.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.771+0000 7f4be521f700 1 -- 172.21.15.134:0/3685607405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4be00fe040 msgr2=0x7f4be010bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:03.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.771+0000 7f4be521f700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4be00fe040 0x7f4be010bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:03.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.771+0000 7f4be521f700 1 -- 172.21.15.134:0/3685607405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc004650 con 0x7f4be00fce40 2024-03-22T07:28:03.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.772+0000 7f4be521f700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be010b870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000c00 tx=0x7f4bdc009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:03.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.775+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc01a070 con 0x7f4be00fce40 2024-03-22T07:28:03.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.775+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bdc014430 con 0x7f4be00fce40 2024-03-22T07:28:03.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.775+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc00e040 con 0x7f4be00fce40 2024-03-22T07:28:03.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.776+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be010ced0 con 0x7f4be00fce40 2024-03-22T07:28:03.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.776+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be010d430 con 0x7f4be00fce40 2024-03-22T07:28:03.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.778+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be005f5f0 con 0x7f4be00fce40 2024-03-22T07:28:03.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.782+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4bdc0145a0 con 0x7f4be00fce40 2024-03-22T07:28:03.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.782+0000 7f4bd5ffb700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4bcc069490 0x7f4bcc06b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:03.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.782+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4bdc088be0 con 0x7f4be00fce40 2024-03-22T07:28:03.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.783+0000 7f4be4a1e700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4bcc069490 0x7f4bcc06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:03.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.784+0000 7f4be4a1e700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4bcc069490 0x7f4bcc06b940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0006fd0 tx=0x7f4bd0000f90 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:03.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:03.788+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4bdc054ea0 con 0x7f4be00fce40 2024-03-22T07:28:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:03 smithi195 ceph-mon[36144]: Upgrade: Updating mgr.smithi195.jxfsnc 2024-03-22T07:28:04.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:03 smithi195 ceph-mon[36144]: Deploying daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:28:04.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:03 smithi195 ceph-mon[36144]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:04.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:03 smithi195 ceph-mon[36144]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:04.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:03 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3356948200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:28:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:03 smithi134 ceph-mon[29057]: Upgrade: Updating mgr.smithi195.jxfsnc 2024-03-22T07:28:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:03 smithi134 ceph-mon[29057]: Deploying daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:28:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:03 smithi134 ceph-mon[29057]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:03 smithi134 ceph-mon[29057]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:04.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:03 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3356948200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:28:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.296+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4be0103760 con 0x7f4be00fce40 2024-03-22T07:28:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.297+0000 7f4bd5ffb700 1 -- 172.21.15.134:0/3685607405 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f4bdc0584c0 con 0x7f4be00fce40 2024-03-22T07:28:04.298 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:28:04.298 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:28:04.299 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:28:04.300 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:04.301 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:04.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.301+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4bcc069490 msgr2=0x7f4bcc06b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.301+0000 7f4be7483700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4bcc069490 0x7f4bcc06b940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0006fd0 tx=0x7f4bd0000f90 comp rx=0 tx=0).stop 2024-03-22T07:28:04.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.301+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 msgr2=0x7f4be010b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.301+0000 7f4be7483700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be010b870 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000c00 tx=0x7f4bdc009dd0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.302+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 shutdown_connections 2024-03-22T07:28:04.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.302+0000 7f4be7483700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4be00fce40 0x7f4be010b870 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.302+0000 7f4be7483700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f4bcc069490 0x7f4bcc06b940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.302+0000 7f4be7483700 1 --2- 172.21.15.134:0/3685607405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4be00fe040 0x7f4be010bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.302+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 >> 172.21.15.134:0/3685607405 conn(0x7f4be00f8570 msgr2=0x7f4be00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:04.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.303+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 shutdown_connections 2024-03-22T07:28:04.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.303+0000 7f4be7483700 1 -- 172.21.15.134:0/3685607405 wait complete. 2024-03-22T07:28:04.307 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:28:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 -- 172.21.15.134:0/2768033986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 msgr2=0x7f3d341023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 --2- 172.21.15.134:0/2768033986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d341023a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3d24004940 tx=0x7f3d24009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:04.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 -- 172.21.15.134:0/2768033986 shutdown_connections 2024-03-22T07:28:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 --2- 172.21.15.134:0/2768033986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d341023a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 --2- 172.21.15.134:0/2768033986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 0x7f3d340ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 -- 172.21.15.134:0/2768033986 >> 172.21.15.134:0/2768033986 conn(0x7f3d340f7430 msgr2=0x7f3d340f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 -- 172.21.15.134:0/2768033986 shutdown_connections 2024-03-22T07:28:04.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.470+0000 7f3d3c047700 1 -- 172.21.15.134:0/2768033986 wait complete. 2024-03-22T07:28:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d3c047700 1 Processor -- start 2024-03-22T07:28:04.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d3c047700 1 -- start start 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d3c047700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 0x7f3d3410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d3c047700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d3410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d3c047700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3410e5a0 con 0x7f3d340fffc0 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d3c047700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3410edf0 con 0x7f3d34066220 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d395e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d3410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d39de3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 0x7f3d3410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d395e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d3410dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40164/0 (socket says 172.21.15.134:40164) 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.471+0000 7f3d395e2700 1 -- 172.21.15.134:0/3326655834 learned_addr learned my addr 172.21.15.134:0/3326655834 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d39de3700 1 -- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 msgr2=0x7f3d3410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d39de3700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d3410dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d39de3700 1 -- 172.21.15.134:0/3326655834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d24005040 con 0x7f3d34066220 2024-03-22T07:28:04.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d395e2700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d3410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:28:04.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d39de3700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 0x7f3d3410da60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d30002840 tx=0x7f3d30004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:04.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d30007cc0 con 0x7f3d34066220 2024-03-22T07:28:04.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3410f0d0 con 0x7f3d34066220 2024-03-22T07:28:04.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d3000f040 con 0x7f3d34066220 2024-03-22T07:28:04.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d30013920 con 0x7f3d34066220 2024-03-22T07:28:04.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.472+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3410f610 con 0x7f3d34066220 2024-03-22T07:28:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.473+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3405f5f0 con 0x7f3d34066220 2024-03-22T07:28:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.473+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3d3001c400 con 0x7f3d34066220 2024-03-22T07:28:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.474+0000 7f3d2a7fc700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3d200692a0 0x7f3d2006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.474+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3d30086f30 con 0x7f3d34066220 2024-03-22T07:28:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.474+0000 7f3d395e2700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3d200692a0 0x7f3d2006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:04.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.474+0000 7f3d395e2700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3d200692a0 0x7f3d2006b750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d24004f90 tx=0x7f3d24009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:04.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.478+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3d30056c20 con 0x7f3d34066220 2024-03-22T07:28:04.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.727+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 --> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d3410f990 con 0x7f3d200692a0 2024-03-22T07:28:04.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.729+0000 7f3d2a7fc700 1 -- 172.21.15.134:0/3326655834 <== mgr.14210 v2:172.21.15.134:6800/1730667826 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f3d3410f990 con 0x7f3d200692a0 2024-03-22T07:28:04.729 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "0/21 daemons upgraded", 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:28:04.730 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:28:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3d200692a0 msgr2=0x7f3d2006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3d200692a0 0x7f3d2006b750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3d24004f90 tx=0x7f3d24009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 msgr2=0x7f3d3410da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 0x7f3d3410da60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d30002840 tx=0x7f3d30004570 comp rx=0 tx=0).stop 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 shutdown_connections 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f3d200692a0 0x7f3d2006b750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d34066220 0x7f3d3410da60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 --2- 172.21.15.134:0/3326655834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d340fffc0 0x7f3d3410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 >> 172.21.15.134:0/3326655834 conn(0x7f3d340f7430 msgr2=0x7f3d340f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 shutdown_connections 2024-03-22T07:28:04.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.731+0000 7f3d3c047700 1 -- 172.21.15.134:0/3326655834 wait complete. 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 -- 172.21.15.134:0/2859327284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 msgr2=0x7f07640ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 --2- 172.21.15.134:0/2859327284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f07640ffa50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0758004940 tx=0x7f0758009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 -- 172.21.15.134:0/2859327284 shutdown_connections 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 --2- 172.21.15.134:0/2859327284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07640fff90 0x7f07641023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 --2- 172.21.15.134:0/2859327284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f07640ffa50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 -- 172.21.15.134:0/2859327284 >> 172.21.15.134:0/2859327284 conn(0x7f07640f74e0 msgr2=0x7f07640f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 -- 172.21.15.134:0/2859327284 shutdown_connections 2024-03-22T07:28:04.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.859+0000 7f076b079700 1 -- 172.21.15.134:0/2859327284 wait complete. 2024-03-22T07:28:04.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f076b079700 1 Processor -- start 2024-03-22T07:28:04.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f076b079700 1 -- start start 2024-03-22T07:28:04.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f076b079700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f076410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:04.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f076b079700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07640fff90 0x7f076410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:04.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f076b079700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076410e570 con 0x7f0764066b70 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f076b079700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076410ed70 con 0x7f07640fff90 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f0768e15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f076410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.860+0000 7f0768e15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f076410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:40180/0 (socket says 172.21.15.134:40180) 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f0768e15700 1 -- 172.21.15.134:0/4055279202 learned_addr learned my addr 172.21.15.134:0/4055279202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f0763fff700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07640fff90 0x7f076410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f0768e15700 1 -- 172.21.15.134:0/4055279202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07640fff90 msgr2=0x7f076410df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f0768e15700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07640fff90 0x7f076410df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f0768e15700 1 -- 172.21.15.134:0/4055279202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758005040 con 0x7f0764066b70 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f0768e15700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f076410da30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0758000c00 tx=0x7f0758009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f075800e030 con 0x7f0764066b70 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0758013de0 con 0x7f0764066b70 2024-03-22T07:28:04.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f075801ce50 con 0x7f0764066b70 2024-03-22T07:28:04.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076410eff0 con 0x7f0764066b70 2024-03-22T07:28:04.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.861+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076410f4e0 con 0x7f0764066b70 2024-03-22T07:28:04.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.863+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076405f5f0 con 0x7f0764066b70 2024-03-22T07:28:04.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.863+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f075801c400 con 0x7f0764066b70 2024-03-22T07:28:04.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.863+0000 7f07617fa700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f07540692a0 0x7f075406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:04.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.864+0000 7f0763fff700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f07540692a0 0x7f075406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:04.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.864+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0758088b80 con 0x7f0764066b70 2024-03-22T07:28:04.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.864+0000 7f0763fff700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f07540692a0 0x7f075406b750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0750009b80 tx=0x7f075000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:04.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:04.870+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f07580588f0 con 0x7f0764066b70 2024-03-22T07:28:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:04 smithi134 ceph-mon[29057]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:04 smithi134 ceph-mon[29057]: pgmap v239: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 527 op/s 2024-03-22T07:28:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:04 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3685607405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:28:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:04 smithi195 ceph-mon[36144]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:04 smithi195 ceph-mon[36144]: pgmap v239: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.3 MiB/s wr, 527 op/s 2024-03-22T07:28:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:04 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3685607405' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:28:05.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.241+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f076404bed0 con 0x7f0764066b70 2024-03-22T07:28:05.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.242+0000 7f07617fa700 1 -- 172.21.15.134:0/4055279202 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0758058480 con 0x7f0764066b70 2024-03-22T07:28:05.242 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:28:05.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f07540692a0 msgr2=0x7f075406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:05.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f07540692a0 0x7f075406b750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0750009b80 tx=0x7f075000b040 comp rx=0 tx=0).stop 2024-03-22T07:28:05.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 msgr2=0x7f076410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:05.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f076410da30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0758000c00 tx=0x7f0758009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:05.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 shutdown_connections 2024-03-22T07:28:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0764066b70 0x7f076410da30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.134:6800/1730667826,v1:172.21.15.134:6801/1730667826] conn(0x7f07540692a0 0x7f075406b750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 --2- 172.21.15.134:0/4055279202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07640fff90 0x7f076410df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 >> 172.21.15.134:0/4055279202 conn(0x7f07640f74e0 msgr2=0x7f07640f78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 shutdown_connections 2024-03-22T07:28:05.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:05.244+0000 7f076b079700 1 -- 172.21.15.134:0/4055279202 wait complete. 2024-03-22T07:28:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:05 smithi195 ceph-mon[36144]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:05 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/4055279202' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:28:06.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:05 smithi134 ceph-mon[29057]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:06.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:05 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/4055279202' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:28:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:06 smithi195 ceph-mon[36144]: pgmap v240: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 483 op/s 2024-03-22T07:28:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:06 smithi134 ceph-mon[29057]: pgmap v240: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 483 op/s 2024-03-22T07:28:08.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:08 smithi195 ceph-mon[36144]: pgmap v241: 65 pgs: 65 active+clean; 99 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.4 MiB/s wr, 620 op/s 2024-03-22T07:28:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:08 smithi134 ceph-mon[29057]: pgmap v241: 65 pgs: 65 active+clean; 99 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.4 MiB/s wr, 620 op/s 2024-03-22T07:28:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:10 smithi195 ceph-mon[36144]: pgmap v242: 65 pgs: 65 active+clean; 118 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s wr, 628 op/s 2024-03-22T07:28:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:10 smithi134 ceph-mon[29057]: pgmap v242: 65 pgs: 65 active+clean; 118 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.6 MiB/s wr, 628 op/s 2024-03-22T07:28:13.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:12 smithi195 ceph-mon[36144]: pgmap v243: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 412 op/s 2024-03-22T07:28:13.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:12 smithi134 ceph-mon[29057]: pgmap v243: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 412 op/s 2024-03-22T07:28:15.124 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:14 smithi195 ceph-mon[36144]: pgmap v244: 65 pgs: 65 active+clean; 149 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 719 op/s 2024-03-22T07:28:15.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:14 smithi134 ceph-mon[29057]: pgmap v244: 65 pgs: 65 active+clean; 149 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 719 op/s 2024-03-22T07:28:16.162 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:15 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:16.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:15 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:16 smithi195 ceph-mon[36144]: pgmap v245: 65 pgs: 65 active+clean; 149 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 705 op/s 2024-03-22T07:28:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:16 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:17.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:16 smithi134 ceph-mon[29057]: pgmap v245: 65 pgs: 65 active+clean; 149 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.7 MiB/s wr, 705 op/s 2024-03-22T07:28:17.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:17.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:17.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:16 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:17.330 INFO:tasks.workunit.client.1.smithi195.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-22T07:28:17.330 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-22T07:28:17.331 INFO:tasks.workunit.client.1.smithi195.stderr:+ make 2024-03-22T07:28:17.772 INFO:tasks.workunit.client.1.smithi195.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-22T07:28:18.023 INFO:tasks.workunit.client.0.smithi134.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-22T07:28:18.024 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-22T07:28:18.024 INFO:tasks.workunit.client.0.smithi134.stderr:+ make 2024-03-22T07:28:18.151 INFO:tasks.workunit.client.0.smithi134.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-22T07:28:18.276 INFO:tasks.workunit.client.1.smithi195.stderr:++ readlink -f fsstress 2024-03-22T07:28:18.276 INFO:tasks.workunit.client.1.smithi195.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-22T07:28:18.276 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-03-22T07:28:18.276 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-22T07:28:18.277 INFO:tasks.workunit.client.1.smithi195.stderr:+ popd 2024-03-22T07:28:18.277 INFO:tasks.workunit.client.1.smithi195.stdout:~/cephtest/mnt.1/client.1/tmp 2024-03-22T07:28:18.277 INFO:tasks.workunit.client.1.smithi195.stderr:++ mktemp -d -p . 2024-03-22T07:28:18.278 INFO:tasks.workunit.client.1.smithi195.stderr:+ T=./tmp.cvOFfrMmgg 2024-03-22T07:28:18.278 INFO:tasks.workunit.client.1.smithi195.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.cvOFfrMmgg -l 1 -n 1000 -p 10 -v 2024-03-22T07:28:18.280 INFO:tasks.workunit.client.1.smithi195.stdout:seed = 1710848261 2024-03-22T07:28:18.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/0: dwrite - no filename 2024-03-22T07:28:18.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/1: chown . 7557288 1 2024-03-22T07:28:18.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/2: truncate - no filename 2024-03-22T07:28:18.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/3: dread - no filename 2024-03-22T07:28:18.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/4: dwrite - no filename 2024-03-22T07:28:18.283 INFO:tasks.workunit.client.1.smithi195.stdout:0/5: write - no filename 2024-03-22T07:28:18.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/0: readlink - no filename 2024-03-22T07:28:18.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/1: chown . 1 1 2024-03-22T07:28:18.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/2: write - no filename 2024-03-22T07:28:18.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/3: link - no file 2024-03-22T07:28:18.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/4: getdents . 0 2024-03-22T07:28:18.285 INFO:tasks.workunit.client.1.smithi195.stdout:1/5: rmdir - no directory 2024-03-22T07:28:18.285 INFO:tasks.workunit.client.1.smithi195.stdout:1/6: rmdir - no directory 2024-03-22T07:28:18.285 INFO:tasks.workunit.client.1.smithi195.stdout:1/7: dread - no filename 2024-03-22T07:28:18.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/6: mknod c0 0 2024-03-22T07:28:18.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/7: dwrite - no filename 2024-03-22T07:28:18.285 INFO:tasks.workunit.client.1.smithi195.stdout:0/8: write - no filename 2024-03-22T07:28:18.286 INFO:tasks.workunit.client.1.smithi195.stdout:2/0: write - no filename 2024-03-22T07:28:18.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/8: mkdir d0 0 2024-03-22T07:28:18.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/9: chown d0 796001 1 2024-03-22T07:28:18.287 INFO:tasks.workunit.client.1.smithi195.stdout:0/9: mkdir d1 0 2024-03-22T07:28:18.288 INFO:tasks.workunit.client.1.smithi195.stdout:0/10: chown d1 620367861 1 2024-03-22T07:28:18.288 INFO:tasks.workunit.client.1.smithi195.stdout:0/11: chown d1 1307679 1 2024-03-22T07:28:18.288 INFO:tasks.workunit.client.1.smithi195.stdout:0/12: dread - no filename 2024-03-22T07:28:18.288 INFO:tasks.workunit.client.1.smithi195.stdout:0/13: read - no filename 2024-03-22T07:28:18.289 INFO:tasks.workunit.client.1.smithi195.stdout:2/1: creat f0 x:0 0 0 2024-03-22T07:28:18.289 INFO:tasks.workunit.client.1.smithi195.stdout:1/10: mknod d0/c1 0 2024-03-22T07:28:18.289 INFO:tasks.workunit.client.1.smithi195.stdout:0/14: symlink d1/l2 0 2024-03-22T07:28:18.289 INFO:tasks.workunit.client.1.smithi195.stdout:0/15: readlink d1/l2 0 2024-03-22T07:28:18.290 INFO:tasks.workunit.client.1.smithi195.stdout:0/16: dread - no filename 2024-03-22T07:28:18.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/0: creat f0 x:0 0 0 2024-03-22T07:28:18.291 INFO:tasks.workunit.client.1.smithi195.stdout:1/11: mkdir d0/d2 0 2024-03-22T07:28:18.292 INFO:tasks.workunit.client.1.smithi195.stdout:0/17: creat d1/f3 x:0 0 0 2024-03-22T07:28:18.293 INFO:tasks.workunit.client.1.smithi195.stdout:5/0: stat - no entries 2024-03-22T07:28:18.293 INFO:tasks.workunit.client.1.smithi195.stdout:5/1: chown . 369690 1 2024-03-22T07:28:18.293 INFO:tasks.workunit.client.1.smithi195.stdout:5/2: chown . 7302850 1 2024-03-22T07:28:18.293 INFO:tasks.workunit.client.1.smithi195.stdout:5/3: fsync - no filename 2024-03-22T07:28:18.293 INFO:tasks.workunit.client.1.smithi195.stdout:5/4: rename - no filename 2024-03-22T07:28:18.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/0: mknod c0 0 2024-03-22T07:28:18.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/1: chown c0 3077802 1 2024-03-22T07:28:18.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/2: read - no filename 2024-03-22T07:28:18.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/3: dwrite - no filename 2024-03-22T07:28:18.294 INFO:tasks.workunit.client.1.smithi195.stdout:3/1: symlink l1 0 2024-03-22T07:28:18.296 INFO:tasks.workunit.client.1.smithi195.stdout:1/12: mkdir d0/d3 0 2024-03-22T07:28:18.296 INFO:tasks.workunit.client.1.smithi195.stdout:1/13: dwrite - no filename 2024-03-22T07:28:18.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/18: mkdir d1/d4 0 2024-03-22T07:28:18.299 INFO:tasks.workunit.client.1.smithi195.stdout:5/5: creat f0 x:0 0 0 2024-03-22T07:28:18.299 INFO:tasks.workunit.client.1.smithi195.stdout:5/6: creat f1 x:0 0 0 2024-03-22T07:28:18.299 INFO:tasks.workunit.client.1.smithi195.stdout:5/7: dread - f0 zero size 2024-03-22T07:28:18.299 INFO:tasks.workunit.client.1.smithi195.stdout:5/8: truncate f1 720711 0 2024-03-22T07:28:18.299 INFO:tasks.workunit.client.1.smithi195.stdout:4/4: rename c0 to c1 0 2024-03-22T07:28:18.299 INFO:tasks.workunit.client.1.smithi195.stdout:4/5: rmdir - no directory 2024-03-22T07:28:18.301 INFO:tasks.workunit.client.1.smithi195.stdout:1/14: rmdir d0/d3 0 2024-03-22T07:28:18.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/19: creat d1/d4/f5 x:0 0 0 2024-03-22T07:28:18.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/20: write d1/f3 [563564,98432] 0 2024-03-22T07:28:18.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/21: readlink d1/l2 0 2024-03-22T07:28:18.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/0: write - no filename 2024-03-22T07:28:18.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/1: truncate - no filename 2024-03-22T07:28:18.305 INFO:tasks.workunit.client.1.smithi195.stdout:6/0: creat f0 x:0 0 0 2024-03-22T07:28:18.306 INFO:tasks.workunit.client.1.smithi195.stdout:2/2: getdents . 0 2024-03-22T07:28:18.308 INFO:tasks.workunit.client.1.smithi195.stdout:5/9: mknod c2 0 2024-03-22T07:28:18.310 INFO:tasks.workunit.client.1.smithi195.stdout:4/6: symlink l2 0 2024-03-22T07:28:18.311 INFO:tasks.workunit.client.1.smithi195.stdout:1/15: symlink d0/l4 0 2024-03-22T07:28:18.311 INFO:tasks.workunit.client.1.smithi195.stdout:1/16: rename d0/d2 to d0/d2/d5 22 2024-03-22T07:28:18.311 INFO:tasks.workunit.client.1.smithi195.stdout:1/17: write - no filename 2024-03-22T07:28:18.312 INFO:tasks.workunit.client.1.smithi195.stdout:8/0: dread - no filename 2024-03-22T07:28:18.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/1: dread - no filename 2024-03-22T07:28:18.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/2: link - no file 2024-03-22T07:28:18.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/3: dread - no filename 2024-03-22T07:28:18.315 INFO:tasks.workunit.client.1.smithi195.stdout:7/2: mkdir d0 0 2024-03-22T07:28:18.315 INFO:tasks.workunit.client.1.smithi195.stdout:7/3: rename d0 to d0/d1 22 2024-03-22T07:28:18.315 INFO:tasks.workunit.client.1.smithi195.stdout:7/4: dread - no filename 2024-03-22T07:28:18.315 INFO:tasks.workunit.client.1.smithi195.stdout:1/18: mkdir d0/d2/d6 0 2024-03-22T07:28:18.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/5: mknod d0/c2 0 2024-03-22T07:28:18.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/6: dwrite - no filename 2024-03-22T07:28:18.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/7: chown d0/c2 99 1 2024-03-22T07:28:18.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/8: dread - no filename 2024-03-22T07:28:18.319 INFO:tasks.workunit.client.1.smithi195.stdout:1/19: mknod d0/d2/d6/c7 0 2024-03-22T07:28:18.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/0: creat f0 x:0 0 0 2024-03-22T07:28:18.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/1: chown f0 3295 1 2024-03-22T07:28:18.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/2: stat f0 0 2024-03-22T07:28:18.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/3: stat f0 0 2024-03-22T07:28:18.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/4: read - f0 zero size 2024-03-22T07:28:18.321 INFO:tasks.workunit.client.1.smithi195.stdout:9/5: read - f0 zero size 2024-03-22T07:28:18.322 INFO:tasks.workunit.client.1.smithi195.stdout:3/2: dwrite f0 [0,4194304] 0 2024-03-22T07:28:18.326 INFO:tasks.workunit.client.1.smithi195.stdout:7/9: mkdir d0/d3 0 2024-03-22T07:28:18.326 INFO:tasks.workunit.client.1.smithi195.stdout:1/20: symlink d0/l8 0 2024-03-22T07:28:18.326 INFO:tasks.workunit.client.1.smithi195.stdout:1/21: write - no filename 2024-03-22T07:28:18.326 INFO:tasks.workunit.client.1.smithi195.stdout:1/22: dwrite - no filename 2024-03-22T07:28:18.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/6: link f0 f1 0 2024-03-22T07:28:18.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/7: fdatasync f0 0 2024-03-22T07:28:18.332 INFO:tasks.workunit.client.1.smithi195.stdout:7/10: link d0/c2 d0/d3/c4 0 2024-03-22T07:28:18.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/23: mkdir d0/d2/d9 0 2024-03-22T07:28:18.334 INFO:tasks.workunit.client.1.smithi195.stdout:9/8: mkdir d2 0 2024-03-22T07:28:18.335 INFO:tasks.workunit.client.1.smithi195.stdout:7/11: symlink d0/l5 0 2024-03-22T07:28:18.339 INFO:tasks.workunit.client.1.smithi195.stdout:7/12: symlink d0/l6 0 2024-03-22T07:28:18.339 INFO:tasks.workunit.client.1.smithi195.stdout:1/24: creat d0/fa x:0 0 0 2024-03-22T07:28:18.344 INFO:tasks.workunit.client.1.smithi195.stdout:7/13: mkdir d0/d7 0 2024-03-22T07:28:18.344 INFO:tasks.workunit.client.1.smithi195.stdout:7/14: truncate - no filename 2024-03-22T07:28:18.344 INFO:tasks.workunit.client.1.smithi195.stdout:7/15: truncate - no filename 2024-03-22T07:28:18.344 INFO:tasks.workunit.client.1.smithi195.stdout:7/16: write - no filename 2024-03-22T07:28:18.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/25: mknod d0/cb 0 2024-03-22T07:28:18.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/26: stat d0/cb 0 2024-03-22T07:28:18.347 INFO:tasks.workunit.client.1.smithi195.stdout:1/27: stat d0/d2 0 2024-03-22T07:28:18.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/9: fsync f0 0 2024-03-22T07:28:18.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/10: readlink - no filename 2024-03-22T07:28:18.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/11: stat f1 0 2024-03-22T07:28:18.496 INFO:tasks.workunit.client.1.smithi195.stdout:9/12: dread - f1 zero size 2024-03-22T07:28:18.502 INFO:tasks.workunit.client.1.smithi195.stdout:1/28: fsync d0/fa 0 2024-03-22T07:28:18.505 INFO:tasks.workunit.client.1.smithi195.stdout:7/17: getdents d0 0 2024-03-22T07:28:18.505 INFO:tasks.workunit.client.1.smithi195.stdout:7/18: getdents d0/d7 0 2024-03-22T07:28:18.505 INFO:tasks.workunit.client.1.smithi195.stdout:7/19: dwrite - no filename 2024-03-22T07:28:18.505 INFO:tasks.workunit.client.1.smithi195.stdout:7/20: chown d0/d3/c4 7910653 1 2024-03-22T07:28:18.577 INFO:tasks.workunit.client.1.smithi195.stdout:6/1: dwrite f0 [0,4194304] 0 2024-03-22T07:28:18.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/10: dwrite f1 [0,4194304] 0 2024-03-22T07:28:18.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/11: fdatasync f1 0 2024-03-22T07:28:18.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/2: dread f0 [0,4194304] 0 2024-03-22T07:28:18.629 INFO:tasks.workunit.client.1.smithi195.stdout:9/13: creat d2/f3 x:0 0 0 2024-03-22T07:28:18.629 INFO:tasks.workunit.client.1.smithi195.stdout:9/14: fsync f1 0 2024-03-22T07:28:18.630 INFO:tasks.workunit.client.1.smithi195.stdout:9/15: fdatasync f0 0 2024-03-22T07:28:18.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/3: dread f0 [0,4194304] 0 2024-03-22T07:28:18.670 INFO:tasks.workunit.client.0.smithi134.stderr:++ readlink -f fsstress 2024-03-22T07:28:18.672 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-22T07:28:18.672 INFO:tasks.workunit.client.0.smithi134.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-22T07:28:18.672 INFO:tasks.workunit.client.0.smithi134.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-22T07:28:18.672 INFO:tasks.workunit.client.0.smithi134.stderr:+ popd 2024-03-22T07:28:18.672 INFO:tasks.workunit.client.0.smithi134.stderr:+ popd 2024-03-22T07:28:18.672 INFO:tasks.workunit.client.0.smithi134.stderr:++ mktemp -d -p . 2024-03-22T07:28:18.679 INFO:tasks.workunit.client.0.smithi134.stderr:+ T=./tmp.vZ6hQWMGAz 2024-03-22T07:28:18.679 INFO:tasks.workunit.client.0.smithi134.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.vZ6hQWMGAz -l 1 -n 1000 -p 10 -v 2024-03-22T07:28:18.683 INFO:tasks.workunit.client.0.smithi134.stdout:seed = 1710702646 2024-03-22T07:28:18.694 INFO:tasks.workunit.client.0.smithi134.stdout:0/0: rename - no filename 2024-03-22T07:28:18.694 INFO:tasks.workunit.client.0.smithi134.stdout:0/1: read - no filename 2024-03-22T07:28:18.697 INFO:tasks.workunit.client.0.smithi134.stdout:1/0: getdents . 0 2024-03-22T07:28:18.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/2: creat f0 x:0 0 0 2024-03-22T07:28:18.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/3: creat f1 x:0 0 0 2024-03-22T07:28:18.701 INFO:tasks.workunit.client.0.smithi134.stdout:0/4: truncate f0 1000759 0 2024-03-22T07:28:18.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/1: creat f0 x:0 0 0 2024-03-22T07:28:18.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/2: creat f1 x:0 0 0 2024-03-22T07:28:18.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/3: creat f2 x:0 0 0 2024-03-22T07:28:18.707 INFO:tasks.workunit.client.0.smithi134.stdout:2/0: dread - no filename 2024-03-22T07:28:18.707 INFO:tasks.workunit.client.0.smithi134.stdout:2/1: getdents . 0 2024-03-22T07:28:18.707 INFO:tasks.workunit.client.0.smithi134.stdout:2/2: read - no filename 2024-03-22T07:28:18.707 INFO:tasks.workunit.client.0.smithi134.stdout:2/3: write - no filename 2024-03-22T07:28:18.711 INFO:tasks.workunit.client.1.smithi195.stdout:1/29: mknod d0/d2/d6/cc 0 2024-03-22T07:28:18.711 INFO:tasks.workunit.client.1.smithi195.stdout:1/30: chown d0/d2/d9 1951 1 2024-03-22T07:28:18.714 INFO:tasks.workunit.client.1.smithi195.stdout:7/21: unlink d0/l6 0 2024-03-22T07:28:18.727 INFO:tasks.workunit.client.0.smithi134.stdout:0/5: mknod c2 0 2024-03-22T07:28:18.735 INFO:tasks.workunit.client.0.smithi134.stdout:3/0: unlink - no file 2024-03-22T07:28:18.735 INFO:tasks.workunit.client.0.smithi134.stdout:3/1: unlink - no file 2024-03-22T07:28:18.736 INFO:tasks.workunit.client.0.smithi134.stdout:3/2: getdents . 0 2024-03-22T07:28:18.738 INFO:tasks.workunit.client.0.smithi134.stdout:0/6: mknod c3 0 2024-03-22T07:28:18.741 INFO:tasks.workunit.client.0.smithi134.stdout:3/3: creat f0 x:0 0 0 2024-03-22T07:28:18.741 INFO:tasks.workunit.client.0.smithi134.stdout:3/4: creat f1 x:0 0 0 2024-03-22T07:28:18.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/0: read - no filename 2024-03-22T07:28:18.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/1: truncate - no filename 2024-03-22T07:28:18.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/2: dread - no filename 2024-03-22T07:28:18.745 INFO:tasks.workunit.client.0.smithi134.stdout:7/3: fdatasync - no filename 2024-03-22T07:28:18.754 INFO:tasks.workunit.client.0.smithi134.stdout:3/5: mknod c2 0 2024-03-22T07:28:18.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/4: creat f0 x:0 0 0 2024-03-22T07:28:18.759 INFO:tasks.workunit.client.0.smithi134.stdout:7/5: rmdir - no directory 2024-03-22T07:28:18.759 INFO:tasks.workunit.client.0.smithi134.stdout:7/6: chown f0 750 1 2024-03-22T07:28:18.765 INFO:tasks.workunit.client.0.smithi134.stdout:7/7: mkdir d1 0 2024-03-22T07:28:18.765 INFO:tasks.workunit.client.0.smithi134.stdout:7/8: fdatasync f0 0 2024-03-22T07:28:18.765 INFO:tasks.workunit.client.0.smithi134.stdout:7/9: dread - f0 zero size 2024-03-22T07:28:18.771 INFO:tasks.workunit.client.0.smithi134.stdout:7/10: link f0 d1/f2 0 2024-03-22T07:28:18.771 INFO:tasks.workunit.client.0.smithi134.stdout:7/11: fdatasync f0 0 2024-03-22T07:28:18.776 INFO:tasks.workunit.client.0.smithi134.stdout:7/12: mkdir d1/d3 0 2024-03-22T07:28:18.782 INFO:tasks.workunit.client.0.smithi134.stdout:7/13: link f0 d1/f4 0 2024-03-22T07:28:18.786 INFO:tasks.workunit.client.0.smithi134.stdout:7/14: mknod d1/d3/c5 0 2024-03-22T07:28:18.786 INFO:tasks.workunit.client.0.smithi134.stdout:7/15: dread - d1/f2 zero size 2024-03-22T07:28:18.786 INFO:tasks.workunit.client.0.smithi134.stdout:7/16: write d1/f4 [733899,62854] 0 2024-03-22T07:28:18.874 INFO:tasks.workunit.client.0.smithi134.stdout:1/4: dwrite f1 [0,4194304] 0 2024-03-22T07:28:18.874 INFO:tasks.workunit.client.0.smithi134.stdout:1/5: creat f3 x:0 0 0 2024-03-22T07:28:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:18 smithi134 ceph-mon[29057]: pgmap v246: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 724 op/s 2024-03-22T07:28:19.210 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:18 smithi195 ceph-mon[36144]: pgmap v246: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 724 op/s 2024-03-22T07:28:19.276 INFO:tasks.workunit.client.1.smithi195.stdout:3/3: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:19.276 INFO:tasks.workunit.client.1.smithi195.stdout:3/4: fdatasync f0 0 2024-03-22T07:28:19.276 INFO:tasks.workunit.client.1.smithi195.stdout:3/5: readlink l1 0 2024-03-22T07:28:19.276 INFO:tasks.workunit.client.1.smithi195.stdout:3/6: chown l1 11927020 1 2024-03-22T07:28:19.510 INFO:tasks.workunit.client.0.smithi134.stdout:0/7: fsync f1 0 2024-03-22T07:28:19.510 INFO:tasks.workunit.client.0.smithi134.stdout:0/8: chown f0 111639 1 2024-03-22T07:28:19.510 INFO:tasks.workunit.client.0.smithi134.stdout:0/9: fsync f0 0 2024-03-22T07:28:19.532 INFO:tasks.workunit.client.0.smithi134.stdout:3/6: getdents . 0 2024-03-22T07:28:19.679 INFO:tasks.workunit.client.0.smithi134.stdout:1/6: readlink - no filename 2024-03-22T07:28:19.679 INFO:tasks.workunit.client.0.smithi134.stdout:8/0: dread - no filename 2024-03-22T07:28:19.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/0: rename - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/1: write - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/2: fdatasync - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/3: truncate - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/4: dread - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/5: write - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/6: dwrite - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/7: link - no file 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/8: fdatasync - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/9: rename - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/10: rmdir - no directory 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/11: dread - no filename 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/12: link - no file 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:9/0: chown . 840880119 1 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:8/13: chown . 357230 1 2024-03-22T07:28:19.680 INFO:tasks.workunit.client.0.smithi134.stdout:1/7: creat f4 x:0 0 0 2024-03-22T07:28:19.681 INFO:tasks.workunit.client.0.smithi134.stdout:5/0: read - no filename 2024-03-22T07:28:19.681 INFO:tasks.workunit.client.0.smithi134.stdout:6/0: dread - no filename 2024-03-22T07:28:19.684 INFO:tasks.workunit.client.0.smithi134.stdout:7/17: fdatasync f0 0 2024-03-22T07:28:20.051 INFO:tasks.workunit.client.1.smithi195.stdout:5/12: rename f1 to f3 0 2024-03-22T07:28:20.082 INFO:tasks.workunit.client.1.smithi195.stdout:9/16: mkdir d2/d4 0 2024-03-22T07:28:20.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/17: truncate f0 77906 0 2024-03-22T07:28:20.626 INFO:tasks.workunit.client.1.smithi195.stdout:1/31: mknod d0/d2/d6/cd 0 2024-03-22T07:28:20.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:20 smithi195 ceph-mon[36144]: pgmap v247: 65 pgs: 65 active+clean; 160 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 627 op/s 2024-03-22T07:28:21.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:20 smithi134 ceph-mon[29057]: pgmap v247: 65 pgs: 65 active+clean; 160 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 627 op/s 2024-03-22T07:28:21.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/7: symlink l2 0 2024-03-22T07:28:21.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/8: chown f0 39589 1 2024-03-22T07:28:21.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/13: symlink l4 0 2024-03-22T07:28:21.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/14: rmdir - no directory 2024-03-22T07:28:21.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/15: write f3 [4998042,106993] 0 2024-03-22T07:28:21.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/16: write f0 [645306,83079] 0 2024-03-22T07:28:21.878 INFO:tasks.workunit.client.1.smithi195.stdout:5/17: write f0 [465678,57321] 0 2024-03-22T07:28:21.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/18: write f0 [1605379,119482] 0 2024-03-22T07:28:21.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/19: creat f5 x:0 0 0 2024-03-22T07:28:21.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/20: stat c2 0 2024-03-22T07:28:21.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/18: creat d2/d4/f5 x:0 0 0 2024-03-22T07:28:21.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/19: read - d2/d4/f5 zero size 2024-03-22T07:28:21.881 INFO:tasks.workunit.client.1.smithi195.stdout:6/4: getdents . 0 2024-03-22T07:28:21.881 INFO:tasks.workunit.client.1.smithi195.stdout:6/5: stat f0 0 2024-03-22T07:28:21.884 INFO:tasks.workunit.client.1.smithi195.stdout:1/32: unlink d0/l4 0 2024-03-22T07:28:21.887 INFO:tasks.workunit.client.1.smithi195.stdout:6/6: write f0 [2537238,58376] 0 2024-03-22T07:28:21.887 INFO:tasks.workunit.client.1.smithi195.stdout:3/9: mkdir d3 0 2024-03-22T07:28:21.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/20: dwrite d2/f3 [0,4194304] 0 2024-03-22T07:28:21.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/7: dread f0 [0,4194304] 0 2024-03-22T07:28:21.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/21: read f1 [32632,101144] 0 2024-03-22T07:28:21.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/22: stat f0 0 2024-03-22T07:28:21.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/23: write d2/d4/f5 [63617,16384] 0 2024-03-22T07:28:23.189 INFO:tasks.workunit.client.1.smithi195.stdout:5/21: symlink l6 0 2024-03-22T07:28:23.189 INFO:tasks.workunit.client.1.smithi195.stdout:5/22: dread - f5 zero size 2024-03-22T07:28:23.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/33: creat d0/d2/fe x:0 0 0 2024-03-22T07:28:23.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/34: fdatasync d0/d2/fe 0 2024-03-22T07:28:23.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/22: rmdir d0/d7 0 2024-03-22T07:28:23.195 INFO:tasks.workunit.client.1.smithi195.stdout:3/10: mkdir d3/d4 0 2024-03-22T07:28:23.199 INFO:tasks.workunit.client.1.smithi195.stdout:5/23: dread f3 [0,4194304] 0 2024-03-22T07:28:23.200 INFO:tasks.workunit.client.1.smithi195.stdout:6/8: mknod c1 0 2024-03-22T07:28:23.204 INFO:tasks.workunit.client.1.smithi195.stdout:9/24: mkdir d2/d4/d6 0 2024-03-22T07:28:23.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:22 smithi195 ceph-mon[36144]: pgmap v248: 65 pgs: 65 active+clean; 173 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s wr, 480 op/s 2024-03-22T07:28:23.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/35: dwrite d0/d2/fe [0,4194304] 0 2024-03-22T07:28:23.215 INFO:tasks.workunit.client.1.smithi195.stdout:3/11: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:23.216 INFO:tasks.workunit.client.1.smithi195.stdout:7/23: creat d0/d3/f8 x:0 0 0 2024-03-22T07:28:23.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/24: chown d0/d3 1 1 2024-03-22T07:28:23.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/25: chown d0/d3 6673873 1 2024-03-22T07:28:23.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/26: dread - d0/d3/f8 zero size 2024-03-22T07:28:23.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/27: chown d0/l5 135 1 2024-03-22T07:28:23.219 INFO:tasks.workunit.client.1.smithi195.stdout:6/9: creat f2 x:0 0 0 2024-03-22T07:28:23.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/10: chown f0 1796 1 2024-03-22T07:28:23.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/11: fdatasync f0 0 2024-03-22T07:28:23.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/12: chown f2 0 1 2024-03-22T07:28:23.220 INFO:tasks.workunit.client.1.smithi195.stdout:6/13: write f2 [771242,126018] 0 2024-03-22T07:28:23.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/25: dwrite d2/d4/f5 [0,4194304] 0 2024-03-22T07:28:23.224 INFO:tasks.workunit.client.1.smithi195.stdout:1/36: symlink d0/d2/d6/lf 0 2024-03-22T07:28:23.224 INFO:tasks.workunit.client.1.smithi195.stdout:1/37: chown d0 357 1 2024-03-22T07:28:23.224 INFO:tasks.workunit.client.1.smithi195.stdout:1/38: chown d0/cb 224868 1 2024-03-22T07:28:23.224 INFO:tasks.workunit.client.1.smithi195.stdout:1/39: creat d0/f10 x:0 0 0 2024-03-22T07:28:23.225 INFO:tasks.workunit.client.1.smithi195.stdout:3/12: symlink d3/l5 0 2024-03-22T07:28:23.227 INFO:tasks.workunit.client.1.smithi195.stdout:9/26: write d2/f3 [3610972,42503] 0 2024-03-22T07:28:23.235 INFO:tasks.workunit.client.1.smithi195.stdout:3/13: symlink d3/l6 0 2024-03-22T07:28:23.236 INFO:tasks.workunit.client.1.smithi195.stdout:3/14: fdatasync f0 0 2024-03-22T07:28:23.239 INFO:tasks.workunit.client.1.smithi195.stdout:9/27: symlink d2/l7 0 2024-03-22T07:28:23.241 INFO:tasks.workunit.client.1.smithi195.stdout:6/14: dwrite f0 [0,4194304] 0 2024-03-22T07:28:23.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/28: symlink d2/l8 0 2024-03-22T07:28:23.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/29: creat d2/f9 x:0 0 0 2024-03-22T07:28:23.243 INFO:tasks.workunit.client.1.smithi195.stdout:9/30: dread f1 [0,4194304] 0 2024-03-22T07:28:23.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/15: fdatasync f2 0 2024-03-22T07:28:23.251 INFO:tasks.workunit.client.1.smithi195.stdout:3/15: dwrite f0 [0,4194304] 0 2024-03-22T07:28:23.251 INFO:tasks.workunit.client.1.smithi195.stdout:1/40: dwrite d0/d2/fe [0,4194304] 0 2024-03-22T07:28:23.254 INFO:tasks.workunit.client.1.smithi195.stdout:3/16: rename l2 to d3/d4/l7 0 2024-03-22T07:28:23.256 INFO:tasks.workunit.client.1.smithi195.stdout:1/41: creat d0/d2/d6/f11 x:0 0 0 2024-03-22T07:28:23.260 INFO:tasks.workunit.client.1.smithi195.stdout:3/17: symlink d3/l8 0 2024-03-22T07:28:23.263 INFO:tasks.workunit.client.1.smithi195.stdout:1/42: symlink d0/d2/d6/l12 0 2024-03-22T07:28:23.263 INFO:tasks.workunit.client.1.smithi195.stdout:1/43: truncate d0/f10 456226 0 2024-03-22T07:28:23.263 INFO:tasks.workunit.client.1.smithi195.stdout:1/44: rename d0/d2 to d0/d2/d13 22 2024-03-22T07:28:23.265 INFO:tasks.workunit.client.1.smithi195.stdout:9/31: dwrite d2/f9 [0,4194304] 0 2024-03-22T07:28:23.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/32: dread d2/d4/f5 [0,4194304] 0 2024-03-22T07:28:23.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/33: chown f1 2 1 2024-03-22T07:28:23.275 INFO:tasks.workunit.client.1.smithi195.stdout:6/16: dwrite f0 [0,4194304] 0 2024-03-22T07:28:23.276 INFO:tasks.workunit.client.1.smithi195.stdout:9/34: symlink d2/d4/d6/la 0 2024-03-22T07:28:23.277 INFO:tasks.workunit.client.1.smithi195.stdout:6/17: unlink f2 0 2024-03-22T07:28:23.278 INFO:tasks.workunit.client.1.smithi195.stdout:6/18: fsync f0 0 2024-03-22T07:28:23.280 INFO:tasks.workunit.client.1.smithi195.stdout:9/35: mkdir d2/d4/d6/db 0 2024-03-22T07:28:23.280 INFO:tasks.workunit.client.1.smithi195.stdout:9/36: stat f1 0 2024-03-22T07:28:23.281 INFO:tasks.workunit.client.1.smithi195.stdout:1/45: dwrite d0/d2/d6/f11 [0,4194304] 0 2024-03-22T07:28:23.281 INFO:tasks.workunit.client.1.smithi195.stdout:1/46: creat d0/d2/f14 x:0 0 0 2024-03-22T07:28:23.283 INFO:tasks.workunit.client.1.smithi195.stdout:9/37: mknod d2/d4/cc 0 2024-03-22T07:28:23.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:22 smithi134 ceph-mon[29057]: pgmap v248: 65 pgs: 65 active+clean; 173 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s wr, 480 op/s 2024-03-22T07:28:23.300 INFO:tasks.workunit.client.1.smithi195.stdout:9/38: dwrite d2/d4/f5 [0,4194304] 0 2024-03-22T07:28:23.301 INFO:tasks.workunit.client.1.smithi195.stdout:6/19: dwrite f0 [0,4194304] 0 2024-03-22T07:28:23.302 INFO:tasks.workunit.client.1.smithi195.stdout:9/39: symlink d2/d4/d6/db/ld 0 2024-03-22T07:28:23.302 INFO:tasks.workunit.client.1.smithi195.stdout:9/40: creat d2/fe x:0 0 0 2024-03-22T07:28:23.305 INFO:tasks.workunit.client.1.smithi195.stdout:9/41: mknod d2/d4/d6/cf 0 2024-03-22T07:28:24.134 INFO:tasks.workunit.client.1.smithi195.stdout:5/24: getdents . 0 2024-03-22T07:28:24.137 INFO:tasks.workunit.client.1.smithi195.stdout:5/25: creat f7 x:0 0 0 2024-03-22T07:28:24.137 INFO:tasks.workunit.client.1.smithi195.stdout:5/26: fdatasync f7 0 2024-03-22T07:28:24.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/27: dread f0 [0,4194304] 0 2024-03-22T07:28:24.139 INFO:tasks.workunit.client.1.smithi195.stdout:5/28: dread - f5 zero size 2024-03-22T07:28:24.140 INFO:tasks.workunit.client.1.smithi195.stdout:5/29: creat f8 x:0 0 0 2024-03-22T07:28:24.142 INFO:tasks.workunit.client.1.smithi195.stdout:5/30: mkdir d9 0 2024-03-22T07:28:24.148 INFO:tasks.workunit.client.1.smithi195.stdout:5/31: truncate f3 2508633 0 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/22: sync 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/7: sync 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:8/4: sync 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:8/5: rename - no filename 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:2/3: sync 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/8: chown l2 0 1 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/9: write - no filename 2024-03-22T07:28:24.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/10: dread - no filename 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/4: truncate f0 941297 0 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/5: fdatasync f0 0 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/6: truncate f0 1264802 0 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:2/7: stat f0 0 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:8/6: getdents . 0 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:7/28: rename d0/d3 to d0/d9 0 2024-03-22T07:28:24.155 INFO:tasks.workunit.client.1.smithi195.stdout:7/29: truncate d0/d9/f8 523907 0 2024-03-22T07:28:24.157 INFO:tasks.workunit.client.1.smithi195.stdout:4/11: creat f3 x:0 0 0 2024-03-22T07:28:24.157 INFO:tasks.workunit.client.1.smithi195.stdout:4/12: dread - f3 zero size 2024-03-22T07:28:24.158 INFO:tasks.workunit.client.1.smithi195.stdout:8/7: symlink l0 0 2024-03-22T07:28:24.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/8: creat f1 x:0 0 0 2024-03-22T07:28:24.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/9: chown f1 15531257 1 2024-03-22T07:28:24.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/10: truncate f1 722452 0 2024-03-22T07:28:24.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/11: creat f2 x:0 0 0 2024-03-22T07:28:24.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/12: truncate f2 651979 0 2024-03-22T07:28:24.164 INFO:tasks.workunit.client.1.smithi195.stdout:8/13: write f1 [26367,56862] 0 2024-03-22T07:28:24.167 INFO:tasks.workunit.client.1.smithi195.stdout:8/14: symlink l3 0 2024-03-22T07:28:24.167 INFO:tasks.workunit.client.1.smithi195.stdout:8/15: creat f4 x:0 0 0 2024-03-22T07:28:24.171 INFO:tasks.workunit.client.1.smithi195.stdout:2/8: dwrite f0 [0,4194304] 0 2024-03-22T07:28:24.171 INFO:tasks.workunit.client.1.smithi195.stdout:2/9: getdents . 0 2024-03-22T07:28:24.172 INFO:tasks.workunit.client.1.smithi195.stdout:2/10: fsync f0 0 2024-03-22T07:28:24.172 INFO:tasks.workunit.client.1.smithi195.stdout:2/11: fsync f0 0 2024-03-22T07:28:24.176 INFO:tasks.workunit.client.1.smithi195.stdout:2/12: rename f0 to f1 0 2024-03-22T07:28:24.183 INFO:tasks.workunit.client.1.smithi195.stdout:8/16: dwrite f2 [0,4194304] 0 2024-03-22T07:28:24.188 INFO:tasks.workunit.client.1.smithi195.stdout:8/17: unlink f4 0 2024-03-22T07:28:24.189 INFO:tasks.workunit.client.1.smithi195.stdout:3/18: truncate f0 7752458 0 2024-03-22T07:28:24.191 INFO:tasks.workunit.client.1.smithi195.stdout:3/19: creat d3/f9 x:0 0 0 2024-03-22T07:28:24.192 INFO:tasks.workunit.client.1.smithi195.stdout:3/20: chown d3 15 1 2024-03-22T07:28:24.193 INFO:tasks.workunit.client.1.smithi195.stdout:2/13: dwrite f1 [0,4194304] 0 2024-03-22T07:28:24.193 INFO:tasks.workunit.client.1.smithi195.stdout:3/21: stat d3/d4/l7 0 2024-03-22T07:28:24.195 INFO:tasks.workunit.client.1.smithi195.stdout:3/22: unlink d3/f9 0 2024-03-22T07:28:24.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/23: link l1 d3/la 0 2024-03-22T07:28:24.200 INFO:tasks.workunit.client.1.smithi195.stdout:3/24: symlink d3/lb 0 2024-03-22T07:28:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:23 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc restarted 2024-03-22T07:28:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:23 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:28:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:23 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:28:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:23 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:28:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:23 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:28:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:23 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:28:24.205 INFO:tasks.workunit.client.1.smithi195.stdout:2/14: dread f1 [0,4194304] 0 2024-03-22T07:28:24.206 INFO:tasks.workunit.client.1.smithi195.stdout:8/18: dwrite f1 [0,4194304] 0 2024-03-22T07:28:24.206 INFO:tasks.workunit.client.1.smithi195.stdout:8/19: creat f5 x:0 0 0 2024-03-22T07:28:24.207 INFO:tasks.workunit.client.1.smithi195.stdout:2/15: mkdir d2 0 2024-03-22T07:28:24.208 INFO:tasks.workunit.client.1.smithi195.stdout:1/47: truncate d0/d2/d6/f11 62503 0 2024-03-22T07:28:24.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/48: chown d0/d2/d6/c7 1 1 2024-03-22T07:28:24.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/49: stat d0/d2/d6/f11 0 2024-03-22T07:28:24.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/50: fsync d0/f10 0 2024-03-22T07:28:24.213 INFO:tasks.workunit.client.1.smithi195.stdout:2/16: mkdir d2/d3 0 2024-03-22T07:28:24.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/51: creat d0/d2/d9/f15 x:0 0 0 2024-03-22T07:28:24.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/52: readlink d0/d2/d6/lf 0 2024-03-22T07:28:24.215 INFO:tasks.workunit.client.1.smithi195.stdout:2/17: symlink d2/l4 0 2024-03-22T07:28:24.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/20: truncate f0 1701414 0 2024-03-22T07:28:24.225 INFO:tasks.workunit.client.1.smithi195.stdout:6/21: rmdir - no directory 2024-03-22T07:28:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:23 smithi134 ceph-mon[29057]: Standby manager daemon smithi195.jxfsnc restarted 2024-03-22T07:28:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:23 smithi134 ceph-mon[29057]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:28:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:23 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:28:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:23 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:28:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:23 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:28:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:23 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:28:24.379 INFO:tasks.workunit.client.0.smithi134.stdout:3/7: creat f3 x:0 0 0 2024-03-22T07:28:24.428 INFO:tasks.workunit.client.0.smithi134.stdout:9/1: creat f0 x:0 0 0 2024-03-22T07:28:24.428 INFO:tasks.workunit.client.0.smithi134.stdout:9/2: creat f1 x:0 0 0 2024-03-22T07:28:24.429 INFO:tasks.workunit.client.0.smithi134.stdout:1/8: mkdir d5 0 2024-03-22T07:28:24.429 INFO:tasks.workunit.client.0.smithi134.stdout:8/14: creat f0 x:0 0 0 2024-03-22T07:28:24.430 INFO:tasks.workunit.client.0.smithi134.stdout:6/1: symlink l0 0 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/2: chown l0 53 1 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/3: dread - no filename 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/1: symlink l0 0 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/2: truncate - no filename 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/3: rmdir - no directory 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/4: readlink l0 0 2024-03-22T07:28:24.431 INFO:tasks.workunit.client.0.smithi134.stdout:5/5: write - no filename 2024-03-22T07:28:24.432 INFO:tasks.workunit.client.0.smithi134.stdout:5/6: fsync - no filename 2024-03-22T07:28:24.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/18: mkdir d1/d3/d6 0 2024-03-22T07:28:24.435 INFO:tasks.workunit.client.0.smithi134.stdout:7/19: dread d1/f4 [0,4194304] 0 2024-03-22T07:28:24.770 INFO:tasks.workunit.client.1.smithi195.stdout:0/23: mkdir d1/d6 0 2024-03-22T07:28:24.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/24: fsync d1/d4/f5 0 2024-03-22T07:28:24.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/25: read - d1/d4/f5 zero size 2024-03-22T07:28:24.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/26: dread d1/f3 [0,4194304] 0 2024-03-22T07:28:24.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/27: fsync d1/f3 0 2024-03-22T07:28:24.773 INFO:tasks.workunit.client.1.smithi195.stdout:0/28: unlink d1/f3 0 2024-03-22T07:28:24.774 INFO:tasks.workunit.client.1.smithi195.stdout:0/29: write d1/d4/f5 [154587,37090] 0 2024-03-22T07:28:24.777 INFO:tasks.workunit.client.1.smithi195.stdout:0/30: rmdir d1/d6 0 2024-03-22T07:28:24.795 INFO:tasks.workunit.client.1.smithi195.stdout:0/31: dwrite d1/d4/f5 [0,4194304] 0 2024-03-22T07:28:25.007 INFO:tasks.workunit.client.0.smithi134.stdout:0/10: getdents . 0 2024-03-22T07:28:25.009 INFO:tasks.workunit.client.0.smithi134.stdout:9/3: symlink l2 0 2024-03-22T07:28:25.010 INFO:tasks.workunit.client.0.smithi134.stdout:1/9: creat d5/f6 x:0 0 0 2024-03-22T07:28:25.011 INFO:tasks.workunit.client.0.smithi134.stdout:6/4: symlink l1 0 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/5: write - no filename 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/6: write - no filename 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/7: chown l0 2 1 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:5/7: mkdir d1 0 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:5/8: write - no filename 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:5/9: truncate - no filename 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:5/10: write - no filename 2024-03-22T07:28:25.012 INFO:tasks.workunit.client.0.smithi134.stdout:5/11: fdatasync - no filename 2024-03-22T07:28:25.013 INFO:tasks.workunit.client.0.smithi134.stdout:7/20: creat d1/d3/f7 x:0 0 0 2024-03-22T07:28:25.013 INFO:tasks.workunit.client.0.smithi134.stdout:7/21: fsync d1/f2 0 2024-03-22T07:28:25.013 INFO:tasks.workunit.client.0.smithi134.stdout:7/22: rename d1/d3 to d1/d3/d6/d8 22 2024-03-22T07:28:25.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/11: unlink f1 0 2024-03-22T07:28:25.016 INFO:tasks.workunit.client.0.smithi134.stdout:3/8: mkdir d4 0 2024-03-22T07:28:25.017 INFO:tasks.workunit.client.0.smithi134.stdout:9/4: mkdir d3 0 2024-03-22T07:28:25.017 INFO:tasks.workunit.client.0.smithi134.stdout:9/5: dread - f0 zero size 2024-03-22T07:28:25.017 INFO:tasks.workunit.client.0.smithi134.stdout:1/10: symlink d5/l7 0 2024-03-22T07:28:25.019 INFO:tasks.workunit.client.0.smithi134.stdout:6/8: mkdir d2 0 2024-03-22T07:28:25.019 INFO:tasks.workunit.client.0.smithi134.stdout:6/9: truncate - no filename 2024-03-22T07:28:25.019 INFO:tasks.workunit.client.0.smithi134.stdout:6/10: chown l0 56731 1 2024-03-22T07:28:25.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/12: symlink d1/l2 0 2024-03-22T07:28:25.020 INFO:tasks.workunit.client.0.smithi134.stdout:7/23: mknod d1/d3/c9 0 2024-03-22T07:28:25.020 INFO:tasks.workunit.client.0.smithi134.stdout:0/12: fsync f0 0 2024-03-22T07:28:25.022 INFO:tasks.workunit.client.0.smithi134.stdout:3/9: link f3 d4/f5 0 2024-03-22T07:28:25.022 INFO:tasks.workunit.client.0.smithi134.stdout:3/10: stat d4 0 2024-03-22T07:28:25.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/11: rename l0 to d2/l3 0 2024-03-22T07:28:25.024 INFO:tasks.workunit.client.0.smithi134.stdout:5/13: mknod d1/c3 0 2024-03-22T07:28:25.026 INFO:tasks.workunit.client.0.smithi134.stdout:3/11: symlink d4/l6 0 2024-03-22T07:28:25.026 INFO:tasks.workunit.client.0.smithi134.stdout:3/12: write f3 [508573,80135] 0 2024-03-22T07:28:25.029 INFO:tasks.workunit.client.0.smithi134.stdout:6/12: creat d2/f4 x:0 0 0 2024-03-22T07:28:25.029 INFO:tasks.workunit.client.0.smithi134.stdout:6/13: write d2/f4 [871462,33486] 0 2024-03-22T07:28:25.029 INFO:tasks.workunit.client.0.smithi134.stdout:6/14: read d2/f4 [92448,99808] 0 2024-03-22T07:28:25.030 INFO:tasks.workunit.client.0.smithi134.stdout:5/14: mkdir d1/d4 0 2024-03-22T07:28:25.030 INFO:tasks.workunit.client.0.smithi134.stdout:5/15: dread - no filename 2024-03-22T07:28:25.036 INFO:tasks.workunit.client.0.smithi134.stdout:3/13: dread d4/f5 [0,4194304] 0 2024-03-22T07:28:25.038 INFO:tasks.workunit.client.0.smithi134.stdout:3/14: write f0 [476165,70330] 0 2024-03-22T07:28:25.038 INFO:tasks.workunit.client.0.smithi134.stdout:6/15: dread d2/f4 [0,4194304] 0 2024-03-22T07:28:25.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/13: getdents . 0 2024-03-22T07:28:25.047 INFO:tasks.workunit.client.0.smithi134.stdout:7/24: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.047 INFO:tasks.workunit.client.0.smithi134.stdout:1/11: dwrite f2 [0,4194304] 0 2024-03-22T07:28:25.048 INFO:tasks.workunit.client.0.smithi134.stdout:1/12: write f4 [149389,55920] 0 2024-03-22T07:28:25.049 INFO:tasks.workunit.client.0.smithi134.stdout:7/25: creat d1/d3/d6/fa x:0 0 0 2024-03-22T07:28:25.051 INFO:tasks.workunit.client.0.smithi134.stdout:0/13: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.051 INFO:tasks.workunit.client.0.smithi134.stdout:0/14: truncate f0 5102620 0 2024-03-22T07:28:25.057 INFO:tasks.workunit.client.0.smithi134.stdout:6/16: dwrite d2/f4 [0,4194304] 0 2024-03-22T07:28:25.058 INFO:tasks.workunit.client.0.smithi134.stdout:6/17: mknod d2/c5 0 2024-03-22T07:28:25.059 INFO:tasks.workunit.client.0.smithi134.stdout:1/13: write f2 [2385836,88796] 0 2024-03-22T07:28:25.060 INFO:tasks.workunit.client.0.smithi134.stdout:1/14: symlink d5/l8 0 2024-03-22T07:28:25.061 INFO:tasks.workunit.client.1.smithi195.stdout:5/32: write f3 [1560815,22653] 0 2024-03-22T07:28:25.061 INFO:tasks.workunit.client.1.smithi195.stdout:8/20: truncate f2 751197 0 2024-03-22T07:28:25.061 INFO:tasks.workunit.client.1.smithi195.stdout:8/21: write f5 [137592,128856] 0 2024-03-22T07:28:25.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/33: symlink d9/la 0 2024-03-22T07:28:25.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/34: write f7 [821559,121043] 0 2024-03-22T07:28:25.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/35: truncate f8 242251 0 2024-03-22T07:28:25.064 INFO:tasks.workunit.client.1.smithi195.stdout:5/36: creat d9/fb x:0 0 0 2024-03-22T07:28:25.066 INFO:tasks.workunit.client.0.smithi134.stdout:3/15: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.072 INFO:tasks.workunit.client.1.smithi195.stdout:4/14: dwrite f3 [0,4194304] 0 2024-03-22T07:28:25.074 INFO:tasks.workunit.client.1.smithi195.stdout:4/15: symlink l4 0 2024-03-22T07:28:25.075 INFO:tasks.workunit.client.1.smithi195.stdout:4/16: mknod c5 0 2024-03-22T07:28:25.080 INFO:tasks.workunit.client.1.smithi195.stdout:2/18: truncate f1 1104614 0 2024-03-22T07:28:25.081 INFO:tasks.workunit.client.1.smithi195.stdout:4/17: dread f3 [0,4194304] 0 2024-03-22T07:28:25.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/42: sync 2024-03-22T07:28:25.092 INFO:tasks.workunit.client.1.smithi195.stdout:6/22: dread f0 [0,4194304] 0 2024-03-22T07:28:25.092 INFO:tasks.workunit.client.1.smithi195.stdout:6/23: fsync f0 0 2024-03-22T07:28:25.092 INFO:tasks.workunit.client.1.smithi195.stdout:9/43: write d2/f9 [3158903,129298] 0 2024-03-22T07:28:25.094 INFO:tasks.workunit.client.1.smithi195.stdout:9/44: symlink d2/d4/l10 0 2024-03-22T07:28:25.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/24: write f0 [212570,72647] 0 2024-03-22T07:28:25.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/25: write f0 [2445526,73410] 0 2024-03-22T07:28:25.095 INFO:tasks.workunit.client.1.smithi195.stdout:9/45: mknod d2/d4/c11 0 2024-03-22T07:28:25.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/18: dwrite f3 [0,4194304] 0 2024-03-22T07:28:25.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/19: fsync f3 0 2024-03-22T07:28:25.097 INFO:tasks.workunit.client.1.smithi195.stdout:6/26: link c1 c3 0 2024-03-22T07:28:25.100 INFO:tasks.workunit.client.1.smithi195.stdout:9/46: unlink d2/l7 0 2024-03-22T07:28:25.100 INFO:tasks.workunit.client.1.smithi195.stdout:9/47: chown d2/d4/d6/cf 11361323 1 2024-03-22T07:28:25.100 INFO:tasks.workunit.client.1.smithi195.stdout:9/48: creat d2/d4/f12 x:0 0 0 2024-03-22T07:28:25.100 INFO:tasks.workunit.client.1.smithi195.stdout:9/49: write d2/f3 [3019700,73971] 0 2024-03-22T07:28:25.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/50: mknod d2/d4/c13 0 2024-03-22T07:28:25.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/51: write f1 [397671,117542] 0 2024-03-22T07:28:25.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/52: mknod d2/d4/d6/c14 0 2024-03-22T07:28:25.109 INFO:tasks.workunit.client.1.smithi195.stdout:9/53: write f1 [164345,21410] 0 2024-03-22T07:28:25.124 INFO:tasks.workunit.client.1.smithi195.stdout:9/54: dwrite d2/d4/f5 [4194304,4194304] 0 2024-03-22T07:28:25.127 INFO:tasks.workunit.client.1.smithi195.stdout:9/55: dread f1 [0,4194304] 0 2024-03-22T07:28:25.127 INFO:tasks.workunit.client.1.smithi195.stdout:9/56: stat d2/d4/d6/db 0 2024-03-22T07:28:25.127 INFO:tasks.workunit.client.1.smithi195.stdout:9/57: readlink d2/d4/d6/db/ld 0 2024-03-22T07:28:25.128 INFO:tasks.workunit.client.1.smithi195.stdout:9/58: symlink d2/l15 0 2024-03-22T07:28:25.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/59: dwrite d2/f3 [0,4194304] 0 2024-03-22T07:28:25.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/60: truncate d2/d4/f12 992429 0 2024-03-22T07:28:25.143 INFO:tasks.workunit.client.1.smithi195.stdout:9/61: creat d2/f16 x:0 0 0 2024-03-22T07:28:25.152 INFO:tasks.workunit.client.1.smithi195.stdout:9/62: write d2/d4/f5 [7940615,126283] 0 2024-03-22T07:28:25.153 INFO:tasks.workunit.client.1.smithi195.stdout:9/63: symlink d2/d4/d6/db/l17 0 2024-03-22T07:28:25.153 INFO:tasks.workunit.client.1.smithi195.stdout:9/64: write f0 [275541,123826] 0 2024-03-22T07:28:25.165 INFO:tasks.workunit.client.0.smithi134.stdout:8/15: getdents . 0 2024-03-22T07:28:25.167 INFO:tasks.workunit.client.0.smithi134.stdout:8/16: mkdir d1 0 2024-03-22T07:28:25.167 INFO:tasks.workunit.client.0.smithi134.stdout:8/17: dread - f0 zero size 2024-03-22T07:28:25.182 INFO:tasks.workunit.client.0.smithi134.stdout:8/18: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.184 INFO:tasks.workunit.client.0.smithi134.stdout:8/19: mkdir d1/d2 0 2024-03-22T07:28:25.201 INFO:tasks.workunit.client.0.smithi134.stdout:8/20: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.201 INFO:tasks.workunit.client.0.smithi134.stdout:8/21: chown d1 1287589746 1 2024-03-22T07:28:25.202 INFO:tasks.workunit.client.0.smithi134.stdout:8/22: link f0 d1/d2/f3 0 2024-03-22T07:28:25.203 INFO:tasks.workunit.client.0.smithi134.stdout:8/23: mkdir d1/d4 0 2024-03-22T07:28:25.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:24 smithi195 ceph-mon[36144]: pgmap v249: 65 pgs: 65 active+clean; 237 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 806 op/s 2024-03-22T07:28:25.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:24 smithi195 ceph-mon[36144]: mgrmap e20: smithi134.wtwqre(active, since 7m), standbys: smithi195.jxfsnc 2024-03-22T07:28:25.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:24 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:25.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:24 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:25.255 INFO:tasks.workunit.client.0.smithi134.stdout:7/26: creat d1/fb x:0 0 0 2024-03-22T07:28:25.256 INFO:tasks.workunit.client.0.smithi134.stdout:7/27: chown d1/f2 365894 1 2024-03-22T07:28:25.256 INFO:tasks.workunit.client.0.smithi134.stdout:7/28: unlink d1/d3/d6/fa 0 2024-03-22T07:28:25.263 INFO:tasks.workunit.client.0.smithi134.stdout:7/29: write d1/f4 [3710086,101762] 0 2024-03-22T07:28:25.263 INFO:tasks.workunit.client.0.smithi134.stdout:7/30: dread - d1/fb zero size 2024-03-22T07:28:25.263 INFO:tasks.workunit.client.0.smithi134.stdout:7/31: chown d1/f4 12143518 1 2024-03-22T07:28:25.268 INFO:tasks.workunit.client.0.smithi134.stdout:7/32: dread d1/f2 [0,4194304] 0 2024-03-22T07:28:25.282 INFO:tasks.workunit.client.1.smithi195.stdout:0/32: write d1/d4/f5 [5133138,81442] 0 2024-03-22T07:28:25.282 INFO:tasks.workunit.client.1.smithi195.stdout:0/33: creat d1/d4/f7 x:0 0 0 2024-03-22T07:28:25.282 INFO:tasks.workunit.client.1.smithi195.stdout:0/34: creat d1/d4/f8 x:0 0 0 2024-03-22T07:28:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:24 smithi134 ceph-mon[29057]: pgmap v249: 65 pgs: 65 active+clean; 237 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 10 MiB/s wr, 806 op/s 2024-03-22T07:28:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:24 smithi134 ceph-mon[29057]: mgrmap e20: smithi134.wtwqre(active, since 7m), standbys: smithi195.jxfsnc 2024-03-22T07:28:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:24 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:24 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:25.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/35: dwrite d1/d4/f5 [4194304,4194304] 0 2024-03-22T07:28:25.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/36: creat d1/d4/f9 x:0 0 0 2024-03-22T07:28:25.308 INFO:tasks.workunit.client.1.smithi195.stdout:0/37: dwrite d1/d4/f9 [0,4194304] 0 2024-03-22T07:28:25.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/38: mknod d1/d4/ca 0 2024-03-22T07:28:25.312 INFO:tasks.workunit.client.1.smithi195.stdout:0/39: chown c0 3400 1 2024-03-22T07:28:25.339 INFO:tasks.workunit.client.0.smithi134.stdout:2/4: sync 2024-03-22T07:28:25.339 INFO:tasks.workunit.client.0.smithi134.stdout:4/1: sync 2024-03-22T07:28:25.339 INFO:tasks.workunit.client.0.smithi134.stdout:4/2: dwrite - no filename 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/3: chown . 58458 1 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/4: dwrite - no filename 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/5: dread - no filename 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/6: write - no filename 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/7: fdatasync - no filename 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/8: rename - no filename 2024-03-22T07:28:25.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/9: unlink - no file 2024-03-22T07:28:25.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/5: symlink l0 0 2024-03-22T07:28:25.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/6: truncate - no filename 2024-03-22T07:28:25.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/7: write - no filename 2024-03-22T07:28:25.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/8: readlink l0 0 2024-03-22T07:28:25.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/9: chown l0 201868 1 2024-03-22T07:28:25.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/10: dread - no filename 2024-03-22T07:28:25.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/10: symlink l0 0 2024-03-22T07:28:25.342 INFO:tasks.workunit.client.0.smithi134.stdout:2/11: rename l0 to l1 0 2024-03-22T07:28:25.342 INFO:tasks.workunit.client.0.smithi134.stdout:2/12: write - no filename 2024-03-22T07:28:25.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/11: creat f1 x:0 0 0 2024-03-22T07:28:25.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/12: write f1 [47746,31964] 0 2024-03-22T07:28:25.343 INFO:tasks.workunit.client.0.smithi134.stdout:2/13: mkdir d2 0 2024-03-22T07:28:25.343 INFO:tasks.workunit.client.0.smithi134.stdout:2/14: dread - no filename 2024-03-22T07:28:25.343 INFO:tasks.workunit.client.0.smithi134.stdout:2/15: write - no filename 2024-03-22T07:28:25.344 INFO:tasks.workunit.client.0.smithi134.stdout:4/13: mkdir d2 0 2024-03-22T07:28:25.344 INFO:tasks.workunit.client.0.smithi134.stdout:2/16: symlink d2/l3 0 2024-03-22T07:28:25.345 INFO:tasks.workunit.client.0.smithi134.stdout:4/14: mknod d2/c3 0 2024-03-22T07:28:25.346 INFO:tasks.workunit.client.0.smithi134.stdout:2/17: mknod d2/c4 0 2024-03-22T07:28:25.346 INFO:tasks.workunit.client.0.smithi134.stdout:2/18: read - no filename 2024-03-22T07:28:25.346 INFO:tasks.workunit.client.0.smithi134.stdout:2/19: write - no filename 2024-03-22T07:28:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:4/15: rename l0 to d2/l4 0 2024-03-22T07:28:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/20: rmdir d2 39 2024-03-22T07:28:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/21: write - no filename 2024-03-22T07:28:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/22: dread - no filename 2024-03-22T07:28:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/23: fsync - no filename 2024-03-22T07:28:25.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/24: dwrite - no filename 2024-03-22T07:28:25.349 INFO:tasks.workunit.client.0.smithi134.stdout:4/16: fdatasync f1 0 2024-03-22T07:28:25.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/25: mkdir d2/d5 0 2024-03-22T07:28:25.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/26: chown d2/l3 10627088 1 2024-03-22T07:28:25.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/27: dread - no filename 2024-03-22T07:28:25.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/17: symlink d2/l5 0 2024-03-22T07:28:25.351 INFO:tasks.workunit.client.0.smithi134.stdout:2/28: unlink d2/l3 0 2024-03-22T07:28:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/29: fdatasync - no filename 2024-03-22T07:28:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/30: fsync - no filename 2024-03-22T07:28:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/31: dwrite - no filename 2024-03-22T07:28:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/32: chown l1 220368 1 2024-03-22T07:28:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/33: truncate - no filename 2024-03-22T07:28:25.352 INFO:tasks.workunit.client.0.smithi134.stdout:4/18: mknod d2/c6 0 2024-03-22T07:28:25.353 INFO:tasks.workunit.client.0.smithi134.stdout:2/34: rename d2/c4 to d2/c6 0 2024-03-22T07:28:25.353 INFO:tasks.workunit.client.0.smithi134.stdout:4/19: mkdir d2/d7 0 2024-03-22T07:28:25.354 INFO:tasks.workunit.client.0.smithi134.stdout:2/35: mknod d2/c7 0 2024-03-22T07:28:25.355 INFO:tasks.workunit.client.0.smithi134.stdout:4/20: unlink d2/l5 0 2024-03-22T07:28:25.355 INFO:tasks.workunit.client.0.smithi134.stdout:4/21: getdents d2/d7 0 2024-03-22T07:28:25.355 INFO:tasks.workunit.client.0.smithi134.stdout:4/22: chown d2/l4 64274 1 2024-03-22T07:28:25.356 INFO:tasks.workunit.client.0.smithi134.stdout:2/36: mkdir d2/d5/d8 0 2024-03-22T07:28:25.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/15: truncate f1 4021984 0 2024-03-22T07:28:25.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/16: creat d5/f9 x:0 0 0 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/17: mkdir d5/da 0 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/18: dread - f0 zero size 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/19: readlink d5/l8 0 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/20: getdents d5/da 0 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/21: write f4 [452712,29645] 0 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/22: readlink d5/l7 0 2024-03-22T07:28:25.370 INFO:tasks.workunit.client.0.smithi134.stdout:1/23: creat d5/fb x:0 0 0 2024-03-22T07:28:25.371 INFO:tasks.workunit.client.0.smithi134.stdout:4/23: dwrite f1 [0,4194304] 0 2024-03-22T07:28:25.373 INFO:tasks.workunit.client.0.smithi134.stdout:3/16: fsync f3 0 2024-03-22T07:28:25.374 INFO:tasks.workunit.client.0.smithi134.stdout:3/17: creat d4/f7 x:0 0 0 2024-03-22T07:28:25.375 INFO:tasks.workunit.client.0.smithi134.stdout:6/18: link d2/l3 d2/l6 0 2024-03-22T07:28:25.376 INFO:tasks.workunit.client.0.smithi134.stdout:3/18: mkdir d4/d8 0 2024-03-22T07:28:25.383 INFO:tasks.workunit.client.0.smithi134.stdout:6/19: read d2/f4 [537353,87250] 0 2024-03-22T07:28:25.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/20: link d2/l6 d2/l7 0 2024-03-22T07:28:25.388 INFO:tasks.workunit.client.0.smithi134.stdout:6/21: unlink d2/f4 0 2024-03-22T07:28:25.389 INFO:tasks.workunit.client.0.smithi134.stdout:6/22: stat d2/l7 0 2024-03-22T07:28:25.389 INFO:tasks.workunit.client.0.smithi134.stdout:6/23: write - no filename 2024-03-22T07:28:25.392 INFO:tasks.workunit.client.0.smithi134.stdout:1/24: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.392 INFO:tasks.workunit.client.0.smithi134.stdout:1/25: chown f3 16217739 1 2024-03-22T07:28:25.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/20: write f3 [4868554,101900] 0 2024-03-22T07:28:25.396 INFO:tasks.workunit.client.0.smithi134.stdout:1/26: link f4 d5/fc 0 2024-03-22T07:28:25.398 INFO:tasks.workunit.client.1.smithi195.stdout:2/19: fsync f1 0 2024-03-22T07:28:25.399 INFO:tasks.workunit.client.1.smithi195.stdout:4/21: creat f6 x:0 0 0 2024-03-22T07:28:25.401 INFO:tasks.workunit.client.1.smithi195.stdout:3/25: truncate f0 3882134 0 2024-03-22T07:28:25.402 INFO:tasks.workunit.client.1.smithi195.stdout:3/26: mknod d3/cc 0 2024-03-22T07:28:25.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/27: chown l1 2345922 1 2024-03-22T07:28:25.405 INFO:tasks.workunit.client.1.smithi195.stdout:6/27: truncate f0 1987439 0 2024-03-22T07:28:25.407 INFO:tasks.workunit.client.1.smithi195.stdout:6/28: getdents . 0 2024-03-22T07:28:25.407 INFO:tasks.workunit.client.1.smithi195.stdout:2/20: write f1 [203164,80540] 0 2024-03-22T07:28:25.408 INFO:tasks.workunit.client.0.smithi134.stdout:3/19: dwrite d4/f5 [0,4194304] 0 2024-03-22T07:28:25.409 INFO:tasks.workunit.client.1.smithi195.stdout:8/22: dwrite f2 [0,4194304] 0 2024-03-22T07:28:25.409 INFO:tasks.workunit.client.0.smithi134.stdout:0/15: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:25.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/29: creat f4 x:0 0 0 2024-03-22T07:28:25.410 INFO:tasks.workunit.client.1.smithi195.stdout:2/21: fsync f1 0 2024-03-22T07:28:25.413 INFO:tasks.workunit.client.1.smithi195.stdout:2/22: getdents d2 0 2024-03-22T07:28:25.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/65: truncate d2/f3 91415 0 2024-03-22T07:28:25.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/23: dread f1 [0,4194304] 0 2024-03-22T07:28:25.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/22: write f3 [1205393,9120] 0 2024-03-22T07:28:25.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/23: chown f6 60997 1 2024-03-22T07:28:25.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/24: dread - f6 zero size 2024-03-22T07:28:25.418 INFO:tasks.workunit.client.0.smithi134.stdout:3/20: unlink c2 0 2024-03-22T07:28:25.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/66: mkdir d2/d4/d6/d18 0 2024-03-22T07:28:25.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/21: mknod d4/d8/c9 0 2024-03-22T07:28:25.422 INFO:tasks.workunit.client.0.smithi134.stdout:3/22: stat d4/d8/c9 0 2024-03-22T07:28:25.422 INFO:tasks.workunit.client.1.smithi195.stdout:2/24: creat d2/d3/f5 x:0 0 0 2024-03-22T07:28:25.423 INFO:tasks.workunit.client.1.smithi195.stdout:4/25: symlink l7 0 2024-03-22T07:28:25.424 INFO:tasks.workunit.client.0.smithi134.stdout:3/23: write f1 [852284,113460] 0 2024-03-22T07:28:25.425 INFO:tasks.workunit.client.0.smithi134.stdout:0/16: write f0 [727851,1337] 0 2024-03-22T07:28:25.426 INFO:tasks.workunit.client.0.smithi134.stdout:3/24: creat d4/d8/fa x:0 0 0 2024-03-22T07:28:25.427 INFO:tasks.workunit.client.1.smithi195.stdout:1/53: symlink d0/d2/l16 0 2024-03-22T07:28:25.429 INFO:tasks.workunit.client.0.smithi134.stdout:0/17: creat f4 x:0 0 0 2024-03-22T07:28:25.429 INFO:tasks.workunit.client.1.smithi195.stdout:8/23: dwrite f1 [0,4194304] 0 2024-03-22T07:28:25.429 INFO:tasks.workunit.client.1.smithi195.stdout:8/24: chown l0 27 1 2024-03-22T07:28:25.430 INFO:tasks.workunit.client.0.smithi134.stdout:0/18: creat f5 x:0 0 0 2024-03-22T07:28:25.430 INFO:tasks.workunit.client.0.smithi134.stdout:0/19: truncate f5 953836 0 2024-03-22T07:28:25.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/24: truncate d1/d2/f3 2658078 0 2024-03-22T07:28:25.433 INFO:tasks.workunit.client.0.smithi134.stdout:8/25: chown d1/d4 783534026 1 2024-03-22T07:28:25.433 INFO:tasks.workunit.client.0.smithi134.stdout:1/27: dwrite f2 [0,4194304] 0 2024-03-22T07:28:25.434 INFO:tasks.workunit.client.0.smithi134.stdout:1/28: chown f0 1 1 2024-03-22T07:28:25.435 INFO:tasks.workunit.client.0.smithi134.stdout:1/29: symlink d5/ld 0 2024-03-22T07:28:25.435 INFO:tasks.workunit.client.0.smithi134.stdout:1/30: readlink d5/ld 0 2024-03-22T07:28:25.436 INFO:tasks.workunit.client.0.smithi134.stdout:3/25: write f0 [516121,111718] 0 2024-03-22T07:28:25.438 INFO:tasks.workunit.client.0.smithi134.stdout:3/26: mknod d4/cb 0 2024-03-22T07:28:25.438 INFO:tasks.workunit.client.0.smithi134.stdout:3/27: creat d4/fc x:0 0 0 2024-03-22T07:28:25.438 INFO:tasks.workunit.client.0.smithi134.stdout:3/28: readlink d4/l6 0 2024-03-22T07:28:25.438 INFO:tasks.workunit.client.0.smithi134.stdout:3/29: truncate f1 1952331 0 2024-03-22T07:28:25.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/67: dwrite d2/fe [0,4194304] 0 2024-03-22T07:28:25.439 INFO:tasks.workunit.client.0.smithi134.stdout:7/33: truncate d1/f4 3684280 0 2024-03-22T07:28:25.441 INFO:tasks.workunit.client.1.smithi195.stdout:0/40: fsync d1/d4/f7 0 2024-03-22T07:28:25.447 INFO:tasks.workunit.client.1.smithi195.stdout:0/41: rename d1 to d1/db 22 2024-03-22T07:28:25.447 INFO:tasks.workunit.client.1.smithi195.stdout:9/68: rename d2/l8 to d2/d4/d6/l19 0 2024-03-22T07:28:25.447 INFO:tasks.workunit.client.1.smithi195.stdout:9/69: write d2/d4/f5 [7573615,33120] 0 2024-03-22T07:28:25.447 INFO:tasks.workunit.client.1.smithi195.stdout:9/70: creat d2/d4/f1a x:0 0 0 2024-03-22T07:28:25.448 INFO:tasks.workunit.client.1.smithi195.stdout:0/42: mkdir d1/dc 0 2024-03-22T07:28:25.451 INFO:tasks.workunit.client.1.smithi195.stdout:9/71: creat d2/d4/d6/db/f1b x:0 0 0 2024-03-22T07:28:25.453 INFO:tasks.workunit.client.1.smithi195.stdout:0/43: rename d1/dc to d1/d4/dd 0 2024-03-22T07:28:25.453 INFO:tasks.workunit.client.1.smithi195.stdout:4/26: dwrite f3 [0,4194304] 0 2024-03-22T07:28:25.454 INFO:tasks.workunit.client.1.smithi195.stdout:9/72: rename d2/l15 to d2/d4/l1c 0 2024-03-22T07:28:25.456 INFO:tasks.workunit.client.0.smithi134.stdout:4/24: rename d2/l4 to d2/d7/l8 0 2024-03-22T07:28:25.456 INFO:tasks.workunit.client.0.smithi134.stdout:4/25: truncate f1 4397316 0 2024-03-22T07:28:25.458 INFO:tasks.workunit.client.0.smithi134.stdout:1/31: rename f0 to d5/fe 0 2024-03-22T07:28:25.459 INFO:tasks.workunit.client.0.smithi134.stdout:4/26: creat d2/d7/f9 x:0 0 0 2024-03-22T07:28:25.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/32: symlink d5/lf 0 2024-03-22T07:28:25.461 INFO:tasks.workunit.client.0.smithi134.stdout:3/30: dwrite d4/f5 [0,4194304] 0 2024-03-22T07:28:25.463 INFO:tasks.workunit.client.0.smithi134.stdout:1/33: symlink d5/l10 0 2024-03-22T07:28:25.465 INFO:tasks.workunit.client.0.smithi134.stdout:3/31: link f0 d4/fd 0 2024-03-22T07:28:25.465 INFO:tasks.workunit.client.0.smithi134.stdout:0/20: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:25.467 INFO:tasks.workunit.client.0.smithi134.stdout:2/37: unlink d2/c6 0 2024-03-22T07:28:25.467 INFO:tasks.workunit.client.0.smithi134.stdout:2/38: dwrite - no filename 2024-03-22T07:28:25.467 INFO:tasks.workunit.client.0.smithi134.stdout:2/39: write - no filename 2024-03-22T07:28:25.468 INFO:tasks.workunit.client.0.smithi134.stdout:2/40: mknod d2/d5/d8/c9 0 2024-03-22T07:28:25.469 INFO:tasks.workunit.client.0.smithi134.stdout:2/41: fdatasync - no filename 2024-03-22T07:28:25.469 INFO:tasks.workunit.client.1.smithi195.stdout:0/44: dread d1/d4/f5 [4194304,4194304] 0 2024-03-22T07:28:25.469 INFO:tasks.workunit.client.1.smithi195.stdout:0/45: dread - d1/d4/f8 zero size 2024-03-22T07:28:25.469 INFO:tasks.workunit.client.1.smithi195.stdout:0/46: chown d1/d4 0 1 2024-03-22T07:28:25.469 INFO:tasks.workunit.client.1.smithi195.stdout:0/47: truncate d1/d4/f7 712991 0 2024-03-22T07:28:25.470 INFO:tasks.workunit.client.0.smithi134.stdout:2/42: creat d2/d5/fa x:0 0 0 2024-03-22T07:28:25.472 INFO:tasks.workunit.client.0.smithi134.stdout:2/43: link d2/c7 d2/d5/cb 0 2024-03-22T07:28:25.472 INFO:tasks.workunit.client.0.smithi134.stdout:2/44: creat d2/d5/fc x:0 0 0 2024-03-22T07:28:25.475 INFO:tasks.workunit.client.0.smithi134.stdout:2/45: link d2/d5/d8/c9 d2/d5/d8/cd 0 2024-03-22T07:28:25.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/27: dwrite f1 [0,4194304] 0 2024-03-22T07:28:25.478 INFO:tasks.workunit.client.1.smithi195.stdout:0/48: dread d1/d4/f9 [0,4194304] 0 2024-03-22T07:28:25.478 INFO:tasks.workunit.client.1.smithi195.stdout:9/73: dwrite d2/d4/d6/db/f1b [0,4194304] 0 2024-03-22T07:28:25.481 INFO:tasks.workunit.client.0.smithi134.stdout:3/32: dread f1 [0,4194304] 0 2024-03-22T07:28:25.481 INFO:tasks.workunit.client.0.smithi134.stdout:3/33: dread - d4/fc zero size 2024-03-22T07:28:25.481 INFO:tasks.workunit.client.0.smithi134.stdout:4/28: symlink d2/la 0 2024-03-22T07:28:25.482 INFO:tasks.workunit.client.0.smithi134.stdout:3/34: mknod d4/ce 0 2024-03-22T07:28:25.484 INFO:tasks.workunit.client.1.smithi195.stdout:9/74: mkdir d2/d4/d1d 0 2024-03-22T07:28:25.484 INFO:tasks.workunit.client.0.smithi134.stdout:0/21: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:25.485 INFO:tasks.workunit.client.0.smithi134.stdout:0/22: write f0 [4110488,6078] 0 2024-03-22T07:28:25.486 INFO:tasks.workunit.client.1.smithi195.stdout:7/30: creat d0/fa x:0 0 0 2024-03-22T07:28:25.487 INFO:tasks.workunit.client.1.smithi195.stdout:7/31: symlink d0/lb 0 2024-03-22T07:28:25.487 INFO:tasks.workunit.client.1.smithi195.stdout:7/32: creat d0/fc x:0 0 0 2024-03-22T07:28:25.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/33: creat d0/d9/fd x:0 0 0 2024-03-22T07:28:25.492 INFO:tasks.workunit.client.1.smithi195.stdout:7/34: rename d0/l5 to d0/d9/le 0 2024-03-22T07:28:25.492 INFO:tasks.workunit.client.1.smithi195.stdout:7/35: chown d0/fc 183 1 2024-03-22T07:28:25.492 INFO:tasks.workunit.client.1.smithi195.stdout:7/36: write d0/d9/fd [458030,89596] 0 2024-03-22T07:28:25.492 INFO:tasks.workunit.client.1.smithi195.stdout:7/37: truncate d0/fa 591912 0 2024-03-22T07:28:25.494 INFO:tasks.workunit.client.1.smithi195.stdout:7/38: unlink d0/c2 0 2024-03-22T07:28:25.496 INFO:tasks.workunit.client.0.smithi134.stdout:1/34: fsync f4 0 2024-03-22T07:28:25.496 INFO:tasks.workunit.client.0.smithi134.stdout:1/35: write d5/f6 [109829,54525] 0 2024-03-22T07:28:25.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/28: fsync f0 0 2024-03-22T07:28:25.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/29: creat d3/fd x:0 0 0 2024-03-22T07:28:25.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/75: dwrite f0 [0,4194304] 0 2024-03-22T07:28:25.501 INFO:tasks.workunit.client.1.smithi195.stdout:9/76: write d2/f9 [2314496,56694] 0 2024-03-22T07:28:25.503 INFO:tasks.workunit.client.1.smithi195.stdout:3/30: rename d3/la to d3/le 0 2024-03-22T07:28:25.506 INFO:tasks.workunit.client.0.smithi134.stdout:0/23: dread f0 [0,4194304] 0 2024-03-22T07:28:25.511 INFO:tasks.workunit.client.1.smithi195.stdout:9/77: creat d2/d4/d6/d18/f1e x:0 0 0 2024-03-22T07:28:25.512 INFO:tasks.workunit.client.1.smithi195.stdout:9/78: read - d2/d4/f1a zero size 2024-03-22T07:28:25.512 INFO:tasks.workunit.client.1.smithi195.stdout:9/79: getdents d2/d4/d1d 0 2024-03-22T07:28:25.512 INFO:tasks.workunit.client.1.smithi195.stdout:9/80: creat d2/d4/d6/db/f1f x:0 0 0 2024-03-22T07:28:25.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/81: mkdir d2/d4/d6/db/d20 0 2024-03-22T07:28:25.518 INFO:tasks.workunit.client.1.smithi195.stdout:4/27: getdents . 0 2024-03-22T07:28:25.519 INFO:tasks.workunit.client.1.smithi195.stdout:9/82: mknod d2/d4/d1d/c21 0 2024-03-22T07:28:25.520 INFO:tasks.workunit.client.1.smithi195.stdout:4/28: mknod c8 0 2024-03-22T07:28:25.521 INFO:tasks.workunit.client.1.smithi195.stdout:9/83: creat d2/d4/d1d/f22 x:0 0 0 2024-03-22T07:28:25.522 INFO:tasks.workunit.client.1.smithi195.stdout:8/25: truncate f2 2811812 0 2024-03-22T07:28:25.523 INFO:tasks.workunit.client.1.smithi195.stdout:9/84: mkdir d2/d4/d23 0 2024-03-22T07:28:25.523 INFO:tasks.workunit.client.0.smithi134.stdout:8/26: fsync f0 0 2024-03-22T07:28:25.524 INFO:tasks.workunit.client.1.smithi195.stdout:8/26: symlink l6 0 2024-03-22T07:28:25.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/27: creat f7 x:0 0 0 2024-03-22T07:28:25.525 INFO:tasks.workunit.client.0.smithi134.stdout:3/35: dwrite d4/d8/fa [0,4194304] 0 2024-03-22T07:28:25.525 INFO:tasks.workunit.client.0.smithi134.stdout:3/36: creat d4/ff x:0 0 0 2024-03-22T07:28:25.526 INFO:tasks.workunit.client.1.smithi195.stdout:7/39: dwrite d0/fa [0,4194304] 0 2024-03-22T07:28:25.527 INFO:tasks.workunit.client.0.smithi134.stdout:1/36: dwrite d5/fc [0,4194304] 0 2024-03-22T07:28:25.527 INFO:tasks.workunit.client.0.smithi134.stdout:1/37: dread - f3 zero size 2024-03-22T07:28:25.527 INFO:tasks.workunit.client.0.smithi134.stdout:3/37: dread f1 [0,4194304] 0 2024-03-22T07:28:25.530 INFO:tasks.workunit.client.1.smithi195.stdout:4/29: dread f3 [0,4194304] 0 2024-03-22T07:28:25.532 INFO:tasks.workunit.client.1.smithi195.stdout:8/28: write f1 [1411360,1168] 0 2024-03-22T07:28:25.532 INFO:tasks.workunit.client.1.smithi195.stdout:8/29: chown l0 4324326 1 2024-03-22T07:28:25.532 INFO:tasks.workunit.client.1.smithi195.stdout:8/30: creat f8 x:0 0 0 2024-03-22T07:28:25.535 INFO:tasks.workunit.client.0.smithi134.stdout:8/27: write d1/d2/f3 [1522289,70575] 0 2024-03-22T07:28:25.539 INFO:tasks.workunit.client.0.smithi134.stdout:7/34: dread d1/f4 [0,4194304] 0 2024-03-22T07:28:25.539 INFO:tasks.workunit.client.0.smithi134.stdout:7/35: readlink - no filename 2024-03-22T07:28:25.540 INFO:tasks.workunit.client.0.smithi134.stdout:3/38: mkdir d4/d10 0 2024-03-22T07:28:25.540 INFO:tasks.workunit.client.0.smithi134.stdout:3/39: truncate f3 4974802 0 2024-03-22T07:28:25.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/49: getdents d1 0 2024-03-22T07:28:25.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/50: readlink d1/l2 0 2024-03-22T07:28:25.541 INFO:tasks.workunit.client.1.smithi195.stdout:0/51: dread - d1/d4/f8 zero size 2024-03-22T07:28:25.543 INFO:tasks.workunit.client.1.smithi195.stdout:7/40: read d0/fa [1452947,1496] 0 2024-03-22T07:28:25.544 INFO:tasks.workunit.client.1.smithi195.stdout:7/41: write d0/d9/fd [41181,16336] 0 2024-03-22T07:28:25.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/28: creat d1/d2/f5 x:0 0 0 2024-03-22T07:28:25.549 INFO:tasks.workunit.client.0.smithi134.stdout:1/38: dwrite d5/fc [0,4194304] 0 2024-03-22T07:28:25.549 INFO:tasks.workunit.client.1.smithi195.stdout:4/30: link f3 f9 0 2024-03-22T07:28:25.552 INFO:tasks.workunit.client.0.smithi134.stdout:7/36: unlink d1/fb 0 2024-03-22T07:28:25.552 INFO:tasks.workunit.client.0.smithi134.stdout:7/37: fsync d1/d3/f7 0 2024-03-22T07:28:25.552 INFO:tasks.workunit.client.0.smithi134.stdout:7/38: creat d1/d3/d6/fc x:0 0 0 2024-03-22T07:28:25.552 INFO:tasks.workunit.client.0.smithi134.stdout:7/39: dread - d1/d3/d6/fc zero size 2024-03-22T07:28:25.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/29: dread f0 [0,4194304] 0 2024-03-22T07:28:25.553 INFO:tasks.workunit.client.1.smithi195.stdout:8/31: unlink f8 0 2024-03-22T07:28:25.554 INFO:tasks.workunit.client.0.smithi134.stdout:4/29: getdents d2/d7 0 2024-03-22T07:28:25.557 INFO:tasks.workunit.client.0.smithi134.stdout:1/39: dread d5/fe [0,4194304] 0 2024-03-22T07:28:25.557 INFO:tasks.workunit.client.0.smithi134.stdout:1/40: fsync d5/fb 0 2024-03-22T07:28:25.557 INFO:tasks.workunit.client.0.smithi134.stdout:1/41: creat d5/f11 x:0 0 0 2024-03-22T07:28:25.558 INFO:tasks.workunit.client.0.smithi134.stdout:3/40: dwrite d4/ff [0,4194304] 0 2024-03-22T07:28:25.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/41: chown d4/f7 0 1 2024-03-22T07:28:25.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/42: chown d4/d8/c9 3601055 1 2024-03-22T07:28:25.559 INFO:tasks.workunit.client.0.smithi134.stdout:7/40: symlink d1/ld 0 2024-03-22T07:28:25.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/52: dwrite d1/d4/f9 [0,4194304] 0 2024-03-22T07:28:25.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/53: stat d1/d4/ca 0 2024-03-22T07:28:25.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/54: chown d1 2692 1 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:2/46: fsync d2/d5/fa 0 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:2/47: truncate d2/d5/fa 975895 0 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:2/48: write d2/d5/fa [231974,93156] 0 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:2/49: chown d2/d5/d8 1533 1 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:8/30: creat d1/d4/f6 x:0 0 0 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:8/31: write d1/d2/f5 [1012203,19380] 0 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:8/32: chown d1 7324711 1 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:8/33: readlink - no filename 2024-03-22T07:28:25.561 INFO:tasks.workunit.client.0.smithi134.stdout:8/34: write d1/d4/f6 [856417,58620] 0 2024-03-22T07:28:25.562 INFO:tasks.workunit.client.0.smithi134.stdout:1/42: dread d5/fe [0,4194304] 0 2024-03-22T07:28:25.562 INFO:tasks.workunit.client.0.smithi134.stdout:1/43: truncate d5/fb 278601 0 2024-03-22T07:28:25.566 INFO:tasks.workunit.client.1.smithi195.stdout:0/55: link d1/d4/ca d1/ce 0 2024-03-22T07:28:25.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/56: mkdir d1/d4/dd/df 0 2024-03-22T07:28:25.568 INFO:tasks.workunit.client.1.smithi195.stdout:0/57: write d1/d4/f8 [315834,90098] 0 2024-03-22T07:28:25.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/41: mkdir d1/de 0 2024-03-22T07:28:25.570 INFO:tasks.workunit.client.0.smithi134.stdout:2/50: creat d2/fe x:0 0 0 2024-03-22T07:28:25.571 INFO:tasks.workunit.client.0.smithi134.stdout:2/51: write d2/d5/fa [238778,89597] 0 2024-03-22T07:28:25.571 INFO:tasks.workunit.client.0.smithi134.stdout:4/30: truncate f1 587012 0 2024-03-22T07:28:25.572 INFO:tasks.workunit.client.0.smithi134.stdout:1/44: rename d5/f6 to d5/da/f12 0 2024-03-22T07:28:25.572 INFO:tasks.workunit.client.0.smithi134.stdout:1/45: chown d5 10 1 2024-03-22T07:28:25.572 INFO:tasks.workunit.client.1.smithi195.stdout:0/58: write d1/d4/f5 [7303146,29758] 0 2024-03-22T07:28:25.574 INFO:tasks.workunit.client.1.smithi195.stdout:5/37: sync 2024-03-22T07:28:25.574 INFO:tasks.workunit.client.0.smithi134.stdout:7/42: creat d1/de/ff x:0 0 0 2024-03-22T07:28:25.574 INFO:tasks.workunit.client.0.smithi134.stdout:7/43: readlink d1/ld 0 2024-03-22T07:28:25.575 INFO:tasks.workunit.client.0.smithi134.stdout:7/44: stat d1/d3/d6 0 2024-03-22T07:28:25.576 INFO:tasks.workunit.client.1.smithi195.stdout:5/38: dread f7 [0,4194304] 0 2024-03-22T07:28:25.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/52: symlink d2/d5/lf 0 2024-03-22T07:28:25.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/53: write d2/fe [537393,115066] 0 2024-03-22T07:28:25.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/54: write d2/fe [756268,116251] 0 2024-03-22T07:28:25.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/55: creat d2/d5/f10 x:0 0 0 2024-03-22T07:28:25.577 INFO:tasks.workunit.client.1.smithi195.stdout:0/59: mkdir d1/d10 0 2024-03-22T07:28:25.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/39: truncate f0 785464 0 2024-03-22T07:28:25.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/35: dwrite d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:25.579 INFO:tasks.workunit.client.0.smithi134.stdout:8/36: fdatasync d1/d2/f3 0 2024-03-22T07:28:25.581 INFO:tasks.workunit.client.1.smithi195.stdout:5/40: mknod d9/cc 0 2024-03-22T07:28:25.582 INFO:tasks.workunit.client.0.smithi134.stdout:7/45: mknod d1/de/c10 0 2024-03-22T07:28:25.582 INFO:tasks.workunit.client.0.smithi134.stdout:7/46: write d1/de/ff [304841,57509] 0 2024-03-22T07:28:25.583 INFO:tasks.workunit.client.1.smithi195.stdout:3/31: rmdir d3 39 2024-03-22T07:28:25.584 INFO:tasks.workunit.client.1.smithi195.stdout:5/41: rename l6 to d9/ld 0 2024-03-22T07:28:25.585 INFO:tasks.workunit.client.0.smithi134.stdout:2/56: rmdir d2/d5/d8 39 2024-03-22T07:28:25.588 INFO:tasks.workunit.client.1.smithi195.stdout:3/32: rename d3/d4 to d3/df 0 2024-03-22T07:28:25.590 INFO:tasks.workunit.client.0.smithi134.stdout:0/24: truncate f0 5137911 0 2024-03-22T07:28:25.590 INFO:tasks.workunit.client.0.smithi134.stdout:0/25: chown f5 1653 1 2024-03-22T07:28:25.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/42: mknod d9/ce 0 2024-03-22T07:28:25.592 INFO:tasks.workunit.client.1.smithi195.stdout:5/43: creat d9/ff x:0 0 0 2024-03-22T07:28:25.593 INFO:tasks.workunit.client.0.smithi134.stdout:8/37: unlink f0 0 2024-03-22T07:28:25.598 INFO:tasks.workunit.client.0.smithi134.stdout:7/47: mkdir d1/de/d11 0 2024-03-22T07:28:25.600 INFO:tasks.workunit.client.1.smithi195.stdout:3/33: link d3/l6 d3/l10 0 2024-03-22T07:28:25.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/60: dwrite d1/d4/f5 [8388608,4194304] 0 2024-03-22T07:28:25.601 INFO:tasks.workunit.client.1.smithi195.stdout:8/32: fsync f2 0 2024-03-22T07:28:25.601 INFO:tasks.workunit.client.1.smithi195.stdout:8/33: write f5 [860750,122787] 0 2024-03-22T07:28:25.601 INFO:tasks.workunit.client.1.smithi195.stdout:8/34: write f7 [752948,36840] 0 2024-03-22T07:28:25.602 INFO:tasks.workunit.client.1.smithi195.stdout:8/35: read f1 [429263,191] 0 2024-03-22T07:28:25.602 INFO:tasks.workunit.client.0.smithi134.stdout:8/38: symlink d1/l7 0 2024-03-22T07:28:25.602 INFO:tasks.workunit.client.0.smithi134.stdout:8/39: chown d1/d2/f3 27999 1 2024-03-22T07:28:25.603 INFO:tasks.workunit.client.0.smithi134.stdout:8/40: creat d1/d4/f8 x:0 0 0 2024-03-22T07:28:25.603 INFO:tasks.workunit.client.0.smithi134.stdout:8/41: rename d1 to d1/d9 22 2024-03-22T07:28:25.603 INFO:tasks.workunit.client.0.smithi134.stdout:8/42: truncate d1/d4/f8 520883 0 2024-03-22T07:28:25.604 INFO:tasks.workunit.client.0.smithi134.stdout:7/48: symlink d1/de/d11/l12 0 2024-03-22T07:28:25.605 INFO:tasks.workunit.client.1.smithi195.stdout:5/44: symlink d9/l10 0 2024-03-22T07:28:25.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/36: unlink l3 0 2024-03-22T07:28:25.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/34: write f0 [926058,90119] 0 2024-03-22T07:28:25.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/43: write d1/d2/f3 [1266971,81911] 0 2024-03-22T07:28:25.610 INFO:tasks.workunit.client.1.smithi195.stdout:0/61: read d1/d4/f5 [1476954,22034] 0 2024-03-22T07:28:25.610 INFO:tasks.workunit.client.1.smithi195.stdout:5/45: link f3 d9/f11 0 2024-03-22T07:28:25.611 INFO:tasks.workunit.client.0.smithi134.stdout:2/57: dwrite d2/fe [0,4194304] 0 2024-03-22T07:28:25.612 INFO:tasks.workunit.client.0.smithi134.stdout:0/26: dwrite f4 [0,4194304] 0 2024-03-22T07:28:25.613 INFO:tasks.workunit.client.0.smithi134.stdout:8/44: symlink d1/d2/la 0 2024-03-22T07:28:25.613 INFO:tasks.workunit.client.0.smithi134.stdout:8/45: stat d1/d4/f8 0 2024-03-22T07:28:25.620 INFO:tasks.workunit.client.1.smithi195.stdout:4/31: getdents . 0 2024-03-22T07:28:25.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/46: symlink d1/d2/lb 0 2024-03-22T07:28:25.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/37: rename f1 to f9 0 2024-03-22T07:28:25.627 INFO:tasks.workunit.client.1.smithi195.stdout:3/35: symlink d3/l11 0 2024-03-22T07:28:25.627 INFO:tasks.workunit.client.1.smithi195.stdout:8/38: dread f7 [0,4194304] 0 2024-03-22T07:28:25.627 INFO:tasks.workunit.client.0.smithi134.stdout:0/27: symlink l6 0 2024-03-22T07:28:25.629 INFO:tasks.workunit.client.1.smithi195.stdout:0/62: creat d1/d4/dd/df/f11 x:0 0 0 2024-03-22T07:28:25.631 INFO:tasks.workunit.client.0.smithi134.stdout:8/47: rename d1/l7 to d1/d4/lc 0 2024-03-22T07:28:25.632 INFO:tasks.workunit.client.0.smithi134.stdout:8/48: read d1/d4/f8 [260466,88611] 0 2024-03-22T07:28:25.632 INFO:tasks.workunit.client.0.smithi134.stdout:8/49: fdatasync d1/d4/f6 0 2024-03-22T07:28:25.632 INFO:tasks.workunit.client.0.smithi134.stdout:3/43: write d4/ff [4823607,78973] 0 2024-03-22T07:28:25.633 INFO:tasks.workunit.client.1.smithi195.stdout:4/32: creat fa x:0 0 0 2024-03-22T07:28:25.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/49: dwrite d1/de/ff [0,4194304] 0 2024-03-22T07:28:25.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/50: dread - d1/d3/f7 zero size 2024-03-22T07:28:25.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/51: chown d1/d3/d6/fc 4723140 1 2024-03-22T07:28:25.635 INFO:tasks.workunit.client.1.smithi195.stdout:5/46: dwrite d9/f11 [0,4194304] 0 2024-03-22T07:28:25.635 INFO:tasks.workunit.client.1.smithi195.stdout:3/36: rename d3/le to d3/l12 0 2024-03-22T07:28:25.635 INFO:tasks.workunit.client.1.smithi195.stdout:5/47: fsync f5 0 2024-03-22T07:28:25.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/37: write f0 [2590095,122621] 0 2024-03-22T07:28:25.636 INFO:tasks.workunit.client.1.smithi195.stdout:8/39: dread f2 [0,4194304] 0 2024-03-22T07:28:25.636 INFO:tasks.workunit.client.0.smithi134.stdout:8/50: rename d1/d2/f3 to d1/fd 0 2024-03-22T07:28:25.643 INFO:tasks.workunit.client.1.smithi195.stdout:6/30: truncate f0 646854 0 2024-03-22T07:28:25.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/31: truncate f1 600609 0 2024-03-22T07:28:25.646 INFO:tasks.workunit.client.0.smithi134.stdout:1/46: getdents d5/da 0 2024-03-22T07:28:25.646 INFO:tasks.workunit.client.0.smithi134.stdout:1/47: fsync f1 0 2024-03-22T07:28:25.647 INFO:tasks.workunit.client.1.smithi195.stdout:8/40: mkdir da 0 2024-03-22T07:28:25.648 INFO:tasks.workunit.client.0.smithi134.stdout:7/52: creat d1/de/d11/f13 x:0 0 0 2024-03-22T07:28:25.648 INFO:tasks.workunit.client.0.smithi134.stdout:7/53: fdatasync d1/d3/d6/fc 0 2024-03-22T07:28:25.651 INFO:tasks.workunit.client.1.smithi195.stdout:8/41: creat da/fb x:0 0 0 2024-03-22T07:28:25.651 INFO:tasks.workunit.client.1.smithi195.stdout:8/42: fdatasync f9 0 2024-03-22T07:28:25.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/33: dwrite fa [0,4194304] 0 2024-03-22T07:28:25.654 INFO:tasks.workunit.client.0.smithi134.stdout:2/58: getdents d2/d5 0 2024-03-22T07:28:25.654 INFO:tasks.workunit.client.0.smithi134.stdout:2/59: write d2/d5/f10 [678867,76549] 0 2024-03-22T07:28:25.655 INFO:tasks.workunit.client.0.smithi134.stdout:3/44: rmdir d4/d8 39 2024-03-22T07:28:25.655 INFO:tasks.workunit.client.0.smithi134.stdout:3/45: chown d4/d8/fa 5 1 2024-03-22T07:28:25.655 INFO:tasks.workunit.client.0.smithi134.stdout:3/46: readlink d4/l6 0 2024-03-22T07:28:25.658 INFO:tasks.workunit.client.0.smithi134.stdout:1/48: mkdir d5/da/d13 0 2024-03-22T07:28:25.660 INFO:tasks.workunit.client.0.smithi134.stdout:7/54: symlink d1/d3/l14 0 2024-03-22T07:28:25.661 INFO:tasks.workunit.client.1.smithi195.stdout:8/43: dread f9 [0,4194304] 0 2024-03-22T07:28:25.661 INFO:tasks.workunit.client.1.smithi195.stdout:3/38: dwrite d3/fd [0,4194304] 0 2024-03-22T07:28:25.663 INFO:tasks.workunit.client.0.smithi134.stdout:2/60: rmdir d2/d5/d8 39 2024-03-22T07:28:25.665 INFO:tasks.workunit.client.0.smithi134.stdout:1/49: mknod d5/da/d13/c14 0 2024-03-22T07:28:25.668 INFO:tasks.workunit.client.0.smithi134.stdout:7/55: truncate d1/f4 3313045 0 2024-03-22T07:28:25.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/48: getdents d9 0 2024-03-22T07:28:25.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/49: dread - f5 zero size 2024-03-22T07:28:25.671 INFO:tasks.workunit.client.1.smithi195.stdout:5/50: chown d9/ld 2692724 1 2024-03-22T07:28:25.672 INFO:tasks.workunit.client.1.smithi195.stdout:8/44: mkdir da/dc 0 2024-03-22T07:28:25.673 INFO:tasks.workunit.client.0.smithi134.stdout:1/50: symlink d5/da/d13/l15 0 2024-03-22T07:28:25.674 INFO:tasks.workunit.client.1.smithi195.stdout:3/39: creat d3/f13 x:0 0 0 2024-03-22T07:28:25.674 INFO:tasks.workunit.client.1.smithi195.stdout:3/40: write d3/f13 [729773,125330] 0 2024-03-22T07:28:25.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/34: symlink lb 0 2024-03-22T07:28:25.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/35: chown c1 145045 1 2024-03-22T07:28:25.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/36: readlink l2 0 2024-03-22T07:28:25.677 INFO:tasks.workunit.client.0.smithi134.stdout:1/51: unlink d5/da/d13/l15 0 2024-03-22T07:28:25.678 INFO:tasks.workunit.client.1.smithi195.stdout:5/51: mkdir d9/d12 0 2024-03-22T07:28:25.679 INFO:tasks.workunit.client.1.smithi195.stdout:0/63: truncate d1/d4/f8 15981 0 2024-03-22T07:28:25.680 INFO:tasks.workunit.client.1.smithi195.stdout:3/41: dread d3/f13 [0,4194304] 0 2024-03-22T07:28:25.680 INFO:tasks.workunit.client.1.smithi195.stdout:3/42: readlink d3/l10 0 2024-03-22T07:28:25.681 INFO:tasks.workunit.client.0.smithi134.stdout:1/52: mknod d5/da/d13/c16 0 2024-03-22T07:28:25.681 INFO:tasks.workunit.client.1.smithi195.stdout:5/52: write d9/fb [442026,98514] 0 2024-03-22T07:28:25.683 INFO:tasks.workunit.client.1.smithi195.stdout:0/64: unlink d1/d4/f9 0 2024-03-22T07:28:25.684 INFO:tasks.workunit.client.1.smithi195.stdout:0/65: readlink d1/l2 0 2024-03-22T07:28:25.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/37: rename lb to lc 0 2024-03-22T07:28:25.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/66: rmdir d1/d4/dd 39 2024-03-22T07:28:25.691 INFO:tasks.workunit.client.1.smithi195.stdout:5/53: symlink d9/l13 0 2024-03-22T07:28:25.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/67: mkdir d1/d4/d12 0 2024-03-22T07:28:25.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/54: mkdir d9/d12/d14 0 2024-03-22T07:28:25.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/55: truncate f5 84712 0 2024-03-22T07:28:25.695 INFO:tasks.workunit.client.1.smithi195.stdout:5/56: write f0 [1567700,102168] 0 2024-03-22T07:28:25.697 INFO:tasks.workunit.client.1.smithi195.stdout:4/38: write fa [793321,21705] 0 2024-03-22T07:28:25.697 INFO:tasks.workunit.client.1.smithi195.stdout:5/57: creat d9/f15 x:0 0 0 2024-03-22T07:28:25.701 INFO:tasks.workunit.client.1.smithi195.stdout:3/43: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:25.702 INFO:tasks.workunit.client.0.smithi134.stdout:8/51: rename d1/fd to d1/d2/fe 0 2024-03-22T07:28:25.702 INFO:tasks.workunit.client.0.smithi134.stdout:8/52: readlink d1/d2/la 0 2024-03-22T07:28:25.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/53: dwrite d5/da/f12 [0,4194304] 0 2024-03-22T07:28:25.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/54: creat d5/f17 x:0 0 0 2024-03-22T07:28:25.704 INFO:tasks.workunit.client.1.smithi195.stdout:4/39: link l7 ld 0 2024-03-22T07:28:25.704 INFO:tasks.workunit.client.1.smithi195.stdout:5/58: fsync d9/fb 0 2024-03-22T07:28:25.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/32: rename d2/c3 to d2/d7/cb 0 2024-03-22T07:28:25.707 INFO:tasks.workunit.client.0.smithi134.stdout:8/53: unlink d1/d2/la 0 2024-03-22T07:28:25.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/59: creat d9/f16 x:0 0 0 2024-03-22T07:28:25.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/60: chown c2 41 1 2024-03-22T07:28:25.711 INFO:tasks.workunit.client.0.smithi134.stdout:1/55: write f4 [1107555,118277] 0 2024-03-22T07:28:25.712 INFO:tasks.workunit.client.0.smithi134.stdout:1/56: stat d5/da/d13 0 2024-03-22T07:28:25.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/47: rename d4/f5 to d4/d10/f11 0 2024-03-22T07:28:25.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/48: fdatasync d4/d10/f11 0 2024-03-22T07:28:25.713 INFO:tasks.workunit.client.1.smithi195.stdout:5/61: creat d9/d12/d14/f17 x:0 0 0 2024-03-22T07:28:25.713 INFO:tasks.workunit.client.1.smithi195.stdout:5/62: fsync d9/fb 0 2024-03-22T07:28:25.713 INFO:tasks.workunit.client.1.smithi195.stdout:5/63: dread - d9/f16 zero size 2024-03-22T07:28:25.714 INFO:tasks.workunit.client.0.smithi134.stdout:8/54: mknod d1/d2/cf 0 2024-03-22T07:28:25.714 INFO:tasks.workunit.client.0.smithi134.stdout:8/55: chown d1/d4/f6 475033059 1 2024-03-22T07:28:25.715 INFO:tasks.workunit.client.1.smithi195.stdout:5/64: symlink d9/d12/l18 0 2024-03-22T07:28:25.717 INFO:tasks.workunit.client.0.smithi134.stdout:1/57: rename d5/f11 to d5/f18 0 2024-03-22T07:28:25.717 INFO:tasks.workunit.client.0.smithi134.stdout:1/58: chown d5/fb 13 1 2024-03-22T07:28:25.717 INFO:tasks.workunit.client.1.smithi195.stdout:5/65: fdatasync d9/ff 0 2024-03-22T07:28:25.717 INFO:tasks.workunit.client.1.smithi195.stdout:5/66: truncate d9/f16 715532 0 2024-03-22T07:28:25.719 INFO:tasks.workunit.client.0.smithi134.stdout:7/56: rename d1/de/d11/l12 to d1/l15 0 2024-03-22T07:28:25.719 INFO:tasks.workunit.client.0.smithi134.stdout:7/57: creat d1/de/d11/f16 x:0 0 0 2024-03-22T07:28:25.719 INFO:tasks.workunit.client.0.smithi134.stdout:7/58: stat d1/f2 0 2024-03-22T07:28:25.719 INFO:tasks.workunit.client.0.smithi134.stdout:7/59: creat d1/f17 x:0 0 0 2024-03-22T07:28:25.719 INFO:tasks.workunit.client.0.smithi134.stdout:7/60: chown d1/f4 0 1 2024-03-22T07:28:25.719 INFO:tasks.workunit.client.1.smithi195.stdout:5/67: readlink d9/la 0 2024-03-22T07:28:25.720 INFO:tasks.workunit.client.1.smithi195.stdout:3/44: write d3/fd [4943612,119810] 0 2024-03-22T07:28:25.720 INFO:tasks.workunit.client.1.smithi195.stdout:3/45: chown d3/cc 59019285 1 2024-03-22T07:28:25.720 INFO:tasks.workunit.client.1.smithi195.stdout:3/46: creat d3/f14 x:0 0 0 2024-03-22T07:28:25.721 INFO:tasks.workunit.client.0.smithi134.stdout:8/56: symlink d1/d2/l10 0 2024-03-22T07:28:25.721 INFO:tasks.workunit.client.0.smithi134.stdout:8/57: read d1/d2/fe [1190249,76106] 0 2024-03-22T07:28:25.721 INFO:tasks.workunit.client.0.smithi134.stdout:7/61: write f0 [2427572,113813] 0 2024-03-22T07:28:25.721 INFO:tasks.workunit.client.0.smithi134.stdout:7/62: readlink d1/l15 0 2024-03-22T07:28:25.723 INFO:tasks.workunit.client.0.smithi134.stdout:1/59: mkdir d5/da/d13/d19 0 2024-03-22T07:28:25.726 INFO:tasks.workunit.client.0.smithi134.stdout:2/61: rename d2/d5/d8/c9 to d2/c11 0 2024-03-22T07:28:25.736 INFO:tasks.workunit.client.0.smithi134.stdout:8/58: mkdir d1/d11 0 2024-03-22T07:28:25.738 INFO:tasks.workunit.client.1.smithi195.stdout:0/68: dread d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:25.739 INFO:tasks.workunit.client.1.smithi195.stdout:3/47: mkdir d3/df/d15 0 2024-03-22T07:28:25.741 INFO:tasks.workunit.client.0.smithi134.stdout:8/59: mkdir d1/d11/d12 0 2024-03-22T07:28:25.741 INFO:tasks.workunit.client.0.smithi134.stdout:8/60: write d1/d2/f5 [1686530,89437] 0 2024-03-22T07:28:25.741 INFO:tasks.workunit.client.0.smithi134.stdout:8/61: getdents d1/d11/d12 0 2024-03-22T07:28:25.742 INFO:tasks.workunit.client.1.smithi195.stdout:3/48: creat d3/df/d15/f16 x:0 0 0 2024-03-22T07:28:25.742 INFO:tasks.workunit.client.1.smithi195.stdout:3/49: stat d3/fd 0 2024-03-22T07:28:25.743 INFO:tasks.workunit.client.0.smithi134.stdout:2/62: rename d2/d5/cb to d2/d5/d8/c12 0 2024-03-22T07:28:25.745 INFO:tasks.workunit.client.0.smithi134.stdout:8/62: mknod d1/d11/c13 0 2024-03-22T07:28:25.747 INFO:tasks.workunit.client.1.smithi195.stdout:3/50: unlink d3/l8 0 2024-03-22T07:28:25.749 INFO:tasks.workunit.client.0.smithi134.stdout:3/49: rename d4/ff to d4/d8/f12 0 2024-03-22T07:28:25.750 INFO:tasks.workunit.client.1.smithi195.stdout:5/68: dwrite f7 [0,4194304] 0 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/63: dwrite d1/f17 [0,4194304] 0 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/64: creat d1/de/f18 x:0 0 0 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/65: chown d1/d3/d6/fc 51384 1 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/66: read d1/f2 [1830482,44065] 0 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/67: truncate d1/de/f18 920199 0 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/68: fdatasync d1/de/ff 0 2024-03-22T07:28:25.751 INFO:tasks.workunit.client.0.smithi134.stdout:7/69: chown d1/f17 338525010 1 2024-03-22T07:28:25.752 INFO:tasks.workunit.client.0.smithi134.stdout:7/70: write d1/de/f18 [1477997,73429] 0 2024-03-22T07:28:25.752 INFO:tasks.workunit.client.0.smithi134.stdout:7/71: chown d1/d3/d6/fc 4597006 1 2024-03-22T07:28:25.752 INFO:tasks.workunit.client.0.smithi134.stdout:1/60: dwrite d5/da/f12 [0,4194304] 0 2024-03-22T07:28:25.752 INFO:tasks.workunit.client.1.smithi195.stdout:3/51: symlink d3/df/d15/l17 0 2024-03-22T07:28:25.752 INFO:tasks.workunit.client.1.smithi195.stdout:3/52: readlink d3/l10 0 2024-03-22T07:28:25.753 INFO:tasks.workunit.client.0.smithi134.stdout:3/50: creat d4/d8/f13 x:0 0 0 2024-03-22T07:28:25.755 INFO:tasks.workunit.client.0.smithi134.stdout:4/33: getdents d2 0 2024-03-22T07:28:25.755 INFO:tasks.workunit.client.0.smithi134.stdout:4/34: getdents d2 0 2024-03-22T07:28:25.759 INFO:tasks.workunit.client.1.smithi195.stdout:0/69: read d1/d4/f5 [11124719,129619] 0 2024-03-22T07:28:25.759 INFO:tasks.workunit.client.1.smithi195.stdout:0/70: write d1/d4/dd/df/f11 [823984,99652] 0 2024-03-22T07:28:25.760 INFO:tasks.workunit.client.1.smithi195.stdout:0/71: read d1/d4/f7 [162825,43352] 0 2024-03-22T07:28:25.765 INFO:tasks.workunit.client.1.smithi195.stdout:0/72: creat d1/d4/dd/f13 x:0 0 0 2024-03-22T07:28:25.766 INFO:tasks.workunit.client.1.smithi195.stdout:0/73: truncate d1/d4/f8 434387 0 2024-03-22T07:28:25.766 INFO:tasks.workunit.client.1.smithi195.stdout:0/74: dread - d1/d4/dd/f13 zero size 2024-03-22T07:28:25.766 INFO:tasks.workunit.client.0.smithi134.stdout:7/72: mkdir d1/d19 0 2024-03-22T07:28:25.766 INFO:tasks.workunit.client.0.smithi134.stdout:7/73: stat d1/f2 0 2024-03-22T07:28:25.768 INFO:tasks.workunit.client.0.smithi134.stdout:8/63: dwrite d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:25.773 INFO:tasks.workunit.client.0.smithi134.stdout:4/35: creat d2/fc x:0 0 0 2024-03-22T07:28:25.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/51: dread d4/fd [0,4194304] 0 2024-03-22T07:28:25.776 INFO:tasks.workunit.client.0.smithi134.stdout:7/74: creat d1/d19/f1a x:0 0 0 2024-03-22T07:28:25.776 INFO:tasks.workunit.client.1.smithi195.stdout:2/25: sync 2024-03-22T07:28:25.776 INFO:tasks.workunit.client.1.smithi195.stdout:1/54: sync 2024-03-22T07:28:25.778 INFO:tasks.workunit.client.1.smithi195.stdout:2/26: dread f1 [0,4194304] 0 2024-03-22T07:28:25.778 INFO:tasks.workunit.client.1.smithi195.stdout:2/27: fsync f1 0 2024-03-22T07:28:25.783 INFO:tasks.workunit.client.1.smithi195.stdout:1/55: symlink d0/d2/d9/l17 0 2024-03-22T07:28:25.785 INFO:tasks.workunit.client.1.smithi195.stdout:2/28: symlink d2/d3/l6 0 2024-03-22T07:28:25.786 INFO:tasks.workunit.client.0.smithi134.stdout:3/52: dread d4/d8/f12 [0,4194304] 0 2024-03-22T07:28:25.786 INFO:tasks.workunit.client.0.smithi134.stdout:7/75: mknod d1/c1b 0 2024-03-22T07:28:25.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/76: chown d1/f2 169353377 1 2024-03-22T07:28:25.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/77: dread - d1/d3/d6/fc zero size 2024-03-22T07:28:25.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/78: dread - d1/de/d11/f13 zero size 2024-03-22T07:28:25.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/79: creat d1/de/f1c x:0 0 0 2024-03-22T07:28:25.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/29: mkdir d2/d3/d7 0 2024-03-22T07:28:25.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/30: dread - d2/d3/f5 zero size 2024-03-22T07:28:25.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/53: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:25.790 INFO:tasks.workunit.client.1.smithi195.stdout:5/69: dwrite f8 [0,4194304] 0 2024-03-22T07:28:25.791 INFO:tasks.workunit.client.0.smithi134.stdout:1/61: dwrite d5/f18 [0,4194304] 0 2024-03-22T07:28:25.791 INFO:tasks.workunit.client.1.smithi195.stdout:2/31: mknod d2/d3/c8 0 2024-03-22T07:28:25.792 INFO:tasks.workunit.client.1.smithi195.stdout:2/32: readlink d2/l4 0 2024-03-22T07:28:25.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/53: creat d4/d10/f14 x:0 0 0 2024-03-22T07:28:25.796 INFO:tasks.workunit.client.1.smithi195.stdout:3/54: mkdir d3/d18 0 2024-03-22T07:28:25.802 INFO:tasks.workunit.client.0.smithi134.stdout:7/80: dwrite d1/d3/f7 [0,4194304] 0 2024-03-22T07:28:25.803 INFO:tasks.workunit.client.0.smithi134.stdout:1/62: mknod d5/c1a 0 2024-03-22T07:28:25.803 INFO:tasks.workunit.client.0.smithi134.stdout:1/63: stat d5/fb 0 2024-03-22T07:28:25.807 INFO:tasks.workunit.client.1.smithi195.stdout:5/70: link f3 d9/d12/d14/f19 0 2024-03-22T07:28:25.809 INFO:tasks.workunit.client.1.smithi195.stdout:2/33: creat d2/f9 x:0 0 0 2024-03-22T07:28:25.812 INFO:tasks.workunit.client.1.smithi195.stdout:3/55: link d3/df/l7 d3/d18/l19 0 2024-03-22T07:28:25.813 INFO:tasks.workunit.client.0.smithi134.stdout:7/81: mknod d1/d19/c1d 0 2024-03-22T07:28:25.813 INFO:tasks.workunit.client.0.smithi134.stdout:7/82: stat d1/d3/c5 0 2024-03-22T07:28:25.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/83: chown d1/d3/d6 0 1 2024-03-22T07:28:25.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/84: write d1/f4 [1577930,90403] 0 2024-03-22T07:28:25.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/85: write d1/de/f1c [249732,108191] 0 2024-03-22T07:28:25.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/86: dread - d1/de/d11/f13 zero size 2024-03-22T07:28:25.814 INFO:tasks.workunit.client.0.smithi134.stdout:7/87: chown d1/d3/c5 50571 1 2024-03-22T07:28:25.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/36: rmdir d2 39 2024-03-22T07:28:25.817 INFO:tasks.workunit.client.1.smithi195.stdout:5/71: rename d9/d12/d14/f19 to d9/d12/f1a 0 2024-03-22T07:28:25.817 INFO:tasks.workunit.client.1.smithi195.stdout:5/72: truncate d9/f15 286609 0 2024-03-22T07:28:25.817 INFO:tasks.workunit.client.1.smithi195.stdout:5/73: chown f8 25439754 1 2024-03-22T07:28:25.818 INFO:tasks.workunit.client.1.smithi195.stdout:2/34: mkdir d2/d3/d7/da 0 2024-03-22T07:28:25.818 INFO:tasks.workunit.client.1.smithi195.stdout:2/35: stat d2/d3/f5 0 2024-03-22T07:28:25.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/37: chown d2/d7/f9 7584981 1 2024-03-22T07:28:25.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/38: write f1 [725669,122908] 0 2024-03-22T07:28:25.821 INFO:tasks.workunit.client.1.smithi195.stdout:5/74: mknod d9/d12/d14/c1b 0 2024-03-22T07:28:25.822 INFO:tasks.workunit.client.1.smithi195.stdout:5/75: fdatasync f7 0 2024-03-22T07:28:25.823 INFO:tasks.workunit.client.0.smithi134.stdout:1/64: mkdir d5/da/d1b 0 2024-03-22T07:28:25.823 INFO:tasks.workunit.client.0.smithi134.stdout:1/65: write d5/f9 [898327,99065] 0 2024-03-22T07:28:25.823 INFO:tasks.workunit.client.0.smithi134.stdout:1/66: read d5/fc [2129678,87202] 0 2024-03-22T07:28:25.823 INFO:tasks.workunit.client.0.smithi134.stdout:1/67: read d5/fb [70686,126537] 0 2024-03-22T07:28:25.825 INFO:tasks.workunit.client.0.smithi134.stdout:4/39: creat d2/fd x:0 0 0 2024-03-22T07:28:25.826 INFO:tasks.workunit.client.1.smithi195.stdout:5/76: creat d9/f1c x:0 0 0 2024-03-22T07:28:25.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/77: mkdir d9/d12/d1d 0 2024-03-22T07:28:25.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/88: dwrite d1/d3/d6/fc [0,4194304] 0 2024-03-22T07:28:25.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/89: chown d1/d3/d6 506459911 1 2024-03-22T07:28:25.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/90: creat d1/d3/d6/f1e x:0 0 0 2024-03-22T07:28:25.829 INFO:tasks.workunit.client.0.smithi134.stdout:7/91: chown d1/c1b 0 1 2024-03-22T07:28:25.830 INFO:tasks.workunit.client.0.smithi134.stdout:1/68: dread f4 [0,4194304] 0 2024-03-22T07:28:25.831 INFO:tasks.workunit.client.0.smithi134.stdout:1/69: dread d5/fb [0,4194304] 0 2024-03-22T07:28:25.832 INFO:tasks.workunit.client.0.smithi134.stdout:8/64: rename d1/d2 to d1/d11/d14 0 2024-03-22T07:28:25.833 INFO:tasks.workunit.client.1.smithi195.stdout:9/85: sync 2024-03-22T07:28:25.833 INFO:tasks.workunit.client.1.smithi195.stdout:7/42: sync 2024-03-22T07:28:25.833 INFO:tasks.workunit.client.1.smithi195.stdout:7/43: fdatasync d0/fa 0 2024-03-22T07:28:25.833 INFO:tasks.workunit.client.1.smithi195.stdout:7/44: creat d0/ff x:0 0 0 2024-03-22T07:28:25.835 INFO:tasks.workunit.client.1.smithi195.stdout:2/36: dwrite d2/f9 [0,4194304] 0 2024-03-22T07:28:25.836 INFO:tasks.workunit.client.1.smithi195.stdout:2/37: truncate f1 1597648 0 2024-03-22T07:28:25.839 INFO:tasks.workunit.client.0.smithi134.stdout:7/92: mknod d1/de/d11/c1f 0 2024-03-22T07:28:25.840 INFO:tasks.workunit.client.0.smithi134.stdout:1/70: write d5/fe [3734420,65896] 0 2024-03-22T07:28:25.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/86: read f0 [2442578,83620] 0 2024-03-22T07:28:25.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/87: chown d2/d4/d23 228909 1 2024-03-22T07:28:25.845 INFO:tasks.workunit.client.0.smithi134.stdout:7/93: mknod d1/de/d11/c20 0 2024-03-22T07:28:25.848 INFO:tasks.workunit.client.1.smithi195.stdout:2/38: unlink d2/d3/l6 0 2024-03-22T07:28:25.850 INFO:tasks.workunit.client.0.smithi134.stdout:4/40: dwrite f1 [0,4194304] 0 2024-03-22T07:28:25.851 INFO:tasks.workunit.client.0.smithi134.stdout:7/94: unlink d1/de/f18 0 2024-03-22T07:28:25.851 INFO:tasks.workunit.client.0.smithi134.stdout:7/95: chown d1/f17 16119763 1 2024-03-22T07:28:25.853 INFO:tasks.workunit.client.0.smithi134.stdout:1/71: read f1 [3786597,38847] 0 2024-03-22T07:28:25.855 INFO:tasks.workunit.client.1.smithi195.stdout:2/39: mkdir d2/d3/db 0 2024-03-22T07:28:25.856 INFO:tasks.workunit.client.0.smithi134.stdout:1/72: creat d5/da/d1b/f1c x:0 0 0 2024-03-22T07:28:25.858 INFO:tasks.workunit.client.1.smithi195.stdout:2/40: mknod d2/cc 0 2024-03-22T07:28:25.858 INFO:tasks.workunit.client.1.smithi195.stdout:2/41: readlink d2/l4 0 2024-03-22T07:28:25.858 INFO:tasks.workunit.client.0.smithi134.stdout:1/73: mkdir d5/d1d 0 2024-03-22T07:28:25.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/78: dwrite d9/d12/f1a [0,4194304] 0 2024-03-22T07:28:25.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/79: read - d9/d12/d14/f17 zero size 2024-03-22T07:28:25.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/42: mkdir d2/d3/db/dd 0 2024-03-22T07:28:25.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/43: write f1 [42711,64138] 0 2024-03-22T07:28:25.860 INFO:tasks.workunit.client.1.smithi195.stdout:2/44: stat d2 0 2024-03-22T07:28:25.860 INFO:tasks.workunit.client.0.smithi134.stdout:1/74: mkdir d5/da/d13/d1e 0 2024-03-22T07:28:25.862 INFO:tasks.workunit.client.1.smithi195.stdout:5/80: link d9/f15 d9/d12/f1e 0 2024-03-22T07:28:25.863 INFO:tasks.workunit.client.1.smithi195.stdout:2/45: mkdir d2/d3/d7/da/de 0 2024-03-22T07:28:25.863 INFO:tasks.workunit.client.1.smithi195.stdout:2/46: truncate f1 1833432 0 2024-03-22T07:28:25.863 INFO:tasks.workunit.client.1.smithi195.stdout:2/47: readlink d2/l4 0 2024-03-22T07:28:25.864 INFO:tasks.workunit.client.1.smithi195.stdout:9/88: dwrite d2/d4/f12 [0,4194304] 0 2024-03-22T07:28:25.864 INFO:tasks.workunit.client.1.smithi195.stdout:9/89: dread - d2/d4/f1a zero size 2024-03-22T07:28:25.864 INFO:tasks.workunit.client.1.smithi195.stdout:7/45: dwrite d0/fa [0,4194304] 0 2024-03-22T07:28:25.864 INFO:tasks.workunit.client.1.smithi195.stdout:7/46: write d0/fc [909387,104955] 0 2024-03-22T07:28:25.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/47: write d0/fc [534735,74985] 0 2024-03-22T07:28:25.866 INFO:tasks.workunit.client.1.smithi195.stdout:9/90: dread d2/f3 [0,4194304] 0 2024-03-22T07:28:25.871 INFO:tasks.workunit.client.0.smithi134.stdout:1/75: unlink f2 0 2024-03-22T07:28:25.871 INFO:tasks.workunit.client.0.smithi134.stdout:1/76: read d5/fc [4079892,81429] 0 2024-03-22T07:28:25.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/77: dread d5/f9 [0,4194304] 0 2024-03-22T07:28:25.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/78: write f3 [843007,17793] 0 2024-03-22T07:28:25.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/79: chown d5/c1a 231 1 2024-03-22T07:28:25.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/80: readlink d5/ld 0 2024-03-22T07:28:25.880 INFO:tasks.workunit.client.0.smithi134.stdout:8/65: rename d1/d11/d14 to d1/d15 0 2024-03-22T07:28:25.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/48: write d0/d9/fd [1345655,45801] 0 2024-03-22T07:28:25.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/49: creat d0/f10 x:0 0 0 2024-03-22T07:28:25.880 INFO:tasks.workunit.client.1.smithi195.stdout:7/50: write d0/fa [4781099,68619] 0 2024-03-22T07:28:25.881 INFO:tasks.workunit.client.1.smithi195.stdout:9/91: rename d2/d4/cc to d2/d4/d6/db/d20/c24 0 2024-03-22T07:28:25.883 INFO:tasks.workunit.client.1.smithi195.stdout:9/92: mknod d2/d4/d1d/c25 0 2024-03-22T07:28:25.883 INFO:tasks.workunit.client.1.smithi195.stdout:9/93: chown d2/f3 5064960 1 2024-03-22T07:28:25.883 INFO:tasks.workunit.client.1.smithi195.stdout:9/94: truncate d2/d4/d6/db/f1f 442726 0 2024-03-22T07:28:25.883 INFO:tasks.workunit.client.1.smithi195.stdout:9/95: dread - d2/f16 zero size 2024-03-22T07:28:25.884 INFO:tasks.workunit.client.1.smithi195.stdout:9/96: link d2/d4/f12 d2/d4/d6/db/d20/f26 0 2024-03-22T07:28:25.884 INFO:tasks.workunit.client.1.smithi195.stdout:9/97: creat d2/f27 x:0 0 0 2024-03-22T07:28:25.885 INFO:tasks.workunit.client.0.smithi134.stdout:8/66: dread d1/d15/f5 [0,4194304] 0 2024-03-22T07:28:25.885 INFO:tasks.workunit.client.1.smithi195.stdout:9/98: mknod d2/d4/d6/db/c28 0 2024-03-22T07:28:25.886 INFO:tasks.workunit.client.0.smithi134.stdout:8/67: write d1/d15/fe [2342688,116922] 0 2024-03-22T07:28:25.886 INFO:tasks.workunit.client.0.smithi134.stdout:4/41: dwrite d2/fc [0,4194304] 0 2024-03-22T07:28:25.890 INFO:tasks.workunit.client.1.smithi195.stdout:2/48: dread d2/f9 [0,4194304] 0 2024-03-22T07:28:25.891 INFO:tasks.workunit.client.0.smithi134.stdout:4/42: rename d2/d7/cb to d2/d7/ce 0 2024-03-22T07:28:25.891 INFO:tasks.workunit.client.0.smithi134.stdout:4/43: write d2/fd [724255,47314] 0 2024-03-22T07:28:25.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/81: dread f3 [0,4194304] 0 2024-03-22T07:28:25.894 INFO:tasks.workunit.client.1.smithi195.stdout:2/49: creat d2/d3/db/ff x:0 0 0 2024-03-22T07:28:25.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/96: dwrite d1/f4 [4194304,4194304] 0 2024-03-22T07:28:25.895 INFO:tasks.workunit.client.0.smithi134.stdout:7/97: chown d1/f4 7473 1 2024-03-22T07:28:25.895 INFO:tasks.workunit.client.0.smithi134.stdout:4/44: creat d2/ff x:0 0 0 2024-03-22T07:28:25.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/68: rename d1/d15/cf to d1/c16 0 2024-03-22T07:28:25.899 INFO:tasks.workunit.client.1.smithi195.stdout:5/81: dwrite f3 [0,4194304] 0 2024-03-22T07:28:25.907 INFO:tasks.workunit.client.1.smithi195.stdout:5/82: rename d9/d12/f1a to d9/d12/f1f 0 2024-03-22T07:28:25.908 INFO:tasks.workunit.client.0.smithi134.stdout:7/98: dread d1/f2 [4194304,4194304] 0 2024-03-22T07:28:25.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/31: sync 2024-03-22T07:28:25.909 INFO:tasks.workunit.client.0.smithi134.stdout:8/69: fdatasync d1/d4/f8 0 2024-03-22T07:28:25.913 INFO:tasks.workunit.client.0.smithi134.stdout:4/45: rename d2/la to d2/d7/l10 0 2024-03-22T07:28:25.913 INFO:tasks.workunit.client.0.smithi134.stdout:4/46: dread - d2/ff zero size 2024-03-22T07:28:25.913 INFO:tasks.workunit.client.1.smithi195.stdout:2/50: dwrite d2/d3/db/ff [0,4194304] 0 2024-03-22T07:28:25.914 INFO:tasks.workunit.client.1.smithi195.stdout:2/51: write d2/d3/f5 [737932,87663] 0 2024-03-22T07:28:25.914 INFO:tasks.workunit.client.1.smithi195.stdout:9/99: getdents d2/d4 0 2024-03-22T07:28:25.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/100: write d2/f9 [20088,127034] 0 2024-03-22T07:28:25.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/101: write d2/d4/d6/d18/f1e [63594,81982] 0 2024-03-22T07:28:25.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/102: truncate d2/d4/f1a 327336 0 2024-03-22T07:28:25.915 INFO:tasks.workunit.client.1.smithi195.stdout:9/103: creat d2/d4/d6/d18/f29 x:0 0 0 2024-03-22T07:28:25.917 INFO:tasks.workunit.client.0.smithi134.stdout:8/70: mknod d1/d11/d12/c17 0 2024-03-22T07:28:25.918 INFO:tasks.workunit.client.0.smithi134.stdout:7/99: dread d1/f17 [0,4194304] 0 2024-03-22T07:28:25.918 INFO:tasks.workunit.client.0.smithi134.stdout:7/100: truncate d1/f17 4722213 0 2024-03-22T07:28:25.919 INFO:tasks.workunit.client.1.smithi195.stdout:5/83: write d9/d12/f1f [639086,103829] 0 2024-03-22T07:28:25.920 INFO:tasks.workunit.client.1.smithi195.stdout:5/84: dread - d9/d12/d14/f17 zero size 2024-03-22T07:28:25.920 INFO:tasks.workunit.client.1.smithi195.stdout:5/85: readlink d9/la 0 2024-03-22T07:28:25.921 INFO:tasks.workunit.client.0.smithi134.stdout:7/101: symlink d1/de/l21 0 2024-03-22T07:28:25.921 INFO:tasks.workunit.client.0.smithi134.stdout:7/102: chown d1/d3/d6/f1e 2971 1 2024-03-22T07:28:25.921 INFO:tasks.workunit.client.0.smithi134.stdout:7/103: creat d1/d3/d6/f22 x:0 0 0 2024-03-22T07:28:25.921 INFO:tasks.workunit.client.0.smithi134.stdout:7/104: read d1/f2 [297187,55871] 0 2024-03-22T07:28:25.921 INFO:tasks.workunit.client.0.smithi134.stdout:7/105: read f0 [2045035,100463] 0 2024-03-22T07:28:25.923 INFO:tasks.workunit.client.1.smithi195.stdout:7/51: dwrite d0/fc [0,4194304] 0 2024-03-22T07:28:25.923 INFO:tasks.workunit.client.1.smithi195.stdout:7/52: creat d0/f11 x:0 0 0 2024-03-22T07:28:25.923 INFO:tasks.workunit.client.1.smithi195.stdout:9/104: creat d2/d4/f2a x:0 0 0 2024-03-22T07:28:25.925 INFO:tasks.workunit.client.0.smithi134.stdout:8/71: dread d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:25.926 INFO:tasks.workunit.client.0.smithi134.stdout:4/47: read f1 [375152,33453] 0 2024-03-22T07:28:25.926 INFO:tasks.workunit.client.1.smithi195.stdout:6/32: mkdir d5 0 2024-03-22T07:28:25.929 INFO:tasks.workunit.client.1.smithi195.stdout:5/86: symlink d9/d12/l20 0 2024-03-22T07:28:25.930 INFO:tasks.workunit.client.0.smithi134.stdout:8/72: creat d1/f18 x:0 0 0 2024-03-22T07:28:25.930 INFO:tasks.workunit.client.1.smithi195.stdout:2/52: dread d2/d3/db/ff [0,4194304] 0 2024-03-22T07:28:25.931 INFO:tasks.workunit.client.1.smithi195.stdout:5/87: dread d9/fb [0,4194304] 0 2024-03-22T07:28:25.933 INFO:tasks.workunit.client.0.smithi134.stdout:4/48: rename d2/fc to d2/d7/f11 0 2024-03-22T07:28:25.936 INFO:tasks.workunit.client.0.smithi134.stdout:4/49: creat d2/d7/f12 x:0 0 0 2024-03-22T07:28:25.936 INFO:tasks.workunit.client.0.smithi134.stdout:4/50: creat d2/d7/f13 x:0 0 0 2024-03-22T07:28:25.940 INFO:tasks.workunit.client.0.smithi134.stdout:8/73: dread d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:25.942 INFO:tasks.workunit.client.1.smithi195.stdout:7/53: symlink d0/l12 0 2024-03-22T07:28:25.943 INFO:tasks.workunit.client.0.smithi134.stdout:7/106: getdents d1/de 0 2024-03-22T07:28:25.943 INFO:tasks.workunit.client.0.smithi134.stdout:7/107: creat d1/d19/f23 x:0 0 0 2024-03-22T07:28:25.945 INFO:tasks.workunit.client.1.smithi195.stdout:9/105: creat d2/d4/d6/d18/f2b x:0 0 0 2024-03-22T07:28:25.946 INFO:tasks.workunit.client.0.smithi134.stdout:8/74: creat d1/d15/f19 x:0 0 0 2024-03-22T07:28:25.946 INFO:tasks.workunit.client.0.smithi134.stdout:8/75: fdatasync d1/d15/fe 0 2024-03-22T07:28:25.947 INFO:tasks.workunit.client.1.smithi195.stdout:6/33: creat d5/f6 x:0 0 0 2024-03-22T07:28:25.949 INFO:tasks.workunit.client.1.smithi195.stdout:2/53: mknod d2/d3/db/c10 0 2024-03-22T07:28:25.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/54: dread d0/fc [0,4194304] 0 2024-03-22T07:28:25.950 INFO:tasks.workunit.client.1.smithi195.stdout:5/88: dwrite f7 [0,4194304] 0 2024-03-22T07:28:25.952 INFO:tasks.workunit.client.0.smithi134.stdout:4/51: rename d2/c6 to d2/d7/c14 0 2024-03-22T07:28:25.954 INFO:tasks.workunit.client.0.smithi134.stdout:7/108: dread d1/f4 [4194304,4194304] 0 2024-03-22T07:28:25.954 INFO:tasks.workunit.client.0.smithi134.stdout:7/109: read - d1/de/d11/f13 zero size 2024-03-22T07:28:25.955 INFO:tasks.workunit.client.1.smithi195.stdout:6/34: mknod d5/c7 0 2024-03-22T07:28:25.956 INFO:tasks.workunit.client.1.smithi195.stdout:6/35: truncate d5/f6 429288 0 2024-03-22T07:28:25.956 INFO:tasks.workunit.client.1.smithi195.stdout:6/36: write f0 [327624,79921] 0 2024-03-22T07:28:25.956 INFO:tasks.workunit.client.1.smithi195.stdout:6/37: chown f0 116 1 2024-03-22T07:28:25.956 INFO:tasks.workunit.client.0.smithi134.stdout:7/110: symlink d1/de/d11/l24 0 2024-03-22T07:28:25.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/54: symlink d2/d3/l11 0 2024-03-22T07:28:25.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/55: chown d2/f9 72562 1 2024-03-22T07:28:25.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/56: write d2/d3/db/ff [4648965,71769] 0 2024-03-22T07:28:25.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/57: write d2/f9 [4528218,23501] 0 2024-03-22T07:28:25.959 INFO:tasks.workunit.client.1.smithi195.stdout:7/55: mkdir d0/d13 0 2024-03-22T07:28:25.959 INFO:tasks.workunit.client.0.smithi134.stdout:8/76: dwrite d1/d15/f19 [0,4194304] 0 2024-03-22T07:28:25.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/45: sync 2024-03-22T07:28:25.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/46: chown f2 2 1 2024-03-22T07:28:25.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/47: fdatasync f9 0 2024-03-22T07:28:25.963 INFO:tasks.workunit.client.1.smithi195.stdout:5/89: rename d9/f15 to d9/d12/d14/f21 0 2024-03-22T07:28:25.963 INFO:tasks.workunit.client.1.smithi195.stdout:7/56: dread d0/fc [0,4194304] 0 2024-03-22T07:28:25.964 INFO:tasks.workunit.client.0.smithi134.stdout:7/111: rmdir d1/d3 39 2024-03-22T07:28:25.964 INFO:tasks.workunit.client.0.smithi134.stdout:7/112: write d1/d19/f1a [733418,69423] 0 2024-03-22T07:28:25.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/58: dread d2/d3/db/ff [0,4194304] 0 2024-03-22T07:28:25.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/59: write d2/f9 [4998691,108796] 0 2024-03-22T07:28:25.965 INFO:tasks.workunit.client.1.smithi195.stdout:6/38: link f4 d5/f8 0 2024-03-22T07:28:25.966 INFO:tasks.workunit.client.1.smithi195.stdout:8/48: mknod da/cd 0 2024-03-22T07:28:25.966 INFO:tasks.workunit.client.0.smithi134.stdout:8/77: fsync d1/d15/f19 0 2024-03-22T07:28:25.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/57: rmdir d0/d9 39 2024-03-22T07:28:25.968 INFO:tasks.workunit.client.1.smithi195.stdout:7/58: dread - d0/f11 zero size 2024-03-22T07:28:25.968 INFO:tasks.workunit.client.1.smithi195.stdout:7/59: getdents d0/d13 0 2024-03-22T07:28:25.969 INFO:tasks.workunit.client.1.smithi195.stdout:2/60: mkdir d2/d3/d7/da/d12 0 2024-03-22T07:28:25.970 INFO:tasks.workunit.client.0.smithi134.stdout:8/78: dread d1/d15/fe [0,4194304] 0 2024-03-22T07:28:25.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/39: symlink d5/l9 0 2024-03-22T07:28:25.971 INFO:tasks.workunit.client.1.smithi195.stdout:6/40: readlink d5/l9 0 2024-03-22T07:28:25.972 INFO:tasks.workunit.client.0.smithi134.stdout:4/52: getdents d2 0 2024-03-22T07:28:25.973 INFO:tasks.workunit.client.1.smithi195.stdout:8/49: mkdir da/de 0 2024-03-22T07:28:25.974 INFO:tasks.workunit.client.0.smithi134.stdout:7/113: write d1/d3/f7 [1483098,36713] 0 2024-03-22T07:28:25.974 INFO:tasks.workunit.client.0.smithi134.stdout:7/114: stat d1/d3/d6/f1e 0 2024-03-22T07:28:25.975 INFO:tasks.workunit.client.1.smithi195.stdout:9/106: rmdir d2/d4/d6/d18 39 2024-03-22T07:28:25.975 INFO:tasks.workunit.client.1.smithi195.stdout:9/107: creat d2/d4/d6/db/f2c x:0 0 0 2024-03-22T07:28:25.975 INFO:tasks.workunit.client.0.smithi134.stdout:4/53: dread f1 [0,4194304] 0 2024-03-22T07:28:25.976 INFO:tasks.workunit.client.0.smithi134.stdout:4/54: chown d2/d7/c14 200093 1 2024-03-22T07:28:25.976 INFO:tasks.workunit.client.1.smithi195.stdout:5/90: mkdir d9/d22 0 2024-03-22T07:28:25.977 INFO:tasks.workunit.client.0.smithi134.stdout:7/115: mknod d1/d19/c25 0 2024-03-22T07:28:25.980 INFO:tasks.workunit.client.1.smithi195.stdout:0/75: sync 2024-03-22T07:28:25.980 INFO:tasks.workunit.client.1.smithi195.stdout:4/40: sync 2024-03-22T07:28:25.980 INFO:tasks.workunit.client.1.smithi195.stdout:1/56: sync 2024-03-22T07:28:25.980 INFO:tasks.workunit.client.1.smithi195.stdout:1/57: write d0/d2/d6/f11 [1105958,13899] 0 2024-03-22T07:28:25.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/41: symlink d5/la 0 2024-03-22T07:28:25.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/79: rmdir d1 39 2024-03-22T07:28:25.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/80: stat d1/d11 0 2024-03-22T07:28:25.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/50: mknod da/de/cf 0 2024-03-22T07:28:25.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/51: chown f9 480219 1 2024-03-22T07:28:25.987 INFO:tasks.workunit.client.0.smithi134.stdout:7/116: link d1/d3/f7 d1/de/f26 0 2024-03-22T07:28:25.988 INFO:tasks.workunit.client.1.smithi195.stdout:9/108: creat d2/d4/f2d x:0 0 0 2024-03-22T07:28:25.988 INFO:tasks.workunit.client.1.smithi195.stdout:9/109: fdatasync d2/f16 0 2024-03-22T07:28:25.989 INFO:tasks.workunit.client.0.smithi134.stdout:8/81: creat d1/d11/d12/f1a x:0 0 0 2024-03-22T07:28:25.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/58: write d0/d2/fe [2374789,124383] 0 2024-03-22T07:28:25.989 INFO:tasks.workunit.client.1.smithi195.stdout:1/59: dread - d0/fa zero size 2024-03-22T07:28:25.990 INFO:tasks.workunit.client.1.smithi195.stdout:5/91: creat d9/d12/d1d/f23 x:0 0 0 2024-03-22T07:28:25.993 INFO:tasks.workunit.client.0.smithi134.stdout:7/117: mknod d1/c27 0 2024-03-22T07:28:25.994 INFO:tasks.workunit.client.1.smithi195.stdout:7/60: rename d0/d9 to d0/d13/d14 0 2024-03-22T07:28:25.994 INFO:tasks.workunit.client.0.smithi134.stdout:8/82: stat d1/d4/lc 0 2024-03-22T07:28:25.995 INFO:tasks.workunit.client.1.smithi195.stdout:2/61: getdents d2/d3/db 0 2024-03-22T07:28:25.996 INFO:tasks.workunit.client.0.smithi134.stdout:4/55: rename d2/d7 to d2/d15 0 2024-03-22T07:28:25.996 INFO:tasks.workunit.client.1.smithi195.stdout:4/41: creat fe x:0 0 0 2024-03-22T07:28:25.996 INFO:tasks.workunit.client.1.smithi195.stdout:4/42: read - fe zero size 2024-03-22T07:28:25.997 INFO:tasks.workunit.client.0.smithi134.stdout:4/56: mknod d2/c16 0 2024-03-22T07:28:25.999 INFO:tasks.workunit.client.0.smithi134.stdout:8/83: symlink d1/d15/l1b 0 2024-03-22T07:28:25.999 INFO:tasks.workunit.client.0.smithi134.stdout:8/84: dread - d1/d11/d12/f1a zero size 2024-03-22T07:28:25.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/76: dwrite d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:26.001 INFO:tasks.workunit.client.1.smithi195.stdout:8/52: link f2 da/de/f10 0 2024-03-22T07:28:26.001 INFO:tasks.workunit.client.0.smithi134.stdout:4/57: rmdir d2 39 2024-03-22T07:28:26.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/58: chown d2/ff 137190455 1 2024-03-22T07:28:26.003 INFO:tasks.workunit.client.0.smithi134.stdout:7/118: dread d1/de/ff [0,4194304] 0 2024-03-22T07:28:26.004 INFO:tasks.workunit.client.0.smithi134.stdout:4/59: rmdir d2 39 2024-03-22T07:28:26.005 INFO:tasks.workunit.client.1.smithi195.stdout:5/92: mknod d9/d12/d1d/c24 0 2024-03-22T07:28:26.005 INFO:tasks.workunit.client.1.smithi195.stdout:5/93: truncate f5 559451 0 2024-03-22T07:28:26.006 INFO:tasks.workunit.client.0.smithi134.stdout:8/85: write d1/d15/f5 [1554838,110901] 0 2024-03-22T07:28:26.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/110: rename d2/d4/d6/db/d20/c24 to d2/c2e 0 2024-03-22T07:28:26.008 INFO:tasks.workunit.client.1.smithi195.stdout:9/111: readlink d2/d4/d6/l19 0 2024-03-22T07:28:26.010 INFO:tasks.workunit.client.0.smithi134.stdout:4/60: truncate d2/fd 494834 0 2024-03-22T07:28:26.011 INFO:tasks.workunit.client.1.smithi195.stdout:7/61: rmdir d0/d13/d14 39 2024-03-22T07:28:26.016 INFO:tasks.workunit.client.1.smithi195.stdout:6/42: getdents d5 0 2024-03-22T07:28:26.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/86: rename d1/d4/f8 to d1/d15/f1c 0 2024-03-22T07:28:26.019 INFO:tasks.workunit.client.0.smithi134.stdout:8/87: chown d1/d4 4233041 1 2024-03-22T07:28:26.019 INFO:tasks.workunit.client.0.smithi134.stdout:8/88: dread - d1/f18 zero size 2024-03-22T07:28:26.024 INFO:tasks.workunit.client.1.smithi195.stdout:0/77: creat d1/d10/f14 x:0 0 0 2024-03-22T07:28:26.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/53: symlink da/de/l11 0 2024-03-22T07:28:26.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/54: chown da/de/f10 23539224 1 2024-03-22T07:28:26.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/55: chown da/de/l11 463 1 2024-03-22T07:28:26.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/56: truncate da/fb 545999 0 2024-03-22T07:28:26.026 INFO:tasks.workunit.client.1.smithi195.stdout:6/43: dread f0 [0,4194304] 0 2024-03-22T07:28:26.028 INFO:tasks.workunit.client.1.smithi195.stdout:5/94: dwrite d9/d12/d14/f21 [0,4194304] 0 2024-03-22T07:28:26.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/60: rmdir d0/d2/d9 39 2024-03-22T07:28:26.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/61: truncate d0/d2/d6/f11 1449335 0 2024-03-22T07:28:26.029 INFO:tasks.workunit.client.0.smithi134.stdout:8/89: rename d1/d15/l10 to d1/d15/l1d 0 2024-03-22T07:28:26.029 INFO:tasks.workunit.client.1.smithi195.stdout:2/62: dwrite d2/d3/f5 [0,4194304] 0 2024-03-22T07:28:26.029 INFO:tasks.workunit.client.1.smithi195.stdout:2/63: getdents d2/d3/d7/da/de 0 2024-03-22T07:28:26.029 INFO:tasks.workunit.client.1.smithi195.stdout:9/112: mknod d2/d4/d6/d18/c2f 0 2024-03-22T07:28:26.029 INFO:tasks.workunit.client.1.smithi195.stdout:9/113: creat d2/d4/d6/db/f30 x:0 0 0 2024-03-22T07:28:26.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/43: rename l2 to lf 0 2024-03-22T07:28:26.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/44: chown c5 6627263 1 2024-03-22T07:28:26.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/45: write fa [549001,86735] 0 2024-03-22T07:28:26.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/90: mknod d1/d11/d12/c1e 0 2024-03-22T07:28:26.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/91: write d1/d15/f5 [2583525,65570] 0 2024-03-22T07:28:26.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/92: write d1/d15/f5 [3372070,51083] 0 2024-03-22T07:28:26.033 INFO:tasks.workunit.client.1.smithi195.stdout:8/57: unlink f5 0 2024-03-22T07:28:26.033 INFO:tasks.workunit.client.0.smithi134.stdout:8/93: chown d1/d15/lb 58386 1 2024-03-22T07:28:26.033 INFO:tasks.workunit.client.0.smithi134.stdout:8/94: readlink d1/d15/l1d 0 2024-03-22T07:28:26.035 INFO:tasks.workunit.client.1.smithi195.stdout:6/44: mkdir d5/db 0 2024-03-22T07:28:26.037 INFO:tasks.workunit.client.1.smithi195.stdout:5/95: creat d9/f25 x:0 0 0 2024-03-22T07:28:26.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/119: dwrite d1/f4 [0,4194304] 0 2024-03-22T07:28:26.038 INFO:tasks.workunit.client.0.smithi134.stdout:7/120: write d1/de/d11/f13 [626254,4863] 0 2024-03-22T07:28:26.039 INFO:tasks.workunit.client.1.smithi195.stdout:1/62: unlink d0/cb 0 2024-03-22T07:28:26.041 INFO:tasks.workunit.client.0.smithi134.stdout:4/61: dwrite d2/ff [0,4194304] 0 2024-03-22T07:28:26.041 INFO:tasks.workunit.client.0.smithi134.stdout:4/62: read - d2/d15/f13 zero size 2024-03-22T07:28:26.047 INFO:tasks.workunit.client.0.smithi134.stdout:8/95: fdatasync d1/d15/f5 0 2024-03-22T07:28:26.047 INFO:tasks.workunit.client.1.smithi195.stdout:1/63: dread d0/d2/d6/f11 [0,4194304] 0 2024-03-22T07:28:26.048 INFO:tasks.workunit.client.1.smithi195.stdout:0/78: dwrite d1/d10/f14 [0,4194304] 0 2024-03-22T07:28:26.051 INFO:tasks.workunit.client.0.smithi134.stdout:8/96: dread d1/d15/f5 [0,4194304] 0 2024-03-22T07:28:26.051 INFO:tasks.workunit.client.0.smithi134.stdout:8/97: readlink d1/d4/lc 0 2024-03-22T07:28:26.051 INFO:tasks.workunit.client.0.smithi134.stdout:8/98: dread - d1/f18 zero size 2024-03-22T07:28:26.054 INFO:tasks.workunit.client.0.smithi134.stdout:8/99: creat d1/d4/f1f x:0 0 0 2024-03-22T07:28:26.056 INFO:tasks.workunit.client.0.smithi134.stdout:8/100: mkdir d1/d11/d12/d20 0 2024-03-22T07:28:26.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/114: rename d2/d4/f2d to d2/d4/d6/db/d20/f31 0 2024-03-22T07:28:26.059 INFO:tasks.workunit.client.0.smithi134.stdout:7/121: dwrite d1/de/f1c [0,4194304] 0 2024-03-22T07:28:26.059 INFO:tasks.workunit.client.0.smithi134.stdout:7/122: chown d1/f4 131685428 1 2024-03-22T07:28:26.060 INFO:tasks.workunit.client.1.smithi195.stdout:6/45: mkdir d5/dc 0 2024-03-22T07:28:26.060 INFO:tasks.workunit.client.0.smithi134.stdout:4/63: dwrite d2/fd [0,4194304] 0 2024-03-22T07:28:26.061 INFO:tasks.workunit.client.0.smithi134.stdout:8/101: mkdir d1/d15/d21 0 2024-03-22T07:28:26.061 INFO:tasks.workunit.client.0.smithi134.stdout:8/102: creat d1/d4/f22 x:0 0 0 2024-03-22T07:28:26.061 INFO:tasks.workunit.client.0.smithi134.stdout:8/103: truncate d1/f18 375668 0 2024-03-22T07:28:26.062 INFO:tasks.workunit.client.1.smithi195.stdout:5/96: symlink d9/d22/l26 0 2024-03-22T07:28:26.063 INFO:tasks.workunit.client.1.smithi195.stdout:1/64: symlink d0/d2/d9/l18 0 2024-03-22T07:28:26.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/56: sync 2024-03-22T07:28:26.065 INFO:tasks.workunit.client.0.smithi134.stdout:7/123: symlink d1/l28 0 2024-03-22T07:28:26.067 INFO:tasks.workunit.client.1.smithi195.stdout:3/57: dread d3/fd [4194304,4194304] 0 2024-03-22T07:28:26.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/79: symlink d1/d4/d12/l15 0 2024-03-22T07:28:26.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/80: write d1/d4/dd/f13 [726976,49685] 0 2024-03-22T07:28:26.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/81: creat d1/d4/dd/df/f16 x:0 0 0 2024-03-22T07:28:26.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/65: dread d0/d2/fe [0,4194304] 0 2024-03-22T07:28:26.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/66: chown d0/d2/d9/f15 0 1 2024-03-22T07:28:26.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/67: write d0/f10 [138472,102224] 0 2024-03-22T07:28:26.069 INFO:tasks.workunit.client.1.smithi195.stdout:1/68: write d0/d2/f14 [128020,93318] 0 2024-03-22T07:28:26.070 INFO:tasks.workunit.client.1.smithi195.stdout:2/64: truncate d2/f9 2062703 0 2024-03-22T07:28:26.070 INFO:tasks.workunit.client.0.smithi134.stdout:4/64: getdents d2 0 2024-03-22T07:28:26.070 INFO:tasks.workunit.client.1.smithi195.stdout:3/58: dread d3/f13 [0,4194304] 0 2024-03-22T07:28:26.072 INFO:tasks.workunit.client.1.smithi195.stdout:8/58: rename da/de/f10 to da/dc/f12 0 2024-03-22T07:28:26.073 INFO:tasks.workunit.client.1.smithi195.stdout:3/59: rename d3 to d3/df/d1a 22 2024-03-22T07:28:26.078 INFO:tasks.workunit.client.1.smithi195.stdout:2/65: write d2/d3/f5 [718022,17420] 0 2024-03-22T07:28:26.078 INFO:tasks.workunit.client.1.smithi195.stdout:4/46: mknod c10 0 2024-03-22T07:28:26.079 INFO:tasks.workunit.client.0.smithi134.stdout:7/124: link d1/f2 d1/d3/d6/f29 0 2024-03-22T07:28:26.081 INFO:tasks.workunit.client.1.smithi195.stdout:6/46: creat d5/dc/fd x:0 0 0 2024-03-22T07:28:26.082 INFO:tasks.workunit.client.0.smithi134.stdout:4/65: stat d2/d15/l10 0 2024-03-22T07:28:26.083 INFO:tasks.workunit.client.0.smithi134.stdout:4/66: write f1 [783128,8819] 0 2024-03-22T07:28:26.083 INFO:tasks.workunit.client.0.smithi134.stdout:4/67: chown d2/fd 1 1 2024-03-22T07:28:26.083 INFO:tasks.workunit.client.0.smithi134.stdout:4/68: write d2/d15/f12 [944072,129136] 0 2024-03-22T07:28:26.084 INFO:tasks.workunit.client.1.smithi195.stdout:5/97: symlink d9/d12/l27 0 2024-03-22T07:28:26.087 INFO:tasks.workunit.client.0.smithi134.stdout:8/104: rename d1/d4/f1f to d1/d15/d21/f23 0 2024-03-22T07:28:26.089 INFO:tasks.workunit.client.1.smithi195.stdout:0/82: link d1/d4/ca d1/d4/dd/df/c17 0 2024-03-22T07:28:26.090 INFO:tasks.workunit.client.1.smithi195.stdout:3/60: dwrite d3/f13 [0,4194304] 0 2024-03-22T07:28:26.091 INFO:tasks.workunit.client.0.smithi134.stdout:7/125: unlink d1/d19/c25 0 2024-03-22T07:28:26.092 INFO:tasks.workunit.client.1.smithi195.stdout:1/69: truncate d0/d2/d6/f11 965088 0 2024-03-22T07:28:26.093 INFO:tasks.workunit.client.0.smithi134.stdout:8/105: creat d1/f24 x:0 0 0 2024-03-22T07:28:26.093 INFO:tasks.workunit.client.0.smithi134.stdout:8/106: chown d1/d15/l1b 295031 1 2024-03-22T07:28:26.093 INFO:tasks.workunit.client.0.smithi134.stdout:7/126: getdents d1/d3 0 2024-03-22T07:28:26.094 INFO:tasks.workunit.client.1.smithi195.stdout:8/59: unlink da/cd 0 2024-03-22T07:28:26.095 INFO:tasks.workunit.client.1.smithi195.stdout:8/60: write da/fb [344724,62538] 0 2024-03-22T07:28:26.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/107: mkdir d1/d11/d25 0 2024-03-22T07:28:26.096 INFO:tasks.workunit.client.1.smithi195.stdout:9/115: mkdir d2/d4/d32 0 2024-03-22T07:28:26.096 INFO:tasks.workunit.client.1.smithi195.stdout:9/116: write f0 [515902,34578] 0 2024-03-22T07:28:26.098 INFO:tasks.workunit.client.1.smithi195.stdout:2/66: rename d2/d3/db/ff to d2/d3/d7/f13 0 2024-03-22T07:28:26.099 INFO:tasks.workunit.client.1.smithi195.stdout:0/83: dread d1/d10/f14 [0,4194304] 0 2024-03-22T07:28:26.100 INFO:tasks.workunit.client.0.smithi134.stdout:4/69: dwrite d2/d15/f12 [0,4194304] 0 2024-03-22T07:28:26.100 INFO:tasks.workunit.client.0.smithi134.stdout:4/70: readlink d2/d15/l10 0 2024-03-22T07:28:26.101 INFO:tasks.workunit.client.1.smithi195.stdout:6/47: symlink d5/le 0 2024-03-22T07:28:26.102 INFO:tasks.workunit.client.0.smithi134.stdout:8/108: rename d1/d11/d12/c17 to d1/d15/c26 0 2024-03-22T07:28:26.103 INFO:tasks.workunit.client.1.smithi195.stdout:5/98: creat d9/f28 x:0 0 0 2024-03-22T07:28:26.104 INFO:tasks.workunit.client.1.smithi195.stdout:9/117: dread f1 [0,4194304] 0 2024-03-22T07:28:26.105 INFO:tasks.workunit.client.0.smithi134.stdout:4/71: mkdir d2/d15/d17 0 2024-03-22T07:28:26.106 INFO:tasks.workunit.client.0.smithi134.stdout:4/72: read f1 [4024026,12957] 0 2024-03-22T07:28:26.107 INFO:tasks.workunit.client.1.smithi195.stdout:0/84: dread d1/d4/f5 [8388608,4194304] 0 2024-03-22T07:28:26.108 INFO:tasks.workunit.client.0.smithi134.stdout:8/109: creat d1/d15/f27 x:0 0 0 2024-03-22T07:28:26.110 INFO:tasks.workunit.client.1.smithi195.stdout:3/61: unlink d3/l12 0 2024-03-22T07:28:26.111 INFO:tasks.workunit.client.1.smithi195.stdout:1/70: creat d0/d2/d9/f19 x:0 0 0 2024-03-22T07:28:26.113 INFO:tasks.workunit.client.0.smithi134.stdout:8/110: creat d1/d11/f28 x:0 0 0 2024-03-22T07:28:26.116 INFO:tasks.workunit.client.1.smithi195.stdout:8/61: dwrite da/fb [0,4194304] 0 2024-03-22T07:28:26.116 INFO:tasks.workunit.client.1.smithi195.stdout:2/67: truncate d2/f9 863880 0 2024-03-22T07:28:26.117 INFO:tasks.workunit.client.1.smithi195.stdout:8/62: chown da/fb 1729893 1 2024-03-22T07:28:26.117 INFO:tasks.workunit.client.0.smithi134.stdout:8/111: mknod d1/d4/c29 0 2024-03-22T07:28:26.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/47: link f3 f11 0 2024-03-22T07:28:26.121 INFO:tasks.workunit.client.1.smithi195.stdout:6/48: symlink d5/db/lf 0 2024-03-22T07:28:26.122 INFO:tasks.workunit.client.0.smithi134.stdout:4/73: dread d2/d15/f11 [0,4194304] 0 2024-03-22T07:28:26.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/112: rename d1/d15/d21 to d1/d11/d12/d2a 0 2024-03-22T07:28:26.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/113: truncate d1/f18 1279899 0 2024-03-22T07:28:26.122 INFO:tasks.workunit.client.0.smithi134.stdout:8/114: creat d1/d11/f2b x:0 0 0 2024-03-22T07:28:26.127 INFO:tasks.workunit.client.1.smithi195.stdout:0/85: rename d1/d4/f5 to d1/d4/f18 0 2024-03-22T07:28:26.127 INFO:tasks.workunit.client.1.smithi195.stdout:0/86: write d1/d4/f7 [710023,130283] 0 2024-03-22T07:28:26.128 INFO:tasks.workunit.client.0.smithi134.stdout:7/127: dwrite d1/de/d11/f13 [0,4194304] 0 2024-03-22T07:28:26.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/115: creat d1/d15/f2c x:0 0 0 2024-03-22T07:28:26.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/116: stat d1/d15/fe 0 2024-03-22T07:28:26.134 INFO:tasks.workunit.client.0.smithi134.stdout:8/117: creat d1/f2d x:0 0 0 2024-03-22T07:28:26.137 INFO:tasks.workunit.client.0.smithi134.stdout:8/118: creat d1/f2e x:0 0 0 2024-03-22T07:28:26.137 INFO:tasks.workunit.client.0.smithi134.stdout:8/119: chown d1/f2d 627 1 2024-03-22T07:28:26.137 INFO:tasks.workunit.client.0.smithi134.stdout:8/120: readlink d1/d15/l1b 0 2024-03-22T07:28:26.138 INFO:tasks.workunit.client.0.smithi134.stdout:7/128: dread d1/de/ff [0,4194304] 0 2024-03-22T07:28:26.140 INFO:tasks.workunit.client.1.smithi195.stdout:8/63: dwrite f7 [0,4194304] 0 2024-03-22T07:28:26.140 INFO:tasks.workunit.client.1.smithi195.stdout:8/64: chown da/dc/f12 913 1 2024-03-22T07:28:26.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/129: unlink d1/d19/f1a 0 2024-03-22T07:28:26.143 INFO:tasks.workunit.client.0.smithi134.stdout:8/121: dread d1/d15/fe [0,4194304] 0 2024-03-22T07:28:26.144 INFO:tasks.workunit.client.1.smithi195.stdout:3/62: dwrite d3/df/d15/f16 [0,4194304] 0 2024-03-22T07:28:26.144 INFO:tasks.workunit.client.1.smithi195.stdout:3/63: truncate d3/f14 525195 0 2024-03-22T07:28:26.145 INFO:tasks.workunit.client.1.smithi195.stdout:2/68: creat d2/d3/d7/da/d12/f14 x:0 0 0 2024-03-22T07:28:26.146 INFO:tasks.workunit.client.0.smithi134.stdout:8/122: mknod d1/d11/d12/d20/c2f 0 2024-03-22T07:28:26.147 INFO:tasks.workunit.client.1.smithi195.stdout:4/48: creat f12 x:0 0 0 2024-03-22T07:28:26.147 INFO:tasks.workunit.client.1.smithi195.stdout:4/49: dread - f12 zero size 2024-03-22T07:28:26.147 INFO:tasks.workunit.client.1.smithi195.stdout:6/49: mkdir d5/db/d10 0 2024-03-22T07:28:26.149 INFO:tasks.workunit.client.1.smithi195.stdout:5/99: rename d9/d12/d14/f21 to d9/f29 0 2024-03-22T07:28:26.149 INFO:tasks.workunit.client.1.smithi195.stdout:5/100: chown d9/d12/f1e 109904 1 2024-03-22T07:28:26.149 INFO:tasks.workunit.client.1.smithi195.stdout:5/101: fsync f8 0 2024-03-22T07:28:26.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/87: mkdir d1/d10/d19 0 2024-03-22T07:28:26.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/88: chown d1/d4/dd 6 1 2024-03-22T07:28:26.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/89: write d1/d4/f7 [1146739,96313] 0 2024-03-22T07:28:26.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/90: creat d1/d4/dd/df/f1a x:0 0 0 2024-03-22T07:28:26.154 INFO:tasks.workunit.client.1.smithi195.stdout:1/71: rmdir d0 39 2024-03-22T07:28:26.155 INFO:tasks.workunit.client.1.smithi195.stdout:1/72: dread - d0/d2/d9/f15 zero size 2024-03-22T07:28:26.155 INFO:tasks.workunit.client.1.smithi195.stdout:1/73: rename d0 to d0/d1a 22 2024-03-22T07:28:26.155 INFO:tasks.workunit.client.1.smithi195.stdout:1/74: chown d0/d2/d9/f15 406137679 1 2024-03-22T07:28:26.155 INFO:tasks.workunit.client.0.smithi134.stdout:7/130: dread d1/f4 [0,4194304] 0 2024-03-22T07:28:26.157 INFO:tasks.workunit.client.1.smithi195.stdout:9/118: dwrite d2/d4/f12 [0,4194304] 0 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.1.smithi195.stdout:8/65: creat da/dc/f13 x:0 0 0 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.1.smithi195.stdout:3/64: dread d3/f13 [0,4194304] 0 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.1.smithi195.stdout:3/65: chown d3/lb 780 1 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.1.smithi195.stdout:8/66: write da/dc/f13 [187746,3092] 0 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.1.smithi195.stdout:8/67: fsync f2 0 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.0.smithi134.stdout:7/131: write d1/de/ff [736018,88260] 0 2024-03-22T07:28:26.160 INFO:tasks.workunit.client.0.smithi134.stdout:7/132: readlink d1/d3/l14 0 2024-03-22T07:28:26.164 INFO:tasks.workunit.client.1.smithi195.stdout:2/69: link d2/cc d2/d3/db/c15 0 2024-03-22T07:28:26.164 INFO:tasks.workunit.client.1.smithi195.stdout:2/70: chown d2/d3 16 1 2024-03-22T07:28:26.165 INFO:tasks.workunit.client.1.smithi195.stdout:6/50: symlink d5/l11 0 2024-03-22T07:28:26.166 INFO:tasks.workunit.client.1.smithi195.stdout:5/102: link l4 d9/d12/d14/l2a 0 2024-03-22T07:28:26.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/74: dwrite d2/d15/f13 [0,4194304] 0 2024-03-22T07:28:26.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/75: rename d2/d15 to d2/d15/d17/d18 22 2024-03-22T07:28:26.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/76: write f1 [2127758,65852] 0 2024-03-22T07:28:26.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/77: getdents d2/d15/d17 0 2024-03-22T07:28:26.168 INFO:tasks.workunit.client.0.smithi134.stdout:8/123: dwrite d1/d15/f1c [4194304,4194304] 0 2024-03-22T07:28:26.170 INFO:tasks.workunit.client.1.smithi195.stdout:0/91: creat d1/f1b x:0 0 0 2024-03-22T07:28:26.172 INFO:tasks.workunit.client.1.smithi195.stdout:1/75: unlink d0/d2/d9/f19 0 2024-03-22T07:28:26.172 INFO:tasks.workunit.client.1.smithi195.stdout:1/76: write d0/d2/d9/f15 [325192,123587] 0 2024-03-22T07:28:26.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/133: read d1/de/f1c [354712,53367] 0 2024-03-22T07:28:26.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/134: write d1/d3/d6/f22 [712650,87597] 0 2024-03-22T07:28:26.176 INFO:tasks.workunit.client.1.smithi195.stdout:3/66: rename d3/l10 to d3/d18/l1b 0 2024-03-22T07:28:26.176 INFO:tasks.workunit.client.1.smithi195.stdout:8/68: rename da to da/de/d14 22 2024-03-22T07:28:26.176 INFO:tasks.workunit.client.1.smithi195.stdout:3/67: chown d3/d18 7044 1 2024-03-22T07:28:26.177 INFO:tasks.workunit.client.1.smithi195.stdout:1/77: dread d0/d2/d6/f11 [0,4194304] 0 2024-03-22T07:28:26.177 INFO:tasks.workunit.client.0.smithi134.stdout:4/78: rename d2/d15/c14 to d2/c19 0 2024-03-22T07:28:26.178 INFO:tasks.workunit.client.0.smithi134.stdout:4/79: readlink d2/d15/l8 0 2024-03-22T07:28:26.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/71: symlink d2/d3/db/dd/l16 0 2024-03-22T07:28:26.182 INFO:tasks.workunit.client.1.smithi195.stdout:4/50: mkdir d13 0 2024-03-22T07:28:26.182 INFO:tasks.workunit.client.1.smithi195.stdout:4/51: fsync f9 0 2024-03-22T07:28:26.182 INFO:tasks.workunit.client.1.smithi195.stdout:4/52: dread - f6 zero size 2024-03-22T07:28:26.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/119: dwrite d2/d4/f12 [0,4194304] 0 2024-03-22T07:28:26.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/120: write d2/d4/d6/db/d20/f31 [890955,88493] 0 2024-03-22T07:28:26.183 INFO:tasks.workunit.client.0.smithi134.stdout:7/135: link d1/c1b d1/d3/c2a 0 2024-03-22T07:28:26.183 INFO:tasks.workunit.client.0.smithi134.stdout:7/136: chown d1/de/c10 139108 1 2024-03-22T07:28:26.183 INFO:tasks.workunit.client.1.smithi195.stdout:8/69: dread f2 [0,4194304] 0 2024-03-22T07:28:26.184 INFO:tasks.workunit.client.1.smithi195.stdout:6/51: creat d5/db/d10/f12 x:0 0 0 2024-03-22T07:28:26.185 INFO:tasks.workunit.client.0.smithi134.stdout:4/80: symlink d2/d15/d17/l1a 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/92: mknod d1/d4/dd/df/c1c 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/93: write d1/d4/f7 [1230339,27000] 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/94: readlink d1/l2 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/95: truncate d1/d4/dd/f13 1798874 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/96: chown d1/d4/dd/df/c1c 0 1 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/97: write d1/d4/f18 [12099580,30738] 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/98: creat d1/d4/dd/df/f1d x:0 0 0 2024-03-22T07:28:26.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/99: chown d1/d4/dd/df/f11 151375 1 2024-03-22T07:28:26.188 INFO:tasks.workunit.client.0.smithi134.stdout:7/137: mkdir d1/de/d11/d2b 0 2024-03-22T07:28:26.188 INFO:tasks.workunit.client.0.smithi134.stdout:7/138: dread - d1/d19/f23 zero size 2024-03-22T07:28:26.189 INFO:tasks.workunit.client.1.smithi195.stdout:3/68: unlink d3/df/d15/f16 0 2024-03-22T07:28:26.189 INFO:tasks.workunit.client.1.smithi195.stdout:3/69: chown d3/df/d15 243193 1 2024-03-22T07:28:26.189 INFO:tasks.workunit.client.1.smithi195.stdout:8/70: fdatasync da/dc/f13 0 2024-03-22T07:28:26.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/78: creat d0/d2/f1b x:0 0 0 2024-03-22T07:28:26.191 INFO:tasks.workunit.client.0.smithi134.stdout:7/139: mknod d1/d19/c2c 0 2024-03-22T07:28:26.191 INFO:tasks.workunit.client.1.smithi195.stdout:1/79: dread d0/d2/d6/f11 [0,4194304] 0 2024-03-22T07:28:26.192 INFO:tasks.workunit.client.1.smithi195.stdout:5/103: dwrite d9/f1c [0,4194304] 0 2024-03-22T07:28:26.192 INFO:tasks.workunit.client.1.smithi195.stdout:2/72: rename d2/d3/db/dd to d2/d17 0 2024-03-22T07:28:26.194 INFO:tasks.workunit.client.1.smithi195.stdout:4/53: creat d13/f14 x:0 0 0 2024-03-22T07:28:26.194 INFO:tasks.workunit.client.1.smithi195.stdout:4/54: dread - f12 zero size 2024-03-22T07:28:26.196 INFO:tasks.workunit.client.0.smithi134.stdout:7/140: mknod d1/de/d11/d2b/c2d 0 2024-03-22T07:28:26.197 INFO:tasks.workunit.client.1.smithi195.stdout:9/121: creat d2/d4/d1d/f33 x:0 0 0 2024-03-22T07:28:26.198 INFO:tasks.workunit.client.0.smithi134.stdout:4/81: dread d2/d15/f13 [0,4194304] 0 2024-03-22T07:28:26.198 INFO:tasks.workunit.client.0.smithi134.stdout:8/124: dwrite d1/d15/f1c [0,4194304] 0 2024-03-22T07:28:26.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/52: link d5/db/lf d5/db/l13 0 2024-03-22T07:28:26.199 INFO:tasks.workunit.client.0.smithi134.stdout:7/141: link d1/de/l21 d1/de/l2e 0 2024-03-22T07:28:26.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/125: symlink d1/d4/l30 0 2024-03-22T07:28:26.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/70: stat l1 0 2024-03-22T07:28:26.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/71: fdatasync d3/fd 0 2024-03-22T07:28:26.203 INFO:tasks.workunit.client.1.smithi195.stdout:3/72: creat d3/df/d15/f1c x:0 0 0 2024-03-22T07:28:26.204 INFO:tasks.workunit.client.1.smithi195.stdout:8/71: unlink da/dc/f13 0 2024-03-22T07:28:26.205 INFO:tasks.workunit.client.1.smithi195.stdout:1/80: unlink d0/l8 0 2024-03-22T07:28:26.207 INFO:tasks.workunit.client.1.smithi195.stdout:2/73: mkdir d2/d3/d7/da/d18 0 2024-03-22T07:28:26.208 INFO:tasks.workunit.client.1.smithi195.stdout:4/55: mkdir d13/d15 0 2024-03-22T07:28:26.210 INFO:tasks.workunit.client.1.smithi195.stdout:9/122: symlink d2/d4/d6/db/d20/l34 0 2024-03-22T07:28:26.211 INFO:tasks.workunit.client.1.smithi195.stdout:6/53: rename d5/f8 to d5/f14 0 2024-03-22T07:28:26.214 INFO:tasks.workunit.client.1.smithi195.stdout:9/123: symlink d2/d4/d32/l35 0 2024-03-22T07:28:26.215 INFO:tasks.workunit.client.1.smithi195.stdout:9/124: truncate d2/d4/d6/d18/f2b 396298 0 2024-03-22T07:28:26.216 INFO:tasks.workunit.client.1.smithi195.stdout:2/74: getdents d2/d3 0 2024-03-22T07:28:26.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/56: dread fa [0,4194304] 0 2024-03-22T07:28:26.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/57: chown c5 10 1 2024-03-22T07:28:26.216 INFO:tasks.workunit.client.1.smithi195.stdout:4/58: stat c1 0 2024-03-22T07:28:26.216 INFO:tasks.workunit.client.1.smithi195.stdout:9/125: creat d2/d4/d6/d18/f36 x:0 0 0 2024-03-22T07:28:26.218 INFO:tasks.workunit.client.1.smithi195.stdout:2/75: mkdir d2/d3/d7/d19 0 2024-03-22T07:28:26.218 INFO:tasks.workunit.client.1.smithi195.stdout:2/76: dread - d2/d3/d7/da/d12/f14 zero size 2024-03-22T07:28:26.218 INFO:tasks.workunit.client.1.smithi195.stdout:4/59: mkdir d13/d15/d16 0 2024-03-22T07:28:26.218 INFO:tasks.workunit.client.1.smithi195.stdout:4/60: dread - f6 zero size 2024-03-22T07:28:26.219 INFO:tasks.workunit.client.1.smithi195.stdout:9/126: rename d2/d4/d1d/f33 to d2/d4/d32/f37 0 2024-03-22T07:28:26.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/127: creat d2/d4/f38 x:0 0 0 2024-03-22T07:28:26.220 INFO:tasks.workunit.client.1.smithi195.stdout:9/128: dread - d2/d4/f38 zero size 2024-03-22T07:28:26.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/129: chown d2/d4/d32/l35 354 1 2024-03-22T07:28:26.221 INFO:tasks.workunit.client.1.smithi195.stdout:9/130: readlink d2/d4/d6/db/l17 0 2024-03-22T07:28:26.254 INFO:tasks.workunit.client.1.smithi195.stdout:7/62: sync 2024-03-22T07:28:26.280 INFO:tasks.workunit.client.0.smithi134.stdout:4/82: dread d2/d15/f11 [0,4194304] 0 2024-03-22T07:28:26.281 INFO:tasks.workunit.client.0.smithi134.stdout:4/83: truncate d2/fd 1214635 0 2024-03-22T07:28:26.283 INFO:tasks.workunit.client.0.smithi134.stdout:4/84: creat d2/d15/f1b x:0 0 0 2024-03-22T07:28:26.284 INFO:tasks.workunit.client.0.smithi134.stdout:4/85: creat d2/d15/d17/f1c x:0 0 0 2024-03-22T07:28:26.293 INFO:tasks.workunit.client.0.smithi134.stdout:8/126: dwrite d1/d11/f2b [0,4194304] 0 2024-03-22T07:28:26.293 INFO:tasks.workunit.client.0.smithi134.stdout:8/127: chown d1/d11/d12/d2a 74672 1 2024-03-22T07:28:26.294 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:26 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:26.294 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:26 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:26.294 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:26 smithi195 ceph-mon[36144]: pgmap v250: 65 pgs: 65 active+clean; 260 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 9.7 MiB/s wr, 600 op/s 2024-03-22T07:28:26.295 INFO:tasks.workunit.client.1.smithi195.stdout:3/73: dwrite d3/f13 [4194304,4194304] 0 2024-03-22T07:28:26.295 INFO:tasks.workunit.client.1.smithi195.stdout:8/72: dwrite da/fb [0,4194304] 0 2024-03-22T07:28:26.295 INFO:tasks.workunit.client.1.smithi195.stdout:1/81: dwrite d0/d2/f14 [0,4194304] 0 2024-03-22T07:28:26.295 INFO:tasks.workunit.client.1.smithi195.stdout:1/82: chown d0/d2/fe 13806414 1 2024-03-22T07:28:26.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/63: dwrite d0/f10 [0,4194304] 0 2024-03-22T07:28:26.296 INFO:tasks.workunit.client.1.smithi195.stdout:6/54: dwrite f0 [0,4194304] 0 2024-03-22T07:28:26.296 INFO:tasks.workunit.client.1.smithi195.stdout:4/61: dwrite d13/f14 [0,4194304] 0 2024-03-22T07:28:26.296 INFO:tasks.workunit.client.1.smithi195.stdout:4/62: creat d13/f17 x:0 0 0 2024-03-22T07:28:26.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/131: dwrite d2/d4/d6/d18/f36 [0,4194304] 0 2024-03-22T07:28:26.297 INFO:tasks.workunit.client.0.smithi134.stdout:7/142: dwrite d1/f2 [0,4194304] 0 2024-03-22T07:28:26.297 INFO:tasks.workunit.client.0.smithi134.stdout:7/143: creat d1/d19/f2f x:0 0 0 2024-03-22T07:28:26.297 INFO:tasks.workunit.client.1.smithi195.stdout:3/74: mkdir d3/df/d15/d1d 0 2024-03-22T07:28:26.297 INFO:tasks.workunit.client.1.smithi195.stdout:3/75: chown d3/df/d15/f1c 831680 1 2024-03-22T07:28:26.303 INFO:tasks.workunit.client.1.smithi195.stdout:8/73: symlink da/de/l15 0 2024-03-22T07:28:26.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/83: symlink d0/l1c 0 2024-03-22T07:28:26.306 INFO:tasks.workunit.client.1.smithi195.stdout:8/74: write da/dc/f12 [448594,93358] 0 2024-03-22T07:28:26.307 INFO:tasks.workunit.client.0.smithi134.stdout:7/144: mknod d1/d3/c30 0 2024-03-22T07:28:26.307 INFO:tasks.workunit.client.0.smithi134.stdout:7/145: fdatasync d1/d3/d6/f22 0 2024-03-22T07:28:26.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/64: truncate d0/fa 2026652 0 2024-03-22T07:28:26.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/55: symlink d5/db/d10/l15 0 2024-03-22T07:28:26.313 INFO:tasks.workunit.client.1.smithi195.stdout:6/56: write d5/f6 [464193,98501] 0 2024-03-22T07:28:26.313 INFO:tasks.workunit.client.1.smithi195.stdout:4/63: dwrite d13/f14 [0,4194304] 0 2024-03-22T07:28:26.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/75: fdatasync da/dc/f12 0 2024-03-22T07:28:26.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/100: rmdir d1 39 2024-03-22T07:28:26.318 INFO:tasks.workunit.client.0.smithi134.stdout:7/146: write f0 [2130718,113748] 0 2024-03-22T07:28:26.321 INFO:tasks.workunit.client.1.smithi195.stdout:8/76: write f7 [4172995,24470] 0 2024-03-22T07:28:26.321 INFO:tasks.workunit.client.1.smithi195.stdout:8/77: write f7 [4891226,99565] 0 2024-03-22T07:28:26.321 INFO:tasks.workunit.client.0.smithi134.stdout:7/147: mkdir d1/de/d11/d2b/d31 0 2024-03-22T07:28:26.323 INFO:tasks.workunit.client.1.smithi195.stdout:9/132: symlink d2/d4/d6/d18/l39 0 2024-03-22T07:28:26.324 INFO:tasks.workunit.client.1.smithi195.stdout:3/76: creat d3/d18/f1e x:0 0 0 2024-03-22T07:28:26.326 INFO:tasks.workunit.client.1.smithi195.stdout:1/84: symlink d0/d2/d9/l1d 0 2024-03-22T07:28:26.329 INFO:tasks.workunit.client.1.smithi195.stdout:8/78: read da/fb [2208877,46984] 0 2024-03-22T07:28:26.331 INFO:tasks.workunit.client.1.smithi195.stdout:3/77: creat d3/df/f1f x:0 0 0 2024-03-22T07:28:26.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/85: rename d0/d2/d6/lf to d0/d2/d6/l1e 0 2024-03-22T07:28:26.333 INFO:tasks.workunit.client.1.smithi195.stdout:1/86: chown d0/d2 27990 1 2024-03-22T07:28:26.336 INFO:tasks.workunit.client.1.smithi195.stdout:0/101: dread d1/d10/f14 [0,4194304] 0 2024-03-22T07:28:26.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/57: read f0 [4075020,56337] 0 2024-03-22T07:28:26.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/58: rmdir d5/dc 39 2024-03-22T07:28:26.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/59: truncate d5/f6 1066012 0 2024-03-22T07:28:26.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/60: truncate d5/dc/fd 474792 0 2024-03-22T07:28:26.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/61: dread - d5/db/d10/f12 zero size 2024-03-22T07:28:26.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/86: getdents d2/d15/d17 0 2024-03-22T07:28:26.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/87: truncate d2/ff 4361432 0 2024-03-22T07:28:26.343 INFO:tasks.workunit.client.0.smithi134.stdout:4/88: rmdir d2 39 2024-03-22T07:28:26.345 INFO:tasks.workunit.client.0.smithi134.stdout:4/89: mkdir d2/d1d 0 2024-03-22T07:28:26.346 INFO:tasks.workunit.client.0.smithi134.stdout:4/90: readlink d2/d15/l10 0 2024-03-22T07:28:26.346 INFO:tasks.workunit.client.0.smithi134.stdout:4/91: fdatasync d2/fd 0 2024-03-22T07:28:26.346 INFO:tasks.workunit.client.0.smithi134.stdout:4/92: read f1 [1315754,92833] 0 2024-03-22T07:28:26.346 INFO:tasks.workunit.client.0.smithi134.stdout:4/93: chown d2/d15/f13 5 1 2024-03-22T07:28:26.346 INFO:tasks.workunit.client.0.smithi134.stdout:4/94: creat d2/d15/f1e x:0 0 0 2024-03-22T07:28:26.347 INFO:tasks.workunit.client.0.smithi134.stdout:4/95: creat d2/d1d/f1f x:0 0 0 2024-03-22T07:28:26.349 INFO:tasks.workunit.client.1.smithi195.stdout:4/64: dwrite f6 [0,4194304] 0 2024-03-22T07:28:26.349 INFO:tasks.workunit.client.1.smithi195.stdout:4/65: chown c8 13407897 1 2024-03-22T07:28:26.350 INFO:tasks.workunit.client.1.smithi195.stdout:9/133: dwrite d2/d4/d1d/f22 [0,4194304] 0 2024-03-22T07:28:26.352 INFO:tasks.workunit.client.1.smithi195.stdout:4/66: creat d13/d15/d16/f18 x:0 0 0 2024-03-22T07:28:26.353 INFO:tasks.workunit.client.1.smithi195.stdout:3/78: dwrite d3/f13 [4194304,4194304] 0 2024-03-22T07:28:26.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/79: dread - d3/df/d15/f1c zero size 2024-03-22T07:28:26.357 INFO:tasks.workunit.client.1.smithi195.stdout:4/67: link f11 d13/d15/f19 0 2024-03-22T07:28:26.357 INFO:tasks.workunit.client.1.smithi195.stdout:4/68: creat d13/f1a x:0 0 0 2024-03-22T07:28:26.359 INFO:tasks.workunit.client.1.smithi195.stdout:3/80: mknod d3/df/d15/c20 0 2024-03-22T07:28:26.360 INFO:tasks.workunit.client.1.smithi195.stdout:4/69: symlink d13/d15/l1b 0 2024-03-22T07:28:26.360 INFO:tasks.workunit.client.0.smithi134.stdout:7/148: dwrite d1/d3/d6/fc [0,4194304] 0 2024-03-22T07:28:26.361 INFO:tasks.workunit.client.1.smithi195.stdout:4/70: creat d13/d15/f1c x:0 0 0 2024-03-22T07:28:26.373 INFO:tasks.workunit.client.1.smithi195.stdout:3/81: dread d3/f13 [4194304,4194304] 0 2024-03-22T07:28:26.373 INFO:tasks.workunit.client.1.smithi195.stdout:3/82: chown d3/df/l7 254046098 1 2024-03-22T07:28:26.376 INFO:tasks.workunit.client.0.smithi134.stdout:7/149: dread d1/de/d11/f13 [0,4194304] 0 2024-03-22T07:28:26.376 INFO:tasks.workunit.client.1.smithi195.stdout:0/102: dwrite d1/f1b [0,4194304] 0 2024-03-22T07:28:26.377 INFO:tasks.workunit.client.1.smithi195.stdout:1/87: dwrite d0/d2/f1b [0,4194304] 0 2024-03-22T07:28:26.377 INFO:tasks.workunit.client.1.smithi195.stdout:1/88: write d0/fa [618019,18369] 0 2024-03-22T07:28:26.377 INFO:tasks.workunit.client.1.smithi195.stdout:1/89: creat d0/d2/f1f x:0 0 0 2024-03-22T07:28:26.377 INFO:tasks.workunit.client.1.smithi195.stdout:8/79: dwrite f7 [0,4194304] 0 2024-03-22T07:28:26.378 INFO:tasks.workunit.client.1.smithi195.stdout:9/134: dwrite d2/d4/d6/db/f1f [0,4194304] 0 2024-03-22T07:28:26.378 INFO:tasks.workunit.client.1.smithi195.stdout:9/135: write d2/d4/d6/db/f30 [448999,18018] 0 2024-03-22T07:28:26.378 INFO:tasks.workunit.client.0.smithi134.stdout:4/96: dwrite d2/d1d/f1f [0,4194304] 0 2024-03-22T07:28:26.384 INFO:tasks.workunit.client.1.smithi195.stdout:3/83: mkdir d3/d21 0 2024-03-22T07:28:26.385 INFO:tasks.workunit.client.1.smithi195.stdout:3/84: fsync d3/f14 0 2024-03-22T07:28:26.385 INFO:tasks.workunit.client.1.smithi195.stdout:0/103: dread d1/d4/f7 [0,4194304] 0 2024-03-22T07:28:26.391 INFO:tasks.workunit.client.0.smithi134.stdout:4/97: symlink d2/d1d/l20 0 2024-03-22T07:28:26.393 INFO:tasks.workunit.client.0.smithi134.stdout:7/150: rmdir d1/d19 39 2024-03-22T07:28:26.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/80: dwrite f7 [0,4194304] 0 2024-03-22T07:28:26.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/81: chown l0 540 1 2024-03-22T07:28:26.395 INFO:tasks.workunit.client.1.smithi195.stdout:8/82: read da/fb [2786632,67452] 0 2024-03-22T07:28:26.395 INFO:tasks.workunit.client.0.smithi134.stdout:4/98: mknod d2/d1d/c21 0 2024-03-22T07:28:26.396 INFO:tasks.workunit.client.0.smithi134.stdout:7/151: unlink d1/f2 0 2024-03-22T07:28:26.397 INFO:tasks.workunit.client.1.smithi195.stdout:9/136: creat d2/d4/d32/f3a x:0 0 0 2024-03-22T07:28:26.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/85: mkdir d3/d22 0 2024-03-22T07:28:26.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/86: chown d3/d22 224108 1 2024-03-22T07:28:26.400 INFO:tasks.workunit.client.1.smithi195.stdout:0/104: mknod d1/d10/d19/c1e 0 2024-03-22T07:28:26.400 INFO:tasks.workunit.client.1.smithi195.stdout:0/105: read - d1/d4/dd/df/f16 zero size 2024-03-22T07:28:26.402 INFO:tasks.workunit.client.1.smithi195.stdout:3/87: mknod d3/df/c23 0 2024-03-22T07:28:26.403 INFO:tasks.workunit.client.1.smithi195.stdout:0/106: mkdir d1/d10/d1f 0 2024-03-22T07:28:26.405 INFO:tasks.workunit.client.1.smithi195.stdout:3/88: dread d3/fd [4194304,4194304] 0 2024-03-22T07:28:26.405 INFO:tasks.workunit.client.1.smithi195.stdout:3/89: fdatasync d3/df/d15/f1c 0 2024-03-22T07:28:26.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/137: rename d2/fe to d2/d4/f3b 0 2024-03-22T07:28:26.406 INFO:tasks.workunit.client.1.smithi195.stdout:0/107: mkdir d1/d10/d19/d20 0 2024-03-22T07:28:26.406 INFO:tasks.workunit.client.1.smithi195.stdout:0/108: write d1/d4/dd/df/f11 [1469402,77978] 0 2024-03-22T07:28:26.406 INFO:tasks.workunit.client.0.smithi134.stdout:7/152: read d1/de/d11/f13 [2661427,78179] 0 2024-03-22T07:28:26.409 INFO:tasks.workunit.client.0.smithi134.stdout:7/153: mkdir d1/d19/d32 0 2024-03-22T07:28:26.409 INFO:tasks.workunit.client.0.smithi134.stdout:7/154: chown f0 16305330 1 2024-03-22T07:28:26.410 INFO:tasks.workunit.client.0.smithi134.stdout:4/99: dread d2/d15/f12 [0,4194304] 0 2024-03-22T07:28:26.411 INFO:tasks.workunit.client.1.smithi195.stdout:9/138: mknod d2/d4/d6/d18/c3c 0 2024-03-22T07:28:26.411 INFO:tasks.workunit.client.1.smithi195.stdout:9/139: creat d2/d4/d1d/f3d x:0 0 0 2024-03-22T07:28:26.412 INFO:tasks.workunit.client.1.smithi195.stdout:9/140: dread - d2/d4/d32/f37 zero size 2024-03-22T07:28:26.412 INFO:tasks.workunit.client.1.smithi195.stdout:9/141: dread - d2/f27 zero size 2024-03-22T07:28:26.412 INFO:tasks.workunit.client.1.smithi195.stdout:9/142: chown d2/d4/f3b 8127375 1 2024-03-22T07:28:26.412 INFO:tasks.workunit.client.1.smithi195.stdout:8/83: dwrite da/dc/f12 [0,4194304] 0 2024-03-22T07:28:26.413 INFO:tasks.workunit.client.1.smithi195.stdout:0/109: creat d1/d10/d1f/f21 x:0 0 0 2024-03-22T07:28:26.414 INFO:tasks.workunit.client.1.smithi195.stdout:8/84: dread f7 [4194304,4194304] 0 2024-03-22T07:28:26.414 INFO:tasks.workunit.client.1.smithi195.stdout:8/85: write da/fb [3878139,58417] 0 2024-03-22T07:28:26.414 INFO:tasks.workunit.client.1.smithi195.stdout:8/86: fsync f7 0 2024-03-22T07:28:26.414 INFO:tasks.workunit.client.1.smithi195.stdout:8/87: fdatasync f2 0 2024-03-22T07:28:26.417 INFO:tasks.workunit.client.0.smithi134.stdout:4/100: mknod d2/d15/d17/c22 0 2024-03-22T07:28:26.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/110: mkdir d1/d4/d22 0 2024-03-22T07:28:26.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/111: stat d1/d4/dd/df 0 2024-03-22T07:28:26.422 INFO:tasks.workunit.client.1.smithi195.stdout:8/88: dread f2 [0,4194304] 0 2024-03-22T07:28:26.427 INFO:tasks.workunit.client.0.smithi134.stdout:4/101: dread d2/d15/f11 [0,4194304] 0 2024-03-22T07:28:26.428 INFO:tasks.workunit.client.0.smithi134.stdout:4/102: rename d2/d15/f9 to d2/d15/f23 0 2024-03-22T07:28:26.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/143: dwrite d2/d4/d32/f37 [0,4194304] 0 2024-03-22T07:28:26.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/155: dwrite d1/d3/d6/fc [0,4194304] 0 2024-03-22T07:28:26.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/156: read - d1/d3/d6/f1e zero size 2024-03-22T07:28:26.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/157: creat d1/f33 x:0 0 0 2024-03-22T07:28:26.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/90: dwrite d3/f14 [0,4194304] 0 2024-03-22T07:28:26.433 INFO:tasks.workunit.client.1.smithi195.stdout:3/91: creat d3/f24 x:0 0 0 2024-03-22T07:28:26.434 INFO:tasks.workunit.client.0.smithi134.stdout:7/158: read d1/f4 [3655479,10467] 0 2024-03-22T07:28:26.434 INFO:tasks.workunit.client.0.smithi134.stdout:7/159: chown d1/de/d11/c20 74 1 2024-03-22T07:28:26.436 INFO:tasks.workunit.client.1.smithi195.stdout:0/112: dread d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:26.436 INFO:tasks.workunit.client.1.smithi195.stdout:0/113: chown d1/d4/d12 1649341416 1 2024-03-22T07:28:26.438 INFO:tasks.workunit.client.1.smithi195.stdout:0/114: mknod d1/d4/c23 0 2024-03-22T07:28:26.441 INFO:tasks.workunit.client.1.smithi195.stdout:2/77: sync 2024-03-22T07:28:26.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/104: sync 2024-03-22T07:28:26.441 INFO:tasks.workunit.client.1.smithi195.stdout:2/78: readlink d2/d3/l11 0 2024-03-22T07:28:26.443 INFO:tasks.workunit.client.1.smithi195.stdout:0/115: mknod d1/d4/c24 0 2024-03-22T07:28:26.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/105: creat d9/d22/f2b x:0 0 0 2024-03-22T07:28:26.443 INFO:tasks.workunit.client.1.smithi195.stdout:2/79: mkdir d2/d3/d1a 0 2024-03-22T07:28:26.454 INFO:tasks.workunit.client.0.smithi134.stdout:4/103: dwrite d2/d15/f12 [0,4194304] 0 2024-03-22T07:28:26.454 INFO:tasks.workunit.client.0.smithi134.stdout:4/104: creat d2/d1d/f24 x:0 0 0 2024-03-22T07:28:26.459 INFO:tasks.workunit.client.0.smithi134.stdout:4/105: rename d2/d15/d17 to d2/d25 0 2024-03-22T07:28:26.459 INFO:tasks.workunit.client.1.smithi195.stdout:3/92: dwrite d3/df/d15/f1c [0,4194304] 0 2024-03-22T07:28:26.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/89: dwrite da/fb [0,4194304] 0 2024-03-22T07:28:26.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/90: chown da/de/l15 15194 1 2024-03-22T07:28:26.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/91: creat da/dc/f16 x:0 0 0 2024-03-22T07:28:26.462 INFO:tasks.workunit.client.0.smithi134.stdout:4/106: unlink d2/d15/ce 0 2024-03-22T07:28:26.466 INFO:tasks.workunit.client.1.smithi195.stdout:8/92: mkdir da/d17 0 2024-03-22T07:28:26.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/93: link da/de/cf da/c18 0 2024-03-22T07:28:26.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/94: write da/dc/f16 [701022,86335] 0 2024-03-22T07:28:26.468 INFO:tasks.workunit.client.1.smithi195.stdout:8/95: chown da/dc/f12 34865617 1 2024-03-22T07:28:26.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/96: stat da/dc/f12 0 2024-03-22T07:28:26.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/97: unlink f2 0 2024-03-22T07:28:26.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/93: dread d3/fd [0,4194304] 0 2024-03-22T07:28:26.478 INFO:tasks.workunit.client.0.smithi134.stdout:7/160: dwrite d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:26.479 INFO:tasks.workunit.client.1.smithi195.stdout:3/94: write d3/f13 [6339008,89782] 0 2024-03-22T07:28:26.479 INFO:tasks.workunit.client.1.smithi195.stdout:3/95: chown d3/df/c23 5708 1 2024-03-22T07:28:26.479 INFO:tasks.workunit.client.1.smithi195.stdout:5/106: dwrite d9/d12/d1d/f23 [0,4194304] 0 2024-03-22T07:28:26.479 INFO:tasks.workunit.client.1.smithi195.stdout:2/80: dwrite f1 [0,4194304] 0 2024-03-22T07:28:26.479 INFO:tasks.workunit.client.1.smithi195.stdout:0/116: dwrite d1/d4/f18 [4194304,4194304] 0 2024-03-22T07:28:26.481 INFO:tasks.workunit.client.0.smithi134.stdout:7/161: rename d1/d3/c5 to d1/de/d11/d2b/c34 0 2024-03-22T07:28:26.484 INFO:tasks.workunit.client.0.smithi134.stdout:7/162: creat d1/d3/f35 x:0 0 0 2024-03-22T07:28:26.487 INFO:tasks.workunit.client.1.smithi195.stdout:8/98: dwrite f7 [0,4194304] 0 2024-03-22T07:28:26.487 INFO:tasks.workunit.client.1.smithi195.stdout:8/99: chown f9 39 1 2024-03-22T07:28:26.487 INFO:tasks.workunit.client.1.smithi195.stdout:8/100: rename da to da/de/d19 22 2024-03-22T07:28:26.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/163: creat d1/d19/d32/f36 x:0 0 0 2024-03-22T07:28:26.490 INFO:tasks.workunit.client.1.smithi195.stdout:2/81: mkdir d2/d3/d7/da/d1b 0 2024-03-22T07:28:26.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/96: getdents d3 0 2024-03-22T07:28:26.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/97: getdents d3/d22 0 2024-03-22T07:28:26.492 INFO:tasks.workunit.client.0.smithi134.stdout:7/164: dread d1/d3/d6/f22 [0,4194304] 0 2024-03-22T07:28:26.493 INFO:tasks.workunit.client.0.smithi134.stdout:7/165: fdatasync d1/d3/f7 0 2024-03-22T07:28:26.494 INFO:tasks.workunit.client.1.smithi195.stdout:8/101: rename da/c18 to da/de/c1a 0 2024-03-22T07:28:26.495 INFO:tasks.workunit.client.1.smithi195.stdout:2/82: symlink d2/l1c 0 2024-03-22T07:28:26.495 INFO:tasks.workunit.client.1.smithi195.stdout:2/83: truncate f1 5089737 0 2024-03-22T07:28:26.495 INFO:tasks.workunit.client.1.smithi195.stdout:3/98: write d3/fd [168224,130229] 0 2024-03-22T07:28:26.495 INFO:tasks.workunit.client.1.smithi195.stdout:3/99: write d3/d18/f1e [917810,106186] 0 2024-03-22T07:28:26.496 INFO:tasks.workunit.client.0.smithi134.stdout:7/166: link d1/ld d1/de/l37 0 2024-03-22T07:28:26.498 INFO:tasks.workunit.client.1.smithi195.stdout:0/117: dwrite d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:26.499 INFO:tasks.workunit.client.0.smithi134.stdout:7/167: symlink d1/de/l38 0 2024-03-22T07:28:26.500 INFO:tasks.workunit.client.1.smithi195.stdout:5/107: dwrite d9/f16 [0,4194304] 0 2024-03-22T07:28:26.500 INFO:tasks.workunit.client.1.smithi195.stdout:2/84: creat d2/d3/d1a/f1d x:0 0 0 2024-03-22T07:28:26.501 INFO:tasks.workunit.client.1.smithi195.stdout:3/100: symlink d3/d18/l25 0 2024-03-22T07:28:26.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/101: write d3/df/d15/f1c [4974512,67462] 0 2024-03-22T07:28:26.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/102: creat d3/d18/f26 x:0 0 0 2024-03-22T07:28:26.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/103: readlink d3/l5 0 2024-03-22T07:28:26.502 INFO:tasks.workunit.client.1.smithi195.stdout:3/104: readlink d3/df/l7 0 2024-03-22T07:28:26.502 INFO:tasks.workunit.client.1.smithi195.stdout:8/102: unlink da/de/c1a 0 2024-03-22T07:28:26.503 INFO:tasks.workunit.client.0.smithi134.stdout:7/168: rename d1/d3/f35 to d1/de/f39 0 2024-03-22T07:28:26.503 INFO:tasks.workunit.client.0.smithi134.stdout:7/169: creat d1/f3a x:0 0 0 2024-03-22T07:28:26.507 INFO:tasks.workunit.client.1.smithi195.stdout:0/118: rmdir d1 39 2024-03-22T07:28:26.511 INFO:tasks.workunit.client.1.smithi195.stdout:5/108: link c2 d9/d22/c2c 0 2024-03-22T07:28:26.513 INFO:tasks.workunit.client.1.smithi195.stdout:2/85: mkdir d2/d1e 0 2024-03-22T07:28:26.513 INFO:tasks.workunit.client.1.smithi195.stdout:2/86: write d2/d3/d7/da/d12/f14 [132723,1224] 0 2024-03-22T07:28:26.514 INFO:tasks.workunit.client.1.smithi195.stdout:3/105: mknod d3/d22/c27 0 2024-03-22T07:28:26.514 INFO:tasks.workunit.client.1.smithi195.stdout:3/106: write f0 [1374151,88130] 0 2024-03-22T07:28:26.514 INFO:tasks.workunit.client.1.smithi195.stdout:8/103: mknod da/c1b 0 2024-03-22T07:28:26.516 INFO:tasks.workunit.client.1.smithi195.stdout:0/119: rename d1/d10/d19/c1e to d1/d4/c25 0 2024-03-22T07:28:26.516 INFO:tasks.workunit.client.1.smithi195.stdout:0/120: stat d1/d4/c23 0 2024-03-22T07:28:26.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/104: creat da/d17/f1c x:0 0 0 2024-03-22T07:28:26.525 INFO:tasks.workunit.client.1.smithi195.stdout:5/109: mkdir d9/d2d 0 2024-03-22T07:28:26.526 INFO:tasks.workunit.client.1.smithi195.stdout:2/87: getdents d2 0 2024-03-22T07:28:26.526 INFO:tasks.workunit.client.1.smithi195.stdout:8/105: symlink da/d17/l1d 0 2024-03-22T07:28:26.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/121: getdents d1/d10/d1f 0 2024-03-22T07:28:26.527 INFO:tasks.workunit.client.1.smithi195.stdout:0/122: truncate d1/d4/dd/df/f16 572895 0 2024-03-22T07:28:26.529 INFO:tasks.workunit.client.1.smithi195.stdout:2/88: symlink d2/l1f 0 2024-03-22T07:28:26.531 INFO:tasks.workunit.client.1.smithi195.stdout:8/106: getdents da 0 2024-03-22T07:28:26.531 INFO:tasks.workunit.client.1.smithi195.stdout:8/107: stat da/de 0 2024-03-22T07:28:26.532 INFO:tasks.workunit.client.1.smithi195.stdout:3/107: dwrite d3/f24 [0,4194304] 0 2024-03-22T07:28:26.533 INFO:tasks.workunit.client.1.smithi195.stdout:8/108: link da/d17/l1d da/de/l1e 0 2024-03-22T07:28:26.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/108: creat d3/f28 x:0 0 0 2024-03-22T07:28:26.538 INFO:tasks.workunit.client.1.smithi195.stdout:8/109: mknod da/d17/c1f 0 2024-03-22T07:28:26.540 INFO:tasks.workunit.client.1.smithi195.stdout:8/110: mknod da/de/c20 0 2024-03-22T07:28:26.540 INFO:tasks.workunit.client.1.smithi195.stdout:8/111: chown da/c1b 5 1 2024-03-22T07:28:26.541 INFO:tasks.workunit.client.1.smithi195.stdout:5/110: write f7 [2781153,3291] 0 2024-03-22T07:28:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:26 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:26 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:26 smithi134 ceph-mon[29057]: pgmap v250: 65 pgs: 65 active+clean; 260 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 9.7 MiB/s wr, 600 op/s 2024-03-22T07:28:26.545 INFO:tasks.workunit.client.1.smithi195.stdout:2/89: write f1 [2050427,50169] 0 2024-03-22T07:28:26.546 INFO:tasks.workunit.client.1.smithi195.stdout:5/111: dread d9/fb [0,4194304] 0 2024-03-22T07:28:26.546 INFO:tasks.workunit.client.1.smithi195.stdout:5/112: fdatasync d9/f1c 0 2024-03-22T07:28:26.546 INFO:tasks.workunit.client.1.smithi195.stdout:5/113: mknod d9/d22/c2e 0 2024-03-22T07:28:26.546 INFO:tasks.workunit.client.1.smithi195.stdout:5/114: write d9/d22/f2b [833188,49426] 0 2024-03-22T07:28:26.547 INFO:tasks.workunit.client.1.smithi195.stdout:2/90: link d2/d3/db/c10 d2/d3/d7/d19/c20 0 2024-03-22T07:28:26.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/123: dwrite d1/d10/f14 [0,4194304] 0 2024-03-22T07:28:26.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/124: write d1/d4/f18 [12100351,63267] 0 2024-03-22T07:28:26.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/125: symlink d1/d4/d12/l26 0 2024-03-22T07:28:26.551 INFO:tasks.workunit.client.1.smithi195.stdout:0/126: creat d1/d4/d12/f27 x:0 0 0 2024-03-22T07:28:26.551 INFO:tasks.workunit.client.1.smithi195.stdout:0/127: write d1/d10/d1f/f21 [370744,5773] 0 2024-03-22T07:28:26.552 INFO:tasks.workunit.client.1.smithi195.stdout:3/109: dread d3/f24 [0,4194304] 0 2024-03-22T07:28:26.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/91: rename d2/d3/d7/da/d12 to d2/d3/d21 0 2024-03-22T07:28:26.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/92: fdatasync d2/d3/d1a/f1d 0 2024-03-22T07:28:26.553 INFO:tasks.workunit.client.1.smithi195.stdout:2/93: mkdir d2/d3/d7/d19/d22 0 2024-03-22T07:28:26.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/94: mknod d2/d3/d7/da/d18/c23 0 2024-03-22T07:28:26.555 INFO:tasks.workunit.client.1.smithi195.stdout:5/115: write d9/f29 [1922292,101082] 0 2024-03-22T07:28:26.557 INFO:tasks.workunit.client.1.smithi195.stdout:8/112: dwrite da/dc/f12 [0,4194304] 0 2024-03-22T07:28:26.557 INFO:tasks.workunit.client.1.smithi195.stdout:3/110: read d3/f24 [2764942,49022] 0 2024-03-22T07:28:26.558 INFO:tasks.workunit.client.1.smithi195.stdout:5/116: mknod d9/c2f 0 2024-03-22T07:28:26.558 INFO:tasks.workunit.client.1.smithi195.stdout:3/111: creat d3/f29 x:0 0 0 2024-03-22T07:28:26.560 INFO:tasks.workunit.client.1.smithi195.stdout:5/117: creat d9/d12/f30 x:0 0 0 2024-03-22T07:28:26.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/95: rmdir d2/d3/d21 39 2024-03-22T07:28:26.562 INFO:tasks.workunit.client.1.smithi195.stdout:8/113: mknod da/dc/c21 0 2024-03-22T07:28:26.564 INFO:tasks.workunit.client.1.smithi195.stdout:5/118: creat d9/f31 x:0 0 0 2024-03-22T07:28:26.564 INFO:tasks.workunit.client.1.smithi195.stdout:5/119: creat d9/d12/d1d/f32 x:0 0 0 2024-03-22T07:28:26.566 INFO:tasks.workunit.client.1.smithi195.stdout:2/96: fsync d2/d3/d21/f14 0 2024-03-22T07:28:26.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/112: write d3/df/d15/f1c [1079353,74793] 0 2024-03-22T07:28:26.570 INFO:tasks.workunit.client.1.smithi195.stdout:0/128: dwrite d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:26.570 INFO:tasks.workunit.client.1.smithi195.stdout:5/120: fdatasync d9/d22/f2b 0 2024-03-22T07:28:26.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/113: unlink d3/f28 0 2024-03-22T07:28:26.571 INFO:tasks.workunit.client.1.smithi195.stdout:8/114: write da/dc/f12 [1053661,60066] 0 2024-03-22T07:28:26.571 INFO:tasks.workunit.client.1.smithi195.stdout:5/121: mknod d9/d12/c33 0 2024-03-22T07:28:26.572 INFO:tasks.workunit.client.1.smithi195.stdout:3/114: truncate f0 2531850 0 2024-03-22T07:28:26.577 INFO:tasks.workunit.client.1.smithi195.stdout:8/115: link da/de/cf da/c22 0 2024-03-22T07:28:26.577 INFO:tasks.workunit.client.1.smithi195.stdout:8/116: chown da/de 2113062809 1 2024-03-22T07:28:26.578 INFO:tasks.workunit.client.1.smithi195.stdout:5/122: readlink d9/ld 0 2024-03-22T07:28:26.580 INFO:tasks.workunit.client.1.smithi195.stdout:3/115: unlink d3/d18/f1e 0 2024-03-22T07:28:26.580 INFO:tasks.workunit.client.1.smithi195.stdout:3/116: chown d3/d18 20762 1 2024-03-22T07:28:26.585 INFO:tasks.workunit.client.1.smithi195.stdout:3/117: dread d3/f24 [0,4194304] 0 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:9/144: sync 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:9/145: readlink d2/d4/d6/db/l17 0 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:9/146: chown d2/d4/d1d/f22 95025 1 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:6/62: sync 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:9/147: creat d2/d4/d6/d18/f3e x:0 0 0 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/71: sync 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:1/90: sync 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/72: fdatasync d13/d15/d16/f18 0 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:1/91: write d0/d2/fe [1693900,101942] 0 2024-03-22T07:28:26.624 INFO:tasks.workunit.client.1.smithi195.stdout:1/92: fsync d0/d2/f1f 0 2024-03-22T07:28:26.625 INFO:tasks.workunit.client.1.smithi195.stdout:7/65: sync 2024-03-22T07:28:26.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/63: mkdir d5/d16 0 2024-03-22T07:28:26.628 INFO:tasks.workunit.client.1.smithi195.stdout:4/73: rename ld to d13/d15/l1d 0 2024-03-22T07:28:26.628 INFO:tasks.workunit.client.1.smithi195.stdout:7/66: symlink d0/l15 0 2024-03-22T07:28:26.628 INFO:tasks.workunit.client.1.smithi195.stdout:7/67: readlink d0/lb 0 2024-03-22T07:28:26.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/64: mkdir d5/db/d17 0 2024-03-22T07:28:26.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/65: dread - d5/db/d10/f12 zero size 2024-03-22T07:28:26.629 INFO:tasks.workunit.client.1.smithi195.stdout:4/74: symlink d13/d15/l1e 0 2024-03-22T07:28:26.630 INFO:tasks.workunit.client.1.smithi195.stdout:4/75: creat d13/f1f x:0 0 0 2024-03-22T07:28:26.630 INFO:tasks.workunit.client.1.smithi195.stdout:4/76: write d13/f1a [366894,106359] 0 2024-03-22T07:28:26.633 INFO:tasks.workunit.client.1.smithi195.stdout:5/123: write d9/d12/d1d/f23 [2569349,36142] 0 2024-03-22T07:28:26.633 INFO:tasks.workunit.client.1.smithi195.stdout:5/124: stat d9/d12/f1e 0 2024-03-22T07:28:26.633 INFO:tasks.workunit.client.1.smithi195.stdout:7/68: write d0/fa [1294901,59309] 0 2024-03-22T07:28:26.633 INFO:tasks.workunit.client.1.smithi195.stdout:2/97: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-03-22T07:28:26.634 INFO:tasks.workunit.client.1.smithi195.stdout:4/77: symlink d13/d15/l20 0 2024-03-22T07:28:26.634 INFO:tasks.workunit.client.1.smithi195.stdout:4/78: write d13/f1f [474946,64037] 0 2024-03-22T07:28:26.634 INFO:tasks.workunit.client.1.smithi195.stdout:8/117: dread f7 [0,4194304] 0 2024-03-22T07:28:26.637 INFO:tasks.workunit.client.1.smithi195.stdout:2/98: getdents d2/d3/d7 0 2024-03-22T07:28:26.637 INFO:tasks.workunit.client.1.smithi195.stdout:9/148: dwrite d2/d4/d32/f3a [0,4194304] 0 2024-03-22T07:28:26.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/79: truncate f11 1068732 0 2024-03-22T07:28:26.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/80: fdatasync d13/d15/f19 0 2024-03-22T07:28:26.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/81: chown f3 0 1 2024-03-22T07:28:26.639 INFO:tasks.workunit.client.1.smithi195.stdout:4/82: write f12 [920602,68797] 0 2024-03-22T07:28:26.639 INFO:tasks.workunit.client.1.smithi195.stdout:3/118: rmdir d3 39 2024-03-22T07:28:26.641 INFO:tasks.workunit.client.1.smithi195.stdout:8/118: rename da/c1b to da/d17/c23 0 2024-03-22T07:28:26.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/69: dread d0/fa [0,4194304] 0 2024-03-22T07:28:26.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/70: write d0/fc [4794481,123196] 0 2024-03-22T07:28:26.641 INFO:tasks.workunit.client.1.smithi195.stdout:2/99: mkdir d2/d3/d24 0 2024-03-22T07:28:26.645 INFO:tasks.workunit.client.1.smithi195.stdout:9/149: symlink d2/d4/d6/d18/l3f 0 2024-03-22T07:28:26.645 INFO:tasks.workunit.client.1.smithi195.stdout:9/150: chown d2/d4 0 1 2024-03-22T07:28:26.647 INFO:tasks.workunit.client.1.smithi195.stdout:4/83: mkdir d13/d15/d16/d21 0 2024-03-22T07:28:26.647 INFO:tasks.workunit.client.1.smithi195.stdout:4/84: creat d13/d15/f22 x:0 0 0 2024-03-22T07:28:26.647 INFO:tasks.workunit.client.1.smithi195.stdout:4/85: chown d13/d15/l1b 92 1 2024-03-22T07:28:26.648 INFO:tasks.workunit.client.1.smithi195.stdout:8/119: stat da/de/l1e 0 2024-03-22T07:28:26.650 INFO:tasks.workunit.client.1.smithi195.stdout:9/151: truncate d2/d4/f3b 3412115 0 2024-03-22T07:28:26.650 INFO:tasks.workunit.client.1.smithi195.stdout:9/152: creat d2/d4/d1d/f40 x:0 0 0 2024-03-22T07:28:26.651 INFO:tasks.workunit.client.1.smithi195.stdout:9/153: write d2/d4/d1d/f3d [698037,12886] 0 2024-03-22T07:28:26.651 INFO:tasks.workunit.client.1.smithi195.stdout:9/154: creat d2/d4/d1d/f41 x:0 0 0 2024-03-22T07:28:26.651 INFO:tasks.workunit.client.1.smithi195.stdout:9/155: chown d2/d4/d6/db/f30 5116 1 2024-03-22T07:28:26.652 INFO:tasks.workunit.client.1.smithi195.stdout:4/86: truncate d13/f14 784158 0 2024-03-22T07:28:26.654 INFO:tasks.workunit.client.1.smithi195.stdout:2/100: mknod d2/d17/c25 0 2024-03-22T07:28:26.654 INFO:tasks.workunit.client.1.smithi195.stdout:2/101: chown d2/d3/db 5305 1 2024-03-22T07:28:26.654 INFO:tasks.workunit.client.1.smithi195.stdout:2/102: chown d2/d3 2679994 1 2024-03-22T07:28:26.658 INFO:tasks.workunit.client.1.smithi195.stdout:3/119: dwrite d3/f29 [0,4194304] 0 2024-03-22T07:28:26.662 INFO:tasks.workunit.client.1.smithi195.stdout:2/103: mkdir d2/d3/d7/d19/d22/d26 0 2024-03-22T07:28:26.666 INFO:tasks.workunit.client.1.smithi195.stdout:9/156: mknod d2/d4/d23/c42 0 2024-03-22T07:28:26.667 INFO:tasks.workunit.client.1.smithi195.stdout:2/104: truncate f1 4126657 0 2024-03-22T07:28:26.667 INFO:tasks.workunit.client.1.smithi195.stdout:2/105: stat d2/d3/d7/f13 0 2024-03-22T07:28:26.668 INFO:tasks.workunit.client.1.smithi195.stdout:9/157: truncate d2/d4/d32/f37 1137552 0 2024-03-22T07:28:26.669 INFO:tasks.workunit.client.1.smithi195.stdout:9/158: creat d2/d4/d6/d18/f43 x:0 0 0 2024-03-22T07:28:26.669 INFO:tasks.workunit.client.1.smithi195.stdout:3/120: dread d3/f24 [0,4194304] 0 2024-03-22T07:28:26.669 INFO:tasks.workunit.client.1.smithi195.stdout:2/106: truncate d2/d3/d21/f14 31140 0 2024-03-22T07:28:26.673 INFO:tasks.workunit.client.1.smithi195.stdout:2/107: creat d2/d3/d7/f27 x:0 0 0 2024-03-22T07:28:26.677 INFO:tasks.workunit.client.1.smithi195.stdout:2/108: rename d2/d3/d1a/f1d to d2/d3/d7/d19/f28 0 2024-03-22T07:28:26.678 INFO:tasks.workunit.client.1.smithi195.stdout:2/109: creat d2/d3/d7/da/d1b/f29 x:0 0 0 2024-03-22T07:28:26.680 INFO:tasks.workunit.client.1.smithi195.stdout:2/110: link d2/l1c d2/d3/d7/da/d18/l2a 0 2024-03-22T07:28:26.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/111: rename d2/d3/d7/f13 to d2/d3/d1a/f2b 0 2024-03-22T07:28:26.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/112: dread - d2/d3/d7/d19/f28 zero size 2024-03-22T07:28:26.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/113: dread - d2/d3/d7/f27 zero size 2024-03-22T07:28:26.682 INFO:tasks.workunit.client.1.smithi195.stdout:2/114: chown d2/d3/c8 278 1 2024-03-22T07:28:26.685 INFO:tasks.workunit.client.1.smithi195.stdout:8/120: dwrite da/dc/f12 [4194304,4194304] 0 2024-03-22T07:28:26.685 INFO:tasks.workunit.client.1.smithi195.stdout:8/121: read - da/d17/f1c zero size 2024-03-22T07:28:26.686 INFO:tasks.workunit.client.1.smithi195.stdout:8/122: readlink da/de/l11 0 2024-03-22T07:28:26.686 INFO:tasks.workunit.client.1.smithi195.stdout:9/159: rmdir d2/d4/d6/d18 39 2024-03-22T07:28:26.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/123: read da/dc/f16 [559568,53827] 0 2024-03-22T07:28:26.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/124: fdatasync f7 0 2024-03-22T07:28:26.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/125: read f9 [3633679,20491] 0 2024-03-22T07:28:26.690 INFO:tasks.workunit.client.1.smithi195.stdout:7/71: dwrite d0/ff [0,4194304] 0 2024-03-22T07:28:26.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/87: dwrite d13/f17 [0,4194304] 0 2024-03-22T07:28:26.690 INFO:tasks.workunit.client.1.smithi195.stdout:3/121: dwrite d3/f24 [4194304,4194304] 0 2024-03-22T07:28:26.690 INFO:tasks.workunit.client.1.smithi195.stdout:9/160: rename d2/d4/f2a to d2/d4/d6/d18/f44 0 2024-03-22T07:28:26.692 INFO:tasks.workunit.client.1.smithi195.stdout:4/88: dread d13/d15/f19 [0,4194304] 0 2024-03-22T07:28:26.696 INFO:tasks.workunit.client.1.smithi195.stdout:3/122: getdents d3/d22 0 2024-03-22T07:28:26.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/161: symlink d2/l45 0 2024-03-22T07:28:26.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/162: chown d2/d4/d1d 0 1 2024-03-22T07:28:26.700 INFO:tasks.workunit.client.1.smithi195.stdout:8/126: rename da/d17/f1c to da/dc/f24 0 2024-03-22T07:28:26.701 INFO:tasks.workunit.client.1.smithi195.stdout:4/89: rename d13/d15/l20 to d13/l23 0 2024-03-22T07:28:26.703 INFO:tasks.workunit.client.1.smithi195.stdout:2/115: dwrite d2/d3/d21/f14 [0,4194304] 0 2024-03-22T07:28:26.703 INFO:tasks.workunit.client.1.smithi195.stdout:2/116: write d2/d3/d7/d19/f28 [775013,58515] 0 2024-03-22T07:28:26.709 INFO:tasks.workunit.client.1.smithi195.stdout:7/72: dwrite d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:26.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/117: read d2/d3/d1a/f2b [3021834,73650] 0 2024-03-22T07:28:26.721 INFO:tasks.workunit.client.1.smithi195.stdout:2/118: creat d2/d3/d7/d19/d22/d26/f2c x:0 0 0 2024-03-22T07:28:26.721 INFO:tasks.workunit.client.1.smithi195.stdout:2/119: chown d2/d3/d7/d19/d22/d26 0 1 2024-03-22T07:28:26.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/73: write d0/f10 [1201372,57279] 0 2024-03-22T07:28:26.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/74: chown d0/d13/d14/f8 215916 1 2024-03-22T07:28:26.730 INFO:tasks.workunit.client.1.smithi195.stdout:7/75: read d0/fc [2204090,124192] 0 2024-03-22T07:28:26.730 INFO:tasks.workunit.client.1.smithi195.stdout:7/76: chown d0/fc 3466 1 2024-03-22T07:28:26.730 INFO:tasks.workunit.client.1.smithi195.stdout:3/123: dwrite d3/f13 [0,4194304] 0 2024-03-22T07:28:26.731 INFO:tasks.workunit.client.1.smithi195.stdout:7/77: rename d0/fa to d0/f16 0 2024-03-22T07:28:26.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/124: symlink d3/df/d15/d1d/l2a 0 2024-03-22T07:28:26.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/125: write d3/f24 [990960,39812] 0 2024-03-22T07:28:26.731 INFO:tasks.workunit.client.1.smithi195.stdout:3/126: chown d3 12 1 2024-03-22T07:28:26.732 INFO:tasks.workunit.client.1.smithi195.stdout:8/127: dwrite da/fb [0,4194304] 0 2024-03-22T07:28:26.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/78: write d0/d13/d14/f8 [4075304,44668] 0 2024-03-22T07:28:26.738 INFO:tasks.workunit.client.1.smithi195.stdout:7/79: getdents d0/d13 0 2024-03-22T07:28:26.740 INFO:tasks.workunit.client.1.smithi195.stdout:4/90: dwrite d13/f14 [0,4194304] 0 2024-03-22T07:28:26.740 INFO:tasks.workunit.client.1.smithi195.stdout:4/91: dread - d13/d15/d16/f18 zero size 2024-03-22T07:28:26.740 INFO:tasks.workunit.client.1.smithi195.stdout:7/80: link d0/d13/d14/c4 d0/d13/c17 0 2024-03-22T07:28:26.741 INFO:tasks.workunit.client.1.smithi195.stdout:4/92: mkdir d13/d15/d24 0 2024-03-22T07:28:26.741 INFO:tasks.workunit.client.1.smithi195.stdout:4/93: creat d13/d15/f25 x:0 0 0 2024-03-22T07:28:26.742 INFO:tasks.workunit.client.1.smithi195.stdout:4/94: fdatasync d13/f1f 0 2024-03-22T07:28:26.742 INFO:tasks.workunit.client.1.smithi195.stdout:4/95: chown d13/f1f 0 1 2024-03-22T07:28:26.744 INFO:tasks.workunit.client.1.smithi195.stdout:7/81: getdents d0 0 2024-03-22T07:28:26.747 INFO:tasks.workunit.client.1.smithi195.stdout:3/127: write d3/f13 [1857213,110121] 0 2024-03-22T07:28:26.747 INFO:tasks.workunit.client.1.smithi195.stdout:8/128: dread da/dc/f12 [4194304,4194304] 0 2024-03-22T07:28:26.748 INFO:tasks.workunit.client.1.smithi195.stdout:8/129: chown da/dc/f16 811413845 1 2024-03-22T07:28:26.751 INFO:tasks.workunit.client.1.smithi195.stdout:3/128: rename d3/f13 to d3/d18/f2b 0 2024-03-22T07:28:26.752 INFO:tasks.workunit.client.1.smithi195.stdout:8/130: rename da/dc/f16 to da/d17/f25 0 2024-03-22T07:28:26.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/131: fdatasync da/fb 0 2024-03-22T07:28:26.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/132: chown da/dc/f24 100891006 1 2024-03-22T07:28:26.754 INFO:tasks.workunit.client.1.smithi195.stdout:3/129: link d3/f29 d3/df/f2c 0 2024-03-22T07:28:26.756 INFO:tasks.workunit.client.1.smithi195.stdout:4/96: dwrite d13/f1a [0,4194304] 0 2024-03-22T07:28:26.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/133: rename da/d17/c23 to da/d17/c26 0 2024-03-22T07:28:26.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/134: fdatasync f7 0 2024-03-22T07:28:26.757 INFO:tasks.workunit.client.1.smithi195.stdout:8/135: read da/dc/f12 [3897618,12976] 0 2024-03-22T07:28:26.759 INFO:tasks.workunit.client.1.smithi195.stdout:3/130: creat d3/f2d x:0 0 0 2024-03-22T07:28:26.766 INFO:tasks.workunit.client.1.smithi195.stdout:3/131: getdents d3/df 0 2024-03-22T07:28:26.767 INFO:tasks.workunit.client.1.smithi195.stdout:3/132: creat d3/d21/f2e x:0 0 0 2024-03-22T07:28:26.769 INFO:tasks.workunit.client.1.smithi195.stdout:7/82: dwrite d0/f16 [0,4194304] 0 2024-03-22T07:28:26.770 INFO:tasks.workunit.client.1.smithi195.stdout:7/83: stat d0/d13/c17 0 2024-03-22T07:28:26.770 INFO:tasks.workunit.client.1.smithi195.stdout:7/84: write d0/f10 [3763515,102289] 0 2024-03-22T07:28:26.771 INFO:tasks.workunit.client.1.smithi195.stdout:7/85: readlink d0/lb 0 2024-03-22T07:28:26.771 INFO:tasks.workunit.client.1.smithi195.stdout:7/86: stat d0/f10 0 2024-03-22T07:28:26.771 INFO:tasks.workunit.client.1.smithi195.stdout:7/87: mknod d0/c18 0 2024-03-22T07:28:26.776 INFO:tasks.workunit.client.1.smithi195.stdout:7/88: dread d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:26.777 INFO:tasks.workunit.client.1.smithi195.stdout:7/89: symlink d0/d13/d14/l19 0 2024-03-22T07:28:26.777 INFO:tasks.workunit.client.1.smithi195.stdout:7/90: dread - d0/f11 zero size 2024-03-22T07:28:26.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/91: unlink d0/f16 0 2024-03-22T07:28:26.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/92: readlink d0/l12 0 2024-03-22T07:28:26.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/93: rename d0/d13 to d0/d13/d1a 22 2024-03-22T07:28:26.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/94: rename d0/d13 to d0/d13/d1b 22 2024-03-22T07:28:26.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/95: read - d0/f11 zero size 2024-03-22T07:28:26.780 INFO:tasks.workunit.client.1.smithi195.stdout:8/136: dwrite da/dc/f24 [0,4194304] 0 2024-03-22T07:28:26.780 INFO:tasks.workunit.client.1.smithi195.stdout:4/97: dwrite d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:26.780 INFO:tasks.workunit.client.1.smithi195.stdout:7/96: dread d0/d13/d14/fd [0,4194304] 0 2024-03-22T07:28:26.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/137: symlink da/l27 0 2024-03-22T07:28:26.785 INFO:tasks.workunit.client.1.smithi195.stdout:4/98: rmdir d13 39 2024-03-22T07:28:26.786 INFO:tasks.workunit.client.1.smithi195.stdout:8/138: symlink da/dc/l28 0 2024-03-22T07:28:26.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/139: dread da/d17/f25 [0,4194304] 0 2024-03-22T07:28:26.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/99: mknod d13/d15/d16/d21/c26 0 2024-03-22T07:28:26.788 INFO:tasks.workunit.client.1.smithi195.stdout:4/100: fsync fe 0 2024-03-22T07:28:26.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/140: mknod da/d17/c29 0 2024-03-22T07:28:26.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/141: chown da/d17/l1d 0 1 2024-03-22T07:28:26.791 INFO:tasks.workunit.client.1.smithi195.stdout:4/101: link d13/f1a d13/d15/d16/d21/f27 0 2024-03-22T07:28:26.797 INFO:tasks.workunit.client.1.smithi195.stdout:3/133: dwrite d3/d18/f2b [4194304,4194304] 0 2024-03-22T07:28:26.798 INFO:tasks.workunit.client.1.smithi195.stdout:3/134: link d3/cc d3/c2f 0 2024-03-22T07:28:26.801 INFO:tasks.workunit.client.1.smithi195.stdout:3/135: creat d3/df/d15/d1d/f30 x:0 0 0 2024-03-22T07:28:26.817 INFO:tasks.workunit.client.1.smithi195.stdout:3/136: write d3/f24 [6115500,74156] 0 2024-03-22T07:28:26.817 INFO:tasks.workunit.client.1.smithi195.stdout:8/142: dwrite da/dc/f24 [0,4194304] 0 2024-03-22T07:28:26.817 INFO:tasks.workunit.client.1.smithi195.stdout:3/137: creat d3/df/d15/d1d/f31 x:0 0 0 2024-03-22T07:28:26.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/102: dwrite fa [0,4194304] 0 2024-03-22T07:28:26.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/103: write d13/f1f [660349,35754] 0 2024-03-22T07:28:26.819 INFO:tasks.workunit.client.1.smithi195.stdout:3/138: mknod d3/df/d15/c32 0 2024-03-22T07:28:26.819 INFO:tasks.workunit.client.1.smithi195.stdout:3/139: chown d3/df/d15/l17 14832 1 2024-03-22T07:28:26.819 INFO:tasks.workunit.client.1.smithi195.stdout:3/140: write d3/df/d15/f1c [819176,101197] 0 2024-03-22T07:28:26.820 INFO:tasks.workunit.client.1.smithi195.stdout:4/104: link d13/d15/d16/d21/f27 d13/d15/d24/f28 0 2024-03-22T07:28:26.822 INFO:tasks.workunit.client.1.smithi195.stdout:8/143: dread da/dc/f12 [4194304,4194304] 0 2024-03-22T07:28:26.822 INFO:tasks.workunit.client.1.smithi195.stdout:0/129: sync 2024-03-22T07:28:26.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/144: mkdir da/dc/d2a 0 2024-03-22T07:28:26.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/145: readlink da/dc/l28 0 2024-03-22T07:28:26.823 INFO:tasks.workunit.client.1.smithi195.stdout:0/130: dread d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:26.824 INFO:tasks.workunit.client.1.smithi195.stdout:8/146: creat da/dc/f2b x:0 0 0 2024-03-22T07:28:26.825 INFO:tasks.workunit.client.1.smithi195.stdout:8/147: fsync f7 0 2024-03-22T07:28:26.825 INFO:tasks.workunit.client.1.smithi195.stdout:8/148: symlink da/l2c 0 2024-03-22T07:28:26.827 INFO:tasks.workunit.client.1.smithi195.stdout:0/131: write d1/d4/f8 [451982,70849] 0 2024-03-22T07:28:26.827 INFO:tasks.workunit.client.1.smithi195.stdout:8/149: creat da/de/f2d x:0 0 0 2024-03-22T07:28:26.827 INFO:tasks.workunit.client.1.smithi195.stdout:8/150: chown da/de/l15 2317 1 2024-03-22T07:28:26.829 INFO:tasks.workunit.client.1.smithi195.stdout:8/151: mknod da/de/c2e 0 2024-03-22T07:28:26.830 INFO:tasks.workunit.client.1.smithi195.stdout:8/152: rmdir da/dc/d2a 0 2024-03-22T07:28:26.831 INFO:tasks.workunit.client.1.smithi195.stdout:8/153: symlink da/l2f 0 2024-03-22T07:28:26.832 INFO:tasks.workunit.client.1.smithi195.stdout:8/154: mknod da/dc/c30 0 2024-03-22T07:28:26.833 INFO:tasks.workunit.client.1.smithi195.stdout:8/155: symlink da/de/l31 0 2024-03-22T07:28:26.836 INFO:tasks.workunit.client.1.smithi195.stdout:3/141: dread d3/f24 [4194304,4194304] 0 2024-03-22T07:28:26.839 INFO:tasks.workunit.client.1.smithi195.stdout:4/105: dwrite fa [0,4194304] 0 2024-03-22T07:28:26.839 INFO:tasks.workunit.client.1.smithi195.stdout:4/106: fdatasync f11 0 2024-03-22T07:28:26.841 INFO:tasks.workunit.client.1.smithi195.stdout:4/107: rename l4 to d13/l29 0 2024-03-22T07:28:26.841 INFO:tasks.workunit.client.1.smithi195.stdout:4/108: chown d13/l29 487262 1 2024-03-22T07:28:26.843 INFO:tasks.workunit.client.1.smithi195.stdout:4/109: rename d13/d15/d24 to d13/d2a 0 2024-03-22T07:28:26.843 INFO:tasks.workunit.client.1.smithi195.stdout:4/110: truncate f3 1358916 0 2024-03-22T07:28:26.843 INFO:tasks.workunit.client.1.smithi195.stdout:0/132: write d1/d10/f14 [1726523,100007] 0 2024-03-22T07:28:26.846 INFO:tasks.workunit.client.1.smithi195.stdout:0/133: rename d1/f1b to d1/d10/d19/d20/f28 0 2024-03-22T07:28:26.848 INFO:tasks.workunit.client.1.smithi195.stdout:0/134: truncate d1/d4/dd/f13 2059751 0 2024-03-22T07:28:26.848 INFO:tasks.workunit.client.1.smithi195.stdout:3/142: dwrite f0 [0,4194304] 0 2024-03-22T07:28:26.848 INFO:tasks.workunit.client.1.smithi195.stdout:0/135: fdatasync d1/d4/dd/df/f1d 0 2024-03-22T07:28:26.852 INFO:tasks.workunit.client.1.smithi195.stdout:8/156: rmdir da/de 39 2024-03-22T07:28:26.852 INFO:tasks.workunit.client.1.smithi195.stdout:8/157: truncate da/de/f2d 913813 0 2024-03-22T07:28:26.860 INFO:tasks.workunit.client.1.smithi195.stdout:8/158: unlink da/dc/f24 0 2024-03-22T07:28:26.861 INFO:tasks.workunit.client.1.smithi195.stdout:8/159: mkdir da/d17/d32 0 2024-03-22T07:28:26.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/111: dwrite d13/f1f [0,4194304] 0 2024-03-22T07:28:26.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/112: write f3 [1999428,123093] 0 2024-03-22T07:28:26.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/160: write da/fb [1599201,81776] 0 2024-03-22T07:28:26.867 INFO:tasks.workunit.client.1.smithi195.stdout:3/143: dwrite d3/df/f2c [0,4194304] 0 2024-03-22T07:28:26.869 INFO:tasks.workunit.client.1.smithi195.stdout:4/113: symlink d13/d15/l2b 0 2024-03-22T07:28:26.870 INFO:tasks.workunit.client.1.smithi195.stdout:8/161: symlink da/l33 0 2024-03-22T07:28:26.870 INFO:tasks.workunit.client.1.smithi195.stdout:8/162: fsync da/de/f2d 0 2024-03-22T07:28:26.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/144: truncate d3/f24 6940944 0 2024-03-22T07:28:26.871 INFO:tasks.workunit.client.1.smithi195.stdout:3/145: chown d3/d18/l25 2412 1 2024-03-22T07:28:26.871 INFO:tasks.workunit.client.1.smithi195.stdout:8/163: mkdir da/de/d34 0 2024-03-22T07:28:26.872 INFO:tasks.workunit.client.1.smithi195.stdout:3/146: mknod d3/d18/c33 0 2024-03-22T07:28:26.872 INFO:tasks.workunit.client.1.smithi195.stdout:3/147: chown d3/d18/f26 205916665 1 2024-03-22T07:28:26.872 INFO:tasks.workunit.client.1.smithi195.stdout:3/148: write d3/f14 [4914429,49508] 0 2024-03-22T07:28:26.873 INFO:tasks.workunit.client.1.smithi195.stdout:8/164: creat da/f35 x:0 0 0 2024-03-22T07:28:26.873 INFO:tasks.workunit.client.1.smithi195.stdout:8/165: dread - da/f35 zero size 2024-03-22T07:28:26.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/149: mkdir d3/d22/d34 0 2024-03-22T07:28:26.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/150: fdatasync d3/df/d15/f1c 0 2024-03-22T07:28:26.877 INFO:tasks.workunit.client.1.smithi195.stdout:4/114: dread d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:26.879 INFO:tasks.workunit.client.1.smithi195.stdout:8/166: read f7 [734714,46282] 0 2024-03-22T07:28:26.880 INFO:tasks.workunit.client.1.smithi195.stdout:4/115: write f3 [238744,49437] 0 2024-03-22T07:28:26.881 INFO:tasks.workunit.client.1.smithi195.stdout:8/167: mknod da/d17/c36 0 2024-03-22T07:28:26.881 INFO:tasks.workunit.client.1.smithi195.stdout:8/168: stat da/d17/c1f 0 2024-03-22T07:28:26.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/116: mknod d13/d2a/c2c 0 2024-03-22T07:28:26.883 INFO:tasks.workunit.client.1.smithi195.stdout:8/169: unlink da/de/l31 0 2024-03-22T07:28:26.883 INFO:tasks.workunit.client.1.smithi195.stdout:8/170: write da/fb [1989942,38287] 0 2024-03-22T07:28:26.884 INFO:tasks.workunit.client.1.smithi195.stdout:4/117: symlink d13/d15/d16/d21/l2d 0 2024-03-22T07:28:26.884 INFO:tasks.workunit.client.1.smithi195.stdout:4/118: fsync f6 0 2024-03-22T07:28:26.884 INFO:tasks.workunit.client.1.smithi195.stdout:4/119: readlink d13/l23 0 2024-03-22T07:28:26.885 INFO:tasks.workunit.client.1.smithi195.stdout:8/171: symlink da/d17/l37 0 2024-03-22T07:28:26.886 INFO:tasks.workunit.client.1.smithi195.stdout:4/120: getdents d13/d15 0 2024-03-22T07:28:26.886 INFO:tasks.workunit.client.1.smithi195.stdout:4/121: readlink d13/l29 0 2024-03-22T07:28:26.886 INFO:tasks.workunit.client.1.smithi195.stdout:4/122: fsync f6 0 2024-03-22T07:28:26.886 INFO:tasks.workunit.client.1.smithi195.stdout:4/123: stat d13/d15/f22 0 2024-03-22T07:28:26.886 INFO:tasks.workunit.client.1.smithi195.stdout:8/172: dread da/de/f2d [0,4194304] 0 2024-03-22T07:28:26.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/124: truncate d13/f14 2317226 0 2024-03-22T07:28:26.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/173: mkdir da/de/d38 0 2024-03-22T07:28:26.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/125: creat d13/d2a/f2e x:0 0 0 2024-03-22T07:28:26.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/126: chown d13/d15/d16/f18 3392705 1 2024-03-22T07:28:26.895 INFO:tasks.workunit.client.1.smithi195.stdout:4/127: truncate f3 1742051 0 2024-03-22T07:28:26.895 INFO:tasks.workunit.client.1.smithi195.stdout:3/151: dwrite d3/df/d15/d1d/f30 [0,4194304] 0 2024-03-22T07:28:26.900 INFO:tasks.workunit.client.1.smithi195.stdout:3/152: truncate d3/df/f2c 630836 0 2024-03-22T07:28:26.900 INFO:tasks.workunit.client.1.smithi195.stdout:3/153: chown d3/l5 324 1 2024-03-22T07:28:26.900 INFO:tasks.workunit.client.1.smithi195.stdout:3/154: creat d3/f35 x:0 0 0 2024-03-22T07:28:26.902 INFO:tasks.workunit.client.1.smithi195.stdout:3/155: rename d3/l11 to d3/df/d15/d1d/l36 0 2024-03-22T07:28:26.902 INFO:tasks.workunit.client.1.smithi195.stdout:8/174: dwrite da/de/f2d [0,4194304] 0 2024-03-22T07:28:26.902 INFO:tasks.workunit.client.1.smithi195.stdout:8/175: getdents da/de/d34 0 2024-03-22T07:28:26.903 INFO:tasks.workunit.client.1.smithi195.stdout:3/156: rmdir d3/d22 39 2024-03-22T07:28:26.903 INFO:tasks.workunit.client.1.smithi195.stdout:3/157: fdatasync f0 0 2024-03-22T07:28:26.906 INFO:tasks.workunit.client.1.smithi195.stdout:4/128: write f6 [2563120,35412] 0 2024-03-22T07:28:26.915 INFO:tasks.workunit.client.1.smithi195.stdout:4/129: write d13/d2a/f28 [2603122,105832] 0 2024-03-22T07:28:26.918 INFO:tasks.workunit.client.1.smithi195.stdout:4/130: rename d13/d15/l1d to d13/d15/l2f 0 2024-03-22T07:28:26.919 INFO:tasks.workunit.client.1.smithi195.stdout:4/131: truncate f3 800844 0 2024-03-22T07:28:26.920 INFO:tasks.workunit.client.1.smithi195.stdout:4/132: symlink d13/d2a/l30 0 2024-03-22T07:28:26.921 INFO:tasks.workunit.client.1.smithi195.stdout:4/133: truncate d13/f14 988491 0 2024-03-22T07:28:26.921 INFO:tasks.workunit.client.1.smithi195.stdout:4/134: chown d13/d15/f25 0 1 2024-03-22T07:28:26.921 INFO:tasks.workunit.client.1.smithi195.stdout:4/135: write d13/d15/f1c [425414,34814] 0 2024-03-22T07:28:26.922 INFO:tasks.workunit.client.1.smithi195.stdout:4/136: rename d13/d15/d16/d21/f27 to d13/f31 0 2024-03-22T07:28:26.923 INFO:tasks.workunit.client.1.smithi195.stdout:4/137: mknod d13/d2a/c32 0 2024-03-22T07:28:26.925 INFO:tasks.workunit.client.1.smithi195.stdout:4/138: link d13/d2a/f2e d13/d15/d16/f33 0 2024-03-22T07:28:26.926 INFO:tasks.workunit.client.1.smithi195.stdout:4/139: creat d13/f34 x:0 0 0 2024-03-22T07:28:26.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/140: creat d13/d15/d16/f35 x:0 0 0 2024-03-22T07:28:26.928 INFO:tasks.workunit.client.1.smithi195.stdout:4/141: mkdir d13/d15/d16/d36 0 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:4/142: chown d13/d15/l2b 9 1 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:4/143: truncate d13/f14 1695875 0 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/158: dwrite d3/df/d15/d1d/f30 [0,4194304] 0 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/159: dread - d3/d18/f26 zero size 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/160: write d3/df/f2c [1513474,14787] 0 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:4/144: creat d13/d15/f37 x:0 0 0 2024-03-22T07:28:26.929 INFO:tasks.workunit.client.1.smithi195.stdout:8/176: dwrite da/fb [0,4194304] 0 2024-03-22T07:28:26.930 INFO:tasks.workunit.client.1.smithi195.stdout:8/177: fsync da/dc/f12 0 2024-03-22T07:28:26.930 INFO:tasks.workunit.client.1.smithi195.stdout:3/161: mkdir d3/d22/d37 0 2024-03-22T07:28:26.939 INFO:tasks.workunit.client.1.smithi195.stdout:8/178: dread f9 [0,4194304] 0 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/93: sync 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:9/163: sync 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:6/66: sync 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:5/125: sync 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/120: sync 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:7/97: sync 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:6/67: readlink d5/la 0 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/121: readlink d2/l1c 0 2024-03-22T07:28:26.940 INFO:tasks.workunit.client.1.smithi195.stdout:6/68: write d5/db/d10/f12 [41230,19678] 0 2024-03-22T07:28:26.942 INFO:tasks.workunit.client.1.smithi195.stdout:5/126: unlink d9/d12/d14/l2a 0 2024-03-22T07:28:26.942 INFO:tasks.workunit.client.1.smithi195.stdout:5/127: truncate d9/f28 653944 0 2024-03-22T07:28:26.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/94: mknod d0/d2/c20 0 2024-03-22T07:28:26.943 INFO:tasks.workunit.client.1.smithi195.stdout:1/95: chown d0/d2/l16 1955 1 2024-03-22T07:28:26.945 INFO:tasks.workunit.client.1.smithi195.stdout:7/98: unlink d0/f10 0 2024-03-22T07:28:26.946 INFO:tasks.workunit.client.1.smithi195.stdout:2/122: truncate d2/d3/d1a/f2b 3112295 0 2024-03-22T07:28:26.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/179: getdents da/de 0 2024-03-22T07:28:26.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/180: chown da/d17/c1f 214914681 1 2024-03-22T07:28:26.947 INFO:tasks.workunit.client.1.smithi195.stdout:8/181: truncate da/fb 4533876 0 2024-03-22T07:28:26.948 INFO:tasks.workunit.client.1.smithi195.stdout:1/96: truncate d0/d2/d6/f11 590980 0 2024-03-22T07:28:26.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/99: truncate d0/d13/d14/f8 1640351 0 2024-03-22T07:28:26.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/100: chown d0/d13/d14 16360 1 2024-03-22T07:28:26.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/101: chown d0 113475 1 2024-03-22T07:28:26.951 INFO:tasks.workunit.client.1.smithi195.stdout:2/123: mknod d2/d3/c2d 0 2024-03-22T07:28:26.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/69: link c3 d5/db/d10/c18 0 2024-03-22T07:28:26.953 INFO:tasks.workunit.client.1.smithi195.stdout:4/145: dwrite d13/d2a/f2e [0,4194304] 0 2024-03-22T07:28:26.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/182: unlink da/dc/c30 0 2024-03-22T07:28:26.954 INFO:tasks.workunit.client.1.smithi195.stdout:5/128: rename d9/ld to d9/l34 0 2024-03-22T07:28:26.954 INFO:tasks.workunit.client.1.smithi195.stdout:3/162: dwrite d3/d18/f2b [0,4194304] 0 2024-03-22T07:28:26.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/97: unlink d0/f10 0 2024-03-22T07:28:26.957 INFO:tasks.workunit.client.1.smithi195.stdout:7/102: truncate d0/ff 1167332 0 2024-03-22T07:28:26.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/124: mknod d2/d3/d7/d19/d22/c2e 0 2024-03-22T07:28:26.959 INFO:tasks.workunit.client.1.smithi195.stdout:6/70: symlink d5/db/d10/l19 0 2024-03-22T07:28:26.960 INFO:tasks.workunit.client.1.smithi195.stdout:6/71: truncate f4 825515 0 2024-03-22T07:28:26.962 INFO:tasks.workunit.client.1.smithi195.stdout:4/146: mknod d13/d15/d16/d36/c38 0 2024-03-22T07:28:26.965 INFO:tasks.workunit.client.1.smithi195.stdout:5/129: write d9/f16 [966834,91340] 0 2024-03-22T07:28:26.965 INFO:tasks.workunit.client.1.smithi195.stdout:5/130: dread - d9/f31 zero size 2024-03-22T07:28:26.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/131: chown f7 45623 1 2024-03-22T07:28:26.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/132: dread - d9/d12/d14/f17 zero size 2024-03-22T07:28:26.966 INFO:tasks.workunit.client.1.smithi195.stdout:3/163: rename d3/df/d15/d1d/l36 to d3/df/d15/d1d/l38 0 2024-03-22T07:28:26.966 INFO:tasks.workunit.client.1.smithi195.stdout:4/147: dread f3 [0,4194304] 0 2024-03-22T07:28:26.967 INFO:tasks.workunit.client.1.smithi195.stdout:4/148: read - d13/d15/f37 zero size 2024-03-22T07:28:26.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/103: creat d0/d13/f1c x:0 0 0 2024-03-22T07:28:26.968 INFO:tasks.workunit.client.1.smithi195.stdout:4/149: dread f9 [0,4194304] 0 2024-03-22T07:28:26.968 INFO:tasks.workunit.client.1.smithi195.stdout:4/150: chown c5 4712261 1 2024-03-22T07:28:26.968 INFO:tasks.workunit.client.1.smithi195.stdout:2/125: truncate d2/d3/d1a/f2b 2307807 0 2024-03-22T07:28:26.969 INFO:tasks.workunit.client.1.smithi195.stdout:4/151: dread d13/d15/f1c [0,4194304] 0 2024-03-22T07:28:26.975 INFO:tasks.workunit.client.1.smithi195.stdout:6/72: mkdir d5/db/d17/d1a 0 2024-03-22T07:28:26.975 INFO:tasks.workunit.client.1.smithi195.stdout:6/73: readlink d5/le 0 2024-03-22T07:28:26.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/183: rmdir da 39 2024-03-22T07:28:26.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/184: write da/dc/f12 [8802488,33939] 0 2024-03-22T07:28:26.980 INFO:tasks.workunit.client.1.smithi195.stdout:3/164: link d3/df/d15/d1d/f30 d3/d18/f39 0 2024-03-22T07:28:26.981 INFO:tasks.workunit.client.1.smithi195.stdout:7/104: symlink d0/l1d 0 2024-03-22T07:28:26.981 INFO:tasks.workunit.client.1.smithi195.stdout:7/105: creat d0/d13/f1e x:0 0 0 2024-03-22T07:28:26.982 INFO:tasks.workunit.client.1.smithi195.stdout:5/133: dwrite f7 [0,4194304] 0 2024-03-22T07:28:26.983 INFO:tasks.workunit.client.1.smithi195.stdout:2/126: write d2/d3/d1a/f2b [2245535,48275] 0 2024-03-22T07:28:26.984 INFO:tasks.workunit.client.1.smithi195.stdout:8/185: rename da/dc/c21 to da/c39 0 2024-03-22T07:28:26.985 INFO:tasks.workunit.client.1.smithi195.stdout:8/186: dread - da/dc/f2b zero size 2024-03-22T07:28:26.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/165: unlink d3/cc 0 2024-03-22T07:28:26.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/166: truncate d3/f14 5626997 0 2024-03-22T07:28:26.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/134: link c2 d9/d2d/c35 0 2024-03-22T07:28:26.988 INFO:tasks.workunit.client.1.smithi195.stdout:5/135: write d9/d12/f1f [5224675,114545] 0 2024-03-22T07:28:26.990 INFO:tasks.workunit.client.1.smithi195.stdout:4/152: rmdir d13 39 2024-03-22T07:28:26.991 INFO:tasks.workunit.client.1.smithi195.stdout:2/127: link d2/d3/db/c10 d2/d3/d7/da/de/c2f 0 2024-03-22T07:28:26.993 INFO:tasks.workunit.client.1.smithi195.stdout:3/167: dread d3/d18/f39 [0,4194304] 0 2024-03-22T07:28:26.993 INFO:tasks.workunit.client.1.smithi195.stdout:7/106: mknod d0/d13/d14/c1f 0 2024-03-22T07:28:26.994 INFO:tasks.workunit.client.1.smithi195.stdout:5/136: mkdir d9/d12/d1d/d36 0 2024-03-22T07:28:26.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/153: symlink d13/d15/d16/d36/l39 0 2024-03-22T07:28:26.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/154: fsync f3 0 2024-03-22T07:28:26.996 INFO:tasks.workunit.client.1.smithi195.stdout:4/155: write f11 [860132,41100] 0 2024-03-22T07:28:26.997 INFO:tasks.workunit.client.1.smithi195.stdout:2/128: chown d2/l4 69027173 1 2024-03-22T07:28:26.998 INFO:tasks.workunit.client.1.smithi195.stdout:8/187: mknod da/dc/c3a 0 2024-03-22T07:28:26.998 INFO:tasks.workunit.client.1.smithi195.stdout:8/188: stat da/d17/c36 0 2024-03-22T07:28:26.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/156: creat d13/f3a x:0 0 0 2024-03-22T07:28:26.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/157: write d13/f3a [775129,106294] 0 2024-03-22T07:28:27.000 INFO:tasks.workunit.client.1.smithi195.stdout:4/158: dread - d13/f34 zero size 2024-03-22T07:28:27.003 INFO:tasks.workunit.client.1.smithi195.stdout:8/189: creat da/dc/f3b x:0 0 0 2024-03-22T07:28:27.004 INFO:tasks.workunit.client.1.smithi195.stdout:2/129: fsync d2/d3/d1a/f2b 0 2024-03-22T07:28:27.004 INFO:tasks.workunit.client.1.smithi195.stdout:5/137: dread f7 [0,4194304] 0 2024-03-22T07:28:27.004 INFO:tasks.workunit.client.1.smithi195.stdout:5/138: fdatasync d9/f28 0 2024-03-22T07:28:27.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/107: mkdir d0/d13/d14/d20 0 2024-03-22T07:28:27.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/108: chown d0/d13/d14/fd 77974 1 2024-03-22T07:28:27.006 INFO:tasks.workunit.client.1.smithi195.stdout:4/159: mkdir d13/d2a/d3b 0 2024-03-22T07:28:27.006 INFO:tasks.workunit.client.1.smithi195.stdout:4/160: chown f11 123 1 2024-03-22T07:28:27.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/109: dread d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:27.008 INFO:tasks.workunit.client.1.smithi195.stdout:3/168: dwrite d3/f29 [0,4194304] 0 2024-03-22T07:28:27.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/130: symlink d2/d3/d7/d19/l30 0 2024-03-22T07:28:27.012 INFO:tasks.workunit.client.1.smithi195.stdout:5/139: mknod d9/d12/c37 0 2024-03-22T07:28:27.013 INFO:tasks.workunit.client.1.smithi195.stdout:8/190: symlink da/dc/l3c 0 2024-03-22T07:28:27.015 INFO:tasks.workunit.client.1.smithi195.stdout:3/169: dread - d3/f35 zero size 2024-03-22T07:28:27.015 INFO:tasks.workunit.client.1.smithi195.stdout:5/140: dread d9/d12/d1d/f23 [0,4194304] 0 2024-03-22T07:28:27.017 INFO:tasks.workunit.client.1.smithi195.stdout:2/131: creat d2/d3/f31 x:0 0 0 2024-03-22T07:28:27.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/191: symlink da/d17/d32/l3d 0 2024-03-22T07:28:27.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/192: chown da/dc 319 1 2024-03-22T07:28:27.020 INFO:tasks.workunit.client.1.smithi195.stdout:2/132: rename d2/d3/d7/da/d18/c23 to d2/d3/d7/d19/c32 0 2024-03-22T07:28:27.020 INFO:tasks.workunit.client.1.smithi195.stdout:2/133: write d2/d3/d1a/f2b [1583145,94763] 0 2024-03-22T07:28:27.020 INFO:tasks.workunit.client.1.smithi195.stdout:3/170: mknod d3/d22/d34/c3a 0 2024-03-22T07:28:27.021 INFO:tasks.workunit.client.1.smithi195.stdout:0/136: sync 2024-03-22T07:28:27.021 INFO:tasks.workunit.client.1.smithi195.stdout:0/137: write d1/d4/dd/df/f16 [143780,91330] 0 2024-03-22T07:28:27.021 INFO:tasks.workunit.client.1.smithi195.stdout:3/171: creat d3/d21/f3b x:0 0 0 2024-03-22T07:28:27.022 INFO:tasks.workunit.client.1.smithi195.stdout:5/141: dread f8 [0,4194304] 0 2024-03-22T07:28:27.026 INFO:tasks.workunit.client.1.smithi195.stdout:0/138: dread d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:27.027 INFO:tasks.workunit.client.1.smithi195.stdout:5/142: truncate d9/d12/f1f 4368256 0 2024-03-22T07:28:27.027 INFO:tasks.workunit.client.1.smithi195.stdout:5/143: chown d9/f29 134 1 2024-03-22T07:28:27.027 INFO:tasks.workunit.client.1.smithi195.stdout:4/161: dwrite d13/f1f [0,4194304] 0 2024-03-22T07:28:27.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/193: write da/dc/f12 [4381798,67911] 0 2024-03-22T07:28:27.028 INFO:tasks.workunit.client.1.smithi195.stdout:5/144: readlink d9/l10 0 2024-03-22T07:28:27.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/194: truncate da/f35 655794 0 2024-03-22T07:28:27.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/162: symlink d13/d2a/d3b/l3c 0 2024-03-22T07:28:27.032 INFO:tasks.workunit.client.1.smithi195.stdout:2/134: write d2/d3/d21/f14 [665915,113175] 0 2024-03-22T07:28:27.032 INFO:tasks.workunit.client.1.smithi195.stdout:5/145: dread d9/f28 [0,4194304] 0 2024-03-22T07:28:27.035 INFO:tasks.workunit.client.1.smithi195.stdout:5/146: unlink d9/d12/f1e 0 2024-03-22T07:28:27.037 INFO:tasks.workunit.client.1.smithi195.stdout:2/135: creat d2/d3/d7/d19/f33 x:0 0 0 2024-03-22T07:28:27.037 INFO:tasks.workunit.client.1.smithi195.stdout:2/136: write d2/d3/d7/d19/d22/d26/f2c [20606,60734] 0 2024-03-22T07:28:27.037 INFO:tasks.workunit.client.1.smithi195.stdout:2/137: write d2/d3/f5 [5082977,31062] 0 2024-03-22T07:28:27.044 INFO:tasks.workunit.client.1.smithi195.stdout:5/147: mknod d9/c38 0 2024-03-22T07:28:27.046 INFO:tasks.workunit.client.1.smithi195.stdout:5/148: mknod d9/d22/c39 0 2024-03-22T07:28:27.047 INFO:tasks.workunit.client.1.smithi195.stdout:4/163: truncate d13/f1f 3787124 0 2024-03-22T07:28:27.048 INFO:tasks.workunit.client.1.smithi195.stdout:4/164: mknod d13/d2a/d3b/c3d 0 2024-03-22T07:28:27.049 INFO:tasks.workunit.client.1.smithi195.stdout:4/165: readlink d13/l23 0 2024-03-22T07:28:27.056 INFO:tasks.workunit.client.1.smithi195.stdout:8/195: truncate da/dc/f12 1451540 0 2024-03-22T07:28:27.056 INFO:tasks.workunit.client.1.smithi195.stdout:8/196: truncate da/dc/f3b 320782 0 2024-03-22T07:28:27.056 INFO:tasks.workunit.client.1.smithi195.stdout:3/172: dwrite d3/d18/f39 [0,4194304] 0 2024-03-22T07:28:27.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/139: dwrite d1/d4/d12/f27 [0,4194304] 0 2024-03-22T07:28:27.065 INFO:tasks.workunit.client.1.smithi195.stdout:0/140: dread d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:27.066 INFO:tasks.workunit.client.1.smithi195.stdout:8/197: rmdir da/de/d34 0 2024-03-22T07:28:27.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/198: dread da/f35 [0,4194304] 0 2024-03-22T07:28:27.068 INFO:tasks.workunit.client.1.smithi195.stdout:0/141: creat d1/d4/d22/f29 x:0 0 0 2024-03-22T07:28:27.068 INFO:tasks.workunit.client.1.smithi195.stdout:4/166: write d13/f1f [5678,53468] 0 2024-03-22T07:28:27.070 INFO:tasks.workunit.client.1.smithi195.stdout:4/167: mkdir d13/d15/d16/d3e 0 2024-03-22T07:28:27.072 INFO:tasks.workunit.client.1.smithi195.stdout:4/168: rename d13/d2a/c2c to d13/d15/d16/d3e/c3f 0 2024-03-22T07:28:27.073 INFO:tasks.workunit.client.1.smithi195.stdout:8/199: dread da/de/f2d [0,4194304] 0 2024-03-22T07:28:27.074 INFO:tasks.workunit.client.1.smithi195.stdout:8/200: getdents da/d17/d32 0 2024-03-22T07:28:27.075 INFO:tasks.workunit.client.1.smithi195.stdout:8/201: write da/dc/f12 [880319,123014] 0 2024-03-22T07:28:27.076 INFO:tasks.workunit.client.1.smithi195.stdout:0/142: read d1/d10/d19/d20/f28 [2039340,26286] 0 2024-03-22T07:28:27.076 INFO:tasks.workunit.client.1.smithi195.stdout:0/143: write d1/d4/dd/df/f1d [48109,52577] 0 2024-03-22T07:28:27.076 INFO:tasks.workunit.client.1.smithi195.stdout:8/202: truncate f9 3763028 0 2024-03-22T07:28:27.077 INFO:tasks.workunit.client.1.smithi195.stdout:3/173: dwrite d3/df/f1f [0,4194304] 0 2024-03-22T07:28:27.077 INFO:tasks.workunit.client.1.smithi195.stdout:0/144: mknod d1/d10/d1f/c2a 0 2024-03-22T07:28:27.079 INFO:tasks.workunit.client.1.smithi195.stdout:8/203: dread da/d17/f25 [0,4194304] 0 2024-03-22T07:28:27.080 INFO:tasks.workunit.client.1.smithi195.stdout:3/174: rename d3/d18/c33 to d3/df/d15/d1d/c3c 0 2024-03-22T07:28:27.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/204: getdents da/de 0 2024-03-22T07:28:27.084 INFO:tasks.workunit.client.1.smithi195.stdout:3/175: rename d3/df/d15/c20 to d3/df/c3d 0 2024-03-22T07:28:27.087 INFO:tasks.workunit.client.1.smithi195.stdout:8/205: fsync f9 0 2024-03-22T07:28:27.087 INFO:tasks.workunit.client.1.smithi195.stdout:8/206: dread - da/dc/f2b zero size 2024-03-22T07:28:27.087 INFO:tasks.workunit.client.1.smithi195.stdout:8/207: write f9 [638420,69247] 0 2024-03-22T07:28:27.088 INFO:tasks.workunit.client.1.smithi195.stdout:4/169: dwrite d13/d15/d16/f33 [0,4194304] 0 2024-03-22T07:28:27.088 INFO:tasks.workunit.client.1.smithi195.stdout:4/170: chown d13/d15/l1b 19 1 2024-03-22T07:28:27.088 INFO:tasks.workunit.client.1.smithi195.stdout:3/176: mkdir d3/d3e 0 2024-03-22T07:28:27.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/171: symlink d13/d2a/l40 0 2024-03-22T07:28:27.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/172: truncate d13/d15/d16/f35 136898 0 2024-03-22T07:28:27.090 INFO:tasks.workunit.client.1.smithi195.stdout:4/173: stat d13/d2a/f28 0 2024-03-22T07:28:27.091 INFO:tasks.workunit.client.1.smithi195.stdout:3/177: write d3/f24 [1059668,119338] 0 2024-03-22T07:28:27.093 INFO:tasks.workunit.client.1.smithi195.stdout:4/174: rename d13/l23 to d13/d15/d16/d21/l41 0 2024-03-22T07:28:27.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/178: creat d3/f3f x:0 0 0 2024-03-22T07:28:27.095 INFO:tasks.workunit.client.1.smithi195.stdout:3/179: dread - d3/d21/f3b zero size 2024-03-22T07:28:27.096 INFO:tasks.workunit.client.1.smithi195.stdout:0/145: dwrite d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:27.096 INFO:tasks.workunit.client.1.smithi195.stdout:0/146: truncate d1/d4/dd/df/f16 1412970 0 2024-03-22T07:28:27.097 INFO:tasks.workunit.client.1.smithi195.stdout:3/180: creat d3/d22/f40 x:0 0 0 2024-03-22T07:28:27.097 INFO:tasks.workunit.client.1.smithi195.stdout:3/181: write d3/df/d15/f1c [1929572,119666] 0 2024-03-22T07:28:27.099 INFO:tasks.workunit.client.1.smithi195.stdout:3/182: symlink d3/df/d15/d1d/l41 0 2024-03-22T07:28:27.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/183: write d3/d18/f26 [803965,116857] 0 2024-03-22T07:28:27.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/184: read d3/f24 [5352245,40927] 0 2024-03-22T07:28:27.100 INFO:tasks.workunit.client.1.smithi195.stdout:3/185: fdatasync d3/df/f1f 0 2024-03-22T07:28:27.101 INFO:tasks.workunit.client.1.smithi195.stdout:0/147: dread d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:27.101 INFO:tasks.workunit.client.1.smithi195.stdout:3/186: link d3/fd d3/d22/d34/f42 0 2024-03-22T07:28:27.103 INFO:tasks.workunit.client.1.smithi195.stdout:8/208: dwrite da/de/f2d [0,4194304] 0 2024-03-22T07:28:27.106 INFO:tasks.workunit.client.1.smithi195.stdout:8/209: mknod da/de/d38/c3e 0 2024-03-22T07:28:27.110 INFO:tasks.workunit.client.1.smithi195.stdout:9/164: sync 2024-03-22T07:28:27.112 INFO:tasks.workunit.client.1.smithi195.stdout:9/165: link d2/d4/l1c d2/d4/d32/l46 0 2024-03-22T07:28:27.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/166: mkdir d2/d4/d6/db/d20/d47 0 2024-03-22T07:28:27.114 INFO:tasks.workunit.client.1.smithi195.stdout:4/175: dwrite f3 [0,4194304] 0 2024-03-22T07:28:27.116 INFO:tasks.workunit.client.1.smithi195.stdout:3/187: dread d3/df/f1f [0,4194304] 0 2024-03-22T07:28:27.117 INFO:tasks.workunit.client.1.smithi195.stdout:9/167: dread f1 [0,4194304] 0 2024-03-22T07:28:27.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/168: readlink d2/d4/d6/db/l17 0 2024-03-22T07:28:27.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/169: creat d2/d4/d6/db/f48 x:0 0 0 2024-03-22T07:28:27.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/170: chown d2/d4/d6/db/d20/l34 12776 1 2024-03-22T07:28:27.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/171: chown d2/d4/d6/db/f2c 89025 1 2024-03-22T07:28:27.118 INFO:tasks.workunit.client.1.smithi195.stdout:9/172: write d2/f9 [949819,15237] 0 2024-03-22T07:28:27.119 INFO:tasks.workunit.client.1.smithi195.stdout:9/173: link d2/f3 d2/d4/d6/f49 0 2024-03-22T07:28:27.119 INFO:tasks.workunit.client.1.smithi195.stdout:9/174: write f1 [5060103,70590] 0 2024-03-22T07:28:27.121 INFO:tasks.workunit.client.1.smithi195.stdout:4/176: write d13/f14 [1441854,113159] 0 2024-03-22T07:28:27.121 INFO:tasks.workunit.client.1.smithi195.stdout:0/148: dwrite d1/d4/dd/df/f1a [0,4194304] 0 2024-03-22T07:28:27.121 INFO:tasks.workunit.client.1.smithi195.stdout:8/210: dwrite da/dc/f2b [0,4194304] 0 2024-03-22T07:28:27.121 INFO:tasks.workunit.client.1.smithi195.stdout:8/211: chown da/d17/l37 1033300410 1 2024-03-22T07:28:27.122 INFO:tasks.workunit.client.1.smithi195.stdout:4/177: creat d13/d15/d16/d3e/f42 x:0 0 0 2024-03-22T07:28:27.124 INFO:tasks.workunit.client.1.smithi195.stdout:8/212: mknod da/d17/c3f 0 2024-03-22T07:28:27.124 INFO:tasks.workunit.client.1.smithi195.stdout:4/178: dread f12 [0,4194304] 0 2024-03-22T07:28:27.126 INFO:tasks.workunit.client.1.smithi195.stdout:3/188: write d3/df/d15/d1d/f30 [1678449,117977] 0 2024-03-22T07:28:27.129 INFO:tasks.workunit.client.1.smithi195.stdout:8/213: creat da/d17/d32/f40 x:0 0 0 2024-03-22T07:28:27.130 INFO:tasks.workunit.client.1.smithi195.stdout:4/179: dread d13/f31 [0,4194304] 0 2024-03-22T07:28:27.130 INFO:tasks.workunit.client.1.smithi195.stdout:4/180: truncate d13/d15/f1c 1369883 0 2024-03-22T07:28:27.131 INFO:tasks.workunit.client.1.smithi195.stdout:8/214: mknod da/dc/c41 0 2024-03-22T07:28:27.131 INFO:tasks.workunit.client.1.smithi195.stdout:0/149: dread d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:27.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/181: rename d13/d15/l2f to d13/d2a/l43 0 2024-03-22T07:28:27.134 INFO:tasks.workunit.client.1.smithi195.stdout:4/182: write d13/d15/f22 [216469,4402] 0 2024-03-22T07:28:27.135 INFO:tasks.workunit.client.1.smithi195.stdout:9/175: dwrite d2/f16 [0,4194304] 0 2024-03-22T07:28:27.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/150: mkdir d1/d4/dd/df/d2b 0 2024-03-22T07:28:27.138 INFO:tasks.workunit.client.1.smithi195.stdout:9/176: write d2/d4/d6/d18/f2b [173321,87001] 0 2024-03-22T07:28:27.138 INFO:tasks.workunit.client.1.smithi195.stdout:4/183: mkdir d13/d15/d44 0 2024-03-22T07:28:27.138 INFO:tasks.workunit.client.1.smithi195.stdout:9/177: fsync d2/d4/d6/db/f48 0 2024-03-22T07:28:27.145 INFO:tasks.workunit.client.1.smithi195.stdout:8/215: rmdir da/d17/d32 39 2024-03-22T07:28:27.146 INFO:tasks.workunit.client.1.smithi195.stdout:4/184: read d13/d15/f19 [3025787,112222] 0 2024-03-22T07:28:27.147 INFO:tasks.workunit.client.1.smithi195.stdout:8/216: symlink da/dc/l42 0 2024-03-22T07:28:27.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/189: dwrite d3/d18/f2b [0,4194304] 0 2024-03-22T07:28:27.147 INFO:tasks.workunit.client.1.smithi195.stdout:3/190: write d3/f3f [388340,89951] 0 2024-03-22T07:28:27.148 INFO:tasks.workunit.client.1.smithi195.stdout:4/185: creat d13/d2a/d3b/f45 x:0 0 0 2024-03-22T07:28:27.149 INFO:tasks.workunit.client.1.smithi195.stdout:4/186: read d13/d15/f22 [124389,127342] 0 2024-03-22T07:28:27.149 INFO:tasks.workunit.client.1.smithi195.stdout:9/178: write d2/d4/d6/db/d20/f26 [1824605,109167] 0 2024-03-22T07:28:27.150 INFO:tasks.workunit.client.1.smithi195.stdout:8/217: link da/d17/c3f da/de/c43 0 2024-03-22T07:28:27.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/187: mkdir d13/d15/d16/d3e/d46 0 2024-03-22T07:28:27.153 INFO:tasks.workunit.client.1.smithi195.stdout:4/188: chown f12 208259602 1 2024-03-22T07:28:27.153 INFO:tasks.workunit.client.1.smithi195.stdout:8/218: creat da/f44 x:0 0 0 2024-03-22T07:28:27.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/189: creat d13/d15/d16/f47 x:0 0 0 2024-03-22T07:28:27.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/190: write d13/f3a [892140,75823] 0 2024-03-22T07:28:27.156 INFO:tasks.workunit.client.1.smithi195.stdout:8/219: creat da/de/f45 x:0 0 0 2024-03-22T07:28:27.156 INFO:tasks.workunit.client.1.smithi195.stdout:8/220: stat da/d17 0 2024-03-22T07:28:27.156 INFO:tasks.workunit.client.1.smithi195.stdout:8/221: truncate da/f35 1553409 0 2024-03-22T07:28:27.157 INFO:tasks.workunit.client.1.smithi195.stdout:9/179: dread d2/d4/d6/db/f1b [0,4194304] 0 2024-03-22T07:28:27.157 INFO:tasks.workunit.client.1.smithi195.stdout:9/180: write d2/d4/d6/d18/f44 [132562,49603] 0 2024-03-22T07:28:27.157 INFO:tasks.workunit.client.1.smithi195.stdout:9/181: chown d2/d4/d6/d18 201 1 2024-03-22T07:28:27.158 INFO:tasks.workunit.client.1.smithi195.stdout:4/191: dread d13/d2a/f28 [0,4194304] 0 2024-03-22T07:28:27.158 INFO:tasks.workunit.client.1.smithi195.stdout:9/182: mkdir d2/d4/d6/db/d20/d4a 0 2024-03-22T07:28:27.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/183: getdents d2/d4/d6/d18 0 2024-03-22T07:28:27.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/184: chown d2/d4 100006 1 2024-03-22T07:28:27.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/185: readlink d2/d4/d6/db/d20/l34 0 2024-03-22T07:28:27.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/186: readlink d2/d4/d6/db/ld 0 2024-03-22T07:28:27.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/187: write d2/d4/d6/f49 [529631,96143] 0 2024-03-22T07:28:27.160 INFO:tasks.workunit.client.1.smithi195.stdout:9/188: creat d2/d4/d32/f4b x:0 0 0 2024-03-22T07:28:27.162 INFO:tasks.workunit.client.1.smithi195.stdout:9/189: getdents d2/d4/d6/db 0 2024-03-22T07:28:27.164 INFO:tasks.workunit.client.1.smithi195.stdout:9/190: symlink d2/d4/d6/db/l4c 0 2024-03-22T07:28:27.164 INFO:tasks.workunit.client.1.smithi195.stdout:3/191: dwrite d3/d22/f40 [0,4194304] 0 2024-03-22T07:28:27.164 INFO:tasks.workunit.client.1.smithi195.stdout:0/151: dwrite d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:27.166 INFO:tasks.workunit.client.1.smithi195.stdout:3/192: dread d3/d18/f26 [0,4194304] 0 2024-03-22T07:28:27.177 INFO:tasks.workunit.client.1.smithi195.stdout:8/222: dwrite da/de/f2d [0,4194304] 0 2024-03-22T07:28:27.179 INFO:tasks.workunit.client.1.smithi195.stdout:8/223: unlink da/fb 0 2024-03-22T07:28:27.180 INFO:tasks.workunit.client.1.smithi195.stdout:8/224: dread da/dc/f3b [0,4194304] 0 2024-03-22T07:28:27.180 INFO:tasks.workunit.client.1.smithi195.stdout:8/225: chown da/de/f2d 4110227 1 2024-03-22T07:28:27.181 INFO:tasks.workunit.client.1.smithi195.stdout:8/226: symlink da/de/d38/l46 0 2024-03-22T07:28:27.181 INFO:tasks.workunit.client.1.smithi195.stdout:4/192: dwrite d13/f34 [0,4194304] 0 2024-03-22T07:28:27.182 INFO:tasks.workunit.client.1.smithi195.stdout:8/227: mkdir da/de/d38/d47 0 2024-03-22T07:28:27.184 INFO:tasks.workunit.client.1.smithi195.stdout:4/193: dread d13/d15/f1c [0,4194304] 0 2024-03-22T07:28:27.189 INFO:tasks.workunit.client.1.smithi195.stdout:9/191: dwrite d2/d4/d6/d18/f3e [0,4194304] 0 2024-03-22T07:28:27.191 INFO:tasks.workunit.client.1.smithi195.stdout:3/193: dwrite d3/df/f1f [0,4194304] 0 2024-03-22T07:28:27.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/192: rename d2/d4/d6/cf to d2/d4/d1d/c4d 0 2024-03-22T07:28:27.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/193: fdatasync d2/d4/d1d/f22 0 2024-03-22T07:28:27.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/194: write d2/d4/d32/f4b [750639,46042] 0 2024-03-22T07:28:27.193 INFO:tasks.workunit.client.1.smithi195.stdout:9/195: chown d2/d4/d1d/f40 3 1 2024-03-22T07:28:27.195 INFO:tasks.workunit.client.1.smithi195.stdout:0/152: dwrite d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:27.195 INFO:tasks.workunit.client.1.smithi195.stdout:0/153: dread - d1/d4/d22/f29 zero size 2024-03-22T07:28:27.201 INFO:tasks.workunit.client.1.smithi195.stdout:4/194: dwrite f3 [0,4194304] 0 2024-03-22T07:28:27.205 INFO:tasks.workunit.client.1.smithi195.stdout:0/154: dread d1/d4/f8 [0,4194304] 0 2024-03-22T07:28:27.205 INFO:tasks.workunit.client.1.smithi195.stdout:0/155: chown d1/d4/f7 280 1 2024-03-22T07:28:27.206 INFO:tasks.workunit.client.1.smithi195.stdout:4/195: write d13/d15/f25 [72574,63720] 0 2024-03-22T07:28:27.206 INFO:tasks.workunit.client.1.smithi195.stdout:4/196: creat d13/d2a/d3b/f48 x:0 0 0 2024-03-22T07:28:27.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/156: rename d1/d4/f8 to d1/d10/d1f/f2c 0 2024-03-22T07:28:27.207 INFO:tasks.workunit.client.1.smithi195.stdout:9/196: dwrite d2/f3 [0,4194304] 0 2024-03-22T07:28:27.208 INFO:tasks.workunit.client.1.smithi195.stdout:4/197: mknod d13/d15/d16/c49 0 2024-03-22T07:28:27.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/198: chown d13/d15/l1b 86600836 1 2024-03-22T07:28:27.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/157: unlink d1/d4/d12/l26 0 2024-03-22T07:28:27.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/158: creat d1/d4/d12/f2d x:0 0 0 2024-03-22T07:28:27.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/159: write d1/d4/d22/f29 [1026497,71373] 0 2024-03-22T07:28:27.210 INFO:tasks.workunit.client.1.smithi195.stdout:0/160: stat d1/d4/d12/l15 0 2024-03-22T07:28:27.210 INFO:tasks.workunit.client.1.smithi195.stdout:9/197: getdents d2/d4/d6/db 0 2024-03-22T07:28:27.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/194: dwrite d3/df/d15/d1d/f31 [0,4194304] 0 2024-03-22T07:28:27.213 INFO:tasks.workunit.client.1.smithi195.stdout:9/198: rmdir d2/d4/d6/db 39 2024-03-22T07:28:27.213 INFO:tasks.workunit.client.1.smithi195.stdout:9/199: chown d2/d4/d6/db/f30 1967 1 2024-03-22T07:28:27.213 INFO:tasks.workunit.client.1.smithi195.stdout:9/200: write d2/d4/d1d/f41 [376695,30389] 0 2024-03-22T07:28:27.227 INFO:tasks.workunit.client.1.smithi195.stdout:4/199: truncate f11 2912486 0 2024-03-22T07:28:27.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/200: symlink d13/d15/l4a 0 2024-03-22T07:28:27.228 INFO:tasks.workunit.client.1.smithi195.stdout:0/161: dwrite d1/d10/d1f/f21 [0,4194304] 0 2024-03-22T07:28:27.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/162: creat d1/d4/f2e x:0 0 0 2024-03-22T07:28:27.233 INFO:tasks.workunit.client.1.smithi195.stdout:0/163: chown d1/d4/dd/df/c17 2949153 1 2024-03-22T07:28:27.233 INFO:tasks.workunit.client.1.smithi195.stdout:4/201: rename f3 to d13/d2a/d3b/f4b 0 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/164: creat d1/d10/d1f/f2f x:0 0 0 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:1/98: sync 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:6/74: sync 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:5/149: sync 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/138: sync 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:7/110: sync 2024-03-22T07:28:27.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/139: dread - d2/d3/d7/d19/f33 zero size 2024-03-22T07:28:27.236 INFO:tasks.workunit.client.1.smithi195.stdout:5/150: write d9/d12/d1d/f32 [500699,99105] 0 2024-03-22T07:28:27.236 INFO:tasks.workunit.client.1.smithi195.stdout:2/140: read d2/d3/f5 [1220083,126938] 0 2024-03-22T07:28:27.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/202: stat d13/d15/d16/d3e/c3f 0 2024-03-22T07:28:27.236 INFO:tasks.workunit.client.1.smithi195.stdout:6/75: write d5/dc/fd [375790,22396] 0 2024-03-22T07:28:27.236 INFO:tasks.workunit.client.1.smithi195.stdout:4/203: dread - d13/d2a/d3b/f45 zero size 2024-03-22T07:28:27.237 INFO:tasks.workunit.client.1.smithi195.stdout:7/111: dread d0/d13/d14/fd [0,4194304] 0 2024-03-22T07:28:27.237 INFO:tasks.workunit.client.1.smithi195.stdout:0/165: rename d1/d4/dd/df/c17 to d1/d10/d1f/c30 0 2024-03-22T07:28:27.238 INFO:tasks.workunit.client.1.smithi195.stdout:0/166: dread d1/d4/dd/df/f1d [0,4194304] 0 2024-03-22T07:28:27.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/201: dwrite d2/d4/f3b [0,4194304] 0 2024-03-22T07:28:27.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/202: fsync d2/d4/f3b 0 2024-03-22T07:28:27.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/195: dwrite d3/d18/f39 [0,4194304] 0 2024-03-22T07:28:27.239 INFO:tasks.workunit.client.1.smithi195.stdout:2/141: creat d2/f34 x:0 0 0 2024-03-22T07:28:27.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/76: symlink d5/dc/l1b 0 2024-03-22T07:28:27.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/77: fdatasync d5/f6 0 2024-03-22T07:28:27.242 INFO:tasks.workunit.client.1.smithi195.stdout:5/151: dread d9/f29 [0,4194304] 0 2024-03-22T07:28:27.243 INFO:tasks.workunit.client.1.smithi195.stdout:4/204: mknod d13/d2a/d3b/c4c 0 2024-03-22T07:28:27.244 INFO:tasks.workunit.client.1.smithi195.stdout:7/112: mknod d0/d13/d14/d20/c21 0 2024-03-22T07:28:27.245 INFO:tasks.workunit.client.1.smithi195.stdout:5/152: dread d9/d12/d1d/f23 [0,4194304] 0 2024-03-22T07:28:27.245 INFO:tasks.workunit.client.1.smithi195.stdout:5/153: chown l4 830970 1 2024-03-22T07:28:27.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/167: truncate d1/d4/dd/f13 1593753 0 2024-03-22T07:28:27.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/203: creat d2/d4/d6/d18/f4e x:0 0 0 2024-03-22T07:28:27.249 INFO:tasks.workunit.client.1.smithi195.stdout:3/196: unlink d3/df/l7 0 2024-03-22T07:28:27.249 INFO:tasks.workunit.client.1.smithi195.stdout:3/197: fdatasync d3/df/d15/f1c 0 2024-03-22T07:28:27.250 INFO:tasks.workunit.client.1.smithi195.stdout:2/142: creat d2/d3/d7/da/de/f35 x:0 0 0 2024-03-22T07:28:27.252 INFO:tasks.workunit.client.1.smithi195.stdout:4/205: mknod d13/d15/d16/c4d 0 2024-03-22T07:28:27.253 INFO:tasks.workunit.client.1.smithi195.stdout:4/206: truncate d13/f14 2553177 0 2024-03-22T07:28:27.253 INFO:tasks.workunit.client.1.smithi195.stdout:0/168: dread d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:27.254 INFO:tasks.workunit.client.1.smithi195.stdout:7/113: mkdir d0/d13/d22 0 2024-03-22T07:28:27.256 INFO:tasks.workunit.client.1.smithi195.stdout:9/204: unlink d2/d4/d6/d18/l39 0 2024-03-22T07:28:27.256 INFO:tasks.workunit.client.1.smithi195.stdout:9/205: chown d2/d4/d6/db/d20/l34 0 1 2024-03-22T07:28:27.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/198: creat d3/d22/d37/f43 x:0 0 0 2024-03-22T07:28:27.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/143: mknod d2/d3/db/c36 0 2024-03-22T07:28:27.258 INFO:tasks.workunit.client.1.smithi195.stdout:2/144: creat d2/d3/d1a/f37 x:0 0 0 2024-03-22T07:28:27.259 INFO:tasks.workunit.client.1.smithi195.stdout:0/169: getdents d1 0 2024-03-22T07:28:27.260 INFO:tasks.workunit.client.1.smithi195.stdout:7/114: creat d0/d13/d22/f23 x:0 0 0 2024-03-22T07:28:27.260 INFO:tasks.workunit.client.1.smithi195.stdout:5/154: mkdir d9/d3a 0 2024-03-22T07:28:27.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/199: rmdir d3/d3e 0 2024-03-22T07:28:27.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/200: creat d3/d21/f44 x:0 0 0 2024-03-22T07:28:27.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/201: truncate d3/d22/d37/f43 68695 0 2024-03-22T07:28:27.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/202: write d3/d21/f2e [21706,59827] 0 2024-03-22T07:28:27.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/203: dread - d3/d21/f44 zero size 2024-03-22T07:28:27.263 INFO:tasks.workunit.client.1.smithi195.stdout:0/170: read d1/d10/d1f/f2c [3814720,40113] 0 2024-03-22T07:28:27.264 INFO:tasks.workunit.client.1.smithi195.stdout:7/115: symlink d0/l24 0 2024-03-22T07:28:27.266 INFO:tasks.workunit.client.1.smithi195.stdout:3/204: mknod d3/df/d15/d1d/c45 0 2024-03-22T07:28:27.268 INFO:tasks.workunit.client.1.smithi195.stdout:1/99: dwrite d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:27.268 INFO:tasks.workunit.client.1.smithi195.stdout:1/100: fdatasync d0/d2/d6/f11 0 2024-03-22T07:28:27.268 INFO:tasks.workunit.client.1.smithi195.stdout:7/116: unlink d0/d13/d14/fd 0 2024-03-22T07:28:27.272 INFO:tasks.workunit.client.1.smithi195.stdout:1/101: mkdir d0/d2/d6/d21 0 2024-03-22T07:28:27.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/102: write d0/fa [448144,14529] 0 2024-03-22T07:28:27.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/103: readlink d0/d2/l16 0 2024-03-22T07:28:27.273 INFO:tasks.workunit.client.1.smithi195.stdout:1/104: chown d0/d2/f1b 66255825 1 2024-03-22T07:28:27.275 INFO:tasks.workunit.client.1.smithi195.stdout:7/117: link d0/d13/f1c d0/f25 0 2024-03-22T07:28:27.276 INFO:tasks.workunit.client.1.smithi195.stdout:6/78: dwrite d5/dc/fd [0,4194304] 0 2024-03-22T07:28:27.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/171: dread d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:27.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/105: symlink d0/d2/d9/l22 0 2024-03-22T07:28:27.277 INFO:tasks.workunit.client.1.smithi195.stdout:3/205: getdents d3/df 0 2024-03-22T07:28:27.277 INFO:tasks.workunit.client.1.smithi195.stdout:3/206: creat d3/d21/f46 x:0 0 0 2024-03-22T07:28:27.277 INFO:tasks.workunit.client.1.smithi195.stdout:3/207: readlink l1 0 2024-03-22T07:28:27.280 INFO:tasks.workunit.client.1.smithi195.stdout:7/118: creat d0/d13/d14/d20/f26 x:0 0 0 2024-03-22T07:28:27.280 INFO:tasks.workunit.client.1.smithi195.stdout:7/119: creat d0/d13/d22/f27 x:0 0 0 2024-03-22T07:28:27.282 INFO:tasks.workunit.client.1.smithi195.stdout:6/79: mknod d5/db/d17/c1c 0 2024-03-22T07:28:27.283 INFO:tasks.workunit.client.1.smithi195.stdout:6/80: readlink d5/db/l13 0 2024-03-22T07:28:27.283 INFO:tasks.workunit.client.1.smithi195.stdout:6/81: chown d5/db/d17/d1a 797475529 1 2024-03-22T07:28:27.286 INFO:tasks.workunit.client.1.smithi195.stdout:0/172: write d1/d4/dd/df/f1a [270865,81983] 0 2024-03-22T07:28:27.286 INFO:tasks.workunit.client.1.smithi195.stdout:0/173: rename d1 to d1/d10/d19/d31 22 2024-03-22T07:28:27.290 INFO:tasks.workunit.client.1.smithi195.stdout:7/120: mkdir d0/d13/d22/d28 0 2024-03-22T07:28:27.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/82: creat d5/d16/f1d x:0 0 0 2024-03-22T07:28:27.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/174: unlink d1/d4/c25 0 2024-03-22T07:28:27.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/175: read d1/d4/dd/df/f1a [1478752,9709] 0 2024-03-22T07:28:27.293 INFO:tasks.workunit.client.1.smithi195.stdout:1/106: read d0/d2/f1f [3952771,124961] 0 2024-03-22T07:28:27.293 INFO:tasks.workunit.client.1.smithi195.stdout:1/107: fsync d0/d2/f14 0 2024-03-22T07:28:27.293 INFO:tasks.workunit.client.1.smithi195.stdout:7/121: dread d0/fc [0,4194304] 0 2024-03-22T07:28:27.294 INFO:tasks.workunit.client.1.smithi195.stdout:6/83: creat d5/f1e x:0 0 0 2024-03-22T07:28:27.295 INFO:tasks.workunit.client.1.smithi195.stdout:0/176: symlink d1/d10/d19/d20/l32 0 2024-03-22T07:28:27.296 INFO:tasks.workunit.client.1.smithi195.stdout:9/206: dwrite d2/d4/d6/d18/f3e [0,4194304] 0 2024-03-22T07:28:27.297 INFO:tasks.workunit.client.1.smithi195.stdout:6/84: unlink f0 0 2024-03-22T07:28:27.298 INFO:tasks.workunit.client.1.smithi195.stdout:6/85: write d5/f14 [507129,90083] 0 2024-03-22T07:28:27.298 INFO:tasks.workunit.client.1.smithi195.stdout:6/86: fdatasync d5/dc/fd 0 2024-03-22T07:28:27.299 INFO:tasks.workunit.client.1.smithi195.stdout:7/122: mkdir d0/d13/d14/d29 0 2024-03-22T07:28:27.299 INFO:tasks.workunit.client.1.smithi195.stdout:7/123: write d0/fc [2173957,86047] 0 2024-03-22T07:28:27.299 INFO:tasks.workunit.client.1.smithi195.stdout:7/124: fdatasync d0/f25 0 2024-03-22T07:28:27.300 INFO:tasks.workunit.client.1.smithi195.stdout:2/145: dwrite f1 [0,4194304] 0 2024-03-22T07:28:27.300 INFO:tasks.workunit.client.1.smithi195.stdout:2/146: read d2/d3/d7/d19/d22/d26/f2c [32359,36960] 0 2024-03-22T07:28:27.301 INFO:tasks.workunit.client.1.smithi195.stdout:5/155: dwrite d9/d22/f2b [0,4194304] 0 2024-03-22T07:28:27.301 INFO:tasks.workunit.client.1.smithi195.stdout:6/87: unlink d5/f14 0 2024-03-22T07:28:27.302 INFO:tasks.workunit.client.1.smithi195.stdout:3/208: dwrite d3/d18/f39 [4194304,4194304] 0 2024-03-22T07:28:27.311 INFO:tasks.workunit.client.1.smithi195.stdout:6/88: symlink d5/db/d10/l1f 0 2024-03-22T07:28:27.311 INFO:tasks.workunit.client.1.smithi195.stdout:6/89: chown d5/db/d10 6969 1 2024-03-22T07:28:27.312 INFO:tasks.workunit.client.1.smithi195.stdout:7/125: symlink d0/d13/d14/l2a 0 2024-03-22T07:28:27.317 INFO:tasks.workunit.client.1.smithi195.stdout:3/209: mkdir d3/d21/d47 0 2024-03-22T07:28:27.319 INFO:tasks.workunit.client.1.smithi195.stdout:2/147: unlink d2/cc 0 2024-03-22T07:28:27.320 INFO:tasks.workunit.client.1.smithi195.stdout:6/90: symlink d5/db/l20 0 2024-03-22T07:28:27.322 INFO:tasks.workunit.client.1.smithi195.stdout:3/210: creat d3/f48 x:0 0 0 2024-03-22T07:28:27.323 INFO:tasks.workunit.client.1.smithi195.stdout:2/148: symlink d2/d3/d7/d19/d22/l38 0 2024-03-22T07:28:27.323 INFO:tasks.workunit.client.1.smithi195.stdout:2/149: chown d2/d3/d21 53073349 1 2024-03-22T07:28:27.323 INFO:tasks.workunit.client.1.smithi195.stdout:2/150: chown d2/d3/d7/d19/f28 15 1 2024-03-22T07:28:27.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/126: mkdir d0/d13/d14/d2b 0 2024-03-22T07:28:27.324 INFO:tasks.workunit.client.1.smithi195.stdout:7/127: dread - d0/f25 zero size 2024-03-22T07:28:27.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/211: mknod d3/df/c49 0 2024-03-22T07:28:27.326 INFO:tasks.workunit.client.1.smithi195.stdout:0/177: dwrite d1/d10/f14 [4194304,4194304] 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:6/91: fdatasync f4 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:6/92: write d5/f1e [946728,74342] 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/207: dwrite d2/d4/d6/d18/f3e [0,4194304] 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:9/208: creat d2/d4/d6/d18/f4f x:0 0 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:5/156: dwrite d9/fb [0,4194304] 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:2/151: unlink d2/d3/d7/d19/c32 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:0/178: dread d1/d4/d22/f29 [0,4194304] 0 2024-03-22T07:28:27.328 INFO:tasks.workunit.client.1.smithi195.stdout:0/179: chown d1/d10/d1f/f21 9760 1 2024-03-22T07:28:27.329 INFO:tasks.workunit.client.1.smithi195.stdout:9/209: write d2/d4/d1d/f41 [185827,16376] 0 2024-03-22T07:28:27.329 INFO:tasks.workunit.client.1.smithi195.stdout:7/128: symlink d0/d13/d22/l2c 0 2024-03-22T07:28:27.329 INFO:tasks.workunit.client.1.smithi195.stdout:0/180: dread d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:27.329 INFO:tasks.workunit.client.1.smithi195.stdout:0/181: fdatasync d1/d4/d22/f29 0 2024-03-22T07:28:27.329 INFO:tasks.workunit.client.1.smithi195.stdout:3/212: creat d3/df/f4a x:0 0 0 2024-03-22T07:28:27.333 INFO:tasks.workunit.client.1.smithi195.stdout:6/93: dread f4 [0,4194304] 0 2024-03-22T07:28:27.333 INFO:tasks.workunit.client.1.smithi195.stdout:5/157: creat d9/d2d/f3b x:0 0 0 2024-03-22T07:28:27.334 INFO:tasks.workunit.client.1.smithi195.stdout:5/158: write d9/f29 [3174124,207] 0 2024-03-22T07:28:27.334 INFO:tasks.workunit.client.1.smithi195.stdout:2/152: creat d2/d3/d24/f39 x:0 0 0 2024-03-22T07:28:27.334 INFO:tasks.workunit.client.1.smithi195.stdout:2/153: dread - d2/d3/d7/f27 zero size 2024-03-22T07:28:27.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/154: chown d2/d3/d7/f27 1533420 1 2024-03-22T07:28:27.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/155: readlink d2/d3/d7/da/d18/l2a 0 2024-03-22T07:28:27.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/156: creat d2/d3/d1a/f3a x:0 0 0 2024-03-22T07:28:27.335 INFO:tasks.workunit.client.1.smithi195.stdout:7/129: link d0/d13/f1e d0/f2d 0 2024-03-22T07:28:27.336 INFO:tasks.workunit.client.1.smithi195.stdout:3/213: dread d3/df/d15/f1c [0,4194304] 0 2024-03-22T07:28:27.336 INFO:tasks.workunit.client.1.smithi195.stdout:3/214: chown d3/df/d15/d1d/f31 2 1 2024-03-22T07:28:27.336 INFO:tasks.workunit.client.1.smithi195.stdout:9/210: write d2/d4/d6/db/f1f [999640,29049] 0 2024-03-22T07:28:27.336 INFO:tasks.workunit.client.1.smithi195.stdout:0/182: rename c0 to d1/d4/d22/c33 0 2024-03-22T07:28:27.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/94: truncate d5/f6 502934 0 2024-03-22T07:28:27.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/95: fsync d5/f1e 0 2024-03-22T07:28:27.342 INFO:tasks.workunit.client.1.smithi195.stdout:3/215: symlink d3/df/l4b 0 2024-03-22T07:28:27.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/211: mkdir d2/d4/d6/d18/d50 0 2024-03-22T07:28:27.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/212: write d2/d4/d6/d18/f2b [167403,50767] 0 2024-03-22T07:28:27.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/183: unlink d1/d10/d19/d20/l32 0 2024-03-22T07:28:27.349 INFO:tasks.workunit.client.1.smithi195.stdout:0/184: creat d1/d4/d12/f34 x:0 0 0 2024-03-22T07:28:27.349 INFO:tasks.workunit.client.1.smithi195.stdout:0/185: write d1/d10/d1f/f2c [4178235,97611] 0 2024-03-22T07:28:27.350 INFO:tasks.workunit.client.1.smithi195.stdout:3/216: dread d3/df/d15/d1d/f30 [4194304,4194304] 0 2024-03-22T07:28:27.352 INFO:tasks.workunit.client.1.smithi195.stdout:6/96: creat d5/db/d17/f21 x:0 0 0 2024-03-22T07:28:27.353 INFO:tasks.workunit.client.1.smithi195.stdout:2/157: getdents d2/d3/d7/da/d1b 0 2024-03-22T07:28:27.353 INFO:tasks.workunit.client.1.smithi195.stdout:2/158: chown d2/d3/f5 605523 1 2024-03-22T07:28:27.354 INFO:tasks.workunit.client.1.smithi195.stdout:9/213: creat d2/d4/d6/db/d20/d4a/f51 x:0 0 0 2024-03-22T07:28:27.354 INFO:tasks.workunit.client.1.smithi195.stdout:9/214: chown d2/d4/d6/db 19 1 2024-03-22T07:28:27.355 INFO:tasks.workunit.client.1.smithi195.stdout:9/215: creat d2/d4/d1d/f52 x:0 0 0 2024-03-22T07:28:27.355 INFO:tasks.workunit.client.1.smithi195.stdout:9/216: chown d2/d4/d23/c42 202 1 2024-03-22T07:28:27.355 INFO:tasks.workunit.client.1.smithi195.stdout:9/217: chown d2/d4/f38 0 1 2024-03-22T07:28:27.356 INFO:tasks.workunit.client.1.smithi195.stdout:3/217: creat d3/d22/d34/f4c x:0 0 0 2024-03-22T07:28:27.358 INFO:tasks.workunit.client.1.smithi195.stdout:5/159: dwrite d9/fb [0,4194304] 0 2024-03-22T07:28:27.358 INFO:tasks.workunit.client.1.smithi195.stdout:0/186: dread d1/d10/f14 [0,4194304] 0 2024-03-22T07:28:27.359 INFO:tasks.workunit.client.1.smithi195.stdout:7/130: dwrite d0/f2d [0,4194304] 0 2024-03-22T07:28:27.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/159: rename d2/d3/d7/da/de/c2f to d2/d3/d1a/c3b 0 2024-03-22T07:28:27.361 INFO:tasks.workunit.client.1.smithi195.stdout:9/218: symlink d2/d4/d6/db/l53 0 2024-03-22T07:28:27.362 INFO:tasks.workunit.client.1.smithi195.stdout:9/219: stat d2/d4/d6/f49 0 2024-03-22T07:28:27.362 INFO:tasks.workunit.client.1.smithi195.stdout:3/218: creat d3/d21/d47/f4d x:0 0 0 2024-03-22T07:28:27.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/97: getdents d5/db/d17 0 2024-03-22T07:28:27.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/98: write d5/db/d17/f21 [98488,110005] 0 2024-03-22T07:28:27.370 INFO:tasks.workunit.client.1.smithi195.stdout:5/160: creat d9/d3a/f3c x:0 0 0 2024-03-22T07:28:27.371 INFO:tasks.workunit.client.1.smithi195.stdout:9/220: write d2/d4/d6/d18/f3e [4018171,48509] 0 2024-03-22T07:28:27.374 INFO:tasks.workunit.client.1.smithi195.stdout:0/187: dwrite d1/d10/d1f/f21 [4194304,4194304] 0 2024-03-22T07:28:27.381 INFO:tasks.workunit.client.1.smithi195.stdout:7/131: symlink d0/d13/d14/d20/l2e 0 2024-03-22T07:28:27.381 INFO:tasks.workunit.client.1.smithi195.stdout:2/160: rmdir d2/d3/d7/d19/d22 39 2024-03-22T07:28:27.386 INFO:tasks.workunit.client.1.smithi195.stdout:6/99: symlink d5/db/d17/d1a/l22 0 2024-03-22T07:28:27.386 INFO:tasks.workunit.client.1.smithi195.stdout:0/188: rename d1/d4/ca to d1/d4/dd/df/c35 0 2024-03-22T07:28:27.390 INFO:tasks.workunit.client.1.smithi195.stdout:3/219: rmdir d3 39 2024-03-22T07:28:27.390 INFO:tasks.workunit.client.1.smithi195.stdout:3/220: dread - d3/d21/f3b zero size 2024-03-22T07:28:27.391 INFO:tasks.workunit.client.1.smithi195.stdout:2/161: dread d2/d3/d1a/f2b [0,4194304] 0 2024-03-22T07:28:27.391 INFO:tasks.workunit.client.1.smithi195.stdout:6/100: rename d5/db/lf to d5/db/l23 0 2024-03-22T07:28:27.392 INFO:tasks.workunit.client.1.smithi195.stdout:9/221: getdents d2/d4/d1d 0 2024-03-22T07:28:27.393 INFO:tasks.workunit.client.1.smithi195.stdout:3/221: chown d3/f14 1012 1 2024-03-22T07:28:27.394 INFO:tasks.workunit.client.1.smithi195.stdout:2/162: mkdir d2/d3/d7/d19/d22/d26/d3c 0 2024-03-22T07:28:27.394 INFO:tasks.workunit.client.1.smithi195.stdout:2/163: fdatasync d2/d3/d7/d19/d22/d26/f2c 0 2024-03-22T07:28:27.395 INFO:tasks.workunit.client.1.smithi195.stdout:9/222: getdents d2/d4/d23 0 2024-03-22T07:28:27.404 INFO:tasks.workunit.client.1.smithi195.stdout:8/228: sync 2024-03-22T07:28:27.405 INFO:tasks.workunit.client.1.smithi195.stdout:8/229: rename da/dc/c3a to da/de/c48 0 2024-03-22T07:28:27.406 INFO:tasks.workunit.client.1.smithi195.stdout:2/164: dread f1 [0,4194304] 0 2024-03-22T07:28:27.407 INFO:tasks.workunit.client.1.smithi195.stdout:5/161: dwrite d9/f28 [0,4194304] 0 2024-03-22T07:28:27.412 INFO:tasks.workunit.client.1.smithi195.stdout:8/230: dread f7 [0,4194304] 0 2024-03-22T07:28:27.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/223: dread d2/d4/d6/f49 [0,4194304] 0 2024-03-22T07:28:27.419 INFO:tasks.workunit.client.1.smithi195.stdout:2/165: dread d2/d3/f5 [0,4194304] 0 2024-03-22T07:28:27.421 INFO:tasks.workunit.client.1.smithi195.stdout:2/166: link d2/d3/db/c36 d2/d3/c3d 0 2024-03-22T07:28:27.422 INFO:tasks.workunit.client.1.smithi195.stdout:6/101: dwrite d5/dc/fd [4194304,4194304] 0 2024-03-22T07:28:27.423 INFO:tasks.workunit.client.1.smithi195.stdout:6/102: symlink d5/db/d17/d1a/l24 0 2024-03-22T07:28:27.423 INFO:tasks.workunit.client.1.smithi195.stdout:6/103: readlink d5/db/d10/l1f 0 2024-03-22T07:28:27.425 INFO:tasks.workunit.client.1.smithi195.stdout:3/222: dwrite d3/d22/d37/f43 [0,4194304] 0 2024-03-22T07:28:27.426 INFO:tasks.workunit.client.1.smithi195.stdout:2/167: dread d2/f9 [0,4194304] 0 2024-03-22T07:28:27.426 INFO:tasks.workunit.client.1.smithi195.stdout:6/104: dread d5/db/d10/f12 [0,4194304] 0 2024-03-22T07:28:27.427 INFO:tasks.workunit.client.1.smithi195.stdout:3/223: symlink d3/d22/l4e 0 2024-03-22T07:28:27.428 INFO:tasks.workunit.client.1.smithi195.stdout:2/168: mknod d2/d3/c3e 0 2024-03-22T07:28:27.429 INFO:tasks.workunit.client.1.smithi195.stdout:6/105: mkdir d5/db/d17/d1a/d25 0 2024-03-22T07:28:27.429 INFO:tasks.workunit.client.1.smithi195.stdout:6/106: readlink d5/db/d17/d1a/l24 0 2024-03-22T07:28:27.429 INFO:tasks.workunit.client.1.smithi195.stdout:5/162: dwrite d9/d3a/f3c [0,4194304] 0 2024-03-22T07:28:27.429 INFO:tasks.workunit.client.1.smithi195.stdout:6/107: write d5/f6 [1412411,104383] 0 2024-03-22T07:28:27.430 INFO:tasks.workunit.client.1.smithi195.stdout:3/224: creat d3/d22/f4f x:0 0 0 2024-03-22T07:28:27.430 INFO:tasks.workunit.client.1.smithi195.stdout:2/169: symlink d2/d3/d7/da/l3f 0 2024-03-22T07:28:27.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/224: dwrite d2/d4/d6/db/f30 [0,4194304] 0 2024-03-22T07:28:27.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/225: write d2/d4/d6/db/f48 [781722,84528] 0 2024-03-22T07:28:27.431 INFO:tasks.workunit.client.1.smithi195.stdout:9/226: creat d2/d4/d32/f54 x:0 0 0 2024-03-22T07:28:27.434 INFO:tasks.workunit.client.1.smithi195.stdout:6/108: rename d5/l9 to d5/l26 0 2024-03-22T07:28:27.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/225: readlink d3/d18/l1b 0 2024-03-22T07:28:27.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/226: chown d3/df/d15/l17 0 1 2024-03-22T07:28:27.436 INFO:tasks.workunit.client.1.smithi195.stdout:2/170: mkdir d2/d3/d21/d40 0 2024-03-22T07:28:27.441 INFO:tasks.workunit.client.1.smithi195.stdout:3/227: dread d3/f24 [0,4194304] 0 2024-03-22T07:28:27.442 INFO:tasks.workunit.client.1.smithi195.stdout:3/228: write d3/d21/f44 [1023478,67973] 0 2024-03-22T07:28:27.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/163: dwrite d9/d12/d1d/f23 [0,4194304] 0 2024-03-22T07:28:27.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/164: creat d9/d12/f3d x:0 0 0 2024-03-22T07:28:27.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/165: chown l4 34666 1 2024-03-22T07:28:27.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/227: rename d2/d4/d1d/f52 to d2/d4/f55 0 2024-03-22T07:28:27.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/228: fdatasync d2/d4/d32/f37 0 2024-03-22T07:28:27.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/229: fdatasync d2/d4/d6/d18/f44 0 2024-03-22T07:28:27.444 INFO:tasks.workunit.client.1.smithi195.stdout:9/230: readlink d2/d4/d6/db/l4c 0 2024-03-22T07:28:27.444 INFO:tasks.workunit.client.1.smithi195.stdout:2/171: getdents d2/d3 0 2024-03-22T07:28:27.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/229: mkdir d3/df/d50 0 2024-03-22T07:28:27.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/230: fdatasync d3/df/d15/f1c 0 2024-03-22T07:28:27.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/231: read d3/d22/d34/f42 [3384070,92333] 0 2024-03-22T07:28:27.445 INFO:tasks.workunit.client.1.smithi195.stdout:3/232: chown d3/df/f1f 1568 1 2024-03-22T07:28:27.446 INFO:tasks.workunit.client.1.smithi195.stdout:3/233: chown d3/df/d15/d1d/c45 117 1 2024-03-22T07:28:27.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/166: mknod d9/d12/d1d/d36/c3e 0 2024-03-22T07:28:27.447 INFO:tasks.workunit.client.1.smithi195.stdout:5/167: chown d9/f16 298937 1 2024-03-22T07:28:27.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/231: rename d2/c2e to d2/d4/d6/c56 0 2024-03-22T07:28:27.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/232: truncate d2/d4/d1d/f41 987145 0 2024-03-22T07:28:27.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/233: stat d2/f27 0 2024-03-22T07:28:27.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/234: chown d2/d4/d32/f4b 251 1 2024-03-22T07:28:27.449 INFO:tasks.workunit.client.1.smithi195.stdout:9/235: write d2/d4/d6/db/f1b [4671438,24618] 0 2024-03-22T07:28:27.449 INFO:tasks.workunit.client.1.smithi195.stdout:3/234: write d3/f2d [285110,53143] 0 2024-03-22T07:28:27.450 INFO:tasks.workunit.client.1.smithi195.stdout:5/168: mkdir d9/d12/d14/d3f 0 2024-03-22T07:28:27.450 INFO:tasks.workunit.client.1.smithi195.stdout:5/169: truncate d9/f25 409177 0 2024-03-22T07:28:27.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/109: dwrite f4 [0,4194304] 0 2024-03-22T07:28:27.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/110: truncate d5/db/d10/f12 140617 0 2024-03-22T07:28:27.452 INFO:tasks.workunit.client.1.smithi195.stdout:9/236: link d2/d4/d32/l35 d2/d4/d6/l57 0 2024-03-22T07:28:27.452 INFO:tasks.workunit.client.1.smithi195.stdout:2/172: link d2/l1f d2/d1e/l41 0 2024-03-22T07:28:27.453 INFO:tasks.workunit.client.1.smithi195.stdout:3/235: creat d3/d18/f51 x:0 0 0 2024-03-22T07:28:27.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/170: unlink l4 0 2024-03-22T07:28:27.457 INFO:tasks.workunit.client.1.smithi195.stdout:6/111: mknod d5/db/c27 0 2024-03-22T07:28:27.457 INFO:tasks.workunit.client.1.smithi195.stdout:6/112: write d5/f6 [2177936,16365] 0 2024-03-22T07:28:27.457 INFO:tasks.workunit.client.1.smithi195.stdout:6/113: truncate d5/d16/f1d 279391 0 2024-03-22T07:28:27.458 INFO:tasks.workunit.client.1.smithi195.stdout:9/237: rename d2/d4/d6/db/l53 to d2/d4/d6/db/d20/d4a/l58 0 2024-03-22T07:28:27.460 INFO:tasks.workunit.client.1.smithi195.stdout:3/236: stat d3/d18/f26 0 2024-03-22T07:28:27.460 INFO:tasks.workunit.client.1.smithi195.stdout:5/171: dread f7 [0,4194304] 0 2024-03-22T07:28:27.460 INFO:tasks.workunit.client.1.smithi195.stdout:5/172: creat d9/d2d/f40 x:0 0 0 2024-03-22T07:28:27.471 INFO:tasks.workunit.client.1.smithi195.stdout:6/114: unlink d5/d16/f1d 0 2024-03-22T07:28:27.471 INFO:tasks.workunit.client.1.smithi195.stdout:6/115: stat d5 0 2024-03-22T07:28:27.472 INFO:tasks.workunit.client.1.smithi195.stdout:9/238: creat d2/d4/d6/d18/d50/f59 x:0 0 0 2024-03-22T07:28:27.475 INFO:tasks.workunit.client.1.smithi195.stdout:5/173: truncate f7 1347260 0 2024-03-22T07:28:27.477 INFO:tasks.workunit.client.1.smithi195.stdout:6/116: creat d5/db/f28 x:0 0 0 2024-03-22T07:28:27.478 INFO:tasks.workunit.client.1.smithi195.stdout:9/239: mknod d2/d4/d6/d18/c5a 0 2024-03-22T07:28:27.478 INFO:tasks.workunit.client.1.smithi195.stdout:9/240: dread - d2/d4/d6/db/d20/d4a/f51 zero size 2024-03-22T07:28:27.478 INFO:tasks.workunit.client.1.smithi195.stdout:9/241: chown d2/d4/d6/db/d20/l34 159 1 2024-03-22T07:28:27.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/174: mkdir d9/d12/d14/d3f/d41 0 2024-03-22T07:28:27.479 INFO:tasks.workunit.client.1.smithi195.stdout:6/117: mkdir d5/db/d17/d1a/d29 0 2024-03-22T07:28:27.480 INFO:tasks.workunit.client.1.smithi195.stdout:3/237: read d3/f29 [1128555,59313] 0 2024-03-22T07:28:27.480 INFO:tasks.workunit.client.1.smithi195.stdout:3/238: chown d3 0 1 2024-03-22T07:28:27.480 INFO:tasks.workunit.client.1.smithi195.stdout:9/242: getdents d2/d4/d1d 0 2024-03-22T07:28:27.481 INFO:tasks.workunit.client.1.smithi195.stdout:5/175: symlink d9/d12/d14/d3f/l42 0 2024-03-22T07:28:27.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/243: unlink d2/d4/d6/l57 0 2024-03-22T07:28:27.483 INFO:tasks.workunit.client.1.smithi195.stdout:1/108: sync 2024-03-22T07:28:27.483 INFO:tasks.workunit.client.1.smithi195.stdout:4/207: sync 2024-03-22T07:28:27.483 INFO:tasks.workunit.client.1.smithi195.stdout:9/244: readlink d2/d4/l10 0 2024-03-22T07:28:27.488 INFO:tasks.workunit.client.1.smithi195.stdout:4/208: rmdir d13/d15/d16/d3e/d46 0 2024-03-22T07:28:27.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/176: dread f3 [0,4194304] 0 2024-03-22T07:28:27.489 INFO:tasks.workunit.client.1.smithi195.stdout:1/109: symlink d0/d2/l23 0 2024-03-22T07:28:27.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/209: dread d13/d2a/d3b/f4b [0,4194304] 0 2024-03-22T07:28:27.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/210: readlink d13/d15/d16/d21/l2d 0 2024-03-22T07:28:27.498 INFO:tasks.workunit.client.1.smithi195.stdout:4/211: creat d13/d2a/d3b/f4e x:0 0 0 2024-03-22T07:28:27.500 INFO:tasks.workunit.client.1.smithi195.stdout:3/239: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:27.500 INFO:tasks.workunit.client.1.smithi195.stdout:3/240: chown d3/df/c23 92375 1 2024-03-22T07:28:27.500 INFO:tasks.workunit.client.1.smithi195.stdout:6/118: dwrite d5/db/f28 [0,4194304] 0 2024-03-22T07:28:27.502 INFO:tasks.workunit.client.1.smithi195.stdout:4/212: truncate d13/d15/f19 2262601 0 2024-03-22T07:28:27.503 INFO:tasks.workunit.client.1.smithi195.stdout:4/213: write d13/f3a [342414,55039] 0 2024-03-22T07:28:27.504 INFO:tasks.workunit.client.1.smithi195.stdout:3/241: mknod d3/d22/c52 0 2024-03-22T07:28:27.506 INFO:tasks.workunit.client.1.smithi195.stdout:6/119: creat d5/db/d17/f2a x:0 0 0 2024-03-22T07:28:27.507 INFO:tasks.workunit.client.1.smithi195.stdout:4/214: rmdir d13/d15/d16/d36 39 2024-03-22T07:28:27.508 INFO:tasks.workunit.client.1.smithi195.stdout:3/242: creat d3/d21/f53 x:0 0 0 2024-03-22T07:28:27.508 INFO:tasks.workunit.client.1.smithi195.stdout:3/243: stat d3/df/l4b 0 2024-03-22T07:28:27.509 INFO:tasks.workunit.client.1.smithi195.stdout:6/120: chown c1 14538 1 2024-03-22T07:28:27.514 INFO:tasks.workunit.client.1.smithi195.stdout:4/215: fsync d13/d2a/d3b/f4b 0 2024-03-22T07:28:27.514 INFO:tasks.workunit.client.1.smithi195.stdout:4/216: creat d13/f4f x:0 0 0 2024-03-22T07:28:27.514 INFO:tasks.workunit.client.1.smithi195.stdout:4/217: write d13/d2a/d3b/f48 [390491,125182] 0 2024-03-22T07:28:27.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/244: rmdir d3/d21 39 2024-03-22T07:28:27.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/245: readlink d3/df/d15/l17 0 2024-03-22T07:28:27.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/246: read - d3/d21/d47/f4d zero size 2024-03-22T07:28:27.517 INFO:tasks.workunit.client.1.smithi195.stdout:3/247: truncate d3/d21/f3b 799988 0 2024-03-22T07:28:27.522 INFO:tasks.workunit.client.1.smithi195.stdout:6/121: write f4 [965148,123077] 0 2024-03-22T07:28:27.523 INFO:tasks.workunit.client.1.smithi195.stdout:9/245: dwrite d2/d4/f5 [4194304,4194304] 0 2024-03-22T07:28:27.523 INFO:tasks.workunit.client.1.smithi195.stdout:5/177: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:27.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/122: readlink d5/l11 0 2024-03-22T07:28:27.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/123: creat d5/d16/f2b x:0 0 0 2024-03-22T07:28:27.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/110: dwrite d0/d2/f1b [4194304,4194304] 0 2024-03-22T07:28:27.526 INFO:tasks.workunit.client.1.smithi195.stdout:9/246: creat d2/d4/f5b x:0 0 0 2024-03-22T07:28:27.527 INFO:tasks.workunit.client.1.smithi195.stdout:6/124: mknod d5/db/d17/d1a/d29/c2c 0 2024-03-22T07:28:27.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/111: unlink d0/d2/d6/f11 0 2024-03-22T07:28:27.530 INFO:tasks.workunit.client.1.smithi195.stdout:9/247: symlink d2/l5c 0 2024-03-22T07:28:27.531 INFO:tasks.workunit.client.1.smithi195.stdout:4/218: dwrite d13/d15/d16/f47 [0,4194304] 0 2024-03-22T07:28:27.531 INFO:tasks.workunit.client.1.smithi195.stdout:6/125: mknod d5/dc/c2d 0 2024-03-22T07:28:27.533 INFO:tasks.workunit.client.1.smithi195.stdout:1/112: creat d0/d2/d9/f24 x:0 0 0 2024-03-22T07:28:27.533 INFO:tasks.workunit.client.1.smithi195.stdout:1/113: stat d0/d2 0 2024-03-22T07:28:27.534 INFO:tasks.workunit.client.1.smithi195.stdout:9/248: creat d2/d4/d6/db/d20/f5d x:0 0 0 2024-03-22T07:28:27.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/249: stat d2/d4/f12 0 2024-03-22T07:28:27.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/250: creat d2/d4/d6/db/d20/d4a/f5e x:0 0 0 2024-03-22T07:28:27.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/251: chown d2/d4/d1d/f41 21358 1 2024-03-22T07:28:27.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/252: chown d2/d4/d6/d18/f43 302177 1 2024-03-22T07:28:27.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/219: rename d13/d15/f19 to d13/d15/d16/d36/f50 0 2024-03-22T07:28:27.539 INFO:tasks.workunit.client.1.smithi195.stdout:1/114: mknod d0/c25 0 2024-03-22T07:28:27.540 INFO:tasks.workunit.client.1.smithi195.stdout:3/248: dwrite d3/df/d15/d1d/f30 [0,4194304] 0 2024-03-22T07:28:27.541 INFO:tasks.workunit.client.1.smithi195.stdout:9/253: rename d2/f16 to d2/d4/d32/f5f 0 2024-03-22T07:28:27.542 INFO:tasks.workunit.client.1.smithi195.stdout:4/220: symlink d13/d15/d16/l51 0 2024-03-22T07:28:27.542 INFO:tasks.workunit.client.1.smithi195.stdout:4/221: read d13/f1a [1940590,96076] 0 2024-03-22T07:28:27.543 INFO:tasks.workunit.client.1.smithi195.stdout:3/249: mkdir d3/d21/d54 0 2024-03-22T07:28:27.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/254: dread d2/d4/d6/db/f48 [0,4194304] 0 2024-03-22T07:28:27.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/255: chown d2/d4/d1d 657559 1 2024-03-22T07:28:27.543 INFO:tasks.workunit.client.1.smithi195.stdout:9/256: chown d2/d4/f3b 0 1 2024-03-22T07:28:27.544 INFO:tasks.workunit.client.1.smithi195.stdout:3/250: symlink d3/d22/l55 0 2024-03-22T07:28:27.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/257: mkdir d2/d4/d6/db/d20/d60 0 2024-03-22T07:28:27.546 INFO:tasks.workunit.client.1.smithi195.stdout:3/251: rmdir d3/d21/d54 0 2024-03-22T07:28:27.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/252: fdatasync d3/d18/f39 0 2024-03-22T07:28:27.547 INFO:tasks.workunit.client.1.smithi195.stdout:1/115: read d0/d2/f14 [1522734,98104] 0 2024-03-22T07:28:27.547 INFO:tasks.workunit.client.1.smithi195.stdout:1/116: readlink d0/d2/d6/l12 0 2024-03-22T07:28:27.547 INFO:tasks.workunit.client.1.smithi195.stdout:1/117: write d0/d2/f14 [4759295,46982] 0 2024-03-22T07:28:27.549 INFO:tasks.workunit.client.1.smithi195.stdout:1/118: creat d0/f26 x:0 0 0 2024-03-22T07:28:27.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/119: mkdir d0/d2/d27 0 2024-03-22T07:28:27.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/120: symlink d0/d2/d27/l28 0 2024-03-22T07:28:27.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/121: dread d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:27.555 INFO:tasks.workunit.client.1.smithi195.stdout:1/122: symlink d0/d2/l29 0 2024-03-22T07:28:27.557 INFO:tasks.workunit.client.1.smithi195.stdout:1/123: mkdir d0/d2/d9/d2a 0 2024-03-22T07:28:27.558 INFO:tasks.workunit.client.1.smithi195.stdout:1/124: symlink d0/l2b 0 2024-03-22T07:28:27.565 INFO:tasks.workunit.client.1.smithi195.stdout:4/222: dwrite d13/d2a/f2e [0,4194304] 0 2024-03-22T07:28:27.566 INFO:tasks.workunit.client.1.smithi195.stdout:4/223: truncate d13/f1a 547429 0 2024-03-22T07:28:27.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/253: dwrite d3/f35 [0,4194304] 0 2024-03-22T07:28:27.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/254: stat d3/d22/c27 0 2024-03-22T07:28:27.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/255: chown d3/d21/f3b 3000 1 2024-03-22T07:28:27.568 INFO:tasks.workunit.client.1.smithi195.stdout:9/258: dwrite d2/d4/d6/d18/f1e [0,4194304] 0 2024-03-22T07:28:27.568 INFO:tasks.workunit.client.1.smithi195.stdout:9/259: readlink d2/d4/d6/db/ld 0 2024-03-22T07:28:27.572 INFO:tasks.workunit.client.1.smithi195.stdout:3/256: rename d3/df/f2c to d3/df/d15/d1d/f56 0 2024-03-22T07:28:27.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/125: rmdir d0/d2/d9 39 2024-03-22T07:28:27.577 INFO:tasks.workunit.client.1.smithi195.stdout:3/257: mknod d3/df/c57 0 2024-03-22T07:28:27.578 INFO:tasks.workunit.client.1.smithi195.stdout:1/126: mknod d0/d2/d9/c2c 0 2024-03-22T07:28:27.579 INFO:tasks.workunit.client.1.smithi195.stdout:3/258: creat d3/f58 x:0 0 0 2024-03-22T07:28:27.580 INFO:tasks.workunit.client.1.smithi195.stdout:3/259: creat d3/d21/d47/f59 x:0 0 0 2024-03-22T07:28:27.586 INFO:tasks.workunit.client.1.smithi195.stdout:4/224: dwrite d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:27.586 INFO:tasks.workunit.client.1.smithi195.stdout:9/260: dwrite d2/d4/d32/f5f [0,4194304] 0 2024-03-22T07:28:27.586 INFO:tasks.workunit.client.1.smithi195.stdout:9/261: dread - d2/d4/f55 zero size 2024-03-22T07:28:27.587 INFO:tasks.workunit.client.1.smithi195.stdout:9/262: write d2/d4/d6/db/f48 [1408642,45908] 0 2024-03-22T07:28:27.587 INFO:tasks.workunit.client.1.smithi195.stdout:9/263: chown d2/d4/d6/d18/f4e 1752 1 2024-03-22T07:28:27.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/260: write f0 [6337844,50772] 0 2024-03-22T07:28:27.590 INFO:tasks.workunit.client.1.smithi195.stdout:4/225: truncate f11 1765212 0 2024-03-22T07:28:27.592 INFO:tasks.workunit.client.1.smithi195.stdout:9/264: link d2/d4/d6/db/d20/l34 d2/d4/d6/db/d20/d60/l61 0 2024-03-22T07:28:27.592 INFO:tasks.workunit.client.1.smithi195.stdout:9/265: write d2/d4/d6/d18/f2b [1432929,112104] 0 2024-03-22T07:28:27.592 INFO:tasks.workunit.client.1.smithi195.stdout:3/261: mknod d3/d21/d47/c5a 0 2024-03-22T07:28:27.593 INFO:tasks.workunit.client.1.smithi195.stdout:4/226: truncate d13/d15/f1c 160924 0 2024-03-22T07:28:27.594 INFO:tasks.workunit.client.1.smithi195.stdout:9/266: mknod d2/d4/d6/db/d20/c62 0 2024-03-22T07:28:27.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/267: dread - d2/f27 zero size 2024-03-22T07:28:27.595 INFO:tasks.workunit.client.1.smithi195.stdout:3/262: mknod d3/df/d50/c5b 0 2024-03-22T07:28:27.595 INFO:tasks.workunit.client.1.smithi195.stdout:2/173: sync 2024-03-22T07:28:27.595 INFO:tasks.workunit.client.1.smithi195.stdout:7/132: sync 2024-03-22T07:28:27.598 INFO:tasks.workunit.client.1.smithi195.stdout:0/189: sync 2024-03-22T07:28:27.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/227: getdents d13/d15/d16 0 2024-03-22T07:28:27.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/228: stat d13/d2a/f28 0 2024-03-22T07:28:27.599 INFO:tasks.workunit.client.1.smithi195.stdout:8/231: sync 2024-03-22T07:28:27.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/190: symlink d1/d10/d19/l36 0 2024-03-22T07:28:27.604 INFO:tasks.workunit.client.1.smithi195.stdout:3/263: rename d3/d21 to d3/df/d15/d1d/d5c 0 2024-03-22T07:28:27.606 INFO:tasks.workunit.client.1.smithi195.stdout:4/229: creat d13/d2a/f52 x:0 0 0 2024-03-22T07:28:27.606 INFO:tasks.workunit.client.1.smithi195.stdout:4/230: read d13/f31 [147716,42389] 0 2024-03-22T07:28:27.606 INFO:tasks.workunit.client.1.smithi195.stdout:4/231: creat d13/d2a/d3b/f53 x:0 0 0 2024-03-22T07:28:27.608 INFO:tasks.workunit.client.1.smithi195.stdout:8/232: rename da/c39 to da/de/d38/c49 0 2024-03-22T07:28:27.609 INFO:tasks.workunit.client.1.smithi195.stdout:0/191: getdents d1/d4/d22 0 2024-03-22T07:28:27.609 INFO:tasks.workunit.client.1.smithi195.stdout:0/192: read d1/d10/f14 [1891317,63211] 0 2024-03-22T07:28:27.611 INFO:tasks.workunit.client.1.smithi195.stdout:0/193: rename d1/d4/d12/f34 to d1/d4/d12/f37 0 2024-03-22T07:28:27.612 INFO:tasks.workunit.client.1.smithi195.stdout:8/233: dread da/dc/f12 [0,4194304] 0 2024-03-22T07:28:27.612 INFO:tasks.workunit.client.1.smithi195.stdout:0/194: truncate d1/d4/dd/df/f11 1070454 0 2024-03-22T07:28:27.613 INFO:tasks.workunit.client.1.smithi195.stdout:0/195: chown d1/ce 35 1 2024-03-22T07:28:27.613 INFO:tasks.workunit.client.1.smithi195.stdout:0/196: dread - d1/d4/d12/f2d zero size 2024-03-22T07:28:27.613 INFO:tasks.workunit.client.1.smithi195.stdout:0/197: dread - d1/d10/d1f/f2f zero size 2024-03-22T07:28:27.615 INFO:tasks.workunit.client.1.smithi195.stdout:8/234: rename da/l27 to da/d17/d32/l4a 0 2024-03-22T07:28:27.615 INFO:tasks.workunit.client.1.smithi195.stdout:8/235: readlink da/d17/l37 0 2024-03-22T07:28:27.615 INFO:tasks.workunit.client.1.smithi195.stdout:7/133: dwrite d0/f11 [0,4194304] 0 2024-03-22T07:28:27.615 INFO:tasks.workunit.client.1.smithi195.stdout:7/134: readlink d0/d13/d14/d20/l2e 0 2024-03-22T07:28:27.616 INFO:tasks.workunit.client.1.smithi195.stdout:2/174: dwrite d2/d3/d7/d19/f28 [0,4194304] 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/175: write d2/f34 [386209,109391] 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/176: truncate d2/d3/d24/f39 908437 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/177: fdatasync d2/d3/d7/da/d1b/f29 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:2/178: readlink d2/d3/d7/d19/d22/l38 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:0/198: unlink d1/d4/dd/df/f1a 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:0/199: fsync d1/d4/dd/df/f1d 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:0/200: getdents d1/d4/dd/df/d2b 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:0/201: truncate d1/d4/d12/f37 265083 0 2024-03-22T07:28:27.617 INFO:tasks.workunit.client.1.smithi195.stdout:0/202: write d1/d10/d1f/f2f [671548,127925] 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:9/268: dwrite d2/d4/d6/db/f48 [0,4194304] 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:9/269: fdatasync d2/d4/d6/d18/f3e 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:9/270: creat d2/f63 x:0 0 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:9/271: stat d2/d4/d6/d18/f2b 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:7/135: read d0/fc [4199588,21565] 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:7/136: write d0/d13/d14/d20/f26 [120966,110750] 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/203: dread d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:27.619 INFO:tasks.workunit.client.1.smithi195.stdout:0/204: dread d1/d4/d12/f37 [0,4194304] 0 2024-03-22T07:28:27.622 INFO:tasks.workunit.client.1.smithi195.stdout:8/236: link l0 da/de/l4b 0 2024-03-22T07:28:27.622 INFO:tasks.workunit.client.1.smithi195.stdout:8/237: fsync da/d17/d32/f40 0 2024-03-22T07:28:27.622 INFO:tasks.workunit.client.1.smithi195.stdout:8/238: chown da/d17/c1f 90562 1 2024-03-22T07:28:27.623 INFO:tasks.workunit.client.1.smithi195.stdout:0/205: fdatasync d1/d10/d1f/f2f 0 2024-03-22T07:28:27.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/179: unlink f1 0 2024-03-22T07:28:27.626 INFO:tasks.workunit.client.1.smithi195.stdout:2/180: rename d2/d3 to d2/d3/d7/da/d42 22 2024-03-22T07:28:27.628 INFO:tasks.workunit.client.1.smithi195.stdout:3/264: dwrite d3/df/d15/d1d/f31 [0,4194304] 0 2024-03-22T07:28:27.631 INFO:tasks.workunit.client.1.smithi195.stdout:9/272: unlink d2/f3 0 2024-03-22T07:28:27.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/137: unlink d0/d13/d14/c4 0 2024-03-22T07:28:27.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/138: readlink d0/d13/d14/l19 0 2024-03-22T07:28:27.632 INFO:tasks.workunit.client.1.smithi195.stdout:8/239: symlink da/d17/l4c 0 2024-03-22T07:28:27.632 INFO:tasks.workunit.client.1.smithi195.stdout:8/240: fsync da/dc/f12 0 2024-03-22T07:28:27.633 INFO:tasks.workunit.client.1.smithi195.stdout:7/139: dread d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:27.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/140: dread d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:27.638 INFO:tasks.workunit.client.1.smithi195.stdout:0/206: mknod d1/d4/dd/df/d2b/c38 0 2024-03-22T07:28:27.638 INFO:tasks.workunit.client.1.smithi195.stdout:0/207: creat d1/d4/f39 x:0 0 0 2024-03-22T07:28:27.638 INFO:tasks.workunit.client.1.smithi195.stdout:0/208: chown d1/d4 7 1 2024-03-22T07:28:27.638 INFO:tasks.workunit.client.1.smithi195.stdout:2/181: mknod d2/d3/d7/da/de/c43 0 2024-03-22T07:28:27.641 INFO:tasks.workunit.client.1.smithi195.stdout:8/241: mkdir da/de/d38/d47/d4d 0 2024-03-22T07:28:27.641 INFO:tasks.workunit.client.1.smithi195.stdout:8/242: creat da/f4e x:0 0 0 2024-03-22T07:28:27.643 INFO:tasks.workunit.client.1.smithi195.stdout:0/209: truncate d1/d4/dd/df/f16 770987 0 2024-03-22T07:28:27.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/182: creat d2/d17/f44 x:0 0 0 2024-03-22T07:28:27.645 INFO:tasks.workunit.client.1.smithi195.stdout:3/265: mknod d3/d18/c5d 0 2024-03-22T07:28:27.645 INFO:tasks.workunit.client.1.smithi195.stdout:3/266: chown d3/d22/l4e 603608339 1 2024-03-22T07:28:27.645 INFO:tasks.workunit.client.1.smithi195.stdout:7/141: dread d0/d13/f1e [0,4194304] 0 2024-03-22T07:28:27.645 INFO:tasks.workunit.client.1.smithi195.stdout:7/142: fsync d0/f2d 0 2024-03-22T07:28:27.646 INFO:tasks.workunit.client.1.smithi195.stdout:9/273: mknod d2/d4/c64 0 2024-03-22T07:28:27.648 INFO:tasks.workunit.client.1.smithi195.stdout:8/243: dread da/dc/f2b [0,4194304] 0 2024-03-22T07:28:27.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/210: creat d1/d4/dd/f3a x:0 0 0 2024-03-22T07:28:27.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/211: write d1/d4/dd/df/f11 [1207986,72858] 0 2024-03-22T07:28:27.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/212: readlink d1/d4/d12/l15 0 2024-03-22T07:28:27.650 INFO:tasks.workunit.client.1.smithi195.stdout:7/143: dread d0/d13/f1e [0,4194304] 0 2024-03-22T07:28:27.650 INFO:tasks.workunit.client.1.smithi195.stdout:2/183: mknod d2/d17/c45 0 2024-03-22T07:28:27.651 INFO:tasks.workunit.client.1.smithi195.stdout:3/267: mknod d3/d22/c5e 0 2024-03-22T07:28:27.651 INFO:tasks.workunit.client.1.smithi195.stdout:3/268: write d3/df/d15/d1d/d5c/d47/f59 [959452,25561] 0 2024-03-22T07:28:27.652 INFO:tasks.workunit.client.1.smithi195.stdout:9/274: dread d2/d4/d6/d18/f36 [0,4194304] 0 2024-03-22T07:28:27.653 INFO:tasks.workunit.client.1.smithi195.stdout:9/275: read d2/d4/d32/f4b [194434,84462] 0 2024-03-22T07:28:27.655 INFO:tasks.workunit.client.1.smithi195.stdout:0/213: mknod d1/d10/c3b 0 2024-03-22T07:28:27.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/244: read da/de/f2d [4071377,74994] 0 2024-03-22T07:28:27.661 INFO:tasks.workunit.client.1.smithi195.stdout:2/184: mknod d2/d3/d7/d19/c46 0 2024-03-22T07:28:27.661 INFO:tasks.workunit.client.1.smithi195.stdout:2/185: chown d2/d3/d7/d19/f28 11 1 2024-03-22T07:28:27.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/269: symlink d3/d22/l5f 0 2024-03-22T07:28:27.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/270: read - d3/d18/f51 zero size 2024-03-22T07:28:27.663 INFO:tasks.workunit.client.1.smithi195.stdout:9/276: stat d2/d4/d6/d18/c3c 0 2024-03-22T07:28:27.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/214: creat d1/d10/d19/d20/f3c x:0 0 0 2024-03-22T07:28:27.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/186: creat d2/d3/d7/d19/d22/d26/d3c/f47 x:0 0 0 2024-03-22T07:28:27.668 INFO:tasks.workunit.client.1.smithi195.stdout:2/187: creat d2/d3/d7/da/de/f48 x:0 0 0 2024-03-22T07:28:27.668 INFO:tasks.workunit.client.1.smithi195.stdout:3/271: symlink d3/df/d15/d1d/l60 0 2024-03-22T07:28:27.668 INFO:tasks.workunit.client.1.smithi195.stdout:3/272: chown d3/df/d15/c32 4 1 2024-03-22T07:28:27.669 INFO:tasks.workunit.client.1.smithi195.stdout:9/277: chown d2/d4/d6/db/d20/d4a/l58 0 1 2024-03-22T07:28:27.672 INFO:tasks.workunit.client.1.smithi195.stdout:0/215: symlink d1/d4/dd/df/d2b/l3d 0 2024-03-22T07:28:27.674 INFO:tasks.workunit.client.1.smithi195.stdout:7/144: mkdir d0/d13/d14/d2f 0 2024-03-22T07:28:27.678 INFO:tasks.workunit.client.1.smithi195.stdout:9/278: rename d2/d4/d6/d18/l3f to d2/d4/d6/db/d20/d47/l65 0 2024-03-22T07:28:27.678 INFO:tasks.workunit.client.1.smithi195.stdout:9/279: chown d2/d4/d6/db/d20 565 1 2024-03-22T07:28:27.679 INFO:tasks.workunit.client.1.smithi195.stdout:0/216: creat d1/d4/dd/df/f3e x:0 0 0 2024-03-22T07:28:27.680 INFO:tasks.workunit.client.1.smithi195.stdout:7/145: truncate d0/f11 2095830 0 2024-03-22T07:28:27.680 INFO:tasks.workunit.client.1.smithi195.stdout:3/273: dread d3/df/d15/d1d/f31 [0,4194304] 0 2024-03-22T07:28:27.681 INFO:tasks.workunit.client.1.smithi195.stdout:9/280: truncate d2/d4/f12 3946465 0 2024-03-22T07:28:27.681 INFO:tasks.workunit.client.1.smithi195.stdout:0/217: mkdir d1/d4/dd/d3f 0 2024-03-22T07:28:27.682 INFO:tasks.workunit.client.1.smithi195.stdout:7/146: truncate d0/d13/d14/d20/f26 193616 0 2024-03-22T07:28:27.684 INFO:tasks.workunit.client.1.smithi195.stdout:3/274: rename d3/d18/l25 to d3/d22/l61 0 2024-03-22T07:28:27.685 INFO:tasks.workunit.client.1.smithi195.stdout:3/275: rename d3/df/c49 to d3/c62 0 2024-03-22T07:28:27.686 INFO:tasks.workunit.client.1.smithi195.stdout:3/276: symlink d3/df/d15/l63 0 2024-03-22T07:28:27.686 INFO:tasks.workunit.client.1.smithi195.stdout:3/277: stat d3/d22/l5f 0 2024-03-22T07:28:27.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/188: dwrite d2/d3/d1a/f2b [0,4194304] 0 2024-03-22T07:28:27.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/189: write d2/d3/d7/da/de/f48 [42206,65899] 0 2024-03-22T07:28:27.694 INFO:tasks.workunit.client.1.smithi195.stdout:9/281: write d2/d4/f5 [6662247,4259] 0 2024-03-22T07:28:27.696 INFO:tasks.workunit.client.1.smithi195.stdout:2/190: link d2/d3/c3e d2/d3/d21/d40/c49 0 2024-03-22T07:28:27.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/147: dread d0/d13/d14/d20/f26 [0,4194304] 0 2024-03-22T07:28:27.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/148: write d0/ff [1911264,15271] 0 2024-03-22T07:28:27.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/149: dread - d0/f25 zero size 2024-03-22T07:28:27.700 INFO:tasks.workunit.client.1.smithi195.stdout:7/150: write d0/d13/d22/f27 [394262,54557] 0 2024-03-22T07:28:27.700 INFO:tasks.workunit.client.1.smithi195.stdout:7/151: write d0/d13/d14/f8 [503101,15731] 0 2024-03-22T07:28:27.705 INFO:tasks.workunit.client.1.smithi195.stdout:7/152: rename d0/d13/d14/d20/f26 to d0/d13/d14/f30 0 2024-03-22T07:28:27.707 INFO:tasks.workunit.client.1.smithi195.stdout:7/153: truncate d0/d13/f1e 100465 0 2024-03-22T07:28:27.707 INFO:tasks.workunit.client.1.smithi195.stdout:7/154: dread - d0/d13/d22/f23 zero size 2024-03-22T07:28:27.709 INFO:tasks.workunit.client.1.smithi195.stdout:9/282: dwrite f1 [4194304,4194304] 0 2024-03-22T07:28:27.709 INFO:tasks.workunit.client.1.smithi195.stdout:9/283: mknod d2/d4/d32/c66 0 2024-03-22T07:28:27.711 INFO:tasks.workunit.client.1.smithi195.stdout:9/284: rename d2/d4/d6/db/ld to d2/l67 0 2024-03-22T07:28:27.712 INFO:tasks.workunit.client.1.smithi195.stdout:9/285: symlink d2/d4/d6/d18/l68 0 2024-03-22T07:28:27.712 INFO:tasks.workunit.client.1.smithi195.stdout:9/286: truncate d2/d4/d6/db/d20/d4a/f51 680900 0 2024-03-22T07:28:27.713 INFO:tasks.workunit.client.1.smithi195.stdout:9/287: link d2/d4/d32/f5f d2/d4/d23/f69 0 2024-03-22T07:28:27.713 INFO:tasks.workunit.client.1.smithi195.stdout:9/288: creat d2/d4/d6/db/d20/d4a/f6a x:0 0 0 2024-03-22T07:28:27.715 INFO:tasks.workunit.client.1.smithi195.stdout:9/289: symlink d2/d4/d23/l6b 0 2024-03-22T07:28:27.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/290: creat d2/d4/d6/db/f6c x:0 0 0 2024-03-22T07:28:27.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/155: read d0/d13/f1e [74809,105999] 0 2024-03-22T07:28:27.720 INFO:tasks.workunit.client.1.smithi195.stdout:7/156: mknod d0/d13/d22/c31 0 2024-03-22T07:28:27.720 INFO:tasks.workunit.client.1.smithi195.stdout:7/157: stat d0/d13/d14/f8 0 2024-03-22T07:28:27.722 INFO:tasks.workunit.client.1.smithi195.stdout:7/158: link d0/d13/d14/le d0/d13/d22/d28/l32 0 2024-03-22T07:28:27.724 INFO:tasks.workunit.client.1.smithi195.stdout:7/159: creat d0/d13/d14/d29/f33 x:0 0 0 2024-03-22T07:28:27.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/160: dread d0/d13/f1e [0,4194304] 0 2024-03-22T07:28:27.725 INFO:tasks.workunit.client.1.smithi195.stdout:7/161: getdents d0/d13 0 2024-03-22T07:28:27.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/162: dread - d0/d13/f1c zero size 2024-03-22T07:28:27.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/163: write d0/f25 [816208,97984] 0 2024-03-22T07:28:27.732 INFO:tasks.workunit.client.1.smithi195.stdout:5/178: sync 2024-03-22T07:28:27.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/126: sync 2024-03-22T07:28:27.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/127: chown d5/db/d10/l15 285511650 1 2024-03-22T07:28:27.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/128: creat d5/db/d10/f2e x:0 0 0 2024-03-22T07:28:27.732 INFO:tasks.workunit.client.1.smithi195.stdout:6/129: readlink d5/db/d17/d1a/l24 0 2024-03-22T07:28:27.736 INFO:tasks.workunit.client.1.smithi195.stdout:5/179: link d9/d12/c33 d9/d12/d14/d3f/c43 0 2024-03-22T07:28:27.736 INFO:tasks.workunit.client.1.smithi195.stdout:5/180: fsync d9/d2d/f3b 0 2024-03-22T07:28:27.737 INFO:tasks.workunit.client.1.smithi195.stdout:6/130: mknod d5/db/d17/d1a/c2f 0 2024-03-22T07:28:27.738 INFO:tasks.workunit.client.1.smithi195.stdout:5/181: creat d9/d12/d1d/d36/f44 x:0 0 0 2024-03-22T07:28:27.739 INFO:tasks.workunit.client.1.smithi195.stdout:7/164: dwrite d0/f25 [0,4194304] 0 2024-03-22T07:28:27.739 INFO:tasks.workunit.client.1.smithi195.stdout:6/131: link d5/l26 d5/d16/l30 0 2024-03-22T07:28:27.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/182: unlink d9/d12/d1d/f23 0 2024-03-22T07:28:27.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/183: truncate d9/f25 760194 0 2024-03-22T07:28:27.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/184: dread - d9/d12/d1d/d36/f44 zero size 2024-03-22T07:28:27.741 INFO:tasks.workunit.client.1.smithi195.stdout:7/165: creat d0/d13/d22/d28/f34 x:0 0 0 2024-03-22T07:28:27.741 INFO:tasks.workunit.client.1.smithi195.stdout:7/166: dread - d0/d13/d22/f23 zero size 2024-03-22T07:28:27.742 INFO:tasks.workunit.client.1.smithi195.stdout:6/132: creat d5/db/d17/d1a/d25/f31 x:0 0 0 2024-03-22T07:28:27.744 INFO:tasks.workunit.client.1.smithi195.stdout:6/133: unlink d5/db/d10/f12 0 2024-03-22T07:28:27.746 INFO:tasks.workunit.client.1.smithi195.stdout:5/185: rename d9/f16 to d9/f45 0 2024-03-22T07:28:27.750 INFO:tasks.workunit.client.1.smithi195.stdout:6/134: dread f4 [0,4194304] 0 2024-03-22T07:28:27.753 INFO:tasks.workunit.client.1.smithi195.stdout:6/135: dread d5/f1e [0,4194304] 0 2024-03-22T07:28:27.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/167: dwrite d0/d13/d22/f27 [0,4194304] 0 2024-03-22T07:28:27.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/168: readlink d0/d13/d22/l2c 0 2024-03-22T07:28:27.755 INFO:tasks.workunit.client.1.smithi195.stdout:6/136: creat d5/db/d17/d1a/f32 x:0 0 0 2024-03-22T07:28:27.759 INFO:tasks.workunit.client.1.smithi195.stdout:7/169: mkdir d0/d13/d14/d29/d35 0 2024-03-22T07:28:27.759 INFO:tasks.workunit.client.1.smithi195.stdout:7/170: write d0/d13/d14/f30 [1041495,23469] 0 2024-03-22T07:28:27.761 INFO:tasks.workunit.client.1.smithi195.stdout:6/137: unlink d5/db/d17/d1a/c2f 0 2024-03-22T07:28:27.763 INFO:tasks.workunit.client.1.smithi195.stdout:7/171: symlink d0/l36 0 2024-03-22T07:28:27.763 INFO:tasks.workunit.client.1.smithi195.stdout:7/172: stat d0/f25 0 2024-03-22T07:28:27.763 INFO:tasks.workunit.client.1.smithi195.stdout:6/138: rename d5/d16/f2b to d5/db/d17/d1a/d25/f33 0 2024-03-22T07:28:27.763 INFO:tasks.workunit.client.1.smithi195.stdout:6/139: write d5/db/d10/f2e [866892,38607] 0 2024-03-22T07:28:27.765 INFO:tasks.workunit.client.1.smithi195.stdout:7/173: unlink d0/d13/d22/d28/f34 0 2024-03-22T07:28:27.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/140: mkdir d5/db/d17/d1a/d25/d34 0 2024-03-22T07:28:27.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/141: write d5/db/d17/f21 [35294,37434] 0 2024-03-22T07:28:27.767 INFO:tasks.workunit.client.1.smithi195.stdout:6/142: chown d5/db/d17/c1c 58 1 2024-03-22T07:28:27.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/143: mknod d5/db/d17/d1a/d25/d34/c35 0 2024-03-22T07:28:27.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/144: readlink d5/l26 0 2024-03-22T07:28:27.768 INFO:tasks.workunit.client.1.smithi195.stdout:6/145: dread - d5/db/d17/d1a/d25/f33 zero size 2024-03-22T07:28:27.773 INFO:tasks.workunit.client.1.smithi195.stdout:5/186: dwrite d9/d12/f1f [0,4194304] 0 2024-03-22T07:28:27.773 INFO:tasks.workunit.client.1.smithi195.stdout:5/187: readlink d9/d12/d14/d3f/l42 0 2024-03-22T07:28:27.773 INFO:tasks.workunit.client.1.smithi195.stdout:5/188: mkdir d9/d22/d46 0 2024-03-22T07:28:27.774 INFO:tasks.workunit.client.1.smithi195.stdout:6/146: dread d5/db/d17/f21 [0,4194304] 0 2024-03-22T07:28:27.774 INFO:tasks.workunit.client.1.smithi195.stdout:6/147: chown d5/db/d17/d1a/d29/c2c 3067 1 2024-03-22T07:28:27.774 INFO:tasks.workunit.client.1.smithi195.stdout:6/148: creat d5/db/d10/f36 x:0 0 0 2024-03-22T07:28:27.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/189: unlink d9/d22/l26 0 2024-03-22T07:28:27.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/190: creat d9/d12/f47 x:0 0 0 2024-03-22T07:28:27.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/191: fsync f7 0 2024-03-22T07:28:27.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/149: mknod d5/db/d10/c37 0 2024-03-22T07:28:27.777 INFO:tasks.workunit.client.1.smithi195.stdout:5/192: symlink d9/d3a/l48 0 2024-03-22T07:28:27.777 INFO:tasks.workunit.client.1.smithi195.stdout:6/150: stat d5/db/l13 0 2024-03-22T07:28:27.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/193: truncate d9/d12/d1d/f32 284070 0 2024-03-22T07:28:27.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/194: stat d9/d12/l18 0 2024-03-22T07:28:27.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/195: creat d9/d12/d1d/d36/f49 x:0 0 0 2024-03-22T07:28:27.779 INFO:tasks.workunit.client.1.smithi195.stdout:7/174: dwrite d0/d13/f1c [0,4194304] 0 2024-03-22T07:28:27.779 INFO:tasks.workunit.client.1.smithi195.stdout:5/196: mknod d9/d12/d14/d3f/c4a 0 2024-03-22T07:28:27.779 INFO:tasks.workunit.client.1.smithi195.stdout:5/197: creat d9/d12/d14/f4b x:0 0 0 2024-03-22T07:28:27.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/198: dread - d9/d12/f30 zero size 2024-03-22T07:28:27.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/199: write d9/d12/f3d [377888,63191] 0 2024-03-22T07:28:27.783 INFO:tasks.workunit.client.1.smithi195.stdout:6/151: dread d5/db/f28 [0,4194304] 0 2024-03-22T07:28:27.783 INFO:tasks.workunit.client.1.smithi195.stdout:6/152: write d5/f6 [2609713,129507] 0 2024-03-22T07:28:27.784 INFO:tasks.workunit.client.1.smithi195.stdout:6/153: write f4 [152650,13955] 0 2024-03-22T07:28:27.787 INFO:tasks.workunit.client.1.smithi195.stdout:5/200: symlink d9/d12/d1d/d36/l4c 0 2024-03-22T07:28:27.790 INFO:tasks.workunit.client.1.smithi195.stdout:6/154: mknod d5/d16/c38 0 2024-03-22T07:28:27.793 INFO:tasks.workunit.client.1.smithi195.stdout:7/175: rmdir d0/d13/d14 39 2024-03-22T07:28:27.798 INFO:tasks.workunit.client.1.smithi195.stdout:6/155: getdents d5/db 0 2024-03-22T07:28:27.798 INFO:tasks.workunit.client.1.smithi195.stdout:1/127: sync 2024-03-22T07:28:27.798 INFO:tasks.workunit.client.1.smithi195.stdout:4/232: sync 2024-03-22T07:28:27.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/156: dread d5/db/f28 [0,4194304] 0 2024-03-22T07:28:27.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/233: rename d13/d15/d16/c49 to d13/d15/c54 0 2024-03-22T07:28:27.801 INFO:tasks.workunit.client.1.smithi195.stdout:1/128: rmdir d0/d2 39 2024-03-22T07:28:27.804 INFO:tasks.workunit.client.1.smithi195.stdout:4/234: rename d13/d15/d16/c4d to d13/d15/c55 0 2024-03-22T07:28:27.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/157: dread d5/dc/fd [4194304,4194304] 0 2024-03-22T07:28:27.806 INFO:tasks.workunit.client.1.smithi195.stdout:1/129: symlink d0/l2d 0 2024-03-22T07:28:27.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/235: rename d13/d2a/f52 to d13/d2a/f56 0 2024-03-22T07:28:27.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/236: fsync d13/f34 0 2024-03-22T07:28:27.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/237: readlink d13/l29 0 2024-03-22T07:28:27.808 INFO:tasks.workunit.client.1.smithi195.stdout:4/238: write d13/d15/d16/f47 [4771128,79021] 0 2024-03-22T07:28:27.808 INFO:tasks.workunit.client.1.smithi195.stdout:1/130: truncate d0/d2/f14 3936554 0 2024-03-22T07:28:27.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/131: write d0/d2/d9/f15 [578911,115643] 0 2024-03-22T07:28:27.811 INFO:tasks.workunit.client.1.smithi195.stdout:4/239: creat d13/d15/d16/f57 x:0 0 0 2024-03-22T07:28:27.811 INFO:tasks.workunit.client.1.smithi195.stdout:4/240: fsync f11 0 2024-03-22T07:28:27.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/176: dwrite d0/d13/d14/f30 [0,4194304] 0 2024-03-22T07:28:27.817 INFO:tasks.workunit.client.1.smithi195.stdout:1/132: dread d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:27.817 INFO:tasks.workunit.client.1.smithi195.stdout:1/133: readlink d0/d2/d27/l28 0 2024-03-22T07:28:27.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/177: creat d0/d13/d14/d29/d35/f37 x:0 0 0 2024-03-22T07:28:27.819 INFO:tasks.workunit.client.1.smithi195.stdout:1/134: creat d0/d2/f2e x:0 0 0 2024-03-22T07:28:27.821 INFO:tasks.workunit.client.1.smithi195.stdout:6/158: dwrite d5/f1e [0,4194304] 0 2024-03-22T07:28:27.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/159: rename d5/db/f28 to d5/db/d17/d1a/d29/f39 0 2024-03-22T07:28:27.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/160: fsync d5/db/d17/d1a/f32 0 2024-03-22T07:28:27.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/161: creat d5/f3a x:0 0 0 2024-03-22T07:28:27.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/135: dread d0/d2/fe [0,4194304] 0 2024-03-22T07:28:27.826 INFO:tasks.workunit.client.1.smithi195.stdout:1/136: truncate d0/d2/f2e 719864 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/201: dwrite d9/f11 [0,4194304] 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/202: fsync d9/f29 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/203: readlink d9/d12/d14/d3f/l42 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/204: truncate d9/d12/d1d/d36/f49 303396 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/205: write d9/d12/f3d [1031101,99039] 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:4/241: dwrite d13/d15/d16/f33 [0,4194304] 0 2024-03-22T07:28:27.828 INFO:tasks.workunit.client.1.smithi195.stdout:1/137: rename d0/fa to d0/d2/d6/f2f 0 2024-03-22T07:28:27.830 INFO:tasks.workunit.client.1.smithi195.stdout:1/138: dread d0/d2/d6/f2f [0,4194304] 0 2024-03-22T07:28:27.830 INFO:tasks.workunit.client.1.smithi195.stdout:1/139: chown d0/d2/f14 2 1 2024-03-22T07:28:27.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/206: link d9/d12/d14/d3f/c4a d9/d12/d14/d3f/d41/c4d 0 2024-03-22T07:28:27.831 INFO:tasks.workunit.client.1.smithi195.stdout:5/207: stat d9/d12/d14/f17 0 2024-03-22T07:28:27.831 INFO:tasks.workunit.client.1.smithi195.stdout:4/242: symlink d13/d2a/d3b/l58 0 2024-03-22T07:28:27.833 INFO:tasks.workunit.client.1.smithi195.stdout:1/140: truncate d0/d2/f1f 2373227 0 2024-03-22T07:28:27.833 INFO:tasks.workunit.client.1.smithi195.stdout:1/141: truncate d0/d2/f14 4013274 0 2024-03-22T07:28:27.835 INFO:tasks.workunit.client.1.smithi195.stdout:4/243: getdents d13/d15/d16/d21 0 2024-03-22T07:28:27.835 INFO:tasks.workunit.client.1.smithi195.stdout:4/244: dread - d13/f4f zero size 2024-03-22T07:28:27.835 INFO:tasks.workunit.client.1.smithi195.stdout:4/245: fdatasync d13/d15/f1c 0 2024-03-22T07:28:27.838 INFO:tasks.workunit.client.1.smithi195.stdout:1/142: creat d0/d2/d27/f30 x:0 0 0 2024-03-22T07:28:27.838 INFO:tasks.workunit.client.1.smithi195.stdout:1/143: chown d0/d2/d27/l28 5 1 2024-03-22T07:28:27.841 INFO:tasks.workunit.client.1.smithi195.stdout:6/162: dwrite d5/db/d17/d1a/d25/f33 [0,4194304] 0 2024-03-22T07:28:27.842 INFO:tasks.workunit.client.1.smithi195.stdout:1/144: mknod d0/d2/d27/c31 0 2024-03-22T07:28:27.842 INFO:tasks.workunit.client.1.smithi195.stdout:1/145: chown d0/d2/d6 256703227 1 2024-03-22T07:28:27.842 INFO:tasks.workunit.client.1.smithi195.stdout:1/146: dread - d0/d2/d27/f30 zero size 2024-03-22T07:28:27.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/246: write d13/f17 [2323901,110678] 0 2024-03-22T07:28:27.848 INFO:tasks.workunit.client.1.smithi195.stdout:0/218: sync 2024-03-22T07:28:27.848 INFO:tasks.workunit.client.1.smithi195.stdout:8/245: sync 2024-03-22T07:28:27.848 INFO:tasks.workunit.client.1.smithi195.stdout:8/246: stat f9 0 2024-03-22T07:28:27.849 INFO:tasks.workunit.client.1.smithi195.stdout:6/163: mkdir d5/db/d10/d3b 0 2024-03-22T07:28:27.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/208: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:27.855 INFO:tasks.workunit.client.1.smithi195.stdout:4/247: symlink d13/d15/d44/l59 0 2024-03-22T07:28:27.855 INFO:tasks.workunit.client.1.smithi195.stdout:4/248: stat d13/d15/d16/l51 0 2024-03-22T07:28:27.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/219: mkdir d1/d10/d1f/d40 0 2024-03-22T07:28:27.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/220: chown d1/d10 38 1 2024-03-22T07:28:27.857 INFO:tasks.workunit.client.1.smithi195.stdout:0/221: chown d1/d10/d19/d20/f3c 60 1 2024-03-22T07:28:27.859 INFO:tasks.workunit.client.1.smithi195.stdout:8/247: rmdir da/de/d38/d47/d4d 0 2024-03-22T07:28:27.861 INFO:tasks.workunit.client.1.smithi195.stdout:6/164: mkdir d5/dc/d3c 0 2024-03-22T07:28:27.862 INFO:tasks.workunit.client.1.smithi195.stdout:1/147: dwrite d0/d2/fe [0,4194304] 0 2024-03-22T07:28:27.865 INFO:tasks.workunit.client.1.smithi195.stdout:4/249: truncate d13/f1f 1420822 0 2024-03-22T07:28:27.866 INFO:tasks.workunit.client.1.smithi195.stdout:0/222: mkdir d1/d4/d22/d41 0 2024-03-22T07:28:27.866 INFO:tasks.workunit.client.1.smithi195.stdout:8/248: rmdir da/d17 39 2024-03-22T07:28:27.866 INFO:tasks.workunit.client.1.smithi195.stdout:8/249: write da/dc/f3b [145492,52575] 0 2024-03-22T07:28:27.867 INFO:tasks.workunit.client.1.smithi195.stdout:6/165: creat d5/dc/d3c/f3d x:0 0 0 2024-03-22T07:28:27.868 INFO:tasks.workunit.client.1.smithi195.stdout:6/166: chown d5/db/d17/f2a 1788 1 2024-03-22T07:28:27.868 INFO:tasks.workunit.client.1.smithi195.stdout:6/167: chown d5/db/d17/d1a/d25/d34/c35 38963 1 2024-03-22T07:28:27.868 INFO:tasks.workunit.client.1.smithi195.stdout:6/168: chown d5/db/d17/d1a/d25 7717 1 2024-03-22T07:28:27.868 INFO:tasks.workunit.client.1.smithi195.stdout:6/169: creat d5/db/d10/f3e x:0 0 0 2024-03-22T07:28:27.868 INFO:tasks.workunit.client.1.smithi195.stdout:1/148: mkdir d0/d2/d6/d21/d32 0 2024-03-22T07:28:27.868 INFO:tasks.workunit.client.1.smithi195.stdout:1/149: fdatasync d0/d2/f1f 0 2024-03-22T07:28:27.869 INFO:tasks.workunit.client.1.smithi195.stdout:0/223: mkdir d1/d4/d42 0 2024-03-22T07:28:27.869 INFO:tasks.workunit.client.1.smithi195.stdout:0/224: getdents d1/d4/dd/d3f 0 2024-03-22T07:28:27.869 INFO:tasks.workunit.client.1.smithi195.stdout:0/225: truncate d1/d4/dd/df/f3e 683139 0 2024-03-22T07:28:27.869 INFO:tasks.workunit.client.1.smithi195.stdout:0/226: chown d1/ce 12 1 2024-03-22T07:28:27.869 INFO:tasks.workunit.client.1.smithi195.stdout:1/150: dread d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:27.871 INFO:tasks.workunit.client.1.smithi195.stdout:6/170: symlink d5/db/l3f 0 2024-03-22T07:28:27.872 INFO:tasks.workunit.client.1.smithi195.stdout:1/151: unlink d0/d2/l16 0 2024-03-22T07:28:27.872 INFO:tasks.workunit.client.1.smithi195.stdout:8/250: dread da/dc/f2b [0,4194304] 0 2024-03-22T07:28:27.873 INFO:tasks.workunit.client.1.smithi195.stdout:6/171: creat d5/db/f40 x:0 0 0 2024-03-22T07:28:27.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/251: unlink da/f44 0 2024-03-22T07:28:27.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/252: chown da/dc/l28 1 1 2024-03-22T07:28:27.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/253: creat da/f4f x:0 0 0 2024-03-22T07:28:27.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/254: chown da/d17/c36 126689 1 2024-03-22T07:28:27.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/209: dwrite d9/d12/f1f [0,4194304] 0 2024-03-22T07:28:27.878 INFO:tasks.workunit.client.1.smithi195.stdout:8/255: unlink da/de/c48 0 2024-03-22T07:28:27.878 INFO:tasks.workunit.client.1.smithi195.stdout:8/256: readlink da/de/d38/l46 0 2024-03-22T07:28:27.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/172: dread d5/f6 [0,4194304] 0 2024-03-22T07:28:27.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/173: read - d5/db/d17/f2a zero size 2024-03-22T07:28:27.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/174: write d5/f6 [3247492,11910] 0 2024-03-22T07:28:27.880 INFO:tasks.workunit.client.1.smithi195.stdout:6/175: truncate d5/dc/d3c/f3d 312864 0 2024-03-22T07:28:27.887 INFO:tasks.workunit.client.1.smithi195.stdout:5/210: mknod d9/d22/d46/c4e 0 2024-03-22T07:28:27.887 INFO:tasks.workunit.client.1.smithi195.stdout:8/257: mknod da/d17/c50 0 2024-03-22T07:28:27.888 INFO:tasks.workunit.client.1.smithi195.stdout:8/258: dread - da/f4e zero size 2024-03-22T07:28:27.888 INFO:tasks.workunit.client.1.smithi195.stdout:6/176: creat d5/db/d17/d1a/d25/d34/f41 x:0 0 0 2024-03-22T07:28:27.888 INFO:tasks.workunit.client.1.smithi195.stdout:6/177: fdatasync d5/db/d17/d1a/d29/f39 0 2024-03-22T07:28:27.888 INFO:tasks.workunit.client.1.smithi195.stdout:6/178: stat d5/c7 0 2024-03-22T07:28:27.890 INFO:tasks.workunit.client.1.smithi195.stdout:5/211: mknod d9/d12/d14/d3f/d41/c4f 0 2024-03-22T07:28:27.890 INFO:tasks.workunit.client.1.smithi195.stdout:5/212: write d9/f45 [1864247,100245] 0 2024-03-22T07:28:27.896 INFO:tasks.workunit.client.1.smithi195.stdout:0/227: dwrite d1/d4/f2e [0,4194304] 0 2024-03-22T07:28:27.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/152: dwrite d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:27.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/153: dread d0/d2/d6/f2f [0,4194304] 0 2024-03-22T07:28:27.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/154: creat d0/d2/d27/f33 x:0 0 0 2024-03-22T07:28:27.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/155: chown d0/d2/d9/f24 3114 1 2024-03-22T07:28:27.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/156: fdatasync d0/f26 0 2024-03-22T07:28:27.903 INFO:tasks.workunit.client.1.smithi195.stdout:0/228: dread d1/d10/d1f/f2f [0,4194304] 0 2024-03-22T07:28:27.903 INFO:tasks.workunit.client.1.smithi195.stdout:8/259: dwrite f7 [0,4194304] 0 2024-03-22T07:28:27.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/157: mknod d0/d2/d9/d2a/c34 0 2024-03-22T07:28:27.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/158: stat d0/d2/d6/cc 0 2024-03-22T07:28:27.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/159: write d0/d2/d9/f24 [143393,100024] 0 2024-03-22T07:28:27.905 INFO:tasks.workunit.client.1.smithi195.stdout:5/213: dread f3 [0,4194304] 0 2024-03-22T07:28:27.905 INFO:tasks.workunit.client.1.smithi195.stdout:8/260: link da/de/l4b da/de/d38/d47/l51 0 2024-03-22T07:28:27.907 INFO:tasks.workunit.client.1.smithi195.stdout:5/214: mkdir d9/d22/d50 0 2024-03-22T07:28:27.907 INFO:tasks.workunit.client.1.smithi195.stdout:5/215: creat d9/d2d/f51 x:0 0 0 2024-03-22T07:28:27.910 INFO:tasks.workunit.client.1.smithi195.stdout:8/261: link da/de/d38/d47/l51 da/de/l52 0 2024-03-22T07:28:27.916 INFO:tasks.workunit.client.1.smithi195.stdout:6/179: rename d5/db/d10 to d5/dc/d42 0 2024-03-22T07:28:27.919 INFO:tasks.workunit.client.1.smithi195.stdout:6/180: getdents d5/d16 0 2024-03-22T07:28:27.922 INFO:tasks.workunit.client.1.smithi195.stdout:6/181: dread d5/dc/fd [4194304,4194304] 0 2024-03-22T07:28:27.924 INFO:tasks.workunit.client.1.smithi195.stdout:6/182: creat d5/d16/f43 x:0 0 0 2024-03-22T07:28:27.924 INFO:tasks.workunit.client.1.smithi195.stdout:6/183: chown d5/dc/fd 198 1 2024-03-22T07:28:27.925 INFO:tasks.workunit.client.1.smithi195.stdout:0/229: dwrite d1/d4/d12/f27 [0,4194304] 0 2024-03-22T07:28:27.925 INFO:tasks.workunit.client.1.smithi195.stdout:8/262: dwrite f7 [0,4194304] 0 2024-03-22T07:28:27.925 INFO:tasks.workunit.client.1.smithi195.stdout:6/184: link d5/dc/fd d5/dc/d3c/f44 0 2024-03-22T07:28:27.925 INFO:tasks.workunit.client.1.smithi195.stdout:6/185: dread - d5/f3a zero size 2024-03-22T07:28:27.926 INFO:tasks.workunit.client.1.smithi195.stdout:6/186: dread d5/db/d17/f21 [0,4194304] 0 2024-03-22T07:28:27.927 INFO:tasks.workunit.client.1.smithi195.stdout:8/263: mkdir da/de/d38/d47/d53 0 2024-03-22T07:28:27.930 INFO:tasks.workunit.client.1.smithi195.stdout:6/187: rename d5/db/d17/d1a/d29 to d5/d16/d45 0 2024-03-22T07:28:27.930 INFO:tasks.workunit.client.1.smithi195.stdout:6/188: fsync d5/f1e 0 2024-03-22T07:28:27.930 INFO:tasks.workunit.client.1.smithi195.stdout:6/189: stat d5/dc/d42/c37 0 2024-03-22T07:28:27.930 INFO:tasks.workunit.client.1.smithi195.stdout:6/190: chown d5/db 0 1 2024-03-22T07:28:27.930 INFO:tasks.workunit.client.1.smithi195.stdout:6/191: write d5/db/d17/d1a/d25/f31 [543303,128548] 0 2024-03-22T07:28:27.931 INFO:tasks.workunit.client.1.smithi195.stdout:6/192: symlink d5/l46 0 2024-03-22T07:28:27.932 INFO:tasks.workunit.client.1.smithi195.stdout:6/193: mknod d5/dc/d42/c47 0 2024-03-22T07:28:27.932 INFO:tasks.workunit.client.1.smithi195.stdout:6/194: creat d5/d16/f48 x:0 0 0 2024-03-22T07:28:27.933 INFO:tasks.workunit.client.1.smithi195.stdout:5/216: getdents d9/d2d 0 2024-03-22T07:28:27.933 INFO:tasks.workunit.client.1.smithi195.stdout:5/217: creat d9/d12/f52 x:0 0 0 2024-03-22T07:28:27.944 INFO:tasks.workunit.client.1.smithi195.stdout:9/291: sync 2024-03-22T07:28:27.944 INFO:tasks.workunit.client.1.smithi195.stdout:3/278: sync 2024-03-22T07:28:27.944 INFO:tasks.workunit.client.1.smithi195.stdout:2/191: sync 2024-03-22T07:28:27.944 INFO:tasks.workunit.client.1.smithi195.stdout:9/292: chown d2/d4/d32/f37 30644 1 2024-03-22T07:28:27.944 INFO:tasks.workunit.client.1.smithi195.stdout:9/293: readlink d2/d4/d6/db/d20/d47/l65 0 2024-03-22T07:28:27.945 INFO:tasks.workunit.client.1.smithi195.stdout:9/294: mkdir d2/d4/d32/d6d 0 2024-03-22T07:28:27.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/230: dwrite d1/d4/d22/f29 [0,4194304] 0 2024-03-22T07:28:27.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/231: fsync d1/d4/dd/df/f16 0 2024-03-22T07:28:27.946 INFO:tasks.workunit.client.1.smithi195.stdout:8/264: dwrite da/de/f45 [0,4194304] 0 2024-03-22T07:28:27.946 INFO:tasks.workunit.client.1.smithi195.stdout:9/295: symlink d2/d4/d6/db/d20/l6e 0 2024-03-22T07:28:27.949 INFO:tasks.workunit.client.1.smithi195.stdout:5/218: dwrite d9/d12/d1d/d36/f49 [0,4194304] 0 2024-03-22T07:28:27.949 INFO:tasks.workunit.client.1.smithi195.stdout:5/219: truncate d9/d12/f47 521430 0 2024-03-22T07:28:27.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/265: dread da/dc/f2b [0,4194304] 0 2024-03-22T07:28:27.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/266: write da/f35 [1835093,32945] 0 2024-03-22T07:28:27.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/267: chown da/de/f45 3 1 2024-03-22T07:28:27.952 INFO:tasks.workunit.client.1.smithi195.stdout:8/268: chown da/dc/f3b 11580 1 2024-03-22T07:28:27.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/296: creat d2/d4/d32/d6d/f6f x:0 0 0 2024-03-22T07:28:27.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/297: fdatasync d2/d4/d6/db/d20/f26 0 2024-03-22T07:28:27.955 INFO:tasks.workunit.client.1.smithi195.stdout:8/269: creat da/de/d38/d47/f54 x:0 0 0 2024-03-22T07:28:27.955 INFO:tasks.workunit.client.1.smithi195.stdout:5/220: dread f0 [0,4194304] 0 2024-03-22T07:28:27.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/192: dread d2/d3/d21/f14 [0,4194304] 0 2024-03-22T07:28:27.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/298: mkdir d2/d4/d6/d18/d70 0 2024-03-22T07:28:27.956 INFO:tasks.workunit.client.1.smithi195.stdout:2/193: dread d2/d3/d7/d19/d22/d26/f2c [0,4194304] 0 2024-03-22T07:28:27.957 INFO:tasks.workunit.client.1.smithi195.stdout:2/194: write d2/d3/d1a/f3a [50869,44468] 0 2024-03-22T07:28:27.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/270: truncate da/d17/f25 195213 0 2024-03-22T07:28:27.959 INFO:tasks.workunit.client.1.smithi195.stdout:9/299: rename d2/d4/f5b to d2/d4/d6/db/d20/d4a/f71 0 2024-03-22T07:28:27.960 INFO:tasks.workunit.client.1.smithi195.stdout:5/221: mkdir d9/d53 0 2024-03-22T07:28:27.960 INFO:tasks.workunit.client.1.smithi195.stdout:5/222: chown d9/la 1103 1 2024-03-22T07:28:27.961 INFO:tasks.workunit.client.1.smithi195.stdout:9/300: rename d2/l5c to d2/d4/d6/d18/d50/l72 0 2024-03-22T07:28:27.962 INFO:tasks.workunit.client.1.smithi195.stdout:9/301: write d2/d4/f38 [129792,107800] 0 2024-03-22T07:28:27.962 INFO:tasks.workunit.client.1.smithi195.stdout:5/223: rmdir d9/d22/d46 39 2024-03-22T07:28:27.963 INFO:tasks.workunit.client.1.smithi195.stdout:9/302: creat d2/d4/d6/db/d20/d47/f73 x:0 0 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/224: symlink d9/d12/d14/d3f/l54 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:9/303: mkdir d2/d4/d23/d74 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:9/304: fdatasync d2/d4/d6/db/d20/f5d 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:9/305: dread - d2/d4/d6/d18/f29 zero size 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/225: mknod d9/d12/d1d/c55 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:6/195: dwrite d5/db/d17/d1a/d25/f31 [0,4194304] 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:5/226: write d9/d12/d1d/f32 [3265,124171] 0 2024-03-22T07:28:27.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/232: dwrite d1/d4/d22/f29 [0,4194304] 0 2024-03-22T07:28:27.968 INFO:tasks.workunit.client.1.smithi195.stdout:6/196: rename d5/dc/d42/l1f to d5/db/d17/d1a/d25/d34/l49 0 2024-03-22T07:28:27.969 INFO:tasks.workunit.client.1.smithi195.stdout:5/227: mknod d9/d12/c56 0 2024-03-22T07:28:27.970 INFO:tasks.workunit.client.1.smithi195.stdout:5/228: fdatasync d9/d12/d1d/d36/f49 0 2024-03-22T07:28:27.970 INFO:tasks.workunit.client.1.smithi195.stdout:5/229: dread d9/d12/f47 [0,4194304] 0 2024-03-22T07:28:27.971 INFO:tasks.workunit.client.1.smithi195.stdout:2/195: write d2/d3/d7/d19/f28 [2282303,113451] 0 2024-03-22T07:28:27.974 INFO:tasks.workunit.client.1.smithi195.stdout:0/233: dread d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:27.983 INFO:tasks.workunit.client.1.smithi195.stdout:5/230: dread d9/d3a/f3c [0,4194304] 0 2024-03-22T07:28:27.985 INFO:tasks.workunit.client.1.smithi195.stdout:0/234: rmdir d1/d4 39 2024-03-22T07:28:27.987 INFO:tasks.workunit.client.1.smithi195.stdout:5/231: mknod d9/d2d/c57 0 2024-03-22T07:28:27.990 INFO:tasks.workunit.client.1.smithi195.stdout:0/235: unlink d1/d10/f14 0 2024-03-22T07:28:27.991 INFO:tasks.workunit.client.1.smithi195.stdout:5/232: mkdir d9/d2d/d58 0 2024-03-22T07:28:27.991 INFO:tasks.workunit.client.1.smithi195.stdout:5/233: write d9/d2d/f3b [4573769,130488] 0 2024-03-22T07:28:27.991 INFO:tasks.workunit.client.1.smithi195.stdout:5/234: dread - d9/d2d/f51 zero size 2024-03-22T07:28:27.991 INFO:tasks.workunit.client.1.smithi195.stdout:5/235: read d9/f45 [2737377,122127] 0 2024-03-22T07:28:27.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/6: sync 2024-03-22T07:28:27.998 INFO:tasks.workunit.client.0.smithi134.stdout:9/7: truncate f1 654454 0 2024-03-22T07:28:27.998 INFO:tasks.workunit.client.1.smithi195.stdout:6/197: dwrite d5/db/d17/d1a/d25/d34/f41 [0,4194304] 0 2024-03-22T07:28:27.999 INFO:tasks.workunit.client.1.smithi195.stdout:6/198: fdatasync d5/db/d17/d1a/f32 0 2024-03-22T07:28:27.999 INFO:tasks.workunit.client.1.smithi195.stdout:8/271: dwrite da/d17/f25 [0,4194304] 0 2024-03-22T07:28:27.999 INFO:tasks.workunit.client.1.smithi195.stdout:2/196: dwrite d2/d3/d7/d19/f33 [0,4194304] 0 2024-03-22T07:28:27.999 INFO:tasks.workunit.client.1.smithi195.stdout:2/197: dread - d2/d3/f31 zero size 2024-03-22T07:28:27.999 INFO:tasks.workunit.client.1.smithi195.stdout:2/198: readlink d2/l1c 0 2024-03-22T07:28:28.006 INFO:tasks.workunit.client.1.smithi195.stdout:5/236: dread d9/f45 [0,4194304] 0 2024-03-22T07:28:28.006 INFO:tasks.workunit.client.1.smithi195.stdout:5/237: write d9/f45 [4962605,9387] 0 2024-03-22T07:28:28.007 INFO:tasks.workunit.client.1.smithi195.stdout:2/199: dread d2/d3/d1a/f3a [0,4194304] 0 2024-03-22T07:28:28.009 INFO:tasks.workunit.client.1.smithi195.stdout:8/272: unlink da/dc/f3b 0 2024-03-22T07:28:28.009 INFO:tasks.workunit.client.1.smithi195.stdout:8/273: stat da/dc/f2b 0 2024-03-22T07:28:28.009 INFO:tasks.workunit.client.1.smithi195.stdout:0/236: dwrite d1/d4/d12/f27 [0,4194304] 0 2024-03-22T07:28:28.010 INFO:tasks.workunit.client.1.smithi195.stdout:0/237: read - d1/d10/d19/d20/f3c zero size 2024-03-22T07:28:28.010 INFO:tasks.workunit.client.1.smithi195.stdout:5/238: rename d9/d22/d46/c4e to d9/d22/c59 0 2024-03-22T07:28:28.010 INFO:tasks.workunit.client.1.smithi195.stdout:5/239: creat d9/d12/d1d/d36/f5a x:0 0 0 2024-03-22T07:28:28.011 INFO:tasks.workunit.client.1.smithi195.stdout:5/240: chown d9/d12/l27 1300575 1 2024-03-22T07:28:28.011 INFO:tasks.workunit.client.1.smithi195.stdout:5/241: readlink d9/d3a/l48 0 2024-03-22T07:28:28.011 INFO:tasks.workunit.client.1.smithi195.stdout:5/242: write d9/d12/f30 [879832,110572] 0 2024-03-22T07:28:28.013 INFO:tasks.workunit.client.1.smithi195.stdout:0/238: mkdir d1/d10/d1f/d40/d43 0 2024-03-22T07:28:28.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/274: symlink da/dc/l55 0 2024-03-22T07:28:28.019 INFO:tasks.workunit.client.1.smithi195.stdout:0/239: dread d1/d4/f2e [0,4194304] 0 2024-03-22T07:28:28.019 INFO:tasks.workunit.client.0.smithi134.stdout:9/8: truncate f1 463788 0 2024-03-22T07:28:28.019 INFO:tasks.workunit.client.0.smithi134.stdout:9/9: dread - f0 zero size 2024-03-22T07:28:28.022 INFO:tasks.workunit.client.1.smithi195.stdout:5/243: rename d9/d12/f30 to d9/f5b 0 2024-03-22T07:28:28.022 INFO:tasks.workunit.client.1.smithi195.stdout:5/244: truncate d9/ff 747503 0 2024-03-22T07:28:28.022 INFO:tasks.workunit.client.1.smithi195.stdout:8/275: rmdir da/de/d38 39 2024-03-22T07:28:28.022 INFO:tasks.workunit.client.1.smithi195.stdout:8/276: creat da/f56 x:0 0 0 2024-03-22T07:28:28.023 INFO:tasks.workunit.client.0.smithi134.stdout:9/10: creat d3/f4 x:0 0 0 2024-03-22T07:28:28.023 INFO:tasks.workunit.client.1.smithi195.stdout:7/178: sync 2024-03-22T07:28:28.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/250: sync 2024-03-22T07:28:28.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/251: fdatasync d13/d2a/d3b/f45 0 2024-03-22T07:28:28.024 INFO:tasks.workunit.client.1.smithi195.stdout:8/277: mknod da/d17/d32/c57 0 2024-03-22T07:28:28.025 INFO:tasks.workunit.client.1.smithi195.stdout:7/179: truncate d0/f11 1398592 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/278: creat da/d17/d32/f58 x:0 0 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/279: creat da/d17/d32/f59 x:0 0 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/280: truncate da/dc/f12 2304254 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/281: fdatasync da/d17/d32/f58 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/282: truncate da/de/f45 3238828 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/283: write da/de/f2d [774672,80488] 0 2024-03-22T07:28:28.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/284: readlink l0 0 2024-03-22T07:28:28.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/252: read d13/d15/d16/f33 [934937,26031] 0 2024-03-22T07:28:28.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/253: creat d13/d15/d16/f5a x:0 0 0 2024-03-22T07:28:28.031 INFO:tasks.workunit.client.1.smithi195.stdout:8/285: mknod da/dc/c5a 0 2024-03-22T07:28:28.031 INFO:tasks.workunit.client.1.smithi195.stdout:8/286: creat da/de/f5b x:0 0 0 2024-03-22T07:28:28.032 INFO:tasks.workunit.client.1.smithi195.stdout:6/199: dwrite d5/f6 [0,4194304] 0 2024-03-22T07:28:28.035 INFO:tasks.workunit.client.1.smithi195.stdout:4/254: dread d13/d2a/f2e [0,4194304] 0 2024-03-22T07:28:28.035 INFO:tasks.workunit.client.1.smithi195.stdout:8/287: symlink da/l5c 0 2024-03-22T07:28:28.035 INFO:tasks.workunit.client.1.smithi195.stdout:8/288: dread - da/d17/d32/f58 zero size 2024-03-22T07:28:28.035 INFO:tasks.workunit.client.1.smithi195.stdout:8/289: stat da/l5c 0 2024-03-22T07:28:28.040 INFO:tasks.workunit.client.1.smithi195.stdout:2/200: dwrite d2/d3/d7/da/d1b/f29 [0,4194304] 0 2024-03-22T07:28:28.041 INFO:tasks.workunit.client.1.smithi195.stdout:6/200: mkdir d5/db/d17/d4a 0 2024-03-22T07:28:28.041 INFO:tasks.workunit.client.1.smithi195.stdout:6/201: write d5/db/d17/f21 [1195897,40490] 0 2024-03-22T07:28:28.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/202: rmdir d5/d16/d45 39 2024-03-22T07:28:28.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/201: write d2/d3/d1a/f2b [3636748,17530] 0 2024-03-22T07:28:28.052 INFO:tasks.workunit.client.1.smithi195.stdout:2/202: read d2/d3/d7/da/de/f48 [51635,84353] 0 2024-03-22T07:28:28.053 INFO:tasks.workunit.client.1.smithi195.stdout:2/203: getdents d2/d3/d7/d19/d22/d26 0 2024-03-22T07:28:28.063 INFO:tasks.workunit.client.0.smithi134.stdout:9/11: dwrite d3/f4 [0,4194304] 0 2024-03-22T07:28:28.064 INFO:tasks.workunit.client.0.smithi134.stdout:0/28: sync 2024-03-22T07:28:28.064 INFO:tasks.workunit.client.0.smithi134.stdout:3/54: sync 2024-03-22T07:28:28.065 INFO:tasks.workunit.client.1.smithi195.stdout:6/203: write d5/db/d17/d1a/d25/f31 [1824440,83887] 0 2024-03-22T07:28:28.065 INFO:tasks.workunit.client.0.smithi134.stdout:1/82: sync 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:2/63: sync 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/24: sync 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/25: dwrite - no filename 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/26: creat d2/f8 x:0 0 0 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/27: dread - d2/f8 zero size 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/107: sync 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:8/128: sync 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.0.smithi134.stdout:8/129: fsync d1/d11/f2b 0 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.1.smithi195.stdout:8/290: dwrite da/d17/f25 [0,4194304] 0 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.1.smithi195.stdout:7/180: dwrite d0/fc [4194304,4194304] 0 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.1.smithi195.stdout:2/204: dwrite d2/f9 [0,4194304] 0 2024-03-22T07:28:28.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/255: dwrite d13/d15/d16/f35 [0,4194304] 0 2024-03-22T07:28:28.067 INFO:tasks.workunit.client.0.smithi134.stdout:1/83: rmdir d5/da/d13/d19 0 2024-03-22T07:28:28.073 INFO:tasks.workunit.client.1.smithi195.stdout:6/204: dread d5/db/d17/f21 [0,4194304] 0 2024-03-22T07:28:28.074 INFO:tasks.workunit.client.1.smithi195.stdout:7/181: unlink d0/d13/d14/c1f 0 2024-03-22T07:28:28.074 INFO:tasks.workunit.client.0.smithi134.stdout:4/108: rename d2/c19 to d2/c26 0 2024-03-22T07:28:28.076 INFO:tasks.workunit.client.0.smithi134.stdout:0/29: write f4 [54425,129885] 0 2024-03-22T07:28:28.076 INFO:tasks.workunit.client.1.smithi195.stdout:2/205: link d2/d3/d7/d19/d22/l38 d2/d3/d24/l4a 0 2024-03-22T07:28:28.077 INFO:tasks.workunit.client.0.smithi134.stdout:9/12: getdents d3 0 2024-03-22T07:28:28.078 INFO:tasks.workunit.client.0.smithi134.stdout:3/55: dread d4/d8/fa [0,4194304] 0 2024-03-22T07:28:28.078 INFO:tasks.workunit.client.0.smithi134.stdout:3/56: dread - d4/d10/f14 zero size 2024-03-22T07:28:28.078 INFO:tasks.workunit.client.0.smithi134.stdout:3/57: chown d4/d10/f14 15 1 2024-03-22T07:28:28.078 INFO:tasks.workunit.client.0.smithi134.stdout:3/58: chown d4/d10/f11 0 1 2024-03-22T07:28:28.080 INFO:tasks.workunit.client.0.smithi134.stdout:2/64: symlink d2/d5/l13 0 2024-03-22T07:28:28.082 INFO:tasks.workunit.client.0.smithi134.stdout:4/109: symlink d2/l27 0 2024-03-22T07:28:28.083 INFO:tasks.workunit.client.1.smithi195.stdout:6/205: write d5/f6 [116001,28293] 0 2024-03-22T07:28:28.083 INFO:tasks.workunit.client.1.smithi195.stdout:4/256: truncate f9 840905 0 2024-03-22T07:28:28.085 INFO:tasks.workunit.client.0.smithi134.stdout:8/130: dread d1/d15/fe [0,4194304] 0 2024-03-22T07:28:28.086 INFO:tasks.workunit.client.1.smithi195.stdout:8/291: dwrite da/de/d38/d47/f54 [0,4194304] 0 2024-03-22T07:28:28.087 INFO:tasks.workunit.client.1.smithi195.stdout:7/182: mknod d0/d13/c38 0 2024-03-22T07:28:28.087 INFO:tasks.workunit.client.1.smithi195.stdout:7/183: readlink d0/d13/d14/d20/l2e 0 2024-03-22T07:28:28.087 INFO:tasks.workunit.client.1.smithi195.stdout:3/279: sync 2024-03-22T07:28:28.087 INFO:tasks.workunit.client.1.smithi195.stdout:1/160: sync 2024-03-22T07:28:28.087 INFO:tasks.workunit.client.1.smithi195.stdout:3/280: fsync d3/df/d15/d1d/d5c/f53 0 2024-03-22T07:28:28.087 INFO:tasks.workunit.client.1.smithi195.stdout:3/281: write d3/df/d15/d1d/d5c/f53 [607846,54641] 0 2024-03-22T07:28:28.088 INFO:tasks.workunit.client.1.smithi195.stdout:9/306: sync 2024-03-22T07:28:28.088 INFO:tasks.workunit.client.1.smithi195.stdout:9/307: write d2/d4/d6/db/f2c [683320,100441] 0 2024-03-22T07:28:28.088 INFO:tasks.workunit.client.1.smithi195.stdout:9/308: fdatasync d2/d4/d6/db/f1f 0 2024-03-22T07:28:28.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/13: symlink d3/l5 0 2024-03-22T07:28:28.090 INFO:tasks.workunit.client.1.smithi195.stdout:6/206: dread f4 [0,4194304] 0 2024-03-22T07:28:28.091 INFO:tasks.workunit.client.1.smithi195.stdout:6/207: truncate d5/d16/f43 83351 0 2024-03-22T07:28:28.091 INFO:tasks.workunit.client.1.smithi195.stdout:4/257: mknod d13/d15/d16/c5b 0 2024-03-22T07:28:28.092 INFO:tasks.workunit.client.0.smithi134.stdout:0/30: dread f0 [0,4194304] 0 2024-03-22T07:28:28.092 INFO:tasks.workunit.client.0.smithi134.stdout:0/31: read f5 [933905,13524] 0 2024-03-22T07:28:28.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/59: link d4/fd d4/f15 0 2024-03-22T07:28:28.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/60: fdatasync d4/d8/f12 0 2024-03-22T07:28:28.095 INFO:tasks.workunit.client.0.smithi134.stdout:2/65: dread - d2/d5/fc zero size 2024-03-22T07:28:28.097 INFO:tasks.workunit.client.0.smithi134.stdout:7/170: sync 2024-03-22T07:28:28.097 INFO:tasks.workunit.client.0.smithi134.stdout:5/16: sync 2024-03-22T07:28:28.098 INFO:tasks.workunit.client.0.smithi134.stdout:8/131: truncate d1/d15/f1c 3432662 0 2024-03-22T07:28:28.100 INFO:tasks.workunit.client.0.smithi134.stdout:6/28: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:28.100 INFO:tasks.workunit.client.0.smithi134.stdout:1/84: dread d5/fe [0,4194304] 0 2024-03-22T07:28:28.100 INFO:tasks.workunit.client.0.smithi134.stdout:1/85: readlink d5/l7 0 2024-03-22T07:28:28.100 INFO:tasks.workunit.client.0.smithi134.stdout:1/86: creat d5/da/d1b/f1f x:0 0 0 2024-03-22T07:28:28.102 INFO:tasks.workunit.client.0.smithi134.stdout:4/110: dread d2/d1d/f1f [0,4194304] 0 2024-03-22T07:28:28.102 INFO:tasks.workunit.client.0.smithi134.stdout:4/111: chown f1 1004953273 1 2024-03-22T07:28:28.102 INFO:tasks.workunit.client.0.smithi134.stdout:4/112: dread - d2/d15/f23 zero size 2024-03-22T07:28:28.104 INFO:tasks.workunit.client.1.smithi195.stdout:7/184: truncate d0/d13/d14/f30 1789938 0 2024-03-22T07:28:28.104 INFO:tasks.workunit.client.1.smithi195.stdout:7/185: write d0/d13/d22/f23 [1006874,127879] 0 2024-03-22T07:28:28.104 INFO:tasks.workunit.client.1.smithi195.stdout:7/186: truncate d0/d13/d14/d29/f33 233951 0 2024-03-22T07:28:28.106 INFO:tasks.workunit.client.1.smithi195.stdout:1/161: mknod d0/d2/d9/d2a/c35 0 2024-03-22T07:28:28.106 INFO:tasks.workunit.client.1.smithi195.stdout:1/162: stat d0 0 2024-03-22T07:28:28.106 INFO:tasks.workunit.client.1.smithi195.stdout:1/163: write d0/d2/f14 [1997648,69456] 0 2024-03-22T07:28:28.106 INFO:tasks.workunit.client.1.smithi195.stdout:1/164: write d0/d2/d6/f2f [270129,63070] 0 2024-03-22T07:28:28.106 INFO:tasks.workunit.client.1.smithi195.stdout:2/206: dwrite d2/d3/f5 [0,4194304] 0 2024-03-22T07:28:28.107 INFO:tasks.workunit.client.0.smithi134.stdout:3/61: rename f1 to d4/f16 0 2024-03-22T07:28:28.107 INFO:tasks.workunit.client.0.smithi134.stdout:3/62: dread - d4/d10/f14 zero size 2024-03-22T07:28:28.107 INFO:tasks.workunit.client.0.smithi134.stdout:3/63: readlink d4/l6 0 2024-03-22T07:28:28.108 INFO:tasks.workunit.client.0.smithi134.stdout:3/64: chown d4/fc 40 1 2024-03-22T07:28:28.109 INFO:tasks.workunit.client.1.smithi195.stdout:9/309: symlink d2/d4/d1d/l75 0 2024-03-22T07:28:28.110 INFO:tasks.workunit.client.0.smithi134.stdout:5/17: symlink d1/d4/l5 0 2024-03-22T07:28:28.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/208: mkdir d5/dc/d42/d4b 0 2024-03-22T07:28:28.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/209: chown d5/dc/c2d 5708702 1 2024-03-22T07:28:28.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/210: dread - d5/d16/f48 zero size 2024-03-22T07:28:28.113 INFO:tasks.workunit.client.0.smithi134.stdout:7/171: truncate d1/d3/d6/fc 1670389 0 2024-03-22T07:28:28.115 INFO:tasks.workunit.client.1.smithi195.stdout:6/211: read d5/dc/d42/f2e [323391,33363] 0 2024-03-22T07:28:28.115 INFO:tasks.workunit.client.1.smithi195.stdout:6/212: creat d5/db/f4c x:0 0 0 2024-03-22T07:28:28.116 INFO:tasks.workunit.client.1.smithi195.stdout:4/258: mkdir d13/d15/d16/d3e/d5c 0 2024-03-22T07:28:28.118 INFO:tasks.workunit.client.0.smithi134.stdout:9/14: dread d3/f4 [0,4194304] 0 2024-03-22T07:28:28.118 INFO:tasks.workunit.client.0.smithi134.stdout:9/15: write f0 [56468,3296] 0 2024-03-22T07:28:28.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/132: mknod d1/d11/d12/d20/c31 0 2024-03-22T07:28:28.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/133: chown d1/d15/f5 1309227 1 2024-03-22T07:28:28.119 INFO:tasks.workunit.client.1.smithi195.stdout:3/282: dwrite d3/df/d15/d1d/d5c/f3b [0,4194304] 0 2024-03-22T07:28:28.122 INFO:tasks.workunit.client.1.smithi195.stdout:8/292: rmdir da/de 39 2024-03-22T07:28:28.123 INFO:tasks.workunit.client.1.smithi195.stdout:6/213: dread d5/db/d17/d1a/d25/f33 [0,4194304] 0 2024-03-22T07:28:28.124 INFO:tasks.workunit.client.0.smithi134.stdout:9/16: fsync f0 0 2024-03-22T07:28:28.124 INFO:tasks.workunit.client.0.smithi134.stdout:7/172: dread d1/d3/d6/f29 [4194304,4194304] 0 2024-03-22T07:28:28.126 INFO:tasks.workunit.client.1.smithi195.stdout:7/187: mkdir d0/d13/d22/d28/d39 0 2024-03-22T07:28:28.126 INFO:tasks.workunit.client.1.smithi195.stdout:7/188: fdatasync d0/f11 0 2024-03-22T07:28:28.126 INFO:tasks.workunit.client.1.smithi195.stdout:7/189: fsync d0/d13/d22/f23 0 2024-03-22T07:28:28.126 INFO:tasks.workunit.client.1.smithi195.stdout:1/165: dwrite d0/d2/fe [0,4194304] 0 2024-03-22T07:28:28.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/134: write d1/d15/f19 [2006553,121522] 0 2024-03-22T07:28:28.131 INFO:tasks.workunit.client.0.smithi134.stdout:1/87: rename d5/f18 to d5/f20 0 2024-03-22T07:28:28.131 INFO:tasks.workunit.client.0.smithi134.stdout:1/88: stat f1 0 2024-03-22T07:28:28.133 INFO:tasks.workunit.client.1.smithi195.stdout:9/310: link d2/d4/f55 d2/d4/d23/d74/f76 0 2024-03-22T07:28:28.135 INFO:tasks.workunit.client.0.smithi134.stdout:4/113: link d2/l27 d2/l28 0 2024-03-22T07:28:28.135 INFO:tasks.workunit.client.0.smithi134.stdout:8/135: dread d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.137 INFO:tasks.workunit.client.0.smithi134.stdout:0/32: getdents . 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/214: dwrite d5/db/d17/d1a/d25/f33 [0,4194304] 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/215: fdatasync d5/db/f4c 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/216: fdatasync d5/dc/fd 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/217: write d5/d16/f43 [1047928,28646] 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/218: fsync d5/db/d17/f21 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/219: creat d5/db/d17/d1a/f4d x:0 0 0 2024-03-22T07:28:28.139 INFO:tasks.workunit.client.1.smithi195.stdout:6/220: creat d5/db/d17/f4e x:0 0 0 2024-03-22T07:28:28.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/259: unlink l7 0 2024-03-22T07:28:28.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/260: dread - d13/d15/f37 zero size 2024-03-22T07:28:28.142 INFO:tasks.workunit.client.0.smithi134.stdout:3/65: mkdir d4/d17 0 2024-03-22T07:28:28.142 INFO:tasks.workunit.client.0.smithi134.stdout:3/66: write d4/fc [1032093,28213] 0 2024-03-22T07:28:28.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/67: chown d4/d10/f14 4 1 2024-03-22T07:28:28.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/68: chown f3 0 1 2024-03-22T07:28:28.145 INFO:tasks.workunit.client.0.smithi134.stdout:5/18: creat d1/d4/f6 x:0 0 0 2024-03-22T07:28:28.145 INFO:tasks.workunit.client.0.smithi134.stdout:5/19: write d1/d4/f6 [472486,81989] 0 2024-03-22T07:28:28.145 INFO:tasks.workunit.client.0.smithi134.stdout:5/20: stat d1 0 2024-03-22T07:28:28.150 INFO:tasks.workunit.client.1.smithi195.stdout:3/283: mkdir d3/d22/d64 0 2024-03-22T07:28:28.152 INFO:tasks.workunit.client.0.smithi134.stdout:0/33: dwrite f5 [0,4194304] 0 2024-03-22T07:28:28.153 INFO:tasks.workunit.client.0.smithi134.stdout:6/29: rmdir d2 39 2024-03-22T07:28:28.154 INFO:tasks.workunit.client.0.smithi134.stdout:1/89: creat d5/da/f21 x:0 0 0 2024-03-22T07:28:28.155 INFO:tasks.workunit.client.0.smithi134.stdout:1/90: write f4 [3958777,98265] 0 2024-03-22T07:28:28.157 INFO:tasks.workunit.client.1.smithi195.stdout:3/284: write d3/f35 [1699552,83391] 0 2024-03-22T07:28:28.157 INFO:tasks.workunit.client.1.smithi195.stdout:3/285: fdatasync d3/df/d15/d1d/d5c/f3b 0 2024-03-22T07:28:28.160 INFO:tasks.workunit.client.0.smithi134.stdout:0/34: dread f4 [0,4194304] 0 2024-03-22T07:28:28.160 INFO:tasks.workunit.client.0.smithi134.stdout:4/114: rename d2/l27 to d2/d15/l29 0 2024-03-22T07:28:28.160 INFO:tasks.workunit.client.0.smithi134.stdout:4/115: dread - d2/d15/f1e zero size 2024-03-22T07:28:28.160 INFO:tasks.workunit.client.0.smithi134.stdout:4/116: readlink d2/d1d/l20 0 2024-03-22T07:28:28.161 INFO:tasks.workunit.client.0.smithi134.stdout:8/136: link d1/d15/c26 d1/d11/c32 0 2024-03-22T07:28:28.161 INFO:tasks.workunit.client.0.smithi134.stdout:8/137: write d1/f18 [1553108,37753] 0 2024-03-22T07:28:28.162 INFO:tasks.workunit.client.1.smithi195.stdout:8/293: mknod da/de/d38/d47/c5d 0 2024-03-22T07:28:28.163 INFO:tasks.workunit.client.0.smithi134.stdout:3/69: mknod d4/d8/c18 0 2024-03-22T07:28:28.165 INFO:tasks.workunit.client.0.smithi134.stdout:5/21: symlink d1/l7 0 2024-03-22T07:28:28.165 INFO:tasks.workunit.client.0.smithi134.stdout:5/22: stat d1/l7 0 2024-03-22T07:28:28.166 INFO:tasks.workunit.client.0.smithi134.stdout:7/173: rmdir d1/d19/d32 39 2024-03-22T07:28:28.166 INFO:tasks.workunit.client.0.smithi134.stdout:7/174: read d1/de/d11/f13 [192302,12290] 0 2024-03-22T07:28:28.167 INFO:tasks.workunit.client.0.smithi134.stdout:5/23: dread d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/294: write f7 [3177074,83483] 0 2024-03-22T07:28:28.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/295: readlink da/dc/l3c 0 2024-03-22T07:28:28.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/296: chown da/de/c43 9656 1 2024-03-22T07:28:28.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/30: link d2/l6 d2/l9 0 2024-03-22T07:28:28.175 INFO:tasks.workunit.client.1.smithi195.stdout:8/297: dread da/de/f45 [0,4194304] 0 2024-03-22T07:28:28.176 INFO:tasks.workunit.client.1.smithi195.stdout:8/298: chown da/d17/f25 304926 1 2024-03-22T07:28:28.177 INFO:tasks.workunit.client.1.smithi195.stdout:7/190: mkdir d0/d13/d14/d29/d35/d3a 0 2024-03-22T07:28:28.179 INFO:tasks.workunit.client.1.smithi195.stdout:1/166: symlink d0/d2/d27/l36 0 2024-03-22T07:28:28.181 INFO:tasks.workunit.client.0.smithi134.stdout:0/35: unlink c2 0 2024-03-22T07:28:28.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/207: rmdir d2/d3/d7/da/de 39 2024-03-22T07:28:28.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/208: chown d2/d3/c2d 128254 1 2024-03-22T07:28:28.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/209: fsync d2/f34 0 2024-03-22T07:28:28.185 INFO:tasks.workunit.client.0.smithi134.stdout:8/138: symlink d1/d11/d25/l33 0 2024-03-22T07:28:28.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/311: truncate f0 5039672 0 2024-03-22T07:28:28.189 INFO:tasks.workunit.client.0.smithi134.stdout:3/70: truncate d4/fd 1720346 0 2024-03-22T07:28:28.189 INFO:tasks.workunit.client.0.smithi134.stdout:3/71: stat d4/d8/c9 0 2024-03-22T07:28:28.189 INFO:tasks.workunit.client.0.smithi134.stdout:3/72: fdatasync d4/d10/f11 0 2024-03-22T07:28:28.190 INFO:tasks.workunit.client.0.smithi134.stdout:7/175: dwrite d1/de/ff [0,4194304] 0 2024-03-22T07:28:28.190 INFO:tasks.workunit.client.0.smithi134.stdout:6/31: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:28.191 INFO:tasks.workunit.client.0.smithi134.stdout:6/32: fsync d2/f8 0 2024-03-22T07:28:28.192 INFO:tasks.workunit.client.0.smithi134.stdout:5/24: mkdir d1/d8 0 2024-03-22T07:28:28.192 INFO:tasks.workunit.client.0.smithi134.stdout:5/25: fsync d1/d4/f6 0 2024-03-22T07:28:28.192 INFO:tasks.workunit.client.0.smithi134.stdout:5/26: readlink l0 0 2024-03-22T07:28:28.194 INFO:tasks.workunit.client.0.smithi134.stdout:0/36: dread f5 [0,4194304] 0 2024-03-22T07:28:28.194 INFO:tasks.workunit.client.0.smithi134.stdout:4/117: getdents d2/d15 0 2024-03-22T07:28:28.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/176: rename d1/d3/d6/f22 to d1/f3b 0 2024-03-22T07:28:28.199 INFO:tasks.workunit.client.1.smithi195.stdout:6/221: creat d5/dc/d42/d4b/f4f x:0 0 0 2024-03-22T07:28:28.199 INFO:tasks.workunit.client.1.smithi195.stdout:6/222: write d5/db/d17/f2a [725480,16305] 0 2024-03-22T07:28:28.200 INFO:tasks.workunit.client.0.smithi134.stdout:3/73: dread f3 [0,4194304] 0 2024-03-22T07:28:28.200 INFO:tasks.workunit.client.0.smithi134.stdout:3/74: chown d4/d10/f11 336305660 1 2024-03-22T07:28:28.203 INFO:tasks.workunit.client.1.smithi195.stdout:4/261: rename d13/f31 to d13/d15/d16/d36/f5d 0 2024-03-22T07:28:28.207 INFO:tasks.workunit.client.0.smithi134.stdout:0/37: dread f4 [0,4194304] 0 2024-03-22T07:28:28.207 INFO:tasks.workunit.client.0.smithi134.stdout:8/139: dwrite d1/d11/f2b [0,4194304] 0 2024-03-22T07:28:28.208 INFO:tasks.workunit.client.0.smithi134.stdout:5/27: rename d1/l2 to d1/l9 0 2024-03-22T07:28:28.210 INFO:tasks.workunit.client.0.smithi134.stdout:4/118: truncate f1 1929273 0 2024-03-22T07:28:28.212 INFO:tasks.workunit.client.0.smithi134.stdout:0/38: creat f7 x:0 0 0 2024-03-22T07:28:28.212 INFO:tasks.workunit.client.0.smithi134.stdout:0/39: fdatasync f4 0 2024-03-22T07:28:28.214 INFO:tasks.workunit.client.1.smithi195.stdout:3/286: mkdir d3/df/d65 0 2024-03-22T07:28:28.216 INFO:tasks.workunit.client.0.smithi134.stdout:5/28: link d1/d4/l5 d1/d8/la 0 2024-03-22T07:28:28.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/40: read f5 [2799850,110695] 0 2024-03-22T07:28:28.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/41: dread - f7 zero size 2024-03-22T07:28:28.218 INFO:tasks.workunit.client.0.smithi134.stdout:7/177: dwrite d1/f3a [0,4194304] 0 2024-03-22T07:28:28.218 INFO:tasks.workunit.client.0.smithi134.stdout:8/140: dread d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.223 INFO:tasks.workunit.client.0.smithi134.stdout:4/119: mkdir d2/d2a 0 2024-03-22T07:28:28.223 INFO:tasks.workunit.client.0.smithi134.stdout:4/120: readlink d2/d15/l10 0 2024-03-22T07:28:28.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/299: creat da/de/d38/d47/d53/f5e x:0 0 0 2024-03-22T07:28:28.227 INFO:tasks.workunit.client.1.smithi195.stdout:7/191: link d0/d13/d14/d20/l2e d0/d13/d22/d28/l3b 0 2024-03-22T07:28:28.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/33: truncate d2/f8 2365832 0 2024-03-22T07:28:28.229 INFO:tasks.workunit.client.0.smithi134.stdout:0/42: symlink l8 0 2024-03-22T07:28:28.229 INFO:tasks.workunit.client.0.smithi134.stdout:0/43: stat f0 0 2024-03-22T07:28:28.230 INFO:tasks.workunit.client.0.smithi134.stdout:0/44: creat f9 x:0 0 0 2024-03-22T07:28:28.231 INFO:tasks.workunit.client.0.smithi134.stdout:3/75: dwrite d4/f7 [0,4194304] 0 2024-03-22T07:28:28.232 INFO:tasks.workunit.client.1.smithi195.stdout:1/167: mkdir d0/d2/d6/d21/d32/d37 0 2024-03-22T07:28:28.232 INFO:tasks.workunit.client.0.smithi134.stdout:5/29: dwrite d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.232 INFO:tasks.workunit.client.0.smithi134.stdout:5/30: chown d1 4675182 1 2024-03-22T07:28:28.232 INFO:tasks.workunit.client.0.smithi134.stdout:5/31: fdatasync d1/d4/f6 0 2024-03-22T07:28:28.235 INFO:tasks.workunit.client.1.smithi195.stdout:2/210: truncate d2/d3/d7/d19/f33 1656503 0 2024-03-22T07:28:28.238 INFO:tasks.workunit.client.1.smithi195.stdout:9/312: symlink d2/d4/d32/l77 0 2024-03-22T07:28:28.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/141: rename d1/d11/d12/c1e to d1/d4/c34 0 2024-03-22T07:28:28.242 INFO:tasks.workunit.client.1.smithi195.stdout:6/223: creat d5/dc/d42/d3b/f50 x:0 0 0 2024-03-22T07:28:28.243 INFO:tasks.workunit.client.0.smithi134.stdout:7/178: creat d1/d3/d6/f3c x:0 0 0 2024-03-22T07:28:28.244 INFO:tasks.workunit.client.0.smithi134.stdout:7/179: creat d1/f3d x:0 0 0 2024-03-22T07:28:28.245 INFO:tasks.workunit.client.1.smithi195.stdout:5/245: sync 2024-03-22T07:28:28.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/240: sync 2024-03-22T07:28:28.246 INFO:tasks.workunit.client.1.smithi195.stdout:4/262: rename d13/d15/d16/l51 to d13/d15/d16/d21/l5e 0 2024-03-22T07:28:28.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/313: dread d2/d4/d23/f69 [0,4194304] 0 2024-03-22T07:28:28.247 INFO:tasks.workunit.client.1.smithi195.stdout:4/263: dread - d13/d15/d16/f5a zero size 2024-03-22T07:28:28.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/314: readlink d2/d4/d32/l77 0 2024-03-22T07:28:28.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/315: fsync d2/d4/d6/db/f30 0 2024-03-22T07:28:28.247 INFO:tasks.workunit.client.0.smithi134.stdout:0/45: dwrite f7 [0,4194304] 0 2024-03-22T07:28:28.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/192: dwrite d0/f2d [0,4194304] 0 2024-03-22T07:28:28.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/193: chown d0/d13/d14/d2f 1761534638 1 2024-03-22T07:28:28.248 INFO:tasks.workunit.client.1.smithi195.stdout:8/300: mknod da/de/d38/d47/c5f 0 2024-03-22T07:28:28.252 INFO:tasks.workunit.client.1.smithi195.stdout:1/168: truncate d0/d2/d9/f24 93332 0 2024-03-22T07:28:28.252 INFO:tasks.workunit.client.1.smithi195.stdout:1/169: chown d0/l2d 14 1 2024-03-22T07:28:28.253 INFO:tasks.workunit.client.0.smithi134.stdout:4/121: symlink d2/d15/l2b 0 2024-03-22T07:28:28.253 INFO:tasks.workunit.client.0.smithi134.stdout:4/122: dread - d2/d15/f1e zero size 2024-03-22T07:28:28.254 INFO:tasks.workunit.client.1.smithi195.stdout:2/211: rmdir d2/d1e 39 2024-03-22T07:28:28.256 INFO:tasks.workunit.client.0.smithi134.stdout:6/34: unlink d2/l6 0 2024-03-22T07:28:28.257 INFO:tasks.workunit.client.1.smithi195.stdout:6/224: rmdir d5/d16/d45 39 2024-03-22T07:28:28.259 INFO:tasks.workunit.client.1.smithi195.stdout:0/241: mkdir d1/d4/dd/df/d44 0 2024-03-22T07:28:28.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/287: rename d3/d22/f40 to d3/df/d15/d1d/d5c/d47/f66 0 2024-03-22T07:28:28.263 INFO:tasks.workunit.client.1.smithi195.stdout:4/264: stat d13/d2a/d3b/l58 0 2024-03-22T07:28:28.267 INFO:tasks.workunit.client.1.smithi195.stdout:7/194: mknod d0/d13/c3c 0 2024-03-22T07:28:28.267 INFO:tasks.workunit.client.0.smithi134.stdout:0/46: dwrite f4 [0,4194304] 0 2024-03-22T07:28:28.268 INFO:tasks.workunit.client.0.smithi134.stdout:5/32: symlink d1/d4/lb 0 2024-03-22T07:28:28.268 INFO:tasks.workunit.client.0.smithi134.stdout:5/33: stat l0 0 2024-03-22T07:28:28.269 INFO:tasks.workunit.client.1.smithi195.stdout:8/301: rmdir da/de/d38 39 2024-03-22T07:28:28.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/142: rmdir d1/d11/d12/d2a 39 2024-03-22T07:28:28.270 INFO:tasks.workunit.client.0.smithi134.stdout:8/143: creat d1/d11/d12/f35 x:0 0 0 2024-03-22T07:28:28.276 INFO:tasks.workunit.client.0.smithi134.stdout:7/180: unlink d1/l15 0 2024-03-22T07:28:28.280 INFO:tasks.workunit.client.0.smithi134.stdout:8/144: dread d1/d15/f1c [0,4194304] 0 2024-03-22T07:28:28.280 INFO:tasks.workunit.client.0.smithi134.stdout:8/145: dread - d1/d4/f22 zero size 2024-03-22T07:28:28.283 INFO:tasks.workunit.client.1.smithi195.stdout:7/195: dwrite d0/d13/d14/d29/d35/f37 [0,4194304] 0 2024-03-22T07:28:28.283 INFO:tasks.workunit.client.1.smithi195.stdout:5/246: rename d9/d12/l20 to d9/d12/d1d/d36/l5c 0 2024-03-22T07:28:28.284 INFO:tasks.workunit.client.1.smithi195.stdout:7/196: dread d0/d13/d14/d29/f33 [0,4194304] 0 2024-03-22T07:28:28.286 INFO:tasks.workunit.client.0.smithi134.stdout:4/123: mknod d2/d15/c2c 0 2024-03-22T07:28:28.289 INFO:tasks.workunit.client.0.smithi134.stdout:8/146: dread d1/d15/f5 [0,4194304] 0 2024-03-22T07:28:28.289 INFO:tasks.workunit.client.0.smithi134.stdout:6/35: mknod d2/ca 0 2024-03-22T07:28:28.290 INFO:tasks.workunit.client.0.smithi134.stdout:8/147: chown d1/d15/f19 1123340 1 2024-03-22T07:28:28.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/170: rmdir d0/d2 39 2024-03-22T07:28:28.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/171: write d0/d2/f1f [2536633,46845] 0 2024-03-22T07:28:28.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/47: symlink la 0 2024-03-22T07:28:28.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/48: readlink l8 0 2024-03-22T07:28:28.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/49: chown f7 108522551 1 2024-03-22T07:28:28.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/50: chown la 0 1 2024-03-22T07:28:28.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/51: readlink la 0 2024-03-22T07:28:28.294 INFO:tasks.workunit.client.0.smithi134.stdout:5/34: symlink d1/lc 0 2024-03-22T07:28:28.295 INFO:tasks.workunit.client.1.smithi195.stdout:9/316: rename d2/d4/d6/d18/d70 to d2/d4/d32/d6d/d78 0 2024-03-22T07:28:28.297 INFO:tasks.workunit.client.1.smithi195.stdout:5/247: truncate f8 1728347 0 2024-03-22T07:28:28.298 INFO:tasks.workunit.client.0.smithi134.stdout:4/124: creat d2/d25/f2d x:0 0 0 2024-03-22T07:28:28.301 INFO:tasks.workunit.client.1.smithi195.stdout:8/302: dwrite da/f4e [0,4194304] 0 2024-03-22T07:28:28.301 INFO:tasks.workunit.client.1.smithi195.stdout:8/303: truncate da/f4f 399546 0 2024-03-22T07:28:28.301 INFO:tasks.workunit.client.0.smithi134.stdout:6/36: rename d2/l7 to d2/lb 0 2024-03-22T07:28:28.302 INFO:tasks.workunit.client.0.smithi134.stdout:6/37: chown d2/f8 192 1 2024-03-22T07:28:28.302 INFO:tasks.workunit.client.0.smithi134.stdout:7/181: dwrite d1/de/f39 [0,4194304] 0 2024-03-22T07:28:28.303 INFO:tasks.workunit.client.1.smithi195.stdout:1/172: mknod d0/c38 0 2024-03-22T07:28:28.305 INFO:tasks.workunit.client.0.smithi134.stdout:8/148: link d1/d4/c29 d1/d11/d25/c36 0 2024-03-22T07:28:28.305 INFO:tasks.workunit.client.0.smithi134.stdout:8/149: fdatasync d1/d11/d12/f1a 0 2024-03-22T07:28:28.305 INFO:tasks.workunit.client.0.smithi134.stdout:8/150: creat d1/d11/d12/f37 x:0 0 0 2024-03-22T07:28:28.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/35: write d1/d4/f6 [3472185,64703] 0 2024-03-22T07:28:28.308 INFO:tasks.workunit.client.1.smithi195.stdout:2/212: rename d2/f9 to d2/d3/d7/d19/d22/d26/f4b 0 2024-03-22T07:28:28.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/317: write d2/d4/d6/d18/f1e [303283,22863] 0 2024-03-22T07:28:28.309 INFO:tasks.workunit.client.1.smithi195.stdout:2/213: write d2/d3/d1a/f2b [4172069,44188] 0 2024-03-22T07:28:28.309 INFO:tasks.workunit.client.1.smithi195.stdout:9/318: truncate d2/d4/d6/d18/f4e 589486 0 2024-03-22T07:28:28.309 INFO:tasks.workunit.client.1.smithi195.stdout:2/214: dread - d2/d3/d7/da/de/f35 zero size 2024-03-22T07:28:28.310 INFO:tasks.workunit.client.0.smithi134.stdout:6/38: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:28.310 INFO:tasks.workunit.client.0.smithi134.stdout:6/39: fsync d2/f8 0 2024-03-22T07:28:28.310 INFO:tasks.workunit.client.0.smithi134.stdout:6/40: truncate d2/f8 3340430 0 2024-03-22T07:28:28.310 INFO:tasks.workunit.client.0.smithi134.stdout:6/41: chown d2/lb 18495 1 2024-03-22T07:28:28.311 INFO:tasks.workunit.client.0.smithi134.stdout:6/42: chown l1 20703478 1 2024-03-22T07:28:28.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/248: mknod d9/d2d/d58/c5d 0 2024-03-22T07:28:28.313 INFO:tasks.workunit.client.0.smithi134.stdout:7/182: dread d1/f3a [0,4194304] 0 2024-03-22T07:28:28.313 INFO:tasks.workunit.client.0.smithi134.stdout:7/183: creat d1/d3/f3e x:0 0 0 2024-03-22T07:28:28.314 INFO:tasks.workunit.client.0.smithi134.stdout:6/43: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:28.318 INFO:tasks.workunit.client.0.smithi134.stdout:8/151: mkdir d1/d4/d38 0 2024-03-22T07:28:28.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/225: rename d5/db/d17/d1a/d25/d34/f41 to d5/f51 0 2024-03-22T07:28:28.322 INFO:tasks.workunit.client.0.smithi134.stdout:4/125: dwrite d2/ff [0,4194304] 0 2024-03-22T07:28:28.322 INFO:tasks.workunit.client.0.smithi134.stdout:4/126: read - d2/d15/f1b zero size 2024-03-22T07:28:28.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/52: truncate f4 1208459 0 2024-03-22T07:28:28.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/53: chown f9 870895910 1 2024-03-22T07:28:28.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/54: chown f7 3959 1 2024-03-22T07:28:28.330 INFO:tasks.workunit.client.1.smithi195.stdout:2/215: mkdir d2/d3/d21/d4c 0 2024-03-22T07:28:28.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/319: write d2/d4/d6/f49 [996606,31056] 0 2024-03-22T07:28:28.332 INFO:tasks.workunit.client.0.smithi134.stdout:7/184: mknod d1/d19/c3f 0 2024-03-22T07:28:28.332 INFO:tasks.workunit.client.0.smithi134.stdout:7/185: readlink d1/de/l2e 0 2024-03-22T07:28:28.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/249: dwrite d9/d12/f47 [0,4194304] 0 2024-03-22T07:28:28.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/250: creat d9/d12/d1d/f5e x:0 0 0 2024-03-22T07:28:28.333 INFO:tasks.workunit.client.1.smithi195.stdout:2/216: fdatasync d2/d3/d1a/f2b 0 2024-03-22T07:28:28.334 INFO:tasks.workunit.client.1.smithi195.stdout:2/217: truncate d2/d3/d24/f39 1279234 0 2024-03-22T07:28:28.334 INFO:tasks.workunit.client.1.smithi195.stdout:3/288: rename d3/df/d65 to d3/df/d15/d1d/d5c/d47/d67 0 2024-03-22T07:28:28.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/226: symlink d5/d16/d45/l52 0 2024-03-22T07:28:28.337 INFO:tasks.workunit.client.1.smithi195.stdout:6/227: dread - d5/f3a zero size 2024-03-22T07:28:28.337 INFO:tasks.workunit.client.0.smithi134.stdout:6/44: mknod d2/cc 0 2024-03-22T07:28:28.338 INFO:tasks.workunit.client.0.smithi134.stdout:6/45: readlink l1 0 2024-03-22T07:28:28.339 INFO:tasks.workunit.client.0.smithi134.stdout:8/152: mkdir d1/d11/d12/d39 0 2024-03-22T07:28:28.341 INFO:tasks.workunit.client.0.smithi134.stdout:6/46: read d2/f8 [268536,65631] 0 2024-03-22T07:28:28.341 INFO:tasks.workunit.client.0.smithi134.stdout:6/47: write d2/f8 [3479529,16272] 0 2024-03-22T07:28:28.341 INFO:tasks.workunit.client.0.smithi134.stdout:0/55: dwrite f7 [0,4194304] 0 2024-03-22T07:28:28.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/127: symlink d2/d25/l2e 0 2024-03-22T07:28:28.342 INFO:tasks.workunit.client.0.smithi134.stdout:4/128: fdatasync d2/d15/f13 0 2024-03-22T07:28:28.344 INFO:tasks.workunit.client.0.smithi134.stdout:7/186: mkdir d1/d40 0 2024-03-22T07:28:28.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/251: mkdir d9/d3a/d5f 0 2024-03-22T07:28:28.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/252: fsync d9/d12/d14/f17 0 2024-03-22T07:28:28.345 INFO:tasks.workunit.client.1.smithi195.stdout:5/253: readlink d9/la 0 2024-03-22T07:28:28.345 INFO:tasks.workunit.client.1.smithi195.stdout:9/320: dwrite d2/d4/d32/f37 [0,4194304] 0 2024-03-22T07:28:28.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/153: unlink d1/d15/f1c 0 2024-03-22T07:28:28.346 INFO:tasks.workunit.client.0.smithi134.stdout:8/154: dread - d1/d11/d12/f1a zero size 2024-03-22T07:28:28.347 INFO:tasks.workunit.client.0.smithi134.stdout:6/48: mknod d2/cd 0 2024-03-22T07:28:28.350 INFO:tasks.workunit.client.0.smithi134.stdout:0/56: symlink lb 0 2024-03-22T07:28:28.351 INFO:tasks.workunit.client.1.smithi195.stdout:3/289: creat d3/d22/d64/f68 x:0 0 0 2024-03-22T07:28:28.353 INFO:tasks.workunit.client.0.smithi134.stdout:7/187: mkdir d1/de/d41 0 2024-03-22T07:28:28.353 INFO:tasks.workunit.client.0.smithi134.stdout:7/188: fdatasync d1/f33 0 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/57: dread f5 [0,4194304] 0 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/58: truncate f9 279949 0 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/59: stat l6 0 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/60: readlink la 0 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/61: rmdir - no directory 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/62: fsync f7 0 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/63: chown f9 42295 1 2024-03-22T07:28:28.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/64: write f5 [3373161,41704] 0 2024-03-22T07:28:28.356 INFO:tasks.workunit.client.1.smithi195.stdout:5/254: write d9/f1c [1942738,121280] 0 2024-03-22T07:28:28.356 INFO:tasks.workunit.client.1.smithi195.stdout:5/255: chown d9/d12/c33 15 1 2024-03-22T07:28:28.362 INFO:tasks.workunit.client.0.smithi134.stdout:0/65: dread f5 [0,4194304] 0 2024-03-22T07:28:28.367 INFO:tasks.workunit.client.1.smithi195.stdout:3/290: dwrite d3/d18/f39 [8388608,4194304] 0 2024-03-22T07:28:28.368 INFO:tasks.workunit.client.1.smithi195.stdout:3/291: fsync d3/df/d15/d1d/d5c/f3b 0 2024-03-22T07:28:28.420 INFO:tasks.workunit.client.1.smithi195.stdout:7/197: rename d0/d13/d14/d20/c21 to d0/d13/d22/c3d 0 2024-03-22T07:28:28.423 INFO:tasks.workunit.client.0.smithi134.stdout:8/155: creat d1/d11/d12/d39/f3a x:0 0 0 2024-03-22T07:28:28.423 INFO:tasks.workunit.client.0.smithi134.stdout:8/156: dread - d1/f2d zero size 2024-03-22T07:28:28.423 INFO:tasks.workunit.client.1.smithi195.stdout:2/218: rmdir d2/d17 39 2024-03-22T07:28:28.424 INFO:tasks.workunit.client.0.smithi134.stdout:6/49: link d2/lb d2/le 0 2024-03-22T07:28:28.425 INFO:tasks.workunit.client.0.smithi134.stdout:6/50: write d2/f8 [3433357,107376] 0 2024-03-22T07:28:28.429 INFO:tasks.workunit.client.0.smithi134.stdout:7/189: mknod d1/d19/d32/c42 0 2024-03-22T07:28:28.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/66: mkdir dc 0 2024-03-22T07:28:28.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/67: read f9 [120592,34733] 0 2024-03-22T07:28:28.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/68: getdents dc 0 2024-03-22T07:28:28.436 INFO:tasks.workunit.client.1.smithi195.stdout:5/256: symlink d9/d22/l60 0 2024-03-22T07:28:28.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/292: unlink d3/d22/d34/f4c 0 2024-03-22T07:28:28.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/293: readlink d3/d18/l1b 0 2024-03-22T07:28:28.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/294: write d3/df/d15/d1d/d5c/d47/f59 [1548802,40513] 0 2024-03-22T07:28:28.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/157: rename d1/d11/d25/c36 to d1/d11/d12/d39/c3b 0 2024-03-22T07:28:28.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/158: truncate d1/d11/d12/f1a 96242 0 2024-03-22T07:28:28.442 INFO:tasks.workunit.client.0.smithi134.stdout:0/69: dread f7 [0,4194304] 0 2024-03-22T07:28:28.443 INFO:tasks.workunit.client.1.smithi195.stdout:1/173: rename d0/d2/d6/d21/d32/d37 to d0/d2/d6/d21/d39 0 2024-03-22T07:28:28.444 INFO:tasks.workunit.client.0.smithi134.stdout:6/51: unlink d2/c5 0 2024-03-22T07:28:28.444 INFO:tasks.workunit.client.1.smithi195.stdout:2/219: rmdir d2/d3/d7/da/d1b 39 2024-03-22T07:28:28.445 INFO:tasks.workunit.client.0.smithi134.stdout:8/159: creat d1/d11/d12/d20/f3c x:0 0 0 2024-03-22T07:28:28.446 INFO:tasks.workunit.client.1.smithi195.stdout:5/257: mknod d9/d12/c61 0 2024-03-22T07:28:28.447 INFO:tasks.workunit.client.0.smithi134.stdout:0/70: mknod dc/cd 0 2024-03-22T07:28:28.449 INFO:tasks.workunit.client.0.smithi134.stdout:7/190: dwrite d1/de/ff [0,4194304] 0 2024-03-22T07:28:28.449 INFO:tasks.workunit.client.0.smithi134.stdout:6/52: mknod d2/cf 0 2024-03-22T07:28:28.450 INFO:tasks.workunit.client.1.smithi195.stdout:2/220: dread d2/d3/d7/d19/d22/d26/f4b [0,4194304] 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/160: mknod d1/d4/c3d 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:6/53: fsync d2/f8 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/161: dread - d1/d4/f22 zero size 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/162: truncate d1/d15/f27 1026779 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/163: fsync d1/d4/f22 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:6/54: write d2/f8 [1970126,106080] 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/164: creat d1/d11/d12/d39/f3e x:0 0 0 2024-03-22T07:28:28.452 INFO:tasks.workunit.client.0.smithi134.stdout:8/165: write d1/f24 [266548,114778] 0 2024-03-22T07:28:28.453 INFO:tasks.workunit.client.0.smithi134.stdout:8/166: write d1/d11/d12/d2a/f23 [102551,40289] 0 2024-03-22T07:28:28.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/174: dread d0/d2/fe [0,4194304] 0 2024-03-22T07:28:28.457 INFO:tasks.workunit.client.0.smithi134.stdout:7/191: rename d1/de/f39 to d1/de/d11/d2b/d31/f43 0 2024-03-22T07:28:28.458 INFO:tasks.workunit.client.1.smithi195.stdout:5/258: symlink d9/d12/d14/l62 0 2024-03-22T07:28:28.459 INFO:tasks.workunit.client.1.smithi195.stdout:5/259: fsync d9/f5b 0 2024-03-22T07:28:28.459 INFO:tasks.workunit.client.1.smithi195.stdout:5/260: read - d9/d12/f52 zero size 2024-03-22T07:28:28.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/295: symlink d3/l69 0 2024-03-22T07:28:28.462 INFO:tasks.workunit.client.0.smithi134.stdout:6/55: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:28.464 INFO:tasks.workunit.client.1.smithi195.stdout:2/221: creat d2/f4d x:0 0 0 2024-03-22T07:28:28.466 INFO:tasks.workunit.client.0.smithi134.stdout:0/71: dwrite f5 [0,4194304] 0 2024-03-22T07:28:28.466 INFO:tasks.workunit.client.0.smithi134.stdout:0/72: read f0 [400983,120519] 0 2024-03-22T07:28:28.469 INFO:tasks.workunit.client.0.smithi134.stdout:6/56: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:28.469 INFO:tasks.workunit.client.0.smithi134.stdout:8/167: rename d1/c16 to d1/d4/d38/c3f 0 2024-03-22T07:28:28.469 INFO:tasks.workunit.client.0.smithi134.stdout:8/168: dread - d1/d11/d12/f37 zero size 2024-03-22T07:28:28.471 INFO:tasks.workunit.client.0.smithi134.stdout:7/192: getdents d1/de/d11/d2b 0 2024-03-22T07:28:28.471 INFO:tasks.workunit.client.0.smithi134.stdout:7/193: truncate d1/de/f1c 4204630 0 2024-03-22T07:28:28.471 INFO:tasks.workunit.client.0.smithi134.stdout:7/194: fdatasync d1/f33 0 2024-03-22T07:28:28.472 INFO:tasks.workunit.client.0.smithi134.stdout:7/195: readlink d1/de/l37 0 2024-03-22T07:28:28.474 INFO:tasks.workunit.client.0.smithi134.stdout:2/66: sync 2024-03-22T07:28:28.474 INFO:tasks.workunit.client.0.smithi134.stdout:2/67: readlink l1 0 2024-03-22T07:28:28.474 INFO:tasks.workunit.client.0.smithi134.stdout:2/68: readlink l1 0 2024-03-22T07:28:28.475 INFO:tasks.workunit.client.0.smithi134.stdout:2/69: creat d2/f14 x:0 0 0 2024-03-22T07:28:28.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/17: sync 2024-03-22T07:28:28.475 INFO:tasks.workunit.client.0.smithi134.stdout:0/73: mkdir dc/de 0 2024-03-22T07:28:28.478 INFO:tasks.workunit.client.0.smithi134.stdout:7/196: unlink d1/de/f1c 0 2024-03-22T07:28:28.482 INFO:tasks.workunit.client.0.smithi134.stdout:9/18: getdents d3 0 2024-03-22T07:28:28.483 INFO:tasks.workunit.client.0.smithi134.stdout:0/74: symlink dc/de/lf 0 2024-03-22T07:28:28.486 INFO:tasks.workunit.client.1.smithi195.stdout:5/261: creat d9/d22/d46/f63 x:0 0 0 2024-03-22T07:28:28.487 INFO:tasks.workunit.client.1.smithi195.stdout:5/262: dread f0 [0,4194304] 0 2024-03-22T07:28:28.491 INFO:tasks.workunit.client.0.smithi134.stdout:7/197: write d1/f17 [857867,99900] 0 2024-03-22T07:28:28.492 INFO:tasks.workunit.client.1.smithi195.stdout:3/296: unlink d3/df/f1f 0 2024-03-22T07:28:28.492 INFO:tasks.workunit.client.1.smithi195.stdout:6/228: rename d5/db to d5/d16/d45/d53 0 2024-03-22T07:28:28.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/297: creat d3/df/d15/f6a x:0 0 0 2024-03-22T07:28:28.497 INFO:tasks.workunit.client.1.smithi195.stdout:6/229: creat d5/d16/d45/d53/d17/d1a/f54 x:0 0 0 2024-03-22T07:28:28.499 INFO:tasks.workunit.client.0.smithi134.stdout:7/198: mknod d1/de/c44 0 2024-03-22T07:28:28.499 INFO:tasks.workunit.client.0.smithi134.stdout:7/199: readlink d1/de/l37 0 2024-03-22T07:28:28.499 INFO:tasks.workunit.client.0.smithi134.stdout:0/75: write f5 [993526,96595] 0 2024-03-22T07:28:28.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/298: mknod d3/d22/d64/c6b 0 2024-03-22T07:28:28.503 INFO:tasks.workunit.client.0.smithi134.stdout:0/76: mknod dc/c10 0 2024-03-22T07:28:28.503 INFO:tasks.workunit.client.0.smithi134.stdout:0/77: chown lb 0 1 2024-03-22T07:28:28.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/230: rename d5/dc/d42 to d5/d16/d45/d53/d17/d1a/d25/d34/d55 0 2024-03-22T07:28:28.505 INFO:tasks.workunit.client.0.smithi134.stdout:0/78: symlink dc/l11 0 2024-03-22T07:28:28.505 INFO:tasks.workunit.client.0.smithi134.stdout:0/79: chown f9 76652704 1 2024-03-22T07:28:28.506 INFO:tasks.workunit.client.1.smithi195.stdout:5/263: write d9/d12/f47 [509382,22448] 0 2024-03-22T07:28:28.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/299: rmdir d3/d22/d34 39 2024-03-22T07:28:28.506 INFO:tasks.workunit.client.1.smithi195.stdout:3/300: dread - d3/df/f4a zero size 2024-03-22T07:28:28.508 INFO:tasks.workunit.client.1.smithi195.stdout:3/301: creat d3/df/d15/d1d/d5c/f6c x:0 0 0 2024-03-22T07:28:28.508 INFO:tasks.workunit.client.1.smithi195.stdout:3/302: readlink d3/df/d15/d1d/l41 0 2024-03-22T07:28:28.510 INFO:tasks.workunit.client.1.smithi195.stdout:3/303: creat d3/d22/d34/f6d x:0 0 0 2024-03-22T07:28:28.511 INFO:tasks.workunit.client.0.smithi134.stdout:7/200: write d1/d19/f23 [3464005,84894] 0 2024-03-22T07:28:28.511 INFO:tasks.workunit.client.0.smithi134.stdout:7/201: write d1/de/f26 [3427319,127802] 0 2024-03-22T07:28:28.512 INFO:tasks.workunit.client.0.smithi134.stdout:7/202: mknod d1/d3/c45 0 2024-03-22T07:28:28.514 INFO:tasks.workunit.client.0.smithi134.stdout:7/203: mkdir d1/d3/d46 0 2024-03-22T07:28:28.520 INFO:tasks.workunit.client.1.smithi195.stdout:1/175: dwrite d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:28.523 INFO:tasks.workunit.client.1.smithi195.stdout:1/176: rename d0/d2/d9/d2a/c34 to d0/d2/d9/c3a 0 2024-03-22T07:28:28.524 INFO:tasks.workunit.client.1.smithi195.stdout:1/177: mknod d0/d2/d6/c3b 0 2024-03-22T07:28:28.527 INFO:tasks.workunit.client.1.smithi195.stdout:1/178: unlink d0/l2d 0 2024-03-22T07:28:28.527 INFO:tasks.workunit.client.1.smithi195.stdout:1/179: getdents d0/d2/d6/d21 0 2024-03-22T07:28:28.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/180: rename d0/d2/d6/l12 to d0/d2/d6/d21/l3c 0 2024-03-22T07:28:28.533 INFO:tasks.workunit.client.1.smithi195.stdout:2/222: dwrite d2/d3/d21/f14 [0,4194304] 0 2024-03-22T07:28:28.534 INFO:tasks.workunit.client.0.smithi134.stdout:8/169: dwrite d1/d11/f2b [4194304,4194304] 0 2024-03-22T07:28:28.536 INFO:tasks.workunit.client.0.smithi134.stdout:9/19: dwrite f1 [0,4194304] 0 2024-03-22T07:28:28.537 INFO:tasks.workunit.client.1.smithi195.stdout:3/304: dwrite d3/d18/f39 [4194304,4194304] 0 2024-03-22T07:28:28.537 INFO:tasks.workunit.client.1.smithi195.stdout:2/223: mkdir d2/d3/d7/da/d4e 0 2024-03-22T07:28:28.537 INFO:tasks.workunit.client.1.smithi195.stdout:2/224: fdatasync d2/d3/d7/d19/d22/d26/f2c 0 2024-03-22T07:28:28.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/80: dwrite f9 [0,4194304] 0 2024-03-22T07:28:28.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/305: dread d3/d18/f26 [0,4194304] 0 2024-03-22T07:28:28.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/306: chown d3/df/d15/l63 1814979 1 2024-03-22T07:28:28.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/307: chown d3/d22/c52 0 1 2024-03-22T07:28:28.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/308: write d3/fd [5690679,13602] 0 2024-03-22T07:28:28.544 INFO:tasks.workunit.client.0.smithi134.stdout:6/57: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:28.544 INFO:tasks.workunit.client.0.smithi134.stdout:2/70: dwrite d2/d5/fc [0,4194304] 0 2024-03-22T07:28:28.545 INFO:tasks.workunit.client.0.smithi134.stdout:2/71: truncate d2/fe 4577127 0 2024-03-22T07:28:28.548 INFO:tasks.workunit.client.1.smithi195.stdout:3/309: getdents d3/df 0 2024-03-22T07:28:28.549 INFO:tasks.workunit.client.1.smithi195.stdout:9/321: sync 2024-03-22T07:28:28.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/242: sync 2024-03-22T07:28:28.550 INFO:tasks.workunit.client.1.smithi195.stdout:8/304: sync 2024-03-22T07:28:28.550 INFO:tasks.workunit.client.1.smithi195.stdout:9/322: fdatasync d2/d4/d32/f54 0 2024-03-22T07:28:28.550 INFO:tasks.workunit.client.1.smithi195.stdout:4/265: sync 2024-03-22T07:28:28.551 INFO:tasks.workunit.client.1.smithi195.stdout:5/264: dread d9/d12/f47 [0,4194304] 0 2024-03-22T07:28:28.551 INFO:tasks.workunit.client.1.smithi195.stdout:5/265: chown d9/l13 92476129 1 2024-03-22T07:28:28.552 INFO:tasks.workunit.client.1.smithi195.stdout:2/225: dread d2/f34 [0,4194304] 0 2024-03-22T07:28:28.554 INFO:tasks.workunit.client.1.smithi195.stdout:3/310: symlink d3/df/l6e 0 2024-03-22T07:28:28.554 INFO:tasks.workunit.client.1.smithi195.stdout:3/311: creat d3/df/d15/d1d/d5c/f6f x:0 0 0 2024-03-22T07:28:28.556 INFO:tasks.workunit.client.1.smithi195.stdout:0/243: mknod d1/d4/dd/c45 0 2024-03-22T07:28:28.560 INFO:tasks.workunit.client.1.smithi195.stdout:9/323: mkdir d2/d4/d32/d6d/d78/d79 0 2024-03-22T07:28:28.560 INFO:tasks.workunit.client.1.smithi195.stdout:9/324: truncate d2/d4/d23/f69 5044304 0 2024-03-22T07:28:28.560 INFO:tasks.workunit.client.1.smithi195.stdout:9/325: truncate d2/d4/d6/f49 4612260 0 2024-03-22T07:28:28.560 INFO:tasks.workunit.client.1.smithi195.stdout:9/326: truncate d2/d4/d23/d74/f76 1020016 0 2024-03-22T07:28:28.561 INFO:tasks.workunit.client.0.smithi134.stdout:9/20: link l2 d3/l6 0 2024-03-22T07:28:28.563 INFO:tasks.workunit.client.1.smithi195.stdout:4/266: mkdir d13/d15/d16/d36/d5f 0 2024-03-22T07:28:28.563 INFO:tasks.workunit.client.1.smithi195.stdout:4/267: truncate d13/d15/f37 6322 0 2024-03-22T07:28:28.567 INFO:tasks.workunit.client.1.smithi195.stdout:2/226: symlink d2/d3/d21/d4c/l4f 0 2024-03-22T07:28:28.568 INFO:tasks.workunit.client.0.smithi134.stdout:0/81: getdents dc/de 0 2024-03-22T07:28:28.568 INFO:tasks.workunit.client.0.smithi134.stdout:0/82: chown f0 1523775 1 2024-03-22T07:28:28.570 INFO:tasks.workunit.client.1.smithi195.stdout:3/312: mkdir d3/d22/d34/d70 0 2024-03-22T07:28:28.573 INFO:tasks.workunit.client.1.smithi195.stdout:0/244: symlink d1/d4/d12/l46 0 2024-03-22T07:28:28.573 INFO:tasks.workunit.client.1.smithi195.stdout:0/245: chown d1/d10/d19/d20/f3c 33258203 1 2024-03-22T07:28:28.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/181: dwrite d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:28.575 INFO:tasks.workunit.client.1.smithi195.stdout:4/268: getdents d13/d15/d44 0 2024-03-22T07:28:28.576 INFO:tasks.workunit.client.1.smithi195.stdout:4/269: chown fa 679566 1 2024-03-22T07:28:28.576 INFO:tasks.workunit.client.0.smithi134.stdout:9/21: stat d3/l6 0 2024-03-22T07:28:28.577 INFO:tasks.workunit.client.1.smithi195.stdout:7/198: sync 2024-03-22T07:28:28.578 INFO:tasks.workunit.client.1.smithi195.stdout:3/313: creat d3/d22/d34/d70/f71 x:0 0 0 2024-03-22T07:28:28.579 INFO:tasks.workunit.client.0.smithi134.stdout:0/83: mknod dc/c12 0 2024-03-22T07:28:28.579 INFO:tasks.workunit.client.0.smithi134.stdout:0/84: getdents dc/de 0 2024-03-22T07:28:28.580 INFO:tasks.workunit.client.1.smithi195.stdout:0/246: mkdir d1/d10/d1f/d40/d47 0 2024-03-22T07:28:28.580 INFO:tasks.workunit.client.1.smithi195.stdout:0/247: creat d1/d10/d19/d20/f48 x:0 0 0 2024-03-22T07:28:28.581 INFO:tasks.workunit.client.0.smithi134.stdout:0/85: mknod dc/de/c13 0 2024-03-22T07:28:28.582 INFO:tasks.workunit.client.1.smithi195.stdout:1/182: mknod d0/d2/d6/c3d 0 2024-03-22T07:28:28.582 INFO:tasks.workunit.client.1.smithi195.stdout:1/183: chown d0/d2/c20 8810754 1 2024-03-22T07:28:28.583 INFO:tasks.workunit.client.1.smithi195.stdout:7/199: creat d0/d13/d14/d29/d35/d3a/f3e x:0 0 0 2024-03-22T07:28:28.584 INFO:tasks.workunit.client.0.smithi134.stdout:0/86: mknod dc/c14 0 2024-03-22T07:28:28.588 INFO:tasks.workunit.client.0.smithi134.stdout:9/22: dread d3/f4 [0,4194304] 0 2024-03-22T07:28:28.589 INFO:tasks.workunit.client.1.smithi195.stdout:1/184: creat d0/d2/d6/d21/d32/f3e x:0 0 0 2024-03-22T07:28:28.590 INFO:tasks.workunit.client.0.smithi134.stdout:9/23: symlink d3/l7 0 2024-03-22T07:28:28.590 INFO:tasks.workunit.client.0.smithi134.stdout:8/170: dwrite d1/d11/d12/d39/f3a [0,4194304] 0 2024-03-22T07:28:28.591 INFO:tasks.workunit.client.0.smithi134.stdout:2/72: dwrite d2/f14 [0,4194304] 0 2024-03-22T07:28:28.591 INFO:tasks.workunit.client.1.smithi195.stdout:1/185: rmdir d0/d2/d9/d2a 39 2024-03-22T07:28:28.593 INFO:tasks.workunit.client.0.smithi134.stdout:7/204: dwrite d1/f17 [4194304,4194304] 0 2024-03-22T07:28:28.595 INFO:tasks.workunit.client.1.smithi195.stdout:0/248: dwrite d1/d4/dd/df/f3e [0,4194304] 0 2024-03-22T07:28:28.595 INFO:tasks.workunit.client.1.smithi195.stdout:0/249: read - d1/d10/d19/d20/f48 zero size 2024-03-22T07:28:28.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/327: dwrite d2/d4/f38 [0,4194304] 0 2024-03-22T07:28:28.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/328: chown d2/l45 918 1 2024-03-22T07:28:28.595 INFO:tasks.workunit.client.0.smithi134.stdout:6/58: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:28.596 INFO:tasks.workunit.client.0.smithi134.stdout:8/171: unlink d1/d15/fe 0 2024-03-22T07:28:28.596 INFO:tasks.workunit.client.0.smithi134.stdout:8/172: write d1/d11/d12/f1a [230602,52209] 0 2024-03-22T07:28:28.596 INFO:tasks.workunit.client.1.smithi195.stdout:2/227: dwrite d2/d3/d7/d19/d22/d26/f2c [0,4194304] 0 2024-03-22T07:28:28.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/24: write d3/f4 [190243,100828] 0 2024-03-22T07:28:28.597 INFO:tasks.workunit.client.1.smithi195.stdout:5/266: dwrite d9/f31 [0,4194304] 0 2024-03-22T07:28:28.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/200: dread d0/fc [4194304,4194304] 0 2024-03-22T07:28:28.605 INFO:tasks.workunit.client.0.smithi134.stdout:0/87: dwrite f0 [4194304,4194304] 0 2024-03-22T07:28:28.610 INFO:tasks.workunit.client.1.smithi195.stdout:9/329: mknod d2/d4/d32/d6d/c7a 0 2024-03-22T07:28:28.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/186: write d0/d2/d9/f15 [3077416,79590] 0 2024-03-22T07:28:28.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/187: fsync d0/d2/d27/f33 0 2024-03-22T07:28:28.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/205: mknod d1/d40/c47 0 2024-03-22T07:28:28.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/206: fsync d1/f17 0 2024-03-22T07:28:28.614 INFO:tasks.workunit.client.0.smithi134.stdout:7/207: dread - d1/f3d zero size 2024-03-22T07:28:28.614 INFO:tasks.workunit.client.0.smithi134.stdout:9/25: dwrite f0 [0,4194304] 0 2024-03-22T07:28:28.616 INFO:tasks.workunit.client.1.smithi195.stdout:2/228: truncate d2/d3/d21/f14 3588407 0 2024-03-22T07:28:28.616 INFO:tasks.workunit.client.1.smithi195.stdout:2/229: truncate d2/d3/d1a/f3a 190556 0 2024-03-22T07:28:28.616 INFO:tasks.workunit.client.1.smithi195.stdout:2/230: creat d2/d3/d1a/f50 x:0 0 0 2024-03-22T07:28:28.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/250: dwrite d1/d10/d1f/f21 [4194304,4194304] 0 2024-03-22T07:28:28.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/251: dread - d1/d10/d19/d20/f3c zero size 2024-03-22T07:28:28.618 INFO:tasks.workunit.client.1.smithi195.stdout:0/252: truncate d1/d4/d12/f27 4907664 0 2024-03-22T07:28:28.622 INFO:tasks.workunit.client.0.smithi134.stdout:6/59: link d2/le d2/l10 0 2024-03-22T07:28:28.622 INFO:tasks.workunit.client.0.smithi134.stdout:6/60: write d2/f8 [4923660,59674] 0 2024-03-22T07:28:28.626 INFO:tasks.workunit.client.1.smithi195.stdout:5/267: symlink d9/d2d/l64 0 2024-03-22T07:28:28.629 INFO:tasks.workunit.client.1.smithi195.stdout:7/201: mknod d0/d13/c3f 0 2024-03-22T07:28:28.629 INFO:tasks.workunit.client.0.smithi134.stdout:8/173: mknod d1/d11/d25/c40 0 2024-03-22T07:28:28.632 INFO:tasks.workunit.client.0.smithi134.stdout:0/88: creat dc/de/f15 x:0 0 0 2024-03-22T07:28:28.640 INFO:tasks.workunit.client.0.smithi134.stdout:1/91: sync 2024-03-22T07:28:28.641 INFO:tasks.workunit.client.0.smithi134.stdout:3/76: sync 2024-03-22T07:28:28.641 INFO:tasks.workunit.client.0.smithi134.stdout:3/77: creat d4/d8/f19 x:0 0 0 2024-03-22T07:28:28.641 INFO:tasks.workunit.client.1.smithi195.stdout:2/231: dwrite d2/d3/d7/f27 [0,4194304] 0 2024-03-22T07:28:28.644 INFO:tasks.workunit.client.0.smithi134.stdout:6/61: symlink d2/l11 0 2024-03-22T07:28:28.646 INFO:tasks.workunit.client.1.smithi195.stdout:0/253: dwrite d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:28.649 INFO:tasks.workunit.client.0.smithi134.stdout:8/174: mkdir d1/d11/d12/d20/d41 0 2024-03-22T07:28:28.649 INFO:tasks.workunit.client.0.smithi134.stdout:8/175: stat d1/d11/d12/d20/f3c 0 2024-03-22T07:28:28.650 INFO:tasks.workunit.client.0.smithi134.stdout:5/36: sync 2024-03-22T07:28:28.650 INFO:tasks.workunit.client.0.smithi134.stdout:5/37: readlink d1/lc 0 2024-03-22T07:28:28.652 INFO:tasks.workunit.client.0.smithi134.stdout:0/89: link dc/c14 dc/de/c16 0 2024-03-22T07:28:28.652 INFO:tasks.workunit.client.0.smithi134.stdout:0/90: chown l8 169736336 1 2024-03-22T07:28:28.653 INFO:tasks.workunit.client.1.smithi195.stdout:1/188: dwrite d0/d2/d27/f33 [0,4194304] 0 2024-03-22T07:28:28.657 INFO:tasks.workunit.client.0.smithi134.stdout:3/78: rmdir d4/d17 0 2024-03-22T07:28:28.658 INFO:tasks.workunit.client.1.smithi195.stdout:0/254: unlink d1/d10/d1f/c2a 0 2024-03-22T07:28:28.659 INFO:tasks.workunit.client.1.smithi195.stdout:9/330: dwrite d2/d4/d1d/f3d [0,4194304] 0 2024-03-22T07:28:28.661 INFO:tasks.workunit.client.0.smithi134.stdout:4/129: sync 2024-03-22T07:28:28.661 INFO:tasks.workunit.client.0.smithi134.stdout:4/130: fdatasync d2/d1d/f1f 0 2024-03-22T07:28:28.661 INFO:tasks.workunit.client.0.smithi134.stdout:4/131: write d2/fd [1507896,107297] 0 2024-03-22T07:28:28.662 INFO:tasks.workunit.client.1.smithi195.stdout:5/268: dwrite f8 [0,4194304] 0 2024-03-22T07:28:28.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/202: dwrite d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:28.664 INFO:tasks.workunit.client.0.smithi134.stdout:6/62: write d2/f8 [3321348,73744] 0 2024-03-22T07:28:28.664 INFO:tasks.workunit.client.0.smithi134.stdout:1/92: dwrite f1 [0,4194304] 0 2024-03-22T07:28:28.664 INFO:tasks.workunit.client.0.smithi134.stdout:1/93: chown d5/f20 25193 1 2024-03-22T07:28:28.664 INFO:tasks.workunit.client.0.smithi134.stdout:1/94: truncate d5/da/d1b/f1c 555810 0 2024-03-22T07:28:28.664 INFO:tasks.workunit.client.0.smithi134.stdout:5/38: truncate d1/d4/f6 90705 0 2024-03-22T07:28:28.664 INFO:tasks.workunit.client.0.smithi134.stdout:9/26: dwrite f0 [0,4194304] 0 2024-03-22T07:28:28.665 INFO:tasks.workunit.client.0.smithi134.stdout:6/63: write d2/f8 [4664129,59602] 0 2024-03-22T07:28:28.666 INFO:tasks.workunit.client.1.smithi195.stdout:2/232: rmdir d2/d3/d7/d19/d22/d26/d3c 39 2024-03-22T07:28:28.667 INFO:tasks.workunit.client.1.smithi195.stdout:0/255: write d1/d10/d19/d20/f28 [4126102,70149] 0 2024-03-22T07:28:28.670 INFO:tasks.workunit.client.0.smithi134.stdout:0/91: getdents dc 0 2024-03-22T07:28:28.670 INFO:tasks.workunit.client.1.smithi195.stdout:0/256: dread d1/d10/d1f/f2f [0,4194304] 0 2024-03-22T07:28:28.672 INFO:tasks.workunit.client.0.smithi134.stdout:7/208: rename d1/d3/d6 to d1/de/d11/d48 0 2024-03-22T07:28:28.672 INFO:tasks.workunit.client.0.smithi134.stdout:7/209: chown d1/d19/d32/f36 19 1 2024-03-22T07:28:28.677 INFO:tasks.workunit.client.0.smithi134.stdout:3/79: link d4/fd d4/f1a 0 2024-03-22T07:28:28.682 INFO:tasks.workunit.client.0.smithi134.stdout:4/132: rmdir d2/d15 39 2024-03-22T07:28:28.686 INFO:tasks.workunit.client.0.smithi134.stdout:5/39: mkdir d1/dd 0 2024-03-22T07:28:28.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/203: rmdir d0/d13/d22/d28/d39 0 2024-03-22T07:28:28.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/204: write d0/d13/d14/f8 [4553372,92736] 0 2024-03-22T07:28:28.690 INFO:tasks.workunit.client.0.smithi134.stdout:9/27: creat d3/f8 x:0 0 0 2024-03-22T07:28:28.690 INFO:tasks.workunit.client.0.smithi134.stdout:9/28: fsync f1 0 2024-03-22T07:28:28.693 INFO:tasks.workunit.client.1.smithi195.stdout:0/257: mknod d1/d10/d19/c49 0 2024-03-22T07:28:28.696 INFO:tasks.workunit.client.1.smithi195.stdout:7/205: mkdir d0/d13/d14/d20/d40 0 2024-03-22T07:28:28.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/331: dwrite d2/d4/d6/db/d20/d4a/f5e [0,4194304] 0 2024-03-22T07:28:28.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/332: write d2/d4/d6/d18/f43 [424965,6540] 0 2024-03-22T07:28:28.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/333: stat d2/d4/d1d 0 2024-03-22T07:28:28.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/334: chown d2/d4/d6/db/d20/d4a/f5e 299 1 2024-03-22T07:28:28.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/269: rmdir d9/d22/d46 39 2024-03-22T07:28:28.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/270: chown d9/f28 5899 1 2024-03-22T07:28:28.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/258: link d1/d10/c3b d1/d10/c4a 0 2024-03-22T07:28:28.700 INFO:tasks.workunit.client.1.smithi195.stdout:0/259: truncate d1/d10/d1f/f2f 1094775 0 2024-03-22T07:28:28.700 INFO:tasks.workunit.client.1.smithi195.stdout:9/335: write d2/d4/d6/db/f1b [3850504,42422] 0 2024-03-22T07:28:28.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/210: creat d1/de/d41/f49 x:0 0 0 2024-03-22T07:28:28.702 INFO:tasks.workunit.client.1.smithi195.stdout:7/206: creat d0/d13/d14/d20/d40/f41 x:0 0 0 2024-03-22T07:28:28.703 INFO:tasks.workunit.client.0.smithi134.stdout:5/40: rmdir d1 39 2024-03-22T07:28:28.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/95: dwrite f1 [0,4194304] 0 2024-03-22T07:28:28.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/96: chown d5/da/d1b 61 1 2024-03-22T07:28:28.704 INFO:tasks.workunit.client.0.smithi134.stdout:9/29: mkdir d3/d9 0 2024-03-22T07:28:28.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/92: rmdir dc/de 39 2024-03-22T07:28:28.709 INFO:tasks.workunit.client.1.smithi195.stdout:5/271: truncate d9/d22/f2b 447232 0 2024-03-22T07:28:28.710 INFO:tasks.workunit.client.0.smithi134.stdout:5/41: mknod d1/d8/ce 0 2024-03-22T07:28:28.710 INFO:tasks.workunit.client.0.smithi134.stdout:5/42: readlink d1/d8/la 0 2024-03-22T07:28:28.713 INFO:tasks.workunit.client.1.smithi195.stdout:0/260: link d1/d4/d12/l15 d1/d4/d12/l4b 0 2024-03-22T07:28:28.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/336: mknod d2/d4/d6/db/d20/c7b 0 2024-03-22T07:28:28.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/207: creat d0/d13/d14/d2b/f42 x:0 0 0 2024-03-22T07:28:28.719 INFO:tasks.workunit.client.1.smithi195.stdout:7/208: chown d0/d13/c3c 24 1 2024-03-22T07:28:28.720 INFO:tasks.workunit.client.1.smithi195.stdout:9/337: dread d2/d4/d6/d18/f44 [0,4194304] 0 2024-03-22T07:28:28.720 INFO:tasks.workunit.client.1.smithi195.stdout:9/338: creat d2/d4/d32/f7c x:0 0 0 2024-03-22T07:28:28.721 INFO:tasks.workunit.client.0.smithi134.stdout:0/93: getdents dc/de 0 2024-03-22T07:28:28.721 INFO:tasks.workunit.client.0.smithi134.stdout:0/94: write f5 [819123,113997] 0 2024-03-22T07:28:28.722 INFO:tasks.workunit.client.1.smithi195.stdout:5/272: creat d9/d2d/f65 x:0 0 0 2024-03-22T07:28:28.723 INFO:tasks.workunit.client.1.smithi195.stdout:0/261: creat d1/d10/d1f/d40/d43/f4c x:0 0 0 2024-03-22T07:28:28.723 INFO:tasks.workunit.client.1.smithi195.stdout:0/262: truncate d1/d4/dd/df/f11 1345003 0 2024-03-22T07:28:28.724 INFO:tasks.workunit.client.1.smithi195.stdout:7/209: creat d0/d13/d14/d2f/f43 x:0 0 0 2024-03-22T07:28:28.725 INFO:tasks.workunit.client.1.smithi195.stdout:9/339: symlink d2/d4/d32/l7d 0 2024-03-22T07:28:28.726 INFO:tasks.workunit.client.1.smithi195.stdout:5/273: symlink d9/d12/d14/d3f/d41/l66 0 2024-03-22T07:28:28.727 INFO:tasks.workunit.client.1.smithi195.stdout:0/263: mkdir d1/d10/d4d 0 2024-03-22T07:28:28.727 INFO:tasks.workunit.client.1.smithi195.stdout:0/264: readlink d1/l2 0 2024-03-22T07:28:28.727 INFO:tasks.workunit.client.1.smithi195.stdout:7/210: symlink d0/d13/d14/d29/d35/l44 0 2024-03-22T07:28:28.728 INFO:tasks.workunit.client.1.smithi195.stdout:5/274: link d9/fb d9/d2d/f67 0 2024-03-22T07:28:28.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/211: symlink d0/d13/d14/d20/l45 0 2024-03-22T07:28:28.729 INFO:tasks.workunit.client.1.smithi195.stdout:2/233: dwrite d2/d3/d7/da/d1b/f29 [0,4194304] 0 2024-03-22T07:28:28.729 INFO:tasks.workunit.client.0.smithi134.stdout:3/80: dwrite d4/d8/fa [0,4194304] 0 2024-03-22T07:28:28.733 INFO:tasks.workunit.client.1.smithi195.stdout:9/340: dread d2/d4/f12 [0,4194304] 0 2024-03-22T07:28:28.734 INFO:tasks.workunit.client.1.smithi195.stdout:5/275: link d9/d2d/d58/c5d d9/c68 0 2024-03-22T07:28:28.735 INFO:tasks.workunit.client.1.smithi195.stdout:9/341: symlink d2/d4/d6/db/d20/d4a/l7e 0 2024-03-22T07:28:28.736 INFO:tasks.workunit.client.1.smithi195.stdout:2/234: write d2/d3/d7/d19/f33 [1631901,115346] 0 2024-03-22T07:28:28.737 INFO:tasks.workunit.client.1.smithi195.stdout:9/342: link d2/d4/d6/db/d20/d4a/f51 d2/d4/d6/db/d20/d4a/f7f 0 2024-03-22T07:28:28.741 INFO:tasks.workunit.client.0.smithi134.stdout:6/64: dwrite d2/f8 [4194304,4194304] 0 2024-03-22T07:28:28.741 INFO:tasks.workunit.client.0.smithi134.stdout:6/65: fdatasync d2/f8 0 2024-03-22T07:28:28.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/43: getdents d1 0 2024-03-22T07:28:28.743 INFO:tasks.workunit.client.0.smithi134.stdout:3/81: read d4/d10/f11 [3024726,8896] 0 2024-03-22T07:28:28.743 INFO:tasks.workunit.client.0.smithi134.stdout:9/30: dwrite d3/f4 [0,4194304] 0 2024-03-22T07:28:28.743 INFO:tasks.workunit.client.0.smithi134.stdout:7/211: dwrite d1/de/f26 [0,4194304] 0 2024-03-22T07:28:28.744 INFO:tasks.workunit.client.1.smithi195.stdout:0/265: dwrite d1/d4/f39 [0,4194304] 0 2024-03-22T07:28:28.744 INFO:tasks.workunit.client.1.smithi195.stdout:0/266: chown d1/d4/dd/df 9662 1 2024-03-22T07:28:28.745 INFO:tasks.workunit.client.0.smithi134.stdout:1/97: dwrite f4 [0,4194304] 0 2024-03-22T07:28:28.748 INFO:tasks.workunit.client.1.smithi195.stdout:5/276: dread d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:28.748 INFO:tasks.workunit.client.1.smithi195.stdout:5/277: fsync d9/f11 0 2024-03-22T07:28:28.748 INFO:tasks.workunit.client.0.smithi134.stdout:5/44: mkdir d1/d4/df 0 2024-03-22T07:28:28.749 INFO:tasks.workunit.client.0.smithi134.stdout:3/82: unlink d4/f15 0 2024-03-22T07:28:28.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/83: truncate d4/d8/f19 586197 0 2024-03-22T07:28:28.756 INFO:tasks.workunit.client.0.smithi134.stdout:9/31: rename d3/l6 to d3/d9/la 0 2024-03-22T07:28:28.756 INFO:tasks.workunit.client.0.smithi134.stdout:9/32: read - d3/f8 zero size 2024-03-22T07:28:28.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/267: truncate d1/d4/f18 8967983 0 2024-03-22T07:28:28.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/268: stat d1 0 2024-03-22T07:28:28.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/269: readlink d1/d4/d12/l46 0 2024-03-22T07:28:28.757 INFO:tasks.workunit.client.1.smithi195.stdout:0/270: readlink d1/d4/dd/df/d2b/l3d 0 2024-03-22T07:28:28.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/212: mknod d1/d19/d32/c4a 0 2024-03-22T07:28:28.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/213: write d1/d3/f3e [735281,35358] 0 2024-03-22T07:28:28.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/214: write d1/d19/f23 [2837759,87166] 0 2024-03-22T07:28:28.762 INFO:tasks.workunit.client.1.smithi195.stdout:0/271: rename d1/d10/d19/l36 to d1/d4/d12/l4e 0 2024-03-22T07:28:28.763 INFO:tasks.workunit.client.1.smithi195.stdout:0/272: truncate d1/d10/d1f/d40/d43/f4c 609580 0 2024-03-22T07:28:28.763 INFO:tasks.workunit.client.1.smithi195.stdout:0/273: creat d1/d10/d19/d20/f4f x:0 0 0 2024-03-22T07:28:28.763 INFO:tasks.workunit.client.1.smithi195.stdout:0/274: stat d1/d4/d22/d41 0 2024-03-22T07:28:28.764 INFO:tasks.workunit.client.1.smithi195.stdout:5/278: getdents d9/d12 0 2024-03-22T07:28:28.767 INFO:tasks.workunit.client.0.smithi134.stdout:5/45: rmdir d1/d4/df 0 2024-03-22T07:28:28.769 INFO:tasks.workunit.client.0.smithi134.stdout:5/46: dread d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.769 INFO:tasks.workunit.client.0.smithi134.stdout:5/47: write d1/d4/f6 [503500,70411] 0 2024-03-22T07:28:28.769 INFO:tasks.workunit.client.0.smithi134.stdout:9/33: read f1 [2671856,5034] 0 2024-03-22T07:28:28.769 INFO:tasks.workunit.client.0.smithi134.stdout:9/34: write d3/f4 [4911097,46666] 0 2024-03-22T07:28:28.770 INFO:tasks.workunit.client.1.smithi195.stdout:2/235: dwrite d2/d3/d7/d19/d22/d26/d3c/f47 [0,4194304] 0 2024-03-22T07:28:28.772 INFO:tasks.workunit.client.1.smithi195.stdout:0/275: creat d1/d4/dd/df/d44/f50 x:0 0 0 2024-03-22T07:28:28.772 INFO:tasks.workunit.client.1.smithi195.stdout:0/276: chown d1/d10/d19/d20 24 1 2024-03-22T07:28:28.774 INFO:tasks.workunit.client.0.smithi134.stdout:0/95: dwrite f5 [0,4194304] 0 2024-03-22T07:28:28.774 INFO:tasks.workunit.client.0.smithi134.stdout:7/215: link d1/de/ff d1/f4b 0 2024-03-22T07:28:28.774 INFO:tasks.workunit.client.0.smithi134.stdout:7/216: stat d1/de/c44 0 2024-03-22T07:28:28.774 INFO:tasks.workunit.client.0.smithi134.stdout:7/217: chown d1/ld 727535476 1 2024-03-22T07:28:28.775 INFO:tasks.workunit.client.0.smithi134.stdout:7/218: chown d1/d19/d32/c4a 1704 1 2024-03-22T07:28:28.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/279: mkdir d9/d12/d1d/d69 0 2024-03-22T07:28:28.775 INFO:tasks.workunit.client.1.smithi195.stdout:5/280: chown d9/d2d/f65 8285500 1 2024-03-22T07:28:28.780 INFO:tasks.workunit.client.0.smithi134.stdout:1/98: dwrite d5/da/f21 [0,4194304] 0 2024-03-22T07:28:28.781 INFO:tasks.workunit.client.0.smithi134.stdout:5/48: dread d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.781 INFO:tasks.workunit.client.0.smithi134.stdout:5/49: write d1/d4/f6 [1353193,1691] 0 2024-03-22T07:28:28.781 INFO:tasks.workunit.client.0.smithi134.stdout:3/84: dwrite d4/d8/fa [4194304,4194304] 0 2024-03-22T07:28:28.781 INFO:tasks.workunit.client.0.smithi134.stdout:9/35: truncate f0 379638 0 2024-03-22T07:28:28.782 INFO:tasks.workunit.client.1.smithi195.stdout:7/212: fsync d0/d13/d14/d2f/f43 0 2024-03-22T07:28:28.783 INFO:tasks.workunit.client.1.smithi195.stdout:2/236: stat d2/d3/c3e 0 2024-03-22T07:28:28.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/281: rmdir d9/d12/d14/d3f/d41 39 2024-03-22T07:28:28.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/282: stat d9/d3a 0 2024-03-22T07:28:28.787 INFO:tasks.workunit.client.1.smithi195.stdout:7/213: creat d0/d13/f46 x:0 0 0 2024-03-22T07:28:28.790 INFO:tasks.workunit.client.0.smithi134.stdout:7/219: symlink d1/d19/d32/l4c 0 2024-03-22T07:28:28.790 INFO:tasks.workunit.client.0.smithi134.stdout:7/220: chown d1/ld 113565 1 2024-03-22T07:28:28.791 INFO:tasks.workunit.client.0.smithi134.stdout:7/221: truncate d1/d19/f23 5198747 0 2024-03-22T07:28:28.791 INFO:tasks.workunit.client.0.smithi134.stdout:7/222: read - d1/de/d11/f16 zero size 2024-03-22T07:28:28.791 INFO:tasks.workunit.client.1.smithi195.stdout:0/277: dwrite d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:28.791 INFO:tasks.workunit.client.1.smithi195.stdout:0/278: write d1/d10/d1f/f2c [1154042,56722] 0 2024-03-22T07:28:28.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:28 smithi134 ceph-mon[29057]: pgmap v251: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 27 MiB/s wr, 614 op/s 2024-03-22T07:28:28.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/36: dread d3/f4 [0,4194304] 0 2024-03-22T07:28:28.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/37: readlink d3/l5 0 2024-03-22T07:28:28.804 INFO:tasks.workunit.client.0.smithi134.stdout:9/38: creat d3/fb x:0 0 0 2024-03-22T07:28:28.811 INFO:tasks.workunit.client.1.smithi195.stdout:7/214: dwrite d0/d13/d14/f30 [0,4194304] 0 2024-03-22T07:28:28.812 INFO:tasks.workunit.client.0.smithi134.stdout:5/50: dwrite d1/d4/f6 [0,4194304] 0 2024-03-22T07:28:28.829 INFO:tasks.workunit.client.0.smithi134.stdout:5/51: dwrite d1/d4/f6 [4194304,4194304] 0 2024-03-22T07:28:28.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/52: write d1/d4/f6 [2333805,27895] 0 2024-03-22T07:28:28.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/53: creat d1/d4/f10 x:0 0 0 2024-03-22T07:28:28.837 INFO:tasks.workunit.client.0.smithi134.stdout:5/54: dread - d1/d4/f10 zero size 2024-03-22T07:28:28.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/283: mknod d9/d12/d14/d3f/c6a 0 2024-03-22T07:28:28.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/284: chown c2 4 1 2024-03-22T07:28:28.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/237: getdents d2/d3/d7 0 2024-03-22T07:28:28.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/238: chown d2/d3/l11 6460497 1 2024-03-22T07:28:28.853 INFO:tasks.workunit.client.1.smithi195.stdout:2/239: creat d2/d3/d24/f51 x:0 0 0 2024-03-22T07:28:28.857 INFO:tasks.workunit.client.0.smithi134.stdout:5/55: dwrite d1/d4/f6 [4194304,4194304] 0 2024-03-22T07:28:28.858 INFO:tasks.workunit.client.1.smithi195.stdout:9/343: rmdir d2/d4/d6/db/d20/d4a 39 2024-03-22T07:28:28.859 INFO:tasks.workunit.client.1.smithi195.stdout:0/279: truncate d1/d4/dd/f13 1431720 0 2024-03-22T07:28:28.863 INFO:tasks.workunit.client.0.smithi134.stdout:6/66: truncate d2/f8 240127 0 2024-03-22T07:28:28.865 INFO:tasks.workunit.client.1.smithi195.stdout:1/189: sync 2024-03-22T07:28:28.865 INFO:tasks.workunit.client.1.smithi195.stdout:1/190: write d0/d2/d27/f30 [517433,63298] 0 2024-03-22T07:28:28.865 INFO:tasks.workunit.client.1.smithi195.stdout:3/314: sync 2024-03-22T07:28:28.866 INFO:tasks.workunit.client.1.smithi195.stdout:8/305: sync 2024-03-22T07:28:28.866 INFO:tasks.workunit.client.1.smithi195.stdout:6/231: sync 2024-03-22T07:28:28.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/270: sync 2024-03-22T07:28:28.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/271: chown d13/f14 950204 1 2024-03-22T07:28:28.866 INFO:tasks.workunit.client.1.smithi195.stdout:3/315: creat d3/df/d15/d1d/d5c/f72 x:0 0 0 2024-03-22T07:28:28.866 INFO:tasks.workunit.client.1.smithi195.stdout:3/316: chown d3/d18 0 1 2024-03-22T07:28:28.870 INFO:tasks.workunit.client.0.smithi134.stdout:1/99: creat d5/da/d13/d1e/f22 x:0 0 0 2024-03-22T07:28:28.870 INFO:tasks.workunit.client.0.smithi134.stdout:1/100: creat d5/f23 x:0 0 0 2024-03-22T07:28:28.872 INFO:tasks.workunit.client.0.smithi134.stdout:3/85: link d4/cb d4/d10/c1b 0 2024-03-22T07:28:28.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/344: dwrite d2/d4/f3b [0,4194304] 0 2024-03-22T07:28:28.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/345: dread - d2/f27 zero size 2024-03-22T07:28:28.877 INFO:tasks.workunit.client.1.smithi195.stdout:9/346: write d2/d4/d6/db/d20/f5d [193083,9795] 0 2024-03-22T07:28:28.879 INFO:tasks.workunit.client.0.smithi134.stdout:0/96: mkdir dc/d17 0 2024-03-22T07:28:28.879 INFO:tasks.workunit.client.0.smithi134.stdout:5/56: dwrite d1/d4/f10 [0,4194304] 0 2024-03-22T07:28:28.882 INFO:tasks.workunit.client.0.smithi134.stdout:7/223: unlink d1/f4b 0 2024-03-22T07:28:28.886 INFO:tasks.workunit.client.1.smithi195.stdout:5/285: link d9/d12/d1d/d36/f49 d9/d12/d14/d3f/f6b 0 2024-03-22T07:28:28.886 INFO:tasks.workunit.client.1.smithi195.stdout:5/286: write f3 [4429545,28851] 0 2024-03-22T07:28:28.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/191: dwrite d0/d2/d6/f2f [0,4194304] 0 2024-03-22T07:28:28.891 INFO:tasks.workunit.client.0.smithi134.stdout:5/57: write d1/d4/f10 [1951921,128347] 0 2024-03-22T07:28:28.891 INFO:tasks.workunit.client.0.smithi134.stdout:3/86: dwrite d4/fc [0,4194304] 0 2024-03-22T07:28:28.891 INFO:tasks.workunit.client.1.smithi195.stdout:2/240: rename d2/d3/d1a/f2b to d2/d3/d21/d4c/f52 0 2024-03-22T07:28:28.892 INFO:tasks.workunit.client.1.smithi195.stdout:2/241: readlink d2/d3/l11 0 2024-03-22T07:28:28.892 INFO:tasks.workunit.client.1.smithi195.stdout:2/242: truncate d2/d3/d7/d19/f28 4589650 0 2024-03-22T07:28:28.894 INFO:tasks.workunit.client.1.smithi195.stdout:0/280: creat d1/d4/dd/f51 x:0 0 0 2024-03-22T07:28:28.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/215: getdents d0/d13/d22 0 2024-03-22T07:28:28.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/216: chown d0/d13/d14/l2a 196107 1 2024-03-22T07:28:28.895 INFO:tasks.workunit.client.1.smithi195.stdout:7/217: fsync d0/d13/d22/f23 0 2024-03-22T07:28:28.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/218: fsync d0/f11 0 2024-03-22T07:28:28.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/219: truncate d0/d13/d14/d2b/f42 198120 0 2024-03-22T07:28:28.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/220: dread d0/d13/d14/d2b/f42 [0,4194304] 0 2024-03-22T07:28:28.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/232: mkdir d5/dc/d56 0 2024-03-22T07:28:28.898 INFO:tasks.workunit.client.1.smithi195.stdout:6/233: chown d5/f51 279697 1 2024-03-22T07:28:28.900 INFO:tasks.workunit.client.0.smithi134.stdout:9/39: dread f0 [0,4194304] 0 2024-03-22T07:28:28.900 INFO:tasks.workunit.client.1.smithi195.stdout:8/306: creat da/dc/f60 x:0 0 0 2024-03-22T07:28:28.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/317: rmdir d3/df/d15/d1d/d5c/d47 39 2024-03-22T07:28:28.909 INFO:tasks.workunit.client.1.smithi195.stdout:3/318: truncate d3/df/d15/d1d/d5c/f44 1338073 0 2024-03-22T07:28:28.910 INFO:tasks.workunit.client.1.smithi195.stdout:3/319: write d3/df/d15/f6a [677429,13407] 0 2024-03-22T07:28:28.911 INFO:tasks.workunit.client.0.smithi134.stdout:1/101: mknod d5/c24 0 2024-03-22T07:28:28.911 INFO:tasks.workunit.client.0.smithi134.stdout:5/58: dwrite d1/d4/f10 [0,4194304] 0 2024-03-22T07:28:28.914 INFO:tasks.workunit.client.0.smithi134.stdout:1/102: dread f3 [0,4194304] 0 2024-03-22T07:28:28.916 INFO:tasks.workunit.client.1.smithi195.stdout:3/320: dread d3/f29 [0,4194304] 0 2024-03-22T07:28:28.919 INFO:tasks.workunit.client.1.smithi195.stdout:8/307: dwrite da/f56 [0,4194304] 0 2024-03-22T07:28:28.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/59: dread d1/d4/f10 [0,4194304] 0 2024-03-22T07:28:28.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/60: write d1/d4/f6 [8632778,50819] 0 2024-03-22T07:28:28.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/61: creat d1/d4/f11 x:0 0 0 2024-03-22T07:28:28.922 INFO:tasks.workunit.client.0.smithi134.stdout:5/62: chown l0 16260452 1 2024-03-22T07:28:28.929 INFO:tasks.workunit.client.1.smithi195.stdout:9/347: symlink d2/d4/d23/l80 0 2024-03-22T07:28:28.929 INFO:tasks.workunit.client.1.smithi195.stdout:9/348: dread - d2/d4/d6/d18/f29 zero size 2024-03-22T07:28:28.929 INFO:tasks.workunit.client.1.smithi195.stdout:9/349: fsync d2/d4/d32/d6d/f6f 0 2024-03-22T07:28:28.929 INFO:tasks.workunit.client.1.smithi195.stdout:9/350: fsync d2/d4/f3b 0 2024-03-22T07:28:28.929 INFO:tasks.workunit.client.0.smithi134.stdout:1/103: dwrite d5/f9 [0,4194304] 0 2024-03-22T07:28:28.930 INFO:tasks.workunit.client.0.smithi134.stdout:1/104: read f3 [376456,38899] 0 2024-03-22T07:28:28.930 INFO:tasks.workunit.client.0.smithi134.stdout:7/224: creat d1/d19/d32/f4d x:0 0 0 2024-03-22T07:28:28.932 INFO:tasks.workunit.client.1.smithi195.stdout:5/287: creat d9/d22/d50/f6c x:0 0 0 2024-03-22T07:28:28.940 INFO:tasks.workunit.client.1.smithi195.stdout:1/192: mknod d0/d2/d6/d21/d32/c3f 0 2024-03-22T07:28:28.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/40: symlink d3/lc 0 2024-03-22T07:28:28.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/41: chown d3/f8 36 1 2024-03-22T07:28:28.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/281: mknod d1/d4/dd/df/c52 0 2024-03-22T07:28:28.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/282: chown d1/d4/d22/c33 1262 1 2024-03-22T07:28:28.946 INFO:tasks.workunit.client.1.smithi195.stdout:0/283: fsync d1/d10/d1f/f21 0 2024-03-22T07:28:28.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/221: mknod d0/d13/d14/d29/d35/d3a/c47 0 2024-03-22T07:28:28.949 INFO:tasks.workunit.client.1.smithi195.stdout:7/222: chown d0/fc 5202208 1 2024-03-22T07:28:28.950 INFO:tasks.workunit.client.0.smithi134.stdout:5/63: symlink d1/l12 0 2024-03-22T07:28:28.950 INFO:tasks.workunit.client.0.smithi134.stdout:5/64: dread - d1/d4/f11 zero size 2024-03-22T07:28:28.951 INFO:tasks.workunit.client.1.smithi195.stdout:6/234: mknod d5/d16/d45/c57 0 2024-03-22T07:28:28.953 INFO:tasks.workunit.client.0.smithi134.stdout:0/97: truncate f5 1450889 0 2024-03-22T07:28:28.953 INFO:tasks.workunit.client.0.smithi134.stdout:0/98: readlink l8 0 2024-03-22T07:28:28.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/223: dread d0/d13/d14/f8 [4194304,4194304] 0 2024-03-22T07:28:28.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/224: readlink d0/d13/d22/d28/l32 0 2024-03-22T07:28:28.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/225: dread - d0/d13/d14/d2f/f43 zero size 2024-03-22T07:28:28.954 INFO:tasks.workunit.client.1.smithi195.stdout:7/226: fdatasync d0/d13/d14/d29/d35/d3a/f3e 0 2024-03-22T07:28:28.954 INFO:tasks.workunit.client.1.smithi195.stdout:4/272: symlink d13/d2a/l60 0 2024-03-22T07:28:28.954 INFO:tasks.workunit.client.1.smithi195.stdout:4/273: chown d13/f14 67909 1 2024-03-22T07:28:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:28 smithi195 ceph-mon[36144]: pgmap v251: 65 pgs: 65 active+clean; 373 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 27 MiB/s wr, 614 op/s 2024-03-22T07:28:28.957 INFO:tasks.workunit.client.0.smithi134.stdout:7/225: dwrite d1/de/d11/f13 [4194304,4194304] 0 2024-03-22T07:28:28.958 INFO:tasks.workunit.client.0.smithi134.stdout:3/87: dwrite d4/fd [0,4194304] 0 2024-03-22T07:28:28.960 INFO:tasks.workunit.client.0.smithi134.stdout:1/105: dwrite f4 [0,4194304] 0 2024-03-22T07:28:28.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/42: link d3/fb d3/d9/fd 0 2024-03-22T07:28:28.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/43: write f1 [3415749,96922] 0 2024-03-22T07:28:28.964 INFO:tasks.workunit.client.0.smithi134.stdout:5/65: mkdir d1/d13 0 2024-03-22T07:28:28.968 INFO:tasks.workunit.client.0.smithi134.stdout:3/88: unlink d4/f7 0 2024-03-22T07:28:28.968 INFO:tasks.workunit.client.0.smithi134.stdout:7/226: dread d1/de/d11/f13 [4194304,4194304] 0 2024-03-22T07:28:28.969 INFO:tasks.workunit.client.1.smithi195.stdout:6/235: dwrite d5/d16/d45/f39 [0,4194304] 0 2024-03-22T07:28:28.969 INFO:tasks.workunit.client.1.smithi195.stdout:0/284: dwrite d1/d4/f39 [0,4194304] 0 2024-03-22T07:28:28.969 INFO:tasks.workunit.client.1.smithi195.stdout:0/285: truncate d1/d4/dd/f51 907301 0 2024-03-22T07:28:28.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/106: symlink d5/d1d/l25 0 2024-03-22T07:28:28.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/286: dread d1/d4/f7 [0,4194304] 0 2024-03-22T07:28:28.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/287: chown d1/d4/f2e 0 1 2024-03-22T07:28:28.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/288: write d1/d4/d12/f37 [658791,2496] 0 2024-03-22T07:28:28.973 INFO:tasks.workunit.client.1.smithi195.stdout:5/288: symlink d9/d2d/d58/l6d 0 2024-03-22T07:28:28.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/289: dread d9/d12/d1d/f32 [0,4194304] 0 2024-03-22T07:28:28.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/290: chown d9/f29 1747846 1 2024-03-22T07:28:28.979 INFO:tasks.workunit.client.0.smithi134.stdout:9/44: link d3/f8 d3/fe 0 2024-03-22T07:28:28.979 INFO:tasks.workunit.client.0.smithi134.stdout:9/45: truncate f0 1089799 0 2024-03-22T07:28:28.982 INFO:tasks.workunit.client.0.smithi134.stdout:5/66: link d1/l12 d1/dd/l14 0 2024-03-22T07:28:28.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/308: rename da/de/d38 to da/d17/d32/d61 0 2024-03-22T07:28:28.984 INFO:tasks.workunit.client.0.smithi134.stdout:3/89: mkdir d4/d1c 0 2024-03-22T07:28:28.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/236: link d5/d16/d45/d53/d17/d1a/d25/d34/d55/l15 d5/d16/d45/d53/d17/d1a/d25/d34/d55/d3b/l58 0 2024-03-22T07:28:28.986 INFO:tasks.workunit.client.0.smithi134.stdout:7/227: symlink d1/l4e 0 2024-03-22T07:28:28.988 INFO:tasks.workunit.client.1.smithi195.stdout:6/237: write d5/d16/d45/d53/d17/f2a [463314,93088] 0 2024-03-22T07:28:28.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/46: mkdir d3/d9/df 0 2024-03-22T07:28:28.991 INFO:tasks.workunit.client.1.smithi195.stdout:0/289: rmdir d1/d4/dd/df 39 2024-03-22T07:28:28.991 INFO:tasks.workunit.client.0.smithi134.stdout:1/107: dwrite f4 [0,4194304] 0 2024-03-22T07:28:28.991 INFO:tasks.workunit.client.0.smithi134.stdout:1/108: stat d5/da/d13/c16 0 2024-03-22T07:28:28.993 INFO:tasks.workunit.client.1.smithi195.stdout:5/291: symlink d9/d2d/l6e 0 2024-03-22T07:28:28.995 INFO:tasks.workunit.client.1.smithi195.stdout:1/193: mkdir d0/d2/d6/d21/d39/d40 0 2024-03-22T07:28:28.996 INFO:tasks.workunit.client.0.smithi134.stdout:3/90: symlink d4/d10/l1d 0 2024-03-22T07:28:28.998 INFO:tasks.workunit.client.0.smithi134.stdout:7/228: mknod d1/d3/d46/c4f 0 2024-03-22T07:28:29.000 INFO:tasks.workunit.client.1.smithi195.stdout:6/238: mkdir d5/d16/d45/d53/d59 0 2024-03-22T07:28:29.000 INFO:tasks.workunit.client.1.smithi195.stdout:6/239: write d5/d16/d45/d53/d17/d1a/d25/f31 [2125742,124853] 0 2024-03-22T07:28:29.000 INFO:tasks.workunit.client.1.smithi195.stdout:6/240: chown d5/d16/d45/d53/d17/d1a/l24 986 1 2024-03-22T07:28:29.000 INFO:tasks.workunit.client.1.smithi195.stdout:6/241: fdatasync d5/f1e 0 2024-03-22T07:28:29.000 INFO:tasks.workunit.client.1.smithi195.stdout:6/242: dread - d5/d16/d45/d53/d17/d1a/d25/d34/d55/d4b/f4f zero size 2024-03-22T07:28:29.002 INFO:tasks.workunit.client.0.smithi134.stdout:9/47: rename d3/d9/fd to d3/d9/f10 0 2024-03-22T07:28:29.002 INFO:tasks.workunit.client.0.smithi134.stdout:9/48: truncate d3/fe 599773 0 2024-03-22T07:28:29.003 INFO:tasks.workunit.client.1.smithi195.stdout:8/309: dwrite f9 [0,4194304] 0 2024-03-22T07:28:29.005 INFO:tasks.workunit.client.0.smithi134.stdout:1/109: creat d5/da/f26 x:0 0 0 2024-03-22T07:28:29.009 INFO:tasks.workunit.client.1.smithi195.stdout:7/227: rename d0/l1d to d0/d13/d14/l48 0 2024-03-22T07:28:29.009 INFO:tasks.workunit.client.1.smithi195.stdout:7/228: chown d0/d13/d14/d29/f33 11 1 2024-03-22T07:28:29.013 INFO:tasks.workunit.client.1.smithi195.stdout:6/243: unlink d5/d16/d45/d53/d17/d1a/l22 0 2024-03-22T07:28:29.015 INFO:tasks.workunit.client.0.smithi134.stdout:7/229: mknod d1/de/d41/c50 0 2024-03-22T07:28:29.016 INFO:tasks.workunit.client.1.smithi195.stdout:8/310: mkdir da/de/d62 0 2024-03-22T07:28:29.017 INFO:tasks.workunit.client.0.smithi134.stdout:9/49: symlink d3/d9/df/l11 0 2024-03-22T07:28:29.018 INFO:tasks.workunit.client.1.smithi195.stdout:4/274: rename d13/d2a/d3b/l3c to d13/l61 0 2024-03-22T07:28:29.019 INFO:tasks.workunit.client.0.smithi134.stdout:6/67: write d2/f8 [398521,39912] 0 2024-03-22T07:28:29.019 INFO:tasks.workunit.client.0.smithi134.stdout:6/68: write d2/f8 [1056363,69329] 0 2024-03-22T07:28:29.020 INFO:tasks.workunit.client.0.smithi134.stdout:7/230: creat d1/d40/f51 x:0 0 0 2024-03-22T07:28:29.020 INFO:tasks.workunit.client.0.smithi134.stdout:7/231: write d1/d19/d32/f36 [142873,63435] 0 2024-03-22T07:28:29.020 INFO:tasks.workunit.client.0.smithi134.stdout:7/232: read d1/d19/d32/f36 [200481,111188] 0 2024-03-22T07:28:29.021 INFO:tasks.workunit.client.1.smithi195.stdout:7/229: mknod d0/d13/d14/d20/d40/c49 0 2024-03-22T07:28:29.023 INFO:tasks.workunit.client.0.smithi134.stdout:9/50: mkdir d3/d9/df/d12 0 2024-03-22T07:28:29.024 INFO:tasks.workunit.client.1.smithi195.stdout:6/244: mkdir d5/d16/d5a 0 2024-03-22T07:28:29.025 INFO:tasks.workunit.client.1.smithi195.stdout:6/245: truncate d5/d16/d45/d53/d17/d1a/f54 13863 0 2024-03-22T07:28:29.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/311: dread da/f56 [0,4194304] 0 2024-03-22T07:28:29.026 INFO:tasks.workunit.client.0.smithi134.stdout:6/69: mknod d2/c12 0 2024-03-22T07:28:29.027 INFO:tasks.workunit.client.0.smithi134.stdout:3/91: dwrite d4/d8/f12 [0,4194304] 0 2024-03-22T07:28:29.028 INFO:tasks.workunit.client.1.smithi195.stdout:5/292: dwrite d9/fb [0,4194304] 0 2024-03-22T07:28:29.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/194: dwrite d0/d2/f14 [0,4194304] 0 2024-03-22T07:28:29.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/195: chown d0/d2/f2e 328020994 1 2024-03-22T07:28:29.028 INFO:tasks.workunit.client.1.smithi195.stdout:5/293: write d9/f29 [4955308,74560] 0 2024-03-22T07:28:29.032 INFO:tasks.workunit.client.1.smithi195.stdout:6/246: mkdir d5/d16/d5b 0 2024-03-22T07:28:29.032 INFO:tasks.workunit.client.1.smithi195.stdout:6/247: chown d5/d16/d45/d53/d17/d1a/d25/f33 24 1 2024-03-22T07:28:29.032 INFO:tasks.workunit.client.0.smithi134.stdout:9/51: symlink d3/d9/df/d12/l13 0 2024-03-22T07:28:29.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/110: dwrite d5/f23 [0,4194304] 0 2024-03-22T07:28:29.034 INFO:tasks.workunit.client.1.smithi195.stdout:8/312: symlink da/d17/d32/d61/d47/d53/l63 0 2024-03-22T07:28:29.037 INFO:tasks.workunit.client.0.smithi134.stdout:6/70: rename d2/ca to d2/c13 0 2024-03-22T07:28:29.037 INFO:tasks.workunit.client.0.smithi134.stdout:6/71: readlink d2/l9 0 2024-03-22T07:28:29.038 INFO:tasks.workunit.client.1.smithi195.stdout:5/294: creat d9/f6f x:0 0 0 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/52: dread d3/fe [0,4194304] 0 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/53: chown d3/fb 2790534 1 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/54: write f1 [3532725,104521] 0 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/55: write f1 [389355,23428] 0 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/56: creat d3/f14 x:0 0 0 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.1.smithi195.stdout:1/196: dread d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:29.043 INFO:tasks.workunit.client.1.smithi195.stdout:8/313: symlink da/d17/l64 0 2024-03-22T07:28:29.044 INFO:tasks.workunit.client.1.smithi195.stdout:2/243: getdents d2/d3/d1a 0 2024-03-22T07:28:29.048 INFO:tasks.workunit.client.0.smithi134.stdout:1/111: mkdir d5/da/d1b/d27 0 2024-03-22T07:28:29.048 INFO:tasks.workunit.client.1.smithi195.stdout:7/230: dwrite d0/d13/f46 [0,4194304] 0 2024-03-22T07:28:29.051 INFO:tasks.workunit.client.0.smithi134.stdout:6/72: symlink d2/l14 0 2024-03-22T07:28:29.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/248: dwrite d5/d16/d45/d53/d17/f21 [0,4194304] 0 2024-03-22T07:28:29.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/249: truncate d5/d16/d45/d53/d17/f4e 180480 0 2024-03-22T07:28:29.056 INFO:tasks.workunit.client.1.smithi195.stdout:6/250: readlink d5/d16/d45/l52 0 2024-03-22T07:28:29.057 INFO:tasks.workunit.client.0.smithi134.stdout:9/57: mknod d3/c15 0 2024-03-22T07:28:29.057 INFO:tasks.workunit.client.0.smithi134.stdout:3/92: dwrite d4/fd [0,4194304] 0 2024-03-22T07:28:29.057 INFO:tasks.workunit.client.0.smithi134.stdout:3/93: creat d4/f1e x:0 0 0 2024-03-22T07:28:29.057 INFO:tasks.workunit.client.1.smithi195.stdout:7/231: read d0/ff [428409,23117] 0 2024-03-22T07:28:29.064 INFO:tasks.workunit.client.0.smithi134.stdout:3/94: dread d4/d10/f11 [0,4194304] 0 2024-03-22T07:28:29.079 INFO:tasks.workunit.client.1.smithi195.stdout:8/314: dwrite da/de/f5b [0,4194304] 0 2024-03-22T07:28:29.080 INFO:tasks.workunit.client.1.smithi195.stdout:8/315: fsync da/d17/d32/d61/d47/d53/f5e 0 2024-03-22T07:28:29.081 INFO:tasks.workunit.client.0.smithi134.stdout:9/58: creat d3/d9/df/d12/f16 x:0 0 0 2024-03-22T07:28:29.081 INFO:tasks.workunit.client.0.smithi134.stdout:9/59: chown d3/d9/df/l11 20282774 1 2024-03-22T07:28:29.082 INFO:tasks.workunit.client.0.smithi134.stdout:9/60: dread d3/fe [0,4194304] 0 2024-03-22T07:28:29.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/232: dread d0/d13/d14/f30 [0,4194304] 0 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/316: dread da/f56 [0,4194304] 0 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/317: dread - da/dc/f60 zero size 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/318: write da/f4f [750463,14027] 0 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/319: chown da/dc/f60 34 1 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/320: write da/d17/d32/f58 [779706,6024] 0 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/321: chown da/d17/d32/f58 13 1 2024-03-22T07:28:29.085 INFO:tasks.workunit.client.1.smithi195.stdout:8/322: truncate da/dc/f60 994042 0 2024-03-22T07:28:29.086 INFO:tasks.workunit.client.1.smithi195.stdout:8/323: chown da/de 698613723 1 2024-03-22T07:28:29.086 INFO:tasks.workunit.client.1.smithi195.stdout:8/324: truncate da/d17/d32/f58 1831741 0 2024-03-22T07:28:29.086 INFO:tasks.workunit.client.1.smithi195.stdout:8/325: chown da/d17/c3f 0 1 2024-03-22T07:28:29.086 INFO:tasks.workunit.client.0.smithi134.stdout:1/112: dwrite d5/da/f26 [0,4194304] 0 2024-03-22T07:28:29.088 INFO:tasks.workunit.client.0.smithi134.stdout:3/95: mknod d4/d10/c1f 0 2024-03-22T07:28:29.088 INFO:tasks.workunit.client.0.smithi134.stdout:3/96: fdatasync d4/d8/fa 0 2024-03-22T07:28:29.093 INFO:tasks.workunit.client.0.smithi134.stdout:9/61: symlink d3/d9/df/d12/l17 0 2024-03-22T07:28:29.096 INFO:tasks.workunit.client.1.smithi195.stdout:2/244: symlink d2/d3/l53 0 2024-03-22T07:28:29.097 INFO:tasks.workunit.client.0.smithi134.stdout:1/113: mknod d5/da/d13/c28 0 2024-03-22T07:28:29.098 INFO:tasks.workunit.client.1.smithi195.stdout:5/295: rmdir d9/d3a 39 2024-03-22T07:28:29.100 INFO:tasks.workunit.client.0.smithi134.stdout:9/62: creat d3/d9/f18 x:0 0 0 2024-03-22T07:28:29.102 INFO:tasks.workunit.client.0.smithi134.stdout:1/114: mknod d5/da/d1b/d27/c29 0 2024-03-22T07:28:29.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/63: mknod d3/d9/df/d12/c19 0 2024-03-22T07:28:29.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/64: readlink d3/d9/df/l11 0 2024-03-22T07:28:29.104 INFO:tasks.workunit.client.0.smithi134.stdout:9/65: chown d3 26 1 2024-03-22T07:28:29.104 INFO:tasks.workunit.client.0.smithi134.stdout:9/66: truncate d3/f14 199863 0 2024-03-22T07:28:29.104 INFO:tasks.workunit.client.1.smithi195.stdout:1/197: mkdir d0/d2/d6/d21/d41 0 2024-03-22T07:28:29.105 INFO:tasks.workunit.client.0.smithi134.stdout:1/115: creat d5/da/f2a x:0 0 0 2024-03-22T07:28:29.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/99: write f5 [1240324,21157] 0 2024-03-22T07:28:29.110 INFO:tasks.workunit.client.1.smithi195.stdout:6/251: creat d5/d16/d45/d53/d17/d4a/f5c x:0 0 0 2024-03-22T07:28:29.113 INFO:tasks.workunit.client.0.smithi134.stdout:1/116: getdents d5/da/d13/d1e 0 2024-03-22T07:28:29.115 INFO:tasks.workunit.client.0.smithi134.stdout:0/100: mkdir dc/d18 0 2024-03-22T07:28:29.119 INFO:tasks.workunit.client.0.smithi134.stdout:0/101: unlink dc/c10 0 2024-03-22T07:28:29.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/233: creat d0/d13/d14/f4a x:0 0 0 2024-03-22T07:28:29.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/234: chown d0/d13/d14/l48 0 1 2024-03-22T07:28:29.125 INFO:tasks.workunit.client.0.smithi134.stdout:9/67: dwrite d3/d9/f10 [0,4194304] 0 2024-03-22T07:28:29.126 INFO:tasks.workunit.client.1.smithi195.stdout:2/245: mknod d2/d17/c54 0 2024-03-22T07:28:29.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/117: write d5/da/f12 [2735265,94174] 0 2024-03-22T07:28:29.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/246: symlink d2/d3/d7/l55 0 2024-03-22T07:28:29.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/247: dread - d2/d3/f31 zero size 2024-03-22T07:28:29.137 INFO:tasks.workunit.client.1.smithi195.stdout:1/198: getdents d0 0 2024-03-22T07:28:29.137 INFO:tasks.workunit.client.1.smithi195.stdout:1/199: chown d0/c38 18 1 2024-03-22T07:28:29.137 INFO:tasks.workunit.client.1.smithi195.stdout:2/248: dread d2/d3/d7/d19/f33 [0,4194304] 0 2024-03-22T07:28:29.138 INFO:tasks.workunit.client.1.smithi195.stdout:6/252: rmdir d5/dc/d3c 39 2024-03-22T07:28:29.140 INFO:tasks.workunit.client.1.smithi195.stdout:2/249: truncate d2/d3/d7/f27 380140 0 2024-03-22T07:28:29.140 INFO:tasks.workunit.client.1.smithi195.stdout:2/250: stat d2/d17/l16 0 2024-03-22T07:28:29.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/253: mknod d5/d16/d5b/c5d 0 2024-03-22T07:28:29.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/254: chown d5/la 5416 1 2024-03-22T07:28:29.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/255: write d5/d16/d45/d53/d17/f2a [1572242,31282] 0 2024-03-22T07:28:29.142 INFO:tasks.workunit.client.1.smithi195.stdout:1/200: dread d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:29.142 INFO:tasks.workunit.client.0.smithi134.stdout:1/118: dread f1 [0,4194304] 0 2024-03-22T07:28:29.142 INFO:tasks.workunit.client.0.smithi134.stdout:1/119: stat d5/fe 0 2024-03-22T07:28:29.143 INFO:tasks.workunit.client.1.smithi195.stdout:2/251: creat d2/d3/d7/da/d4e/f56 x:0 0 0 2024-03-22T07:28:29.143 INFO:tasks.workunit.client.1.smithi195.stdout:2/252: stat d2/d3/f31 0 2024-03-22T07:28:29.143 INFO:tasks.workunit.client.1.smithi195.stdout:2/253: getdents d2/d3/d1a 0 2024-03-22T07:28:29.143 INFO:tasks.workunit.client.1.smithi195.stdout:2/254: readlink d2/d17/l16 0 2024-03-22T07:28:29.145 INFO:tasks.workunit.client.0.smithi134.stdout:0/102: dwrite f5 [0,4194304] 0 2024-03-22T07:28:29.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/235: dwrite d0/f25 [0,4194304] 0 2024-03-22T07:28:29.146 INFO:tasks.workunit.client.1.smithi195.stdout:6/256: rename d5/d16/d45/d53/d17/d1a/d25 to d5/d5e 0 2024-03-22T07:28:29.147 INFO:tasks.workunit.client.0.smithi134.stdout:1/120: mknod d5/da/d13/d1e/c2b 0 2024-03-22T07:28:29.150 INFO:tasks.workunit.client.1.smithi195.stdout:6/257: mkdir d5/d5e/d34/d55/d4b/d5f 0 2024-03-22T07:28:29.150 INFO:tasks.workunit.client.1.smithi195.stdout:6/258: write d5/d16/d45/d53/d17/d1a/f54 [602380,27573] 0 2024-03-22T07:28:29.152 INFO:tasks.workunit.client.1.smithi195.stdout:6/259: creat d5/d5e/d34/d55/d4b/d5f/f60 x:0 0 0 2024-03-22T07:28:29.152 INFO:tasks.workunit.client.1.smithi195.stdout:6/260: fdatasync d5/d16/d45/d53/d17/d4a/f5c 0 2024-03-22T07:28:29.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/261: symlink d5/d5e/l61 0 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:7/233: rename d1/d3 to d1/de/d11/d48/d52 0 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:7/234: stat d1/f3a 0 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:7/235: chown d1/de/d11/l24 15801402 1 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:7/236: dread - d1/d40/f51 zero size 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/103: read f5 [479255,121826] 0 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/104: chown dc/d17 1 1 2024-03-22T07:28:29.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/105: write dc/de/f15 [727441,1050] 0 2024-03-22T07:28:29.157 INFO:tasks.workunit.client.0.smithi134.stdout:0/106: write f0 [3530106,115450] 0 2024-03-22T07:28:29.158 INFO:tasks.workunit.client.0.smithi134.stdout:9/68: link d3/d9/f10 d3/f1a 0 2024-03-22T07:28:29.158 INFO:tasks.workunit.client.0.smithi134.stdout:9/69: write d3/d9/df/d12/f16 [982771,21577] 0 2024-03-22T07:28:29.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/121: write d5/f23 [3953933,89774] 0 2024-03-22T07:28:29.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/122: rename d5/da/d1b to d5/da/d1b/d27/d2c 22 2024-03-22T07:28:29.160 INFO:tasks.workunit.client.1.smithi195.stdout:7/236: dwrite d0/f11 [0,4194304] 0 2024-03-22T07:28:29.160 INFO:tasks.workunit.client.0.smithi134.stdout:7/237: creat d1/d19/f53 x:0 0 0 2024-03-22T07:28:29.160 INFO:tasks.workunit.client.0.smithi134.stdout:0/107: mknod dc/d17/c19 0 2024-03-22T07:28:29.162 INFO:tasks.workunit.client.1.smithi195.stdout:7/237: creat d0/d13/d14/d20/f4b x:0 0 0 2024-03-22T07:28:29.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/238: dread d0/d13/d14/d2b/f42 [0,4194304] 0 2024-03-22T07:28:29.164 INFO:tasks.workunit.client.1.smithi195.stdout:1/201: dwrite d0/d2/d6/d21/d32/f3e [0,4194304] 0 2024-03-22T07:28:29.164 INFO:tasks.workunit.client.0.smithi134.stdout:5/67: truncate d1/d4/f6 5346873 0 2024-03-22T07:28:29.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/70: dread d3/d9/f10 [0,4194304] 0 2024-03-22T07:28:29.172 INFO:tasks.workunit.client.0.smithi134.stdout:1/123: write d5/da/f21 [3008126,3230] 0 2024-03-22T07:28:29.172 INFO:tasks.workunit.client.0.smithi134.stdout:1/124: write d5/da/f21 [3857428,90027] 0 2024-03-22T07:28:29.172 INFO:tasks.workunit.client.0.smithi134.stdout:9/71: mkdir d3/d9/df/d12/d1b 0 2024-03-22T07:28:29.173 INFO:tasks.workunit.client.1.smithi195.stdout:7/239: dread d0/d13/f1c [0,4194304] 0 2024-03-22T07:28:29.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/262: dwrite d5/d5e/f31 [0,4194304] 0 2024-03-22T07:28:29.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/263: fsync d5/d16/d45/d53/d17/f2a 0 2024-03-22T07:28:29.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/264: write d5/d5e/d34/d55/f3e [954715,104903] 0 2024-03-22T07:28:29.173 INFO:tasks.workunit.client.1.smithi195.stdout:6/265: write d5/d16/d45/d53/f4c [460108,103421] 0 2024-03-22T07:28:29.175 INFO:tasks.workunit.client.0.smithi134.stdout:7/238: dread d1/de/d11/d48/f29 [4194304,4194304] 0 2024-03-22T07:28:29.175 INFO:tasks.workunit.client.0.smithi134.stdout:7/239: write d1/f33 [429702,17711] 0 2024-03-22T07:28:29.175 INFO:tasks.workunit.client.1.smithi195.stdout:1/202: read d0/d2/f1f [2485263,74074] 0 2024-03-22T07:28:29.175 INFO:tasks.workunit.client.0.smithi134.stdout:1/125: unlink d5/l10 0 2024-03-22T07:28:29.177 INFO:tasks.workunit.client.0.smithi134.stdout:9/72: symlink d3/l1c 0 2024-03-22T07:28:29.180 INFO:tasks.workunit.client.0.smithi134.stdout:0/108: dread dc/de/f15 [0,4194304] 0 2024-03-22T07:28:29.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/240: creat d1/de/d11/d2b/d31/f54 x:0 0 0 2024-03-22T07:28:29.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/241: creat d1/de/d11/f55 x:0 0 0 2024-03-22T07:28:29.184 INFO:tasks.workunit.client.0.smithi134.stdout:1/126: mkdir d5/d1d/d2d 0 2024-03-22T07:28:29.186 INFO:tasks.workunit.client.0.smithi134.stdout:1/127: fsync d5/f23 0 2024-03-22T07:28:29.186 INFO:tasks.workunit.client.1.smithi195.stdout:7/240: symlink d0/d13/d22/d28/l4c 0 2024-03-22T07:28:29.186 INFO:tasks.workunit.client.1.smithi195.stdout:7/241: write d0/d13/d14/d29/d35/f37 [5202760,12454] 0 2024-03-22T07:28:29.189 INFO:tasks.workunit.client.0.smithi134.stdout:9/73: truncate d3/f4 3244157 0 2024-03-22T07:28:29.190 INFO:tasks.workunit.client.0.smithi134.stdout:9/74: write f0 [782735,57550] 0 2024-03-22T07:28:29.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/109: dread f9 [0,4194304] 0 2024-03-22T07:28:29.190 INFO:tasks.workunit.client.0.smithi134.stdout:9/75: creat d3/d9/df/d12/f1d x:0 0 0 2024-03-22T07:28:29.191 INFO:tasks.workunit.client.1.smithi195.stdout:6/266: creat d5/d16/d45/d53/f62 x:0 0 0 2024-03-22T07:28:29.191 INFO:tasks.workunit.client.1.smithi195.stdout:6/267: chown d5/d5e/d34/d55/c47 7 1 2024-03-22T07:28:29.191 INFO:tasks.workunit.client.1.smithi195.stdout:6/268: fdatasync d5/f1e 0 2024-03-22T07:28:29.191 INFO:tasks.workunit.client.1.smithi195.stdout:6/269: write d5/d16/d45/d53/f62 [257914,81903] 0 2024-03-22T07:28:29.195 INFO:tasks.workunit.client.0.smithi134.stdout:7/242: symlink d1/de/d11/d48/l56 0 2024-03-22T07:28:29.197 INFO:tasks.workunit.client.1.smithi195.stdout:6/270: getdents d5/d5e/d34/d55 0 2024-03-22T07:28:29.198 INFO:tasks.workunit.client.0.smithi134.stdout:1/128: symlink d5/da/d13/d1e/l2e 0 2024-03-22T07:28:29.200 INFO:tasks.workunit.client.1.smithi195.stdout:7/242: write d0/d13/d14/f30 [3071778,26976] 0 2024-03-22T07:28:29.205 INFO:tasks.workunit.client.0.smithi134.stdout:1/129: link d5/l8 d5/d1d/d2d/l2f 0 2024-03-22T07:28:29.206 INFO:tasks.workunit.client.1.smithi195.stdout:7/243: mknod d0/d13/d14/d2b/c4d 0 2024-03-22T07:28:29.207 INFO:tasks.workunit.client.1.smithi195.stdout:7/244: creat d0/d13/d14/d20/d40/f4e x:0 0 0 2024-03-22T07:28:29.208 INFO:tasks.workunit.client.0.smithi134.stdout:5/68: dwrite d1/d4/f10 [4194304,4194304] 0 2024-03-22T07:28:29.209 INFO:tasks.workunit.client.0.smithi134.stdout:2/73: sync 2024-03-22T07:28:29.212 INFO:tasks.workunit.client.0.smithi134.stdout:8/176: sync 2024-03-22T07:28:29.213 INFO:tasks.workunit.client.0.smithi134.stdout:4/133: sync 2024-03-22T07:28:29.213 INFO:tasks.workunit.client.0.smithi134.stdout:4/134: dread - d2/d25/f2d zero size 2024-03-22T07:28:29.213 INFO:tasks.workunit.client.1.smithi195.stdout:7/245: rename d0/d13/d14/d2b/c4d to d0/d13/d22/c4f 0 2024-03-22T07:28:29.213 INFO:tasks.workunit.client.1.smithi195.stdout:6/271: read d5/dc/d3c/f44 [1414511,81817] 0 2024-03-22T07:28:29.213 INFO:tasks.workunit.client.0.smithi134.stdout:0/110: fsync f0 0 2024-03-22T07:28:29.214 INFO:tasks.workunit.client.0.smithi134.stdout:0/111: stat l8 0 2024-03-22T07:28:29.215 INFO:tasks.workunit.client.0.smithi134.stdout:0/112: read dc/de/f15 [621140,43044] 0 2024-03-22T07:28:29.215 INFO:tasks.workunit.client.0.smithi134.stdout:9/76: dwrite d3/fe [0,4194304] 0 2024-03-22T07:28:29.216 INFO:tasks.workunit.client.1.smithi195.stdout:1/203: dwrite d0/d2/d9/f24 [0,4194304] 0 2024-03-22T07:28:29.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/246: symlink d0/d13/d14/d2f/l50 0 2024-03-22T07:28:29.219 INFO:tasks.workunit.client.0.smithi134.stdout:2/74: link d2/d5/l13 d2/d5/d8/l15 0 2024-03-22T07:28:29.221 INFO:tasks.workunit.client.1.smithi195.stdout:6/272: dread d5/f1e [0,4194304] 0 2024-03-22T07:28:29.222 INFO:tasks.workunit.client.0.smithi134.stdout:4/135: dread d2/d1d/f1f [0,4194304] 0 2024-03-22T07:28:29.222 INFO:tasks.workunit.client.0.smithi134.stdout:4/136: truncate d2/d15/f1b 16087 0 2024-03-22T07:28:29.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/130: dwrite f4 [0,4194304] 0 2024-03-22T07:28:29.224 INFO:tasks.workunit.client.0.smithi134.stdout:1/131: write d5/da/f2a [43050,29947] 0 2024-03-22T07:28:29.225 INFO:tasks.workunit.client.0.smithi134.stdout:0/113: creat dc/d18/f1a x:0 0 0 2024-03-22T07:28:29.225 INFO:tasks.workunit.client.0.smithi134.stdout:0/114: chown f7 13150768 1 2024-03-22T07:28:29.225 INFO:tasks.workunit.client.0.smithi134.stdout:0/115: creat dc/d18/f1b x:0 0 0 2024-03-22T07:28:29.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/204: rename d0/d2/d9/f24 to d0/d2/d6/f42 0 2024-03-22T07:28:29.236 INFO:tasks.workunit.client.0.smithi134.stdout:9/77: symlink d3/d9/df/d12/d1b/l1e 0 2024-03-22T07:28:29.236 INFO:tasks.workunit.client.0.smithi134.stdout:9/78: creat d3/d9/df/d12/f1f x:0 0 0 2024-03-22T07:28:29.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/247: mknod d0/d13/d14/d20/d40/c51 0 2024-03-22T07:28:29.239 INFO:tasks.workunit.client.0.smithi134.stdout:4/137: getdents d2/d15 0 2024-03-22T07:28:29.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/273: mknod d5/d16/d45/d53/d17/d4a/c63 0 2024-03-22T07:28:29.242 INFO:tasks.workunit.client.1.smithi195.stdout:1/205: unlink d0/d2/d6/c3b 0 2024-03-22T07:28:29.244 INFO:tasks.workunit.client.1.smithi195.stdout:7/248: mkdir d0/d13/d22/d52 0 2024-03-22T07:28:29.244 INFO:tasks.workunit.client.1.smithi195.stdout:7/249: dread - d0/d13/d14/d20/d40/f4e zero size 2024-03-22T07:28:29.246 INFO:tasks.workunit.client.1.smithi195.stdout:6/274: symlink d5/d16/l64 0 2024-03-22T07:28:29.247 INFO:tasks.workunit.client.1.smithi195.stdout:7/250: write d0/d13/f1c [1291518,81852] 0 2024-03-22T07:28:29.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/275: creat d5/d5e/d34/d55/d4b/f65 x:0 0 0 2024-03-22T07:28:29.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/276: dread - d5/d5e/d34/d55/d4b/f4f zero size 2024-03-22T07:28:29.248 INFO:tasks.workunit.client.1.smithi195.stdout:6/277: fdatasync d5/d16/d45/f39 0 2024-03-22T07:28:29.249 INFO:tasks.workunit.client.0.smithi134.stdout:2/75: dwrite d2/f14 [4194304,4194304] 0 2024-03-22T07:28:29.250 INFO:tasks.workunit.client.0.smithi134.stdout:2/76: chown d2/c11 2197615 1 2024-03-22T07:28:29.250 INFO:tasks.workunit.client.0.smithi134.stdout:1/132: dwrite d5/fc [0,4194304] 0 2024-03-22T07:28:29.250 INFO:tasks.workunit.client.0.smithi134.stdout:1/133: creat d5/da/d1b/f30 x:0 0 0 2024-03-22T07:28:29.250 INFO:tasks.workunit.client.0.smithi134.stdout:1/134: read d5/da/d1b/f1c [208183,109166] 0 2024-03-22T07:28:29.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/278: symlink d5/d5e/d34/d55/l66 0 2024-03-22T07:28:29.253 INFO:tasks.workunit.client.0.smithi134.stdout:4/138: mknod d2/d1d/c2f 0 2024-03-22T07:28:29.253 INFO:tasks.workunit.client.0.smithi134.stdout:0/116: mknod dc/c1c 0 2024-03-22T07:28:29.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/206: write d0/d2/d27/f33 [2779027,13134] 0 2024-03-22T07:28:29.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/279: link c1 d5/dc/d56/c67 0 2024-03-22T07:28:29.255 INFO:tasks.workunit.client.1.smithi195.stdout:6/280: write d5/d16/d45/d53/f62 [675641,7209] 0 2024-03-22T07:28:29.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/207: write d0/f26 [850913,30281] 0 2024-03-22T07:28:29.257 INFO:tasks.workunit.client.0.smithi134.stdout:2/77: symlink d2/l16 0 2024-03-22T07:28:29.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/275: sync 2024-03-22T07:28:29.258 INFO:tasks.workunit.client.1.smithi195.stdout:9/351: sync 2024-03-22T07:28:29.258 INFO:tasks.workunit.client.1.smithi195.stdout:3/321: sync 2024-03-22T07:28:29.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/276: read - d13/d15/d16/f57 zero size 2024-03-22T07:28:29.258 INFO:tasks.workunit.client.1.smithi195.stdout:0/290: sync 2024-03-22T07:28:29.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/255: truncate d2/d3/d7/f27 1310143 0 2024-03-22T07:28:29.262 INFO:tasks.workunit.client.1.smithi195.stdout:7/251: dwrite d0/d13/d14/d20/d40/f4e [0,4194304] 0 2024-03-22T07:28:29.262 INFO:tasks.workunit.client.1.smithi195.stdout:6/281: unlink d5/l11 0 2024-03-22T07:28:29.263 INFO:tasks.workunit.client.1.smithi195.stdout:6/282: write d5/d5e/d34/d55/f3e [573185,58533] 0 2024-03-22T07:28:29.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/135: link d5/da/d13/c28 d5/da/d13/c31 0 2024-03-22T07:28:29.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/136: write d5/fe [2355190,110543] 0 2024-03-22T07:28:29.264 INFO:tasks.workunit.client.1.smithi195.stdout:1/208: creat d0/d2/d6/d21/d39/d40/f43 x:0 0 0 2024-03-22T07:28:29.267 INFO:tasks.workunit.client.0.smithi134.stdout:8/177: rename d1/d11 to d1/d15/d42 0 2024-03-22T07:28:29.268 INFO:tasks.workunit.client.1.smithi195.stdout:3/322: mknod d3/df/d15/d1d/c73 0 2024-03-22T07:28:29.269 INFO:tasks.workunit.client.1.smithi195.stdout:3/323: stat d3/df/d15/d1d/d5c/d47/f59 0 2024-03-22T07:28:29.269 INFO:tasks.workunit.client.1.smithi195.stdout:3/324: write d3/df/d15/d1d/d5c/f2e [1093679,65983] 0 2024-03-22T07:28:29.270 INFO:tasks.workunit.client.0.smithi134.stdout:4/139: creat d2/d15/f30 x:0 0 0 2024-03-22T07:28:29.270 INFO:tasks.workunit.client.1.smithi195.stdout:1/209: dread d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:29.271 INFO:tasks.workunit.client.1.smithi195.stdout:4/277: mknod d13/c62 0 2024-03-22T07:28:29.271 INFO:tasks.workunit.client.1.smithi195.stdout:4/278: chown d13/d15/f1c 5110 1 2024-03-22T07:28:29.272 INFO:tasks.workunit.client.0.smithi134.stdout:0/117: rmdir dc/d17 39 2024-03-22T07:28:29.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/352: dwrite d2/d4/f55 [0,4194304] 0 2024-03-22T07:28:29.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/353: fsync f1 0 2024-03-22T07:28:29.273 INFO:tasks.workunit.client.1.smithi195.stdout:9/354: write d2/d4/d6/db/f6c [180827,12417] 0 2024-03-22T07:28:29.275 INFO:tasks.workunit.client.1.smithi195.stdout:0/291: link d1/d4/d22/f29 d1/d10/d1f/d40/d43/f53 0 2024-03-22T07:28:29.275 INFO:tasks.workunit.client.0.smithi134.stdout:2/78: symlink d2/d5/d8/l17 0 2024-03-22T07:28:29.276 INFO:tasks.workunit.client.0.smithi134.stdout:2/79: chown d2/d5/l13 8 1 2024-03-22T07:28:29.276 INFO:tasks.workunit.client.0.smithi134.stdout:2/80: chown d2/d5/d8/l17 1345 1 2024-03-22T07:28:29.277 INFO:tasks.workunit.client.0.smithi134.stdout:0/118: write f4 [1060811,23713] 0 2024-03-22T07:28:29.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/256: link d2/d3/d7/d19/c20 d2/d3/d24/c57 0 2024-03-22T07:28:29.278 INFO:tasks.workunit.client.1.smithi195.stdout:2/257: write d2/d3/d7/da/de/f35 [222617,100131] 0 2024-03-22T07:28:29.281 INFO:tasks.workunit.client.0.smithi134.stdout:1/137: rename d5/f17 to d5/d1d/d2d/f32 0 2024-03-22T07:28:29.281 INFO:tasks.workunit.client.0.smithi134.stdout:1/138: fdatasync d5/da/f12 0 2024-03-22T07:28:29.281 INFO:tasks.workunit.client.0.smithi134.stdout:1/139: write d5/fb [512628,121158] 0 2024-03-22T07:28:29.285 INFO:tasks.workunit.client.0.smithi134.stdout:4/140: symlink d2/d25/l31 0 2024-03-22T07:28:29.288 INFO:tasks.workunit.client.1.smithi195.stdout:1/210: dwrite d0/d2/f14 [0,4194304] 0 2024-03-22T07:28:29.289 INFO:tasks.workunit.client.1.smithi195.stdout:1/211: fdatasync d0/f26 0 2024-03-22T07:28:29.289 INFO:tasks.workunit.client.1.smithi195.stdout:1/212: creat d0/d2/d6/d21/d32/f44 x:0 0 0 2024-03-22T07:28:29.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/283: rename d5/d16/d45/d53/f4c to d5/d5e/d34/d55/d4b/f68 0 2024-03-22T07:28:29.291 INFO:tasks.workunit.client.1.smithi195.stdout:6/284: dread - d5/d16/d45/d53/f40 zero size 2024-03-22T07:28:29.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/141: dread d2/d1d/f1f [0,4194304] 0 2024-03-22T07:28:29.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/142: getdents d2/d2a 0 2024-03-22T07:28:29.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/143: chown d2/d25/l2e 0 1 2024-03-22T07:28:29.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/144: fsync d2/d25/f2d 0 2024-03-22T07:28:29.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/145: dread - d2/d15/f30 zero size 2024-03-22T07:28:29.292 INFO:tasks.workunit.client.0.smithi134.stdout:4/146: write f1 [2399411,79591] 0 2024-03-22T07:28:29.295 INFO:tasks.workunit.client.1.smithi195.stdout:1/213: write d0/d2/f14 [3233696,24912] 0 2024-03-22T07:28:29.295 INFO:tasks.workunit.client.1.smithi195.stdout:9/355: dwrite d2/d4/f5 [0,4194304] 0 2024-03-22T07:28:29.295 INFO:tasks.workunit.client.1.smithi195.stdout:0/292: rmdir d1/d4/d22 39 2024-03-22T07:28:29.296 INFO:tasks.workunit.client.0.smithi134.stdout:2/81: mknod d2/d5/d8/c18 0 2024-03-22T07:28:29.303 INFO:tasks.workunit.client.0.smithi134.stdout:7/243: rmdir d1/de/d11 39 2024-03-22T07:28:29.304 INFO:tasks.workunit.client.0.smithi134.stdout:0/119: rename f7 to dc/d18/f1d 0 2024-03-22T07:28:29.307 INFO:tasks.workunit.client.0.smithi134.stdout:9/79: write d3/f4 [2558894,89757] 0 2024-03-22T07:28:29.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/69: link d1/d4/f6 d1/d13/f15 0 2024-03-22T07:28:29.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/70: write d1/d4/f11 [982353,41648] 0 2024-03-22T07:28:29.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/71: chown d1/l12 122470419 1 2024-03-22T07:28:29.308 INFO:tasks.workunit.client.0.smithi134.stdout:4/147: link d2/l28 d2/l32 0 2024-03-22T07:28:29.308 INFO:tasks.workunit.client.0.smithi134.stdout:4/148: dread - d2/d25/f1c zero size 2024-03-22T07:28:29.310 INFO:tasks.workunit.client.1.smithi195.stdout:7/252: mknod d0/d13/d14/c53 0 2024-03-22T07:28:29.310 INFO:tasks.workunit.client.1.smithi195.stdout:7/253: write d0/f11 [5201360,33339] 0 2024-03-22T07:28:29.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/254: chown d0/d13/d22/d52 0 1 2024-03-22T07:28:29.311 INFO:tasks.workunit.client.0.smithi134.stdout:2/82: chown d2/d5/f10 411817 1 2024-03-22T07:28:29.313 INFO:tasks.workunit.client.0.smithi134.stdout:1/140: getdents d5/da 0 2024-03-22T07:28:29.313 INFO:tasks.workunit.client.0.smithi134.stdout:1/141: write d5/f23 [1802861,32401] 0 2024-03-22T07:28:29.319 INFO:tasks.workunit.client.0.smithi134.stdout:1/142: dread d5/da/f12 [0,4194304] 0 2024-03-22T07:28:29.322 INFO:tasks.workunit.client.0.smithi134.stdout:0/120: dwrite dc/d18/f1b [0,4194304] 0 2024-03-22T07:28:29.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/255: write d0/d13/f46 [282579,125563] 0 2024-03-22T07:28:29.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/256: truncate d0/d13/d14/d2f/f43 390455 0 2024-03-22T07:28:29.335 INFO:tasks.workunit.client.0.smithi134.stdout:7/244: rename d1/de/d11/d48/d52/c30 to d1/de/d11/d48/d52/d46/c57 0 2024-03-22T07:28:29.337 INFO:tasks.workunit.client.1.smithi195.stdout:3/325: rename d3/d22/f4f to d3/df/d15/d1d/f74 0 2024-03-22T07:28:29.338 INFO:tasks.workunit.client.0.smithi134.stdout:9/80: unlink d3/d9/df/d12/l17 0 2024-03-22T07:28:29.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/285: mknod d5/d16/d5b/c69 0 2024-03-22T07:28:29.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/286: creat d5/d16/f6a x:0 0 0 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/287: write d5/d5e/d34/d55/d4b/f68 [525497,28778] 0 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/288: fsync d5/dc/d3c/f44 0 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/289: chown d5/d16/d45/d53/d59 3167 1 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/290: write d5/d5e/d34/d55/d4b/f68 [1573890,56749] 0 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/291: write d5/d16/d45/d53/d17/d4a/f5c [239123,8144] 0 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.1.smithi195.stdout:6/292: chown d5/dc/d3c/f3d 0 1 2024-03-22T07:28:29.340 INFO:tasks.workunit.client.0.smithi134.stdout:4/149: creat d2/f33 x:0 0 0 2024-03-22T07:28:29.342 INFO:tasks.workunit.client.0.smithi134.stdout:2/83: mknod d2/d5/d8/c19 0 2024-03-22T07:28:29.345 INFO:tasks.workunit.client.1.smithi195.stdout:0/293: creat d1/d4/d12/f54 x:0 0 0 2024-03-22T07:28:29.345 INFO:tasks.workunit.client.1.smithi195.stdout:0/294: stat d1/d4/f39 0 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/150: read d2/d15/f11 [1508629,17620] 0 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/151: chown d2/d25/c22 748402 1 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/152: dread - d2/d25/f1c zero size 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/153: fsync d2/d25/f2d 0 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/154: chown d2/d25/f1c 15672152 1 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/155: chown d2/d1d/c2f 12517 1 2024-03-22T07:28:29.350 INFO:tasks.workunit.client.0.smithi134.stdout:4/156: stat d2/d1d/c21 0 2024-03-22T07:28:29.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/84: dread d2/fe [0,4194304] 0 2024-03-22T07:28:29.353 INFO:tasks.workunit.client.1.smithi195.stdout:7/257: link d0/lb d0/d13/d14/d2f/l54 0 2024-03-22T07:28:29.355 INFO:tasks.workunit.client.0.smithi134.stdout:1/143: mknod d5/da/d13/d1e/c33 0 2024-03-22T07:28:29.360 INFO:tasks.workunit.client.1.smithi195.stdout:6/293: dwrite d5/d5e/d34/d55/f36 [0,4194304] 0 2024-03-22T07:28:29.361 INFO:tasks.workunit.client.1.smithi195.stdout:9/356: getdents d2/d4/d32/d6d 0 2024-03-22T07:28:29.361 INFO:tasks.workunit.client.1.smithi195.stdout:9/357: fdatasync d2/d4/d6/db/d20/d4a/f6a 0 2024-03-22T07:28:29.365 INFO:tasks.workunit.client.0.smithi134.stdout:2/85: read d2/d5/fc [2638002,97444] 0 2024-03-22T07:28:29.368 INFO:tasks.workunit.client.1.smithi195.stdout:8/326: sync 2024-03-22T07:28:29.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/296: sync 2024-03-22T07:28:29.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/294: dread d5/dc/d3c/f44 [0,4194304] 0 2024-03-22T07:28:29.369 INFO:tasks.workunit.client.1.smithi195.stdout:6/295: truncate d5/f51 5023233 0 2024-03-22T07:28:29.370 INFO:tasks.workunit.client.0.smithi134.stdout:2/86: dread d2/d5/fc [0,4194304] 0 2024-03-22T07:28:29.373 INFO:tasks.workunit.client.1.smithi195.stdout:8/327: write da/dc/f2b [912191,13940] 0 2024-03-22T07:28:29.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/328: dread - da/d17/d32/f40 zero size 2024-03-22T07:28:29.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/329: write da/d17/d32/f40 [384596,81251] 0 2024-03-22T07:28:29.375 INFO:tasks.workunit.client.1.smithi195.stdout:3/326: link d3/df/d15/l17 d3/l75 0 2024-03-22T07:28:29.378 INFO:tasks.workunit.client.0.smithi134.stdout:0/121: mknod dc/d18/c1e 0 2024-03-22T07:28:29.381 INFO:tasks.workunit.client.0.smithi134.stdout:5/72: rename d1/dd to d1/d8/d16 0 2024-03-22T07:28:29.383 INFO:tasks.workunit.client.1.smithi195.stdout:9/358: mknod d2/d4/d6/db/d20/c81 0 2024-03-22T07:28:29.386 INFO:tasks.workunit.client.0.smithi134.stdout:7/245: mknod d1/de/d11/d48/c58 0 2024-03-22T07:28:29.388 INFO:tasks.workunit.client.1.smithi195.stdout:5/297: creat d9/d53/f70 x:0 0 0 2024-03-22T07:28:29.388 INFO:tasks.workunit.client.1.smithi195.stdout:5/298: chown d9/d22/c39 983796 1 2024-03-22T07:28:29.389 INFO:tasks.workunit.client.0.smithi134.stdout:9/81: mknod d3/d9/df/d12/d1b/c20 0 2024-03-22T07:28:29.390 INFO:tasks.workunit.client.0.smithi134.stdout:4/157: mknod d2/d1d/c34 0 2024-03-22T07:28:29.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/258: mknod d0/d13/d14/c55 0 2024-03-22T07:28:29.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/259: write d0/d13/d14/d2b/f42 [887165,114197] 0 2024-03-22T07:28:29.392 INFO:tasks.workunit.client.1.smithi195.stdout:6/296: link d5/c7 d5/dc/d56/c6b 0 2024-03-22T07:28:29.392 INFO:tasks.workunit.client.0.smithi134.stdout:5/73: mknod d1/c17 0 2024-03-22T07:28:29.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/279: rename d13/d15/d16 to d13/d63 0 2024-03-22T07:28:29.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/280: read d13/d15/f25 [3158917,86481] 0 2024-03-22T07:28:29.394 INFO:tasks.workunit.client.1.smithi195.stdout:4/281: fsync d13/d2a/d3b/f4b 0 2024-03-22T07:28:29.396 INFO:tasks.workunit.client.0.smithi134.stdout:7/246: unlink d1/d19/c2c 0 2024-03-22T07:28:29.396 INFO:tasks.workunit.client.0.smithi134.stdout:7/247: dread - d1/d19/f2f zero size 2024-03-22T07:28:29.397 INFO:tasks.workunit.client.1.smithi195.stdout:9/359: truncate d2/d4/d32/f4b 221550 0 2024-03-22T07:28:29.397 INFO:tasks.workunit.client.1.smithi195.stdout:9/360: fsync d2/d4/d6/db/d20/f26 0 2024-03-22T07:28:29.397 INFO:tasks.workunit.client.1.smithi195.stdout:9/361: truncate d2/d4/d6/d18/f4f 34118 0 2024-03-22T07:28:29.398 INFO:tasks.workunit.client.1.smithi195.stdout:9/362: dread d2/d4/d6/d18/f4f [0,4194304] 0 2024-03-22T07:28:29.398 INFO:tasks.workunit.client.0.smithi134.stdout:9/82: creat d3/d9/df/f21 x:0 0 0 2024-03-22T07:28:29.400 INFO:tasks.workunit.client.1.smithi195.stdout:5/299: creat d9/d2d/d58/f71 x:0 0 0 2024-03-22T07:28:29.402 INFO:tasks.workunit.client.1.smithi195.stdout:6/297: creat d5/dc/d3c/f6c x:0 0 0 2024-03-22T07:28:29.404 INFO:tasks.workunit.client.1.smithi195.stdout:1/214: rename d0/c38 to d0/d2/d27/c45 0 2024-03-22T07:28:29.404 INFO:tasks.workunit.client.0.smithi134.stdout:4/158: write d2/d15/f13 [3223455,78378] 0 2024-03-22T07:28:29.405 INFO:tasks.workunit.client.1.smithi195.stdout:4/282: mkdir d13/d15/d64 0 2024-03-22T07:28:29.405 INFO:tasks.workunit.client.1.smithi195.stdout:4/283: chown lc 3505 1 2024-03-22T07:28:29.406 INFO:tasks.workunit.client.1.smithi195.stdout:4/284: truncate d13/d63/d36/f50 1226050 0 2024-03-22T07:28:29.406 INFO:tasks.workunit.client.1.smithi195.stdout:4/285: fdatasync d13/d63/f33 0 2024-03-22T07:28:29.406 INFO:tasks.workunit.client.1.smithi195.stdout:9/363: unlink d2/d4/d6/d18/c5a 0 2024-03-22T07:28:29.408 INFO:tasks.workunit.client.1.smithi195.stdout:3/327: dwrite d3/df/d15/d1d/f31 [0,4194304] 0 2024-03-22T07:28:29.408 INFO:tasks.workunit.client.0.smithi134.stdout:4/159: mkdir d2/d15/d35 0 2024-03-22T07:28:29.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/298: truncate d5/f1e 1479954 0 2024-03-22T07:28:29.411 INFO:tasks.workunit.client.1.smithi195.stdout:1/215: mknod d0/d2/d6/d21/d39/c46 0 2024-03-22T07:28:29.412 INFO:tasks.workunit.client.0.smithi134.stdout:4/160: symlink d2/d25/l36 0 2024-03-22T07:28:29.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/286: mkdir d13/d63/d3e/d5c/d65 0 2024-03-22T07:28:29.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/287: getdents d13/d63/d36/d5f 0 2024-03-22T07:28:29.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/288: creat d13/d2a/d3b/f66 x:0 0 0 2024-03-22T07:28:29.415 INFO:tasks.workunit.client.0.smithi134.stdout:7/248: dread d1/de/ff [0,4194304] 0 2024-03-22T07:28:29.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/364: creat d2/f82 x:0 0 0 2024-03-22T07:28:29.416 INFO:tasks.workunit.client.1.smithi195.stdout:3/328: mkdir d3/d22/d34/d76 0 2024-03-22T07:28:29.417 INFO:tasks.workunit.client.1.smithi195.stdout:3/329: dread - d3/df/d15/d1d/d5c/f46 zero size 2024-03-22T07:28:29.417 INFO:tasks.workunit.client.0.smithi134.stdout:7/249: getdents d1/de/d11/d48/d52/d46 0 2024-03-22T07:28:29.420 INFO:tasks.workunit.client.1.smithi195.stdout:6/299: unlink d5/d16/f6a 0 2024-03-22T07:28:29.420 INFO:tasks.workunit.client.0.smithi134.stdout:4/161: write d2/d15/f12 [2746634,112133] 0 2024-03-22T07:28:29.420 INFO:tasks.workunit.client.0.smithi134.stdout:4/162: stat d2/fd 0 2024-03-22T07:28:29.421 INFO:tasks.workunit.client.1.smithi195.stdout:1/216: mkdir d0/d2/d6/d21/d41/d47 0 2024-03-22T07:28:29.423 INFO:tasks.workunit.client.0.smithi134.stdout:4/163: mkdir d2/d15/d35/d37 0 2024-03-22T07:28:29.425 INFO:tasks.workunit.client.1.smithi195.stdout:4/289: symlink d13/d63/d36/l67 0 2024-03-22T07:28:29.425 INFO:tasks.workunit.client.1.smithi195.stdout:4/290: fsync d13/f34 0 2024-03-22T07:28:29.425 INFO:tasks.workunit.client.0.smithi134.stdout:7/250: dread d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:29.426 INFO:tasks.workunit.client.1.smithi195.stdout:9/365: creat d2/d4/d6/db/d20/d4a/f83 x:0 0 0 2024-03-22T07:28:29.426 INFO:tasks.workunit.client.1.smithi195.stdout:9/366: write d2/d4/d6/db/d20/f26 [4983163,128200] 0 2024-03-22T07:28:29.430 INFO:tasks.workunit.client.1.smithi195.stdout:4/291: dread d13/f14 [0,4194304] 0 2024-03-22T07:28:29.430 INFO:tasks.workunit.client.1.smithi195.stdout:9/367: mknod d2/d4/d6/d18/d50/c84 0 2024-03-22T07:28:29.430 INFO:tasks.workunit.client.1.smithi195.stdout:4/292: write d13/d2a/d3b/f66 [489556,34986] 0 2024-03-22T07:28:29.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/217: read d0/d2/d6/f2f [3917156,40988] 0 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/251: creat d1/de/f59 x:0 0 0 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/252: chown d1/de/l2e 624 1 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/253: dread - d1/d19/f2f zero size 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/254: dread - d1/d40/f51 zero size 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/255: write d1/de/d11/d2b/d31/f54 [676300,33923] 0 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/256: creat d1/de/f5a x:0 0 0 2024-03-22T07:28:29.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/257: mknod d1/c5b 0 2024-03-22T07:28:29.432 INFO:tasks.workunit.client.1.smithi195.stdout:9/368: symlink d2/d4/d6/db/l85 0 2024-03-22T07:28:29.432 INFO:tasks.workunit.client.1.smithi195.stdout:9/369: readlink d2/d4/d32/l35 0 2024-03-22T07:28:29.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/258: mknod d1/de/d11/d2b/d31/c5c 0 2024-03-22T07:28:29.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/259: creat d1/de/d41/f5d x:0 0 0 2024-03-22T07:28:29.433 INFO:tasks.workunit.client.1.smithi195.stdout:9/370: mknod d2/d4/d23/c86 0 2024-03-22T07:28:29.434 INFO:tasks.workunit.client.0.smithi134.stdout:4/164: write d2/ff [1715932,70734] 0 2024-03-22T07:28:29.434 INFO:tasks.workunit.client.0.smithi134.stdout:4/165: fsync d2/d25/f2d 0 2024-03-22T07:28:29.434 INFO:tasks.workunit.client.0.smithi134.stdout:4/166: dread - d2/d15/f1e zero size 2024-03-22T07:28:29.434 INFO:tasks.workunit.client.0.smithi134.stdout:4/167: chown d2 220338 1 2024-03-22T07:28:29.434 INFO:tasks.workunit.client.0.smithi134.stdout:7/260: truncate d1/f17 737486 0 2024-03-22T07:28:29.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/293: dread d13/d63/f35 [0,4194304] 0 2024-03-22T07:28:29.435 INFO:tasks.workunit.client.1.smithi195.stdout:4/294: truncate d13/d2a/d3b/f53 253365 0 2024-03-22T07:28:29.435 INFO:tasks.workunit.client.1.smithi195.stdout:9/371: mknod d2/d4/d23/c87 0 2024-03-22T07:28:29.437 INFO:tasks.workunit.client.0.smithi134.stdout:4/168: truncate d2/d15/f11 1589469 0 2024-03-22T07:28:29.437 INFO:tasks.workunit.client.0.smithi134.stdout:4/169: dread - d2/d15/f30 zero size 2024-03-22T07:28:29.437 INFO:tasks.workunit.client.0.smithi134.stdout:4/170: mknod d2/d15/c38 0 2024-03-22T07:28:29.438 INFO:tasks.workunit.client.1.smithi195.stdout:9/372: dread f0 [0,4194304] 0 2024-03-22T07:28:29.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/373: write d2/d4/d6/f49 [3620683,84382] 0 2024-03-22T07:28:29.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/374: truncate d2/d4/d6/d18/f44 307505 0 2024-03-22T07:28:29.445 INFO:tasks.workunit.client.1.smithi195.stdout:4/295: dread d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:29.447 INFO:tasks.workunit.client.1.smithi195.stdout:4/296: mkdir d13/d2a/d3b/d68 0 2024-03-22T07:28:29.447 INFO:tasks.workunit.client.0.smithi134.stdout:4/171: dread d2/d1d/f1f [0,4194304] 0 2024-03-22T07:28:29.448 INFO:tasks.workunit.client.1.smithi195.stdout:4/297: link d13/f1f d13/d63/d3e/d5c/f69 0 2024-03-22T07:28:29.452 INFO:tasks.workunit.client.1.smithi195.stdout:4/298: write d13/d63/f35 [4013100,4380] 0 2024-03-22T07:28:29.453 INFO:tasks.workunit.client.1.smithi195.stdout:4/299: rename d13/d63/f35 to d13/d63/f6a 0 2024-03-22T07:28:29.453 INFO:tasks.workunit.client.1.smithi195.stdout:4/300: chown d13/d2a/l60 830 1 2024-03-22T07:28:29.455 INFO:tasks.workunit.client.0.smithi134.stdout:7/261: dwrite d1/de/f26 [0,4194304] 0 2024-03-22T07:28:29.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/301: write f11 [247018,116422] 0 2024-03-22T07:28:29.456 INFO:tasks.workunit.client.1.smithi195.stdout:4/302: chown fa 15662691 1 2024-03-22T07:28:29.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/303: mkdir d13/d15/d6b 0 2024-03-22T07:28:29.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/304: chown d13 1663 1 2024-03-22T07:28:29.457 INFO:tasks.workunit.client.1.smithi195.stdout:4/305: fdatasync d13/f3a 0 2024-03-22T07:28:29.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/306: mkdir d13/d63/d6c 0 2024-03-22T07:28:29.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/307: read d13/d63/f6a [3464311,18815] 0 2024-03-22T07:28:29.459 INFO:tasks.workunit.client.1.smithi195.stdout:4/308: link d13/d63/d21/l41 d13/d15/d44/l6d 0 2024-03-22T07:28:29.463 INFO:tasks.workunit.client.1.smithi195.stdout:4/309: dread d13/f1f [0,4194304] 0 2024-03-22T07:28:29.464 INFO:tasks.workunit.client.1.smithi195.stdout:4/310: rmdir d13/d63/d6c 0 2024-03-22T07:28:29.466 INFO:tasks.workunit.client.1.smithi195.stdout:4/311: dread d13/f1f [0,4194304] 0 2024-03-22T07:28:29.466 INFO:tasks.workunit.client.1.smithi195.stdout:4/312: fdatasync d13/d63/f47 0 2024-03-22T07:28:29.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/313: link d13/d15/l4a d13/d63/d36/d5f/l6e 0 2024-03-22T07:28:29.468 INFO:tasks.workunit.client.0.smithi134.stdout:7/262: dwrite d1/de/d11/f16 [0,4194304] 0 2024-03-22T07:28:29.468 INFO:tasks.workunit.client.0.smithi134.stdout:7/263: fdatasync d1/d19/f53 0 2024-03-22T07:28:29.470 INFO:tasks.workunit.client.1.smithi195.stdout:4/314: rename d13/d2a/d3b/f66 to d13/d15/f6f 0 2024-03-22T07:28:29.490 INFO:tasks.workunit.client.1.smithi195.stdout:1/218: write d0/d2/f1b [2350019,113236] 0 2024-03-22T07:28:29.507 INFO:tasks.workunit.client.0.smithi134.stdout:0/122: dwrite f9 [4194304,4194304] 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:8/330: dwrite f7 [4194304,4194304] 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:8/331: fsync da/d17/d32/d61/d47/d53/f5e 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:5/300: dwrite d9/fb [4194304,4194304] 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:5/301: fsync d9/d12/f52 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:7/260: dwrite d0/d13/d22/f23 [0,4194304] 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:7/261: readlink d0/d13/d14/l19 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:4/315: dwrite d13/d63/d3e/d5c/f69 [0,4194304] 0 2024-03-22T07:28:29.508 INFO:tasks.workunit.client.1.smithi195.stdout:9/375: dwrite d2/d4/d6/d18/d50/f59 [0,4194304] 0 2024-03-22T07:28:29.510 INFO:tasks.workunit.client.0.smithi134.stdout:0/123: dread f4 [0,4194304] 0 2024-03-22T07:28:29.513 INFO:tasks.workunit.client.0.smithi134.stdout:5/74: getdents d1 0 2024-03-22T07:28:29.514 INFO:tasks.workunit.client.1.smithi195.stdout:7/262: dread d0/d13/d14/d20/d40/f4e [0,4194304] 0 2024-03-22T07:28:29.514 INFO:tasks.workunit.client.1.smithi195.stdout:7/263: readlink d0/l15 0 2024-03-22T07:28:29.519 INFO:tasks.workunit.client.0.smithi134.stdout:0/124: creat dc/f1f x:0 0 0 2024-03-22T07:28:29.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/302: write d9/f28 [1190718,86513] 0 2024-03-22T07:28:29.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/303: fdatasync d9/d2d/f65 0 2024-03-22T07:28:29.521 INFO:tasks.workunit.client.0.smithi134.stdout:5/75: creat d1/d13/f18 x:0 0 0 2024-03-22T07:28:29.525 INFO:tasks.workunit.client.1.smithi195.stdout:9/376: truncate d2/d4/f5 427087 0 2024-03-22T07:28:29.525 INFO:tasks.workunit.client.0.smithi134.stdout:5/76: dread d1/d4/f10 [0,4194304] 0 2024-03-22T07:28:29.530 INFO:tasks.workunit.client.1.smithi195.stdout:7/264: mkdir d0/d13/d14/d20/d40/d56 0 2024-03-22T07:28:29.532 INFO:tasks.workunit.client.1.smithi195.stdout:4/316: link d13/d15/f1c d13/d2a/f70 0 2024-03-22T07:28:29.532 INFO:tasks.workunit.client.0.smithi134.stdout:5/77: dread d1/d13/f15 [0,4194304] 0 2024-03-22T07:28:29.536 INFO:tasks.workunit.client.1.smithi195.stdout:7/265: mkdir d0/d13/d22/d57 0 2024-03-22T07:28:29.537 INFO:tasks.workunit.client.1.smithi195.stdout:6/300: dread d5/f1e [0,4194304] 0 2024-03-22T07:28:29.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/317: rename d13/d2a/l60 to d13/d63/d36/d5f/l71 0 2024-03-22T07:28:29.537 INFO:tasks.workunit.client.1.smithi195.stdout:4/318: read d13/f17 [3443729,99789] 0 2024-03-22T07:28:29.539 INFO:tasks.workunit.client.1.smithi195.stdout:5/304: getdents d9/d22 0 2024-03-22T07:28:29.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/266: mknod d0/d13/d14/d29/d35/d3a/c58 0 2024-03-22T07:28:29.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/267: write d0/f25 [2856520,66189] 0 2024-03-22T07:28:29.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/268: chown d0/d13/d14/d2f/f43 730705 1 2024-03-22T07:28:29.540 INFO:tasks.workunit.client.1.smithi195.stdout:7/269: chown d0/l24 1259 1 2024-03-22T07:28:29.541 INFO:tasks.workunit.client.1.smithi195.stdout:6/301: mkdir d5/d6d 0 2024-03-22T07:28:29.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/305: rename d9/d53/f70 to d9/d2d/f72 0 2024-03-22T07:28:29.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/306: chown d9/f1c 322916 1 2024-03-22T07:28:29.545 INFO:tasks.workunit.client.1.smithi195.stdout:9/377: dwrite d2/d4/d6/d18/f29 [0,4194304] 0 2024-03-22T07:28:29.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/125: dwrite dc/d18/f1d [4194304,4194304] 0 2024-03-22T07:28:29.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/126: fsync dc/de/f15 0 2024-03-22T07:28:29.546 INFO:tasks.workunit.client.1.smithi195.stdout:5/307: mkdir d9/d73 0 2024-03-22T07:28:29.548 INFO:tasks.workunit.client.1.smithi195.stdout:4/319: write d13/f34 [1462891,34420] 0 2024-03-22T07:28:29.549 INFO:tasks.workunit.client.1.smithi195.stdout:4/320: dread - d13/d63/f18 zero size 2024-03-22T07:28:29.549 INFO:tasks.workunit.client.1.smithi195.stdout:4/321: write d13/d15/f1c [317465,114677] 0 2024-03-22T07:28:29.550 INFO:tasks.workunit.client.0.smithi134.stdout:5/78: dwrite d1/d13/f18 [0,4194304] 0 2024-03-22T07:28:29.550 INFO:tasks.workunit.client.0.smithi134.stdout:0/127: creat dc/f20 x:0 0 0 2024-03-22T07:28:29.556 INFO:tasks.workunit.client.1.smithi195.stdout:5/308: rename d9/l13 to d9/d2d/l74 0 2024-03-22T07:28:29.556 INFO:tasks.workunit.client.1.smithi195.stdout:5/309: write d9/d2d/f51 [614933,48694] 0 2024-03-22T07:28:29.558 INFO:tasks.workunit.client.0.smithi134.stdout:7/264: rmdir d1/de 39 2024-03-22T07:28:29.561 INFO:tasks.workunit.client.0.smithi134.stdout:5/79: rename d1/c3 to d1/d4/c19 0 2024-03-22T07:28:29.563 INFO:tasks.workunit.client.1.smithi195.stdout:4/322: creat d13/d63/d3e/d5c/d65/f72 x:0 0 0 2024-03-22T07:28:29.563 INFO:tasks.workunit.client.1.smithi195.stdout:4/323: write f6 [5047388,103592] 0 2024-03-22T07:28:29.563 INFO:tasks.workunit.client.1.smithi195.stdout:4/324: creat d13/f73 x:0 0 0 2024-03-22T07:28:29.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/302: dwrite d5/d16/d45/d53/d17/d4a/f5c [0,4194304] 0 2024-03-22T07:28:29.564 INFO:tasks.workunit.client.0.smithi134.stdout:0/128: creat dc/d17/f21 x:0 0 0 2024-03-22T07:28:29.566 INFO:tasks.workunit.client.0.smithi134.stdout:7/265: creat d1/de/d11/d2b/d31/f5e x:0 0 0 2024-03-22T07:28:29.568 INFO:tasks.workunit.client.1.smithi195.stdout:9/378: dwrite d2/d4/d6/d18/f3e [0,4194304] 0 2024-03-22T07:28:29.569 INFO:tasks.workunit.client.0.smithi134.stdout:5/80: rename d1/d4/f6 to d1/d4/f1a 0 2024-03-22T07:28:29.570 INFO:tasks.workunit.client.0.smithi134.stdout:0/129: write dc/d18/f1d [2221029,108229] 0 2024-03-22T07:28:29.571 INFO:tasks.workunit.client.1.smithi195.stdout:4/325: symlink d13/d15/d64/l74 0 2024-03-22T07:28:29.579 INFO:tasks.workunit.client.0.smithi134.stdout:7/266: symlink d1/de/d11/d2b/d31/l5f 0 2024-03-22T07:28:29.579 INFO:tasks.workunit.client.0.smithi134.stdout:7/267: write d1/de/f5a [685535,130229] 0 2024-03-22T07:28:29.583 INFO:tasks.workunit.client.0.smithi134.stdout:5/81: dwrite d1/d4/f11 [0,4194304] 0 2024-03-22T07:28:29.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/268: mknod d1/de/c60 0 2024-03-22T07:28:29.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/269: write d1/de/d11/d48/f1e [122047,27193] 0 2024-03-22T07:28:29.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/270: chown d1/ld 3790 1 2024-03-22T07:28:29.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/271: fsync d1/de/d11/d2b/d31/f43 0 2024-03-22T07:28:29.584 INFO:tasks.workunit.client.0.smithi134.stdout:0/130: symlink dc/l22 0 2024-03-22T07:28:29.589 INFO:tasks.workunit.client.1.smithi195.stdout:6/303: rename d5/dc to d5/d5e/d34/d55/d3b/d6e 0 2024-03-22T07:28:29.589 INFO:tasks.workunit.client.1.smithi195.stdout:6/304: write d5/d5e/d34/d55/d4b/f65 [923864,89631] 0 2024-03-22T07:28:29.591 INFO:tasks.workunit.client.1.smithi195.stdout:9/379: rename d2/d4/d6/db/d20/d60 to d2/d4/d6/d18/d50/d88 0 2024-03-22T07:28:29.593 INFO:tasks.workunit.client.1.smithi195.stdout:6/305: creat d5/d16/d45/f6f x:0 0 0 2024-03-22T07:28:29.595 INFO:tasks.workunit.client.1.smithi195.stdout:4/326: rename lf to d13/d63/d36/d5f/l75 0 2024-03-22T07:28:29.599 INFO:tasks.workunit.client.1.smithi195.stdout:6/306: creat d5/d5e/d34/d55/d3b/d6e/d3c/f70 x:0 0 0 2024-03-22T07:28:29.602 INFO:tasks.workunit.client.0.smithi134.stdout:6/73: sync 2024-03-22T07:28:29.602 INFO:tasks.workunit.client.1.smithi195.stdout:4/327: unlink d13/d63/d21/l2d 0 2024-03-22T07:28:29.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/82: stat d1/d4/l5 0 2024-03-22T07:28:29.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/307: creat d5/d16/d45/d53/d17/d1a/f71 x:0 0 0 2024-03-22T07:28:29.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/380: dwrite d2/d4/d6/db/d20/d4a/f83 [0,4194304] 0 2024-03-22T07:28:29.605 INFO:tasks.workunit.client.1.smithi195.stdout:9/381: read - d2/f63 zero size 2024-03-22T07:28:29.606 INFO:tasks.workunit.client.0.smithi134.stdout:7/272: creat d1/de/d11/d48/d52/d46/f61 x:0 0 0 2024-03-22T07:28:29.606 INFO:tasks.workunit.client.0.smithi134.stdout:6/74: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:29.609 INFO:tasks.workunit.client.1.smithi195.stdout:6/308: symlink d5/d5e/d34/d55/d3b/d6e/d56/l72 0 2024-03-22T07:28:29.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/273: rename d1/de/d11/d2b/c34 to d1/de/d11/d2b/c62 0 2024-03-22T07:28:29.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/274: truncate d1/de/d41/f5d 775449 0 2024-03-22T07:28:29.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/275: chown d1/de/d11/f13 1514684 1 2024-03-22T07:28:29.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/276: chown d1/de/d11/c20 1 1 2024-03-22T07:28:29.616 INFO:tasks.workunit.client.0.smithi134.stdout:6/75: creat d2/f15 x:0 0 0 2024-03-22T07:28:29.616 INFO:tasks.workunit.client.0.smithi134.stdout:7/277: dread d1/de/d11/d48/fc [0,4194304] 0 2024-03-22T07:28:29.616 INFO:tasks.workunit.client.0.smithi134.stdout:7/278: fdatasync d1/f3d 0 2024-03-22T07:28:29.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/382: creat d2/d4/d32/d6d/f89 x:0 0 0 2024-03-22T07:28:29.617 INFO:tasks.workunit.client.1.smithi195.stdout:9/383: chown d2/d4/d6/d18/f3e 933469546 1 2024-03-22T07:28:29.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/309: rename d5/d5e/d34/c35 to d5/d5e/d34/d55/d4b/c73 0 2024-03-22T07:28:29.621 INFO:tasks.workunit.client.1.smithi195.stdout:4/328: dwrite d13/d2a/f28 [0,4194304] 0 2024-03-22T07:28:29.621 INFO:tasks.workunit.client.0.smithi134.stdout:6/76: rename d2/l3 to d2/l16 0 2024-03-22T07:28:29.623 INFO:tasks.workunit.client.1.smithi195.stdout:6/310: truncate d5/f51 4468529 0 2024-03-22T07:28:29.625 INFO:tasks.workunit.client.0.smithi134.stdout:6/77: rename d2/f15 to d2/f17 0 2024-03-22T07:28:29.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/311: rmdir d5/d16/d45/d53/d17 39 2024-03-22T07:28:29.627 INFO:tasks.workunit.client.0.smithi134.stdout:6/78: symlink d2/l18 0 2024-03-22T07:28:29.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/312: mknod d5/d16/d45/d53/d59/c74 0 2024-03-22T07:28:29.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/313: write d5/d16/d45/d53/d17/f4e [276815,108387] 0 2024-03-22T07:28:29.629 INFO:tasks.workunit.client.1.smithi195.stdout:6/314: dread - d5/d5e/d34/d55/d4b/f4f zero size 2024-03-22T07:28:29.630 INFO:tasks.workunit.client.0.smithi134.stdout:7/279: write d1/de/d11/d48/f29 [6413877,16280] 0 2024-03-22T07:28:29.631 INFO:tasks.workunit.client.1.smithi195.stdout:6/315: mknod d5/d5e/d34/c75 0 2024-03-22T07:28:29.633 INFO:tasks.workunit.client.0.smithi134.stdout:7/280: mkdir d1/d63 0 2024-03-22T07:28:29.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/281: dread - d1/f3d zero size 2024-03-22T07:28:29.635 INFO:tasks.workunit.client.0.smithi134.stdout:7/282: getdents d1/de/d11/d48/d52 0 2024-03-22T07:28:29.640 INFO:tasks.workunit.client.0.smithi134.stdout:7/283: mknod d1/de/d41/c64 0 2024-03-22T07:28:29.640 INFO:tasks.workunit.client.0.smithi134.stdout:7/284: chown d1/de/d11/d2b/d31/f5e 16547 1 2024-03-22T07:28:29.641 INFO:tasks.workunit.client.0.smithi134.stdout:7/285: write d1/de/d11/d48/d52/d46/f61 [919093,118887] 0 2024-03-22T07:28:29.641 INFO:tasks.workunit.client.0.smithi134.stdout:7/286: readlink d1/de/l21 0 2024-03-22T07:28:29.641 INFO:tasks.workunit.client.0.smithi134.stdout:7/287: truncate d1/f33 812775 0 2024-03-22T07:28:29.645 INFO:tasks.workunit.client.0.smithi134.stdout:7/288: rename d1/d19/d32/f36 to d1/de/d11/d48/f65 0 2024-03-22T07:28:29.646 INFO:tasks.workunit.client.1.smithi195.stdout:9/384: dwrite d2/d4/d32/d6d/f89 [0,4194304] 0 2024-03-22T07:28:29.651 INFO:tasks.workunit.client.1.smithi195.stdout:9/385: rename d2/d4/d6/db/d20/d47/l65 to d2/d4/d1d/l8a 0 2024-03-22T07:28:29.652 INFO:tasks.workunit.client.0.smithi134.stdout:5/83: getdents d1/d4 0 2024-03-22T07:28:29.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/329: dwrite fa [4194304,4194304] 0 2024-03-22T07:28:29.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/330: creat d13/d2a/d3b/f76 x:0 0 0 2024-03-22T07:28:29.654 INFO:tasks.workunit.client.0.smithi134.stdout:5/84: creat d1/d8/f1b x:0 0 0 2024-03-22T07:28:29.654 INFO:tasks.workunit.client.0.smithi134.stdout:5/85: creat d1/d13/f1c x:0 0 0 2024-03-22T07:28:29.656 INFO:tasks.workunit.client.1.smithi195.stdout:4/331: dread d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:29.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/86: rmdir d1 39 2024-03-22T07:28:29.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/87: readlink d1/l12 0 2024-03-22T07:28:29.657 INFO:tasks.workunit.client.0.smithi134.stdout:5/88: write d1/d8/f1b [522064,105795] 0 2024-03-22T07:28:29.659 INFO:tasks.workunit.client.0.smithi134.stdout:3/97: sync 2024-03-22T07:28:29.659 INFO:tasks.workunit.client.0.smithi134.stdout:8/178: sync 2024-03-22T07:28:29.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/332: mkdir d13/d2a/d3b/d77 0 2024-03-22T07:28:29.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/333: truncate d13/f3a 1017242 0 2024-03-22T07:28:29.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/334: creat d13/d2a/d3b/f78 x:0 0 0 2024-03-22T07:28:29.660 INFO:tasks.workunit.client.0.smithi134.stdout:6/79: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:29.660 INFO:tasks.workunit.client.0.smithi134.stdout:6/80: chown d2/l18 3836866 1 2024-03-22T07:28:29.660 INFO:tasks.workunit.client.0.smithi134.stdout:5/89: symlink d1/l1d 0 2024-03-22T07:28:29.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/98: rename d4/f16 to d4/d1c/f20 0 2024-03-22T07:28:29.662 INFO:tasks.workunit.client.0.smithi134.stdout:3/99: creat d4/f21 x:0 0 0 2024-03-22T07:28:29.662 INFO:tasks.workunit.client.0.smithi134.stdout:8/179: dread d1/f24 [0,4194304] 0 2024-03-22T07:28:29.664 INFO:tasks.workunit.client.1.smithi195.stdout:6/316: dwrite d5/d16/d45/d53/d17/f21 [0,4194304] 0 2024-03-22T07:28:29.664 INFO:tasks.workunit.client.1.smithi195.stdout:6/317: write d5/d5e/d34/d55/d3b/d6e/d3c/f70 [670496,56951] 0 2024-03-22T07:28:29.665 INFO:tasks.workunit.client.0.smithi134.stdout:5/90: getdents d1/d8/d16 0 2024-03-22T07:28:29.668 INFO:tasks.workunit.client.1.smithi195.stdout:6/318: dread d5/d5e/d34/d55/f2e [0,4194304] 0 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/172: sync 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:1/144: sync 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:1/145: fdatasync d5/da/f2a 0 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/173: read - d2/d25/f1c zero size 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/174: write d2/d1d/f24 [514086,30718] 0 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/175: write d2/d25/f2d [507271,106520] 0 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/176: read - d2/f33 zero size 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/87: sync 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/88: stat d2/fe 0 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:2/89: creat d2/f1a x:0 0 0 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:9/83: sync 2024-03-22T07:28:29.670 INFO:tasks.workunit.client.0.smithi134.stdout:7/289: dwrite d1/d40/f51 [0,4194304] 0 2024-03-22T07:28:29.672 INFO:tasks.workunit.client.1.smithi195.stdout:2/258: sync 2024-03-22T07:28:29.673 INFO:tasks.workunit.client.0.smithi134.stdout:6/81: write d2/f8 [3751240,97078] 0 2024-03-22T07:28:29.675 INFO:tasks.workunit.client.0.smithi134.stdout:1/146: mkdir d5/da/d13/d1e/d34 0 2024-03-22T07:28:29.675 INFO:tasks.workunit.client.0.smithi134.stdout:3/100: dread d4/f1a [0,4194304] 0 2024-03-22T07:28:29.675 INFO:tasks.workunit.client.0.smithi134.stdout:3/101: stat d4/d8/f13 0 2024-03-22T07:28:29.677 INFO:tasks.workunit.client.0.smithi134.stdout:9/84: dread d3/f4 [0,4194304] 0 2024-03-22T07:28:29.677 INFO:tasks.workunit.client.0.smithi134.stdout:9/85: fdatasync f0 0 2024-03-22T07:28:29.680 INFO:tasks.workunit.client.0.smithi134.stdout:9/86: read d3/fb [3539823,50202] 0 2024-03-22T07:28:29.681 INFO:tasks.workunit.client.1.smithi195.stdout:4/335: dwrite d13/f14 [0,4194304] 0 2024-03-22T07:28:29.681 INFO:tasks.workunit.client.0.smithi134.stdout:2/90: creat d2/d5/d8/f1b x:0 0 0 2024-03-22T07:28:29.682 INFO:tasks.workunit.client.1.smithi195.stdout:6/319: mknod d5/d5e/d34/d55/d3b/d6e/c76 0 2024-03-22T07:28:29.684 INFO:tasks.workunit.client.1.smithi195.stdout:2/259: creat d2/d3/d7/da/f58 x:0 0 0 2024-03-22T07:28:29.684 INFO:tasks.workunit.client.1.smithi195.stdout:2/260: write d2/f34 [392957,94197] 0 2024-03-22T07:28:29.688 INFO:tasks.workunit.client.0.smithi134.stdout:7/290: rename d1/de/c44 to d1/d19/c66 0 2024-03-22T07:28:29.689 INFO:tasks.workunit.client.0.smithi134.stdout:7/291: dread d1/f3b [0,4194304] 0 2024-03-22T07:28:29.690 INFO:tasks.workunit.client.1.smithi195.stdout:6/320: creat d5/d5e/d34/d55/d3b/d6e/d56/f77 x:0 0 0 2024-03-22T07:28:29.690 INFO:tasks.workunit.client.0.smithi134.stdout:5/91: dwrite d1/d4/f1a [0,4194304] 0 2024-03-22T07:28:29.690 INFO:tasks.workunit.client.0.smithi134.stdout:5/92: creat d1/d13/f1e x:0 0 0 2024-03-22T07:28:29.690 INFO:tasks.workunit.client.0.smithi134.stdout:9/87: write d3/f8 [22821,65567] 0 2024-03-22T07:28:29.691 INFO:tasks.workunit.client.0.smithi134.stdout:9/88: stat d3/d9/f18 0 2024-03-22T07:28:29.691 INFO:tasks.workunit.client.0.smithi134.stdout:9/89: truncate d3/d9/df/d12/f1d 539072 0 2024-03-22T07:28:29.691 INFO:tasks.workunit.client.0.smithi134.stdout:8/180: mknod d1/c43 0 2024-03-22T07:28:29.692 INFO:tasks.workunit.client.1.smithi195.stdout:4/336: dread d13/d2a/f2e [0,4194304] 0 2024-03-22T07:28:29.693 INFO:tasks.workunit.client.0.smithi134.stdout:6/82: mknod d2/c19 0 2024-03-22T07:28:29.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/321: unlink d5/l26 0 2024-03-22T07:28:29.696 INFO:tasks.workunit.client.1.smithi195.stdout:2/261: write d2/d3/d7/d19/d22/d26/d3c/f47 [364535,17176] 0 2024-03-22T07:28:29.696 INFO:tasks.workunit.client.0.smithi134.stdout:1/147: symlink d5/l35 0 2024-03-22T07:28:29.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/262: dread d2/d3/d24/f39 [0,4194304] 0 2024-03-22T07:28:29.701 INFO:tasks.workunit.client.0.smithi134.stdout:5/93: dread d1/d4/f1a [0,4194304] 0 2024-03-22T07:28:29.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/263: symlink d2/d3/d7/d19/l59 0 2024-03-22T07:28:29.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/264: chown d2/d17/f44 112 1 2024-03-22T07:28:29.703 INFO:tasks.workunit.client.0.smithi134.stdout:4/177: getdents d2/d1d 0 2024-03-22T07:28:29.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/91: stat d2/d5/l13 0 2024-03-22T07:28:29.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/92: dread - d2/f1a zero size 2024-03-22T07:28:29.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/93: chown d2/d5/fc 27690204 1 2024-03-22T07:28:29.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/94: creat d2/f1c x:0 0 0 2024-03-22T07:28:29.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/95: dread - d2/f1a zero size 2024-03-22T07:28:29.707 INFO:tasks.workunit.client.1.smithi195.stdout:2/265: link d2/d3/d7/da/de/f35 d2/d3/d7/da/de/f5a 0 2024-03-22T07:28:29.708 INFO:tasks.workunit.client.0.smithi134.stdout:7/292: symlink d1/l67 0 2024-03-22T07:28:29.710 INFO:tasks.workunit.client.1.smithi195.stdout:2/266: creat d2/d3/d21/d40/f5b x:0 0 0 2024-03-22T07:28:29.712 INFO:tasks.workunit.client.0.smithi134.stdout:9/90: rename d3/fb to d3/f22 0 2024-03-22T07:28:29.713 INFO:tasks.workunit.client.0.smithi134.stdout:9/91: fdatasync d3/f22 0 2024-03-22T07:28:29.714 INFO:tasks.workunit.client.0.smithi134.stdout:8/181: rename d1/d15/d42/d12/d39 to d1/d15/d42/d44 0 2024-03-22T07:28:29.715 INFO:tasks.workunit.client.0.smithi134.stdout:4/178: link d2/d15/f23 d2/d15/f39 0 2024-03-22T07:28:29.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/92: dread f0 [0,4194304] 0 2024-03-22T07:28:29.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/93: fdatasync d3/f1a 0 2024-03-22T07:28:29.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/94: readlink d3/lc 0 2024-03-22T07:28:29.717 INFO:tasks.workunit.client.0.smithi134.stdout:8/182: dread d1/f18 [0,4194304] 0 2024-03-22T07:28:29.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/148: dwrite d5/da/d1b/f1f [0,4194304] 0 2024-03-22T07:28:29.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/149: creat d5/da/d1b/f36 x:0 0 0 2024-03-22T07:28:29.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/150: write d5/da/f2a [862058,21456] 0 2024-03-22T07:28:29.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/96: unlink d2/d5/d8/c18 0 2024-03-22T07:28:29.720 INFO:tasks.workunit.client.1.smithi195.stdout:2/267: read d2/d3/d21/f14 [1092326,121145] 0 2024-03-22T07:28:29.720 INFO:tasks.workunit.client.1.smithi195.stdout:2/268: readlink d2/d1e/l41 0 2024-03-22T07:28:29.720 INFO:tasks.workunit.client.0.smithi134.stdout:7/293: symlink d1/l68 0 2024-03-22T07:28:29.721 INFO:tasks.workunit.client.0.smithi134.stdout:6/83: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:29.722 INFO:tasks.workunit.client.0.smithi134.stdout:5/94: rename d1/l12 to d1/d8/l1f 0 2024-03-22T07:28:29.722 INFO:tasks.workunit.client.0.smithi134.stdout:7/294: fdatasync d1/f4 0 2024-03-22T07:28:29.723 INFO:tasks.workunit.client.0.smithi134.stdout:4/179: dread d2/fd [0,4194304] 0 2024-03-22T07:28:29.724 INFO:tasks.workunit.client.0.smithi134.stdout:8/183: creat d1/d15/d42/d12/d20/d41/f45 x:0 0 0 2024-03-22T07:28:29.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/184: dread d1/d15/f27 [0,4194304] 0 2024-03-22T07:28:29.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/185: chown d1/d15/d42/d12/d20/c2f 237540177 1 2024-03-22T07:28:29.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/186: readlink d1/d4/lc 0 2024-03-22T07:28:29.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/187: fdatasync d1/d15/d42/d12/d20/d41/f45 0 2024-03-22T07:28:29.728 INFO:tasks.workunit.client.0.smithi134.stdout:1/151: write d5/f9 [3340413,57795] 0 2024-03-22T07:28:29.728 INFO:tasks.workunit.client.0.smithi134.stdout:1/152: chown d5/da/d1b/f1f 23443 1 2024-03-22T07:28:29.728 INFO:tasks.workunit.client.0.smithi134.stdout:2/97: symlink d2/l1d 0 2024-03-22T07:28:29.729 INFO:tasks.workunit.client.0.smithi134.stdout:6/84: stat d2/le 0 2024-03-22T07:28:29.733 INFO:tasks.workunit.client.0.smithi134.stdout:3/102: rename d4/d1c to d4/d22 0 2024-03-22T07:28:29.734 INFO:tasks.workunit.client.0.smithi134.stdout:9/95: rename d3/lc to d3/d9/df/l23 0 2024-03-22T07:28:29.739 INFO:tasks.workunit.client.0.smithi134.stdout:5/95: mkdir d1/d8/d20 0 2024-03-22T07:28:29.741 INFO:tasks.workunit.client.0.smithi134.stdout:4/180: link d2/c16 d2/d15/d35/d37/c3a 0 2024-03-22T07:28:29.741 INFO:tasks.workunit.client.0.smithi134.stdout:4/181: write d2/d25/f2d [1059561,31179] 0 2024-03-22T07:28:29.742 INFO:tasks.workunit.client.0.smithi134.stdout:6/85: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:29.745 INFO:tasks.workunit.client.0.smithi134.stdout:2/98: stat d2/d5/lf 0 2024-03-22T07:28:29.746 INFO:tasks.workunit.client.0.smithi134.stdout:3/103: mkdir d4/d8/d23 0 2024-03-22T07:28:29.746 INFO:tasks.workunit.client.0.smithi134.stdout:3/104: write d4/d8/f12 [5110910,102163] 0 2024-03-22T07:28:29.748 INFO:tasks.workunit.client.0.smithi134.stdout:9/96: creat d3/d9/df/d12/d1b/f24 x:0 0 0 2024-03-22T07:28:29.748 INFO:tasks.workunit.client.1.smithi195.stdout:0/295: sync 2024-03-22T07:28:29.749 INFO:tasks.workunit.client.1.smithi195.stdout:1/219: sync 2024-03-22T07:28:29.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/330: sync 2024-03-22T07:28:29.752 INFO:tasks.workunit.client.1.smithi195.stdout:4/337: rename d13/d2a/d3b to d13/d63/d79 0 2024-03-22T07:28:29.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/153: dwrite f4 [0,4194304] 0 2024-03-22T07:28:29.757 INFO:tasks.workunit.client.1.smithi195.stdout:1/220: getdents d0/d2/d27 0 2024-03-22T07:28:29.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/295: dwrite d1/de/d11/d48/f65 [0,4194304] 0 2024-03-22T07:28:29.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/296: fsync d1/de/f59 0 2024-03-22T07:28:29.757 INFO:tasks.workunit.client.0.smithi134.stdout:7/297: chown d1/d63 224453 1 2024-03-22T07:28:29.758 INFO:tasks.workunit.client.1.smithi195.stdout:3/331: symlink d3/df/d15/d1d/d5c/l77 0 2024-03-22T07:28:29.758 INFO:tasks.workunit.client.0.smithi134.stdout:3/105: mknod d4/d8/c24 0 2024-03-22T07:28:29.758 INFO:tasks.workunit.client.0.smithi134.stdout:3/106: fsync d4/d8/fa 0 2024-03-22T07:28:29.758 INFO:tasks.workunit.client.0.smithi134.stdout:4/182: dread d2/d1d/f24 [0,4194304] 0 2024-03-22T07:28:29.759 INFO:tasks.workunit.client.0.smithi134.stdout:4/183: chown d2/d15/f12 205 1 2024-03-22T07:28:29.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/338: mkdir d13/d63/d7a 0 2024-03-22T07:28:29.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/269: fsync d2/d3/d7/da/de/f5a 0 2024-03-22T07:28:29.761 INFO:tasks.workunit.client.1.smithi195.stdout:3/332: dread d3/f3f [0,4194304] 0 2024-03-22T07:28:29.761 INFO:tasks.workunit.client.1.smithi195.stdout:3/333: read f0 [4644646,26191] 0 2024-03-22T07:28:29.761 INFO:tasks.workunit.client.1.smithi195.stdout:2/270: dread d2/d3/d1a/f3a [0,4194304] 0 2024-03-22T07:28:29.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/271: dread - d2/d3/d1a/f50 zero size 2024-03-22T07:28:29.762 INFO:tasks.workunit.client.1.smithi195.stdout:3/334: dread d3/f3f [0,4194304] 0 2024-03-22T07:28:29.764 INFO:tasks.workunit.client.1.smithi195.stdout:6/322: rename d5/d16/d45/l52 to d5/d5e/d34/d55/d3b/d6e/l78 0 2024-03-22T07:28:29.764 INFO:tasks.workunit.client.1.smithi195.stdout:6/323: chown d5/f3a 6 1 2024-03-22T07:28:29.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/188: dwrite d1/d15/d42/d12/f35 [0,4194304] 0 2024-03-22T07:28:29.765 INFO:tasks.workunit.client.0.smithi134.stdout:8/189: fsync d1/f2d 0 2024-03-22T07:28:29.766 INFO:tasks.workunit.client.0.smithi134.stdout:2/99: symlink d2/d5/l1e 0 2024-03-22T07:28:29.766 INFO:tasks.workunit.client.0.smithi134.stdout:2/100: stat d2/f1a 0 2024-03-22T07:28:29.767 INFO:tasks.workunit.client.0.smithi134.stdout:1/154: write d5/da/d1b/f1f [721633,123886] 0 2024-03-22T07:28:29.767 INFO:tasks.workunit.client.0.smithi134.stdout:1/155: readlink d5/l35 0 2024-03-22T07:28:29.767 INFO:tasks.workunit.client.0.smithi134.stdout:1/156: fdatasync d5/f20 0 2024-03-22T07:28:29.767 INFO:tasks.workunit.client.0.smithi134.stdout:8/190: dread d1/d15/d42/d12/f1a [0,4194304] 0 2024-03-22T07:28:29.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/339: unlink d13/d63/f57 0 2024-03-22T07:28:29.771 INFO:tasks.workunit.client.0.smithi134.stdout:6/86: dwrite d2/f8 [0,4194304] 0 2024-03-22T07:28:29.773 INFO:tasks.workunit.client.1.smithi195.stdout:1/221: dread d0/d2/d6/f42 [0,4194304] 0 2024-03-22T07:28:29.774 INFO:tasks.workunit.client.1.smithi195.stdout:1/222: write d0/d2/d27/f30 [561035,12741] 0 2024-03-22T07:28:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:2/272: mkdir d2/d3/d7/d5c 0 2024-03-22T07:28:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:2/273: dread - d2/d3/d1a/f50 zero size 2024-03-22T07:28:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:2/274: truncate d2/d3/d7/d19/f33 2778861 0 2024-03-22T07:28:29.776 INFO:tasks.workunit.client.1.smithi195.stdout:2/275: creat d2/d3/d21/d40/f5d x:0 0 0 2024-03-22T07:28:29.777 INFO:tasks.workunit.client.0.smithi134.stdout:3/107: dwrite d4/d10/f14 [0,4194304] 0 2024-03-22T07:28:29.777 INFO:tasks.workunit.client.1.smithi195.stdout:4/340: write d13/d63/f47 [944105,26195] 0 2024-03-22T07:28:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:4/341: stat d13/d63/d79/c4c 0 2024-03-22T07:28:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:0/296: dwrite d1/d4/dd/df/f1d [0,4194304] 0 2024-03-22T07:28:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:0/297: write d1/d4/f7 [1872601,67901] 0 2024-03-22T07:28:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:0/298: readlink d1/d4/dd/df/d2b/l3d 0 2024-03-22T07:28:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:0/299: dread - d1/d4/dd/f3a zero size 2024-03-22T07:28:29.778 INFO:tasks.workunit.client.1.smithi195.stdout:3/335: rmdir d3/df/d50 39 2024-03-22T07:28:29.779 INFO:tasks.workunit.client.1.smithi195.stdout:6/324: write d5/d16/d45/d53/d17/d1a/f71 [490429,96580] 0 2024-03-22T07:28:29.781 INFO:tasks.workunit.client.1.smithi195.stdout:1/223: mknod d0/d2/d6/d21/d39/d40/c48 0 2024-03-22T07:28:29.787 INFO:tasks.workunit.client.1.smithi195.stdout:2/276: mknod d2/d3/d21/d40/c5e 0 2024-03-22T07:28:29.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/184: rename d2/c16 to d2/d25/c3b 0 2024-03-22T07:28:29.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/185: dread - d2/d15/f30 zero size 2024-03-22T07:28:29.799 INFO:tasks.workunit.client.0.smithi134.stdout:5/96: truncate d1/d4/f1a 4194028 0 2024-03-22T07:28:29.800 INFO:tasks.workunit.client.0.smithi134.stdout:4/186: dread f1 [0,4194304] 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:9/386: sync 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:7/270: sync 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:5/310: sync 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:8/332: sync 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:5/311: creat d9/d22/d50/f75 x:0 0 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:5/312: creat d9/d22/d50/f76 x:0 0 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:8/333: write da/f4f [1241757,69963] 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:4/342: getdents d13/d63 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:6/325: dwrite d5/f1e [0,4194304] 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:6/326: write d5/d16/d45/d53/d17/f4e [933828,56960] 0 2024-03-22T07:28:29.809 INFO:tasks.workunit.client.1.smithi195.stdout:6/327: chown d5/d5e/d34/d55/d4b 1989836 1 2024-03-22T07:28:29.810 INFO:tasks.workunit.client.1.smithi195.stdout:0/300: getdents d1/d10 0 2024-03-22T07:28:29.810 INFO:tasks.workunit.client.0.smithi134.stdout:2/101: mknod d2/c1f 0 2024-03-22T07:28:29.810 INFO:tasks.workunit.client.0.smithi134.stdout:5/97: dread d1/d8/f1b [0,4194304] 0 2024-03-22T07:28:29.811 INFO:tasks.workunit.client.1.smithi195.stdout:3/336: getdents d3/d22/d64 0 2024-03-22T07:28:29.814 INFO:tasks.workunit.client.0.smithi134.stdout:1/157: link d5/da/f12 d5/d1d/d2d/f37 0 2024-03-22T07:28:29.814 INFO:tasks.workunit.client.0.smithi134.stdout:1/158: fsync d5/fe 0 2024-03-22T07:28:29.814 INFO:tasks.workunit.client.0.smithi134.stdout:1/159: chown d5/da/d13/c28 124 1 2024-03-22T07:28:29.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/191: rmdir d1/d15/d42 39 2024-03-22T07:28:29.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/192: chown d1/d15/d42/d12/f35 6 1 2024-03-22T07:28:29.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/193: truncate d1/d15/f19 4560271 0 2024-03-22T07:28:29.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/194: readlink d1/d15/l1d 0 2024-03-22T07:28:29.820 INFO:tasks.workunit.client.0.smithi134.stdout:6/87: mknod d2/c1a 0 2024-03-22T07:28:29.827 INFO:tasks.workunit.client.1.smithi195.stdout:4/343: symlink d13/d63/d3e/d5c/l7b 0 2024-03-22T07:28:29.830 INFO:tasks.workunit.client.0.smithi134.stdout:4/187: symlink d2/d1d/l3c 0 2024-03-22T07:28:29.830 INFO:tasks.workunit.client.0.smithi134.stdout:4/188: stat d2/d15/d35/d37 0 2024-03-22T07:28:29.830 INFO:tasks.workunit.client.1.smithi195.stdout:6/328: rmdir d5/d5e/d34/d55/d4b 39 2024-03-22T07:28:29.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/329: read d5/d16/d45/d53/d17/f4e [168696,82099] 0 2024-03-22T07:28:29.831 INFO:tasks.workunit.client.0.smithi134.stdout:2/102: write d2/d5/fa [1836104,77515] 0 2024-03-22T07:28:29.832 INFO:tasks.workunit.client.1.smithi195.stdout:2/277: dwrite d2/d3/d7/da/de/f48 [0,4194304] 0 2024-03-22T07:28:29.834 INFO:tasks.workunit.client.1.smithi195.stdout:0/301: link d1/d4/dd/f51 d1/d4/d12/f55 0 2024-03-22T07:28:29.835 INFO:tasks.workunit.client.1.smithi195.stdout:9/387: dwrite d2/d4/d6/db/d20/d47/f73 [0,4194304] 0 2024-03-22T07:28:29.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/388: write f0 [2645772,64763] 0 2024-03-22T07:28:29.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/389: dread - d2/f82 zero size 2024-03-22T07:28:29.836 INFO:tasks.workunit.client.1.smithi195.stdout:3/337: creat d3/d22/d37/f78 x:0 0 0 2024-03-22T07:28:29.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/271: getdents d0/d13 0 2024-03-22T07:28:29.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/272: dread - d0/d13/d14/f4a zero size 2024-03-22T07:28:29.837 INFO:tasks.workunit.client.1.smithi195.stdout:7/273: truncate d0/d13/d14/d29/d35/d3a/f3e 670049 0 2024-03-22T07:28:29.838 INFO:tasks.workunit.client.0.smithi134.stdout:1/160: dwrite d5/fc [4194304,4194304] 0 2024-03-22T07:28:29.840 INFO:tasks.workunit.client.1.smithi195.stdout:5/313: mknod d9/c77 0 2024-03-22T07:28:29.840 INFO:tasks.workunit.client.1.smithi195.stdout:5/314: fdatasync d9/d2d/f40 0 2024-03-22T07:28:29.841 INFO:tasks.workunit.client.0.smithi134.stdout:7/298: truncate d1/f4 3916131 0 2024-03-22T07:28:29.841 INFO:tasks.workunit.client.0.smithi134.stdout:7/299: dread - d1/d19/d32/f4d zero size 2024-03-22T07:28:29.842 INFO:tasks.workunit.client.1.smithi195.stdout:8/334: symlink da/dc/l65 0 2024-03-22T07:28:29.844 INFO:tasks.workunit.client.0.smithi134.stdout:6/88: mkdir d2/d1b 0 2024-03-22T07:28:29.844 INFO:tasks.workunit.client.0.smithi134.stdout:6/89: creat d2/f1c x:0 0 0 2024-03-22T07:28:29.844 INFO:tasks.workunit.client.0.smithi134.stdout:6/90: write d2/f17 [244275,73854] 0 2024-03-22T07:28:29.846 INFO:tasks.workunit.client.1.smithi195.stdout:4/344: mknod d13/d63/d36/c7c 0 2024-03-22T07:28:29.848 INFO:tasks.workunit.client.0.smithi134.stdout:3/108: rmdir d4/d8 39 2024-03-22T07:28:29.851 INFO:tasks.workunit.client.0.smithi134.stdout:4/189: mknod d2/c3d 0 2024-03-22T07:28:29.852 INFO:tasks.workunit.client.0.smithi134.stdout:4/190: dread d2/d15/f1b [0,4194304] 0 2024-03-22T07:28:29.852 INFO:tasks.workunit.client.0.smithi134.stdout:4/191: stat d2/d1d/f24 0 2024-03-22T07:28:29.853 INFO:tasks.workunit.client.0.smithi134.stdout:4/192: write d2/d25/f2d [728084,28132] 0 2024-03-22T07:28:29.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/315: write d9/f11 [1107500,16821] 0 2024-03-22T07:28:29.854 INFO:tasks.workunit.client.1.smithi195.stdout:5/316: readlink d9/d12/d1d/d36/l5c 0 2024-03-22T07:28:29.855 INFO:tasks.workunit.client.0.smithi134.stdout:5/98: truncate d1/d4/f1a 2140484 0 2024-03-22T07:28:29.855 INFO:tasks.workunit.client.0.smithi134.stdout:5/99: creat d1/d8/f21 x:0 0 0 2024-03-22T07:28:29.856 INFO:tasks.workunit.client.1.smithi195.stdout:0/302: unlink d1/d4/dd/df/f1d 0 2024-03-22T07:28:29.856 INFO:tasks.workunit.client.1.smithi195.stdout:0/303: creat d1/d10/d19/d20/f56 x:0 0 0 2024-03-22T07:28:29.856 INFO:tasks.workunit.client.1.smithi195.stdout:0/304: chown d1/d4/dd/f51 11915565 1 2024-03-22T07:28:29.856 INFO:tasks.workunit.client.0.smithi134.stdout:8/195: mkdir d1/d46 0 2024-03-22T07:28:29.858 INFO:tasks.workunit.client.1.smithi195.stdout:2/278: dwrite d2/d3/f31 [0,4194304] 0 2024-03-22T07:28:29.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/274: dwrite d0/ff [0,4194304] 0 2024-03-22T07:28:29.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/279: creat d2/d3/d24/f5f x:0 0 0 2024-03-22T07:28:29.859 INFO:tasks.workunit.client.1.smithi195.stdout:2/280: write d2/d17/f44 [193688,50337] 0 2024-03-22T07:28:29.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/193: dread d2/d25/f2d [0,4194304] 0 2024-03-22T07:28:29.864 INFO:tasks.workunit.client.0.smithi134.stdout:1/161: link d5/f23 d5/d1d/d2d/f38 0 2024-03-22T07:28:29.866 INFO:tasks.workunit.client.1.smithi195.stdout:9/390: rename d2/d4/d6/db/d20/d4a/f7f to d2/d4/d1d/f8b 0 2024-03-22T07:28:29.868 INFO:tasks.workunit.client.0.smithi134.stdout:7/300: mkdir d1/de/d11/d2b/d69 0 2024-03-22T07:28:29.869 INFO:tasks.workunit.client.1.smithi195.stdout:3/338: chown d3/c2f 74874377 1 2024-03-22T07:28:29.869 INFO:tasks.workunit.client.1.smithi195.stdout:3/339: readlink d3/df/d15/d1d/l41 0 2024-03-22T07:28:29.869 INFO:tasks.workunit.client.1.smithi195.stdout:3/340: dread - d3/df/d15/d1d/d5c/f46 zero size 2024-03-22T07:28:29.869 INFO:tasks.workunit.client.0.smithi134.stdout:0/131: sync 2024-03-22T07:28:29.872 INFO:tasks.workunit.client.1.smithi195.stdout:8/335: mknod da/c66 0 2024-03-22T07:28:29.873 INFO:tasks.workunit.client.0.smithi134.stdout:3/109: creat d4/d22/f25 x:0 0 0 2024-03-22T07:28:29.873 INFO:tasks.workunit.client.0.smithi134.stdout:3/110: fdatasync d4/d10/f14 0 2024-03-22T07:28:29.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/317: dwrite d9/d2d/d58/f71 [0,4194304] 0 2024-03-22T07:28:29.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/318: write d9/d12/d1d/f5e [505978,22557] 0 2024-03-22T07:28:29.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/319: fsync d9/d2d/d58/f71 0 2024-03-22T07:28:29.875 INFO:tasks.workunit.client.1.smithi195.stdout:4/345: rmdir d13/d63/d79/d77 0 2024-03-22T07:28:29.876 INFO:tasks.workunit.client.0.smithi134.stdout:2/103: symlink d2/d5/l20 0 2024-03-22T07:28:29.878 INFO:tasks.workunit.client.1.smithi195.stdout:6/330: rmdir d5/d16/d5b 39 2024-03-22T07:28:29.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/346: dread d13/d63/f33 [0,4194304] 0 2024-03-22T07:28:29.883 INFO:tasks.workunit.client.0.smithi134.stdout:4/194: dwrite d2/d15/f39 [0,4194304] 0 2024-03-22T07:28:29.883 INFO:tasks.workunit.client.0.smithi134.stdout:4/195: creat d2/d25/f3e x:0 0 0 2024-03-22T07:28:29.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/196: write d2/d15/f13 [3323340,39115] 0 2024-03-22T07:28:29.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/197: chown d2/d15/f11 0 1 2024-03-22T07:28:29.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/198: stat d2/d2a 0 2024-03-22T07:28:29.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/199: write d2/d15/f13 [137792,99869] 0 2024-03-22T07:28:29.884 INFO:tasks.workunit.client.0.smithi134.stdout:4/200: read - d2/d25/f3e zero size 2024-03-22T07:28:29.887 INFO:tasks.workunit.client.1.smithi195.stdout:0/305: link d1/d10/d1f/d40/d43/f53 d1/d10/d1f/f57 0 2024-03-22T07:28:29.889 INFO:tasks.workunit.client.0.smithi134.stdout:8/196: unlink d1/d4/f6 0 2024-03-22T07:28:29.889 INFO:tasks.workunit.client.0.smithi134.stdout:8/197: creat d1/d4/f47 x:0 0 0 2024-03-22T07:28:29.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/198: dread - d1/d15/d42/d12/d20/f3c zero size 2024-03-22T07:28:29.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/199: readlink d1/d15/lb 0 2024-03-22T07:28:29.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/200: creat d1/d15/d42/d12/d20/d41/f48 x:0 0 0 2024-03-22T07:28:29.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/201: write d1/d15/d42/d12/d20/d41/f45 [180241,80725] 0 2024-03-22T07:28:29.896 INFO:tasks.workunit.client.0.smithi134.stdout:4/201: dread d2/d15/f39 [0,4194304] 0 2024-03-22T07:28:29.896 INFO:tasks.workunit.client.0.smithi134.stdout:4/202: stat d2/d1d/c2f 0 2024-03-22T07:28:29.897 INFO:tasks.workunit.client.0.smithi134.stdout:1/162: mkdir d5/da/d1b/d27/d39 0 2024-03-22T07:28:29.897 INFO:tasks.workunit.client.0.smithi134.stdout:1/163: chown d5/lf 1 1 2024-03-22T07:28:29.898 INFO:tasks.workunit.client.1.smithi195.stdout:2/281: mkdir d2/d3/d21/d60 0 2024-03-22T07:28:29.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/301: rmdir d1/d63 0 2024-03-22T07:28:29.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/302: chown d1/de/d11/f55 22 1 2024-03-22T07:28:29.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/303: chown d1/de/d11/d48 2 1 2024-03-22T07:28:29.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/304: readlink d1/de/d11/d48/d52/l14 0 2024-03-22T07:28:29.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/305: truncate d1/de/d41/f49 28271 0 2024-03-22T07:28:29.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/306: chown d1/de/l21 75499 1 2024-03-22T07:28:29.900 INFO:tasks.workunit.client.1.smithi195.stdout:7/275: rename d0/d13/d14/d20/d40/d56 to d0/d13/d22/d52/d59 0 2024-03-22T07:28:29.901 INFO:tasks.workunit.client.0.smithi134.stdout:3/111: link d4/d8/c9 d4/d22/c26 0 2024-03-22T07:28:29.902 INFO:tasks.workunit.client.1.smithi195.stdout:9/391: mkdir d2/d4/d32/d6d/d78/d8c 0 2024-03-22T07:28:29.904 INFO:tasks.workunit.client.1.smithi195.stdout:3/341: mknod d3/d22/d64/c79 0 2024-03-22T07:28:29.905 INFO:tasks.workunit.client.1.smithi195.stdout:5/320: dread f3 [0,4194304] 0 2024-03-22T07:28:29.905 INFO:tasks.workunit.client.0.smithi134.stdout:2/104: dwrite d2/d5/fc [0,4194304] 0 2024-03-22T07:28:29.905 INFO:tasks.workunit.client.0.smithi134.stdout:2/105: readlink d2/d5/l13 0 2024-03-22T07:28:29.906 INFO:tasks.workunit.client.0.smithi134.stdout:5/100: truncate d1/d4/f1a 1246031 0 2024-03-22T07:28:29.911 INFO:tasks.workunit.client.0.smithi134.stdout:8/202: mkdir d1/d15/d42/d49 0 2024-03-22T07:28:29.911 INFO:tasks.workunit.client.1.smithi195.stdout:5/321: write d9/f31 [1953638,37472] 0 2024-03-22T07:28:29.913 INFO:tasks.workunit.client.0.smithi134.stdout:4/203: link d2/d15/c38 d2/c3f 0 2024-03-22T07:28:29.916 INFO:tasks.workunit.client.0.smithi134.stdout:8/203: dread d1/d15/f5 [0,4194304] 0 2024-03-22T07:28:29.917 INFO:tasks.workunit.client.0.smithi134.stdout:1/164: rename d5/da/d1b/d27/c29 to d5/da/d13/d1e/d34/c3a 0 2024-03-22T07:28:29.918 INFO:tasks.workunit.client.0.smithi134.stdout:7/307: unlink d1/f3d 0 2024-03-22T07:28:29.921 INFO:tasks.workunit.client.0.smithi134.stdout:8/204: dread d1/d15/f5 [0,4194304] 0 2024-03-22T07:28:29.921 INFO:tasks.workunit.client.0.smithi134.stdout:8/205: creat d1/d4/f4a x:0 0 0 2024-03-22T07:28:29.921 INFO:tasks.workunit.client.0.smithi134.stdout:8/206: write d1/d4/f4a [334941,4677] 0 2024-03-22T07:28:29.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/112: mknod d4/d22/c27 0 2024-03-22T07:28:29.924 INFO:tasks.workunit.client.1.smithi195.stdout:4/347: unlink d13/d63/d21/l5e 0 2024-03-22T07:28:29.925 INFO:tasks.workunit.client.0.smithi134.stdout:5/101: symlink d1/d13/l22 0 2024-03-22T07:28:29.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/282: link d2/d3/l53 d2/d3/d7/d19/d22/d26/d3c/l61 0 2024-03-22T07:28:29.930 INFO:tasks.workunit.client.0.smithi134.stdout:4/204: rename d2/d25/f2d to d2/d15/f40 0 2024-03-22T07:28:29.933 INFO:tasks.workunit.client.0.smithi134.stdout:7/308: creat d1/de/d11/f6a x:0 0 0 2024-03-22T07:28:29.933 INFO:tasks.workunit.client.0.smithi134.stdout:7/309: write d1/f33 [1311697,125350] 0 2024-03-22T07:28:29.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/276: mknod d0/d13/d14/d29/d35/c5a 0 2024-03-22T07:28:29.936 INFO:tasks.workunit.client.1.smithi195.stdout:9/392: creat d2/d4/d23/f8d x:0 0 0 2024-03-22T07:28:29.936 INFO:tasks.workunit.client.1.smithi195.stdout:9/393: chown d2/d4/f3b 95 1 2024-03-22T07:28:29.936 INFO:tasks.workunit.client.1.smithi195.stdout:9/394: fdatasync d2/d4/d6/db/d20/d47/f73 0 2024-03-22T07:28:29.936 INFO:tasks.workunit.client.0.smithi134.stdout:3/113: symlink d4/d8/l28 0 2024-03-22T07:28:29.938 INFO:tasks.workunit.client.0.smithi134.stdout:4/205: mknod d2/d15/c41 0 2024-03-22T07:28:29.939 INFO:tasks.workunit.client.0.smithi134.stdout:4/206: write d2/ff [5268034,98621] 0 2024-03-22T07:28:29.939 INFO:tasks.workunit.client.0.smithi134.stdout:4/207: chown d2/d15/l29 31613166 1 2024-03-22T07:28:29.940 INFO:tasks.workunit.client.1.smithi195.stdout:5/322: rename d9/d12/d14/d3f to d9/d12/d1d/d69/d78 0 2024-03-22T07:28:29.942 INFO:tasks.workunit.client.1.smithi195.stdout:4/348: truncate d13/d2a/f70 416842 0 2024-03-22T07:28:29.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/114: truncate d4/d10/f11 1520023 0 2024-03-22T07:28:29.945 INFO:tasks.workunit.client.0.smithi134.stdout:7/310: rmdir d1/de/d11/d48/d52/d46 39 2024-03-22T07:28:29.945 INFO:tasks.workunit.client.0.smithi134.stdout:7/311: write d1/d19/d32/f4d [614481,30317] 0 2024-03-22T07:28:29.946 INFO:tasks.workunit.client.0.smithi134.stdout:7/312: creat d1/de/d11/d48/f6b x:0 0 0 2024-03-22T07:28:29.947 INFO:tasks.workunit.client.1.smithi195.stdout:9/395: mknod d2/c8e 0 2024-03-22T07:28:29.948 INFO:tasks.workunit.client.1.smithi195.stdout:2/283: link d2/d3/d7/da/de/c43 d2/d3/db/c62 0 2024-03-22T07:28:29.948 INFO:tasks.workunit.client.1.smithi195.stdout:7/277: mkdir d0/d13/d14/d5b 0 2024-03-22T07:28:29.948 INFO:tasks.workunit.client.1.smithi195.stdout:7/278: write d0/d13/d14/d2f/f43 [661950,122337] 0 2024-03-22T07:28:29.949 INFO:tasks.workunit.client.1.smithi195.stdout:2/284: dread d2/d3/d24/f39 [0,4194304] 0 2024-03-22T07:28:29.949 INFO:tasks.workunit.client.1.smithi195.stdout:9/396: mknod d2/d4/d23/c8f 0 2024-03-22T07:28:29.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/349: mkdir d13/d2a/d7d 0 2024-03-22T07:28:29.952 INFO:tasks.workunit.client.1.smithi195.stdout:2/285: rename d2/d3/l53 to d2/l63 0 2024-03-22T07:28:29.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/397: mknod d2/d4/c90 0 2024-03-22T07:28:29.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/398: readlink d2/d4/d23/l6b 0 2024-03-22T07:28:29.953 INFO:tasks.workunit.client.1.smithi195.stdout:4/350: mkdir d13/d2a/d7e 0 2024-03-22T07:28:29.957 INFO:tasks.workunit.client.1.smithi195.stdout:5/323: read d9/d2d/f51 [595354,113554] 0 2024-03-22T07:28:29.963 INFO:tasks.workunit.client.0.smithi134.stdout:0/132: dwrite dc/d18/f1d [0,4194304] 0 2024-03-22T07:28:29.964 INFO:tasks.workunit.client.0.smithi134.stdout:0/133: creat dc/de/f23 x:0 0 0 2024-03-22T07:28:29.964 INFO:tasks.workunit.client.0.smithi134.stdout:0/134: fdatasync dc/d18/f1b 0 2024-03-22T07:28:29.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/135: link dc/l11 dc/l24 0 2024-03-22T07:28:29.967 INFO:tasks.workunit.client.0.smithi134.stdout:0/136: creat dc/d18/f25 x:0 0 0 2024-03-22T07:28:29.969 INFO:tasks.workunit.client.1.smithi195.stdout:8/336: dwrite da/f4f [0,4194304] 0 2024-03-22T07:28:29.969 INFO:tasks.workunit.client.1.smithi195.stdout:8/337: chown da/dc/c41 1077 1 2024-03-22T07:28:29.970 INFO:tasks.workunit.client.0.smithi134.stdout:7/313: write d1/de/d11/d2b/d31/f43 [2487619,105907] 0 2024-03-22T07:28:29.970 INFO:tasks.workunit.client.0.smithi134.stdout:0/137: link dc/f20 dc/d18/f26 0 2024-03-22T07:28:29.973 INFO:tasks.workunit.client.0.smithi134.stdout:7/314: creat d1/de/d11/d2b/d69/f6c x:0 0 0 2024-03-22T07:28:29.973 INFO:tasks.workunit.client.0.smithi134.stdout:0/138: mknod dc/de/c27 0 2024-03-22T07:28:29.974 INFO:tasks.workunit.client.1.smithi195.stdout:4/351: dread d13/d63/d36/f50 [0,4194304] 0 2024-03-22T07:28:29.974 INFO:tasks.workunit.client.0.smithi134.stdout:7/315: link d1/de/c60 d1/c6d 0 2024-03-22T07:28:29.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/324: dread d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:29.975 INFO:tasks.workunit.client.1.smithi195.stdout:5/325: dread - d9/d12/d14/f17 zero size 2024-03-22T07:28:29.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/342: dwrite d3/df/d15/d1d/f31 [4194304,4194304] 0 2024-03-22T07:28:29.976 INFO:tasks.workunit.client.0.smithi134.stdout:0/139: rename dc/l24 to dc/de/l28 0 2024-03-22T07:28:29.976 INFO:tasks.workunit.client.0.smithi134.stdout:0/140: chown dc/l11 3 1 2024-03-22T07:28:29.976 INFO:tasks.workunit.client.1.smithi195.stdout:0/306: dwrite d1/d10/d19/d20/f48 [0,4194304] 0 2024-03-22T07:28:29.977 INFO:tasks.workunit.client.0.smithi134.stdout:7/316: symlink d1/de/d11/d48/d52/l6e 0 2024-03-22T07:28:29.977 INFO:tasks.workunit.client.1.smithi195.stdout:4/352: read - d13/d2a/f56 zero size 2024-03-22T07:28:29.979 INFO:tasks.workunit.client.0.smithi134.stdout:0/141: unlink l8 0 2024-03-22T07:28:29.979 INFO:tasks.workunit.client.0.smithi134.stdout:0/142: dread - dc/d17/f21 zero size 2024-03-22T07:28:29.981 INFO:tasks.workunit.client.1.smithi195.stdout:5/326: mknod d9/d22/c79 0 2024-03-22T07:28:29.981 INFO:tasks.workunit.client.1.smithi195.stdout:5/327: creat d9/d53/f7a x:0 0 0 2024-03-22T07:28:29.983 INFO:tasks.workunit.client.0.smithi134.stdout:0/143: dread f9 [0,4194304] 0 2024-03-22T07:28:29.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/307: mknod d1/d10/c58 0 2024-03-22T07:28:29.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/308: creat d1/d4/dd/f59 x:0 0 0 2024-03-22T07:28:29.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/309: chown d1/d10/d1f/d40/d43 495552300 1 2024-03-22T07:28:29.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/144: truncate f5 2905986 0 2024-03-22T07:28:29.993 INFO:tasks.workunit.client.1.smithi195.stdout:4/353: dread d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:29.994 INFO:tasks.workunit.client.0.smithi134.stdout:8/207: dwrite d1/d15/d42/d12/f37 [0,4194304] 0 2024-03-22T07:28:29.995 INFO:tasks.workunit.client.1.smithi195.stdout:4/354: creat d13/d63/d3e/f7f x:0 0 0 2024-03-22T07:28:29.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/310: dread d1/d10/d1f/f2c [0,4194304] 0 2024-03-22T07:28:29.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/311: write d1/d4/d12/f37 [730098,107770] 0 2024-03-22T07:28:29.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/312: write d1/d4/d12/f54 [1036645,124084] 0 2024-03-22T07:28:30.000 INFO:tasks.workunit.client.0.smithi134.stdout:8/208: dread d1/d15/d42/d12/d2a/f23 [0,4194304] 0 2024-03-22T07:28:30.000 INFO:tasks.workunit.client.0.smithi134.stdout:8/209: truncate d1/f24 1005230 0 2024-03-22T07:28:30.000 INFO:tasks.workunit.client.0.smithi134.stdout:8/210: fsync d1/d15/d42/f28 0 2024-03-22T07:28:30.002 INFO:tasks.workunit.client.1.smithi195.stdout:8/338: dwrite da/d17/d32/d61/d47/d53/f5e [0,4194304] 0 2024-03-22T07:28:30.003 INFO:tasks.workunit.client.1.smithi195.stdout:9/399: dwrite d2/d4/d6/db/d20/f5d [0,4194304] 0 2024-03-22T07:28:30.003 INFO:tasks.workunit.client.1.smithi195.stdout:9/400: creat d2/d4/d6/d18/d50/f91 x:0 0 0 2024-03-22T07:28:30.004 INFO:tasks.workunit.client.0.smithi134.stdout:2/106: dwrite d2/fe [0,4194304] 0 2024-03-22T07:28:30.004 INFO:tasks.workunit.client.0.smithi134.stdout:2/107: chown d2/d5/l1e 114416972 1 2024-03-22T07:28:30.004 INFO:tasks.workunit.client.0.smithi134.stdout:5/102: dwrite d1/d13/f1c [0,4194304] 0 2024-03-22T07:28:30.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/286: dwrite d2/f4d [0,4194304] 0 2024-03-22T07:28:30.005 INFO:tasks.workunit.client.1.smithi195.stdout:2/287: chown d2/d3/d21/d40/c5e 425 1 2024-03-22T07:28:30.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/313: rename d1/d4/dd/c45 to d1/d10/d19/d20/c5a 0 2024-03-22T07:28:30.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/314: stat d1/d4 0 2024-03-22T07:28:30.006 INFO:tasks.workunit.client.0.smithi134.stdout:4/208: dread d2/d15/f13 [0,4194304] 0 2024-03-22T07:28:30.007 INFO:tasks.workunit.client.0.smithi134.stdout:8/211: creat d1/f4b x:0 0 0 2024-03-22T07:28:30.013 INFO:tasks.workunit.client.1.smithi195.stdout:8/339: creat da/d17/d32/d61/d47/f67 x:0 0 0 2024-03-22T07:28:30.014 INFO:tasks.workunit.client.0.smithi134.stdout:3/115: dwrite f0 [0,4194304] 0 2024-03-22T07:28:30.014 INFO:tasks.workunit.client.0.smithi134.stdout:3/116: chown d4/d10/f14 0 1 2024-03-22T07:28:30.014 INFO:tasks.workunit.client.0.smithi134.stdout:3/117: chown d4/d8/f19 2086173 1 2024-03-22T07:28:30.015 INFO:tasks.workunit.client.0.smithi134.stdout:3/118: stat d4/d22/f20 0 2024-03-22T07:28:30.017 INFO:tasks.workunit.client.1.smithi195.stdout:5/328: dwrite d9/d12/d14/f17 [0,4194304] 0 2024-03-22T07:28:30.017 INFO:tasks.workunit.client.0.smithi134.stdout:8/212: symlink d1/d15/d42/d12/l4c 0 2024-03-22T07:28:30.017 INFO:tasks.workunit.client.0.smithi134.stdout:7/317: dwrite d1/f17 [0,4194304] 0 2024-03-22T07:28:30.017 INFO:tasks.workunit.client.0.smithi134.stdout:7/318: write d1/d19/f53 [320036,12865] 0 2024-03-22T07:28:30.018 INFO:tasks.workunit.client.0.smithi134.stdout:1/165: dwrite d5/da/f26 [0,4194304] 0 2024-03-22T07:28:30.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/213: dread d1/d15/d42/d12/f1a [0,4194304] 0 2024-03-22T07:28:30.019 INFO:tasks.workunit.client.0.smithi134.stdout:2/108: rename d2/d5/l13 to d2/d5/l21 0 2024-03-22T07:28:30.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/214: dread d1/d15/d42/d12/f35 [0,4194304] 0 2024-03-22T07:28:30.034 INFO:tasks.workunit.client.1.smithi195.stdout:2/288: truncate d2/d3/d7/d19/d22/d26/f2c 3459622 0 2024-03-22T07:28:30.034 INFO:tasks.workunit.client.0.smithi134.stdout:4/209: dwrite d2/d15/f1b [0,4194304] 0 2024-03-22T07:28:30.035 INFO:tasks.workunit.client.1.smithi195.stdout:7/279: dwrite d0/d13/d14/d2f/f43 [0,4194304] 0 2024-03-22T07:28:30.036 INFO:tasks.workunit.client.0.smithi134.stdout:7/319: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:30.037 INFO:tasks.workunit.client.1.smithi195.stdout:0/315: symlink d1/d10/l5b 0 2024-03-22T07:28:30.038 INFO:tasks.workunit.client.1.smithi195.stdout:0/316: chown d1/d4/dd/df/d44 246928 1 2024-03-22T07:28:30.042 INFO:tasks.workunit.client.1.smithi195.stdout:8/340: mknod da/de/c68 0 2024-03-22T07:28:30.042 INFO:tasks.workunit.client.1.smithi195.stdout:8/341: getdents da/de/d62 0 2024-03-22T07:28:30.042 INFO:tasks.workunit.client.1.smithi195.stdout:8/342: readlink da/d17/l4c 0 2024-03-22T07:28:30.043 INFO:tasks.workunit.client.0.smithi134.stdout:1/166: truncate d5/da/d1b/f1f 2818629 0 2024-03-22T07:28:30.043 INFO:tasks.workunit.client.1.smithi195.stdout:7/280: dread d0/d13/f1c [0,4194304] 0 2024-03-22T07:28:30.049 INFO:tasks.workunit.client.0.smithi134.stdout:2/109: dwrite d2/fe [0,4194304] 0 2024-03-22T07:28:30.051 INFO:tasks.workunit.client.1.smithi195.stdout:8/343: read f9 [2292396,97524] 0 2024-03-22T07:28:30.054 INFO:tasks.workunit.client.1.smithi195.stdout:5/329: mkdir d9/d22/d7b 0 2024-03-22T07:28:30.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/401: mknod d2/d4/c92 0 2024-03-22T07:28:30.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/402: fsync d2/d4/f3b 0 2024-03-22T07:28:30.057 INFO:tasks.workunit.client.1.smithi195.stdout:9/403: write d2/d4/d6/f49 [425074,60984] 0 2024-03-22T07:28:30.058 INFO:tasks.workunit.client.1.smithi195.stdout:5/330: write f5 [188606,122423] 0 2024-03-22T07:28:30.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/317: rmdir d1/d4/dd/df/d2b 39 2024-03-22T07:28:30.061 INFO:tasks.workunit.client.0.smithi134.stdout:2/110: write d2/fe [3915143,65936] 0 2024-03-22T07:28:30.061 INFO:tasks.workunit.client.0.smithi134.stdout:7/320: link d1/de/d11/d2b/d31/c5c d1/d19/d32/c6f 0 2024-03-22T07:28:30.061 INFO:tasks.workunit.client.0.smithi134.stdout:7/321: fsync d1/d19/f53 0 2024-03-22T07:28:30.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/224: sync 2024-03-22T07:28:30.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/225: write d0/d2/f14 [4799705,81798] 0 2024-03-22T07:28:30.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/226: truncate d0/d2/d27/f30 1031712 0 2024-03-22T07:28:30.062 INFO:tasks.workunit.client.1.smithi195.stdout:0/318: dread d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:30.062 INFO:tasks.workunit.client.1.smithi195.stdout:7/281: mknod d0/d13/d14/d2f/c5c 0 2024-03-22T07:28:30.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/282: read d0/f11 [4928644,83250] 0 2024-03-22T07:28:30.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/283: creat d0/d13/d14/d29/d35/d3a/f5d x:0 0 0 2024-03-22T07:28:30.064 INFO:tasks.workunit.client.1.smithi195.stdout:8/344: mknod da/c69 0 2024-03-22T07:28:30.067 INFO:tasks.workunit.client.1.smithi195.stdout:9/404: mknod d2/d4/d6/db/d20/d4a/c93 0 2024-03-22T07:28:30.067 INFO:tasks.workunit.client.1.smithi195.stdout:1/227: dread d0/f26 [0,4194304] 0 2024-03-22T07:28:30.067 INFO:tasks.workunit.client.0.smithi134.stdout:7/322: link d1/c5b d1/de/c70 0 2024-03-22T07:28:30.068 INFO:tasks.workunit.client.1.smithi195.stdout:5/331: truncate f0 508659 0 2024-03-22T07:28:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:0/319: rename d1/d10/d1f/c30 to d1/d10/d1f/d40/c5c 0 2024-03-22T07:28:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:5/332: rename d9 to d9/d3a/d5f/d7c 22 2024-03-22T07:28:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:5/333: fsync d9/d2d/f3b 0 2024-03-22T07:28:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:5/334: stat f7 0 2024-03-22T07:28:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:0/320: write d1/d10/d1f/f57 [4333648,82034] 0 2024-03-22T07:28:30.071 INFO:tasks.workunit.client.1.smithi195.stdout:0/321: write d1/d4/d12/f27 [5895950,78663] 0 2024-03-22T07:28:30.075 INFO:tasks.workunit.client.1.smithi195.stdout:7/284: unlink d0/c18 0 2024-03-22T07:28:30.075 INFO:tasks.workunit.client.1.smithi195.stdout:7/285: chown d0/d13/d14/d20/d40/c49 175929 1 2024-03-22T07:28:30.077 INFO:tasks.workunit.client.1.smithi195.stdout:8/345: mknod da/d17/d32/d61/c6a 0 2024-03-22T07:28:30.078 INFO:tasks.workunit.client.1.smithi195.stdout:8/346: write da/f56 [5195616,62395] 0 2024-03-22T07:28:30.078 INFO:tasks.workunit.client.1.smithi195.stdout:8/347: creat da/f6b x:0 0 0 2024-03-22T07:28:30.078 INFO:tasks.workunit.client.1.smithi195.stdout:8/348: write f9 [2906746,39120] 0 2024-03-22T07:28:30.078 INFO:tasks.workunit.client.1.smithi195.stdout:1/228: truncate d0/d2/d6/f42 2709045 0 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.1.smithi195.stdout:2/289: dwrite d2/d3/d7/da/d1b/f29 [0,4194304] 0 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.1.smithi195.stdout:2/290: chown d2/d3/d7/da/de/f48 902 1 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.0.smithi134.stdout:8/215: dwrite d1/d15/d42/d12/f35 [0,4194304] 0 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.0.smithi134.stdout:8/216: write d1/d4/f47 [643719,75136] 0 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.0.smithi134.stdout:8/217: fdatasync d1/d15/d42/d44/f3e 0 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.0.smithi134.stdout:5/103: dwrite d1/d13/f15 [0,4194304] 0 2024-03-22T07:28:30.081 INFO:tasks.workunit.client.0.smithi134.stdout:5/104: dread - d1/d13/f1e zero size 2024-03-22T07:28:30.082 INFO:tasks.workunit.client.1.smithi195.stdout:9/405: dwrite d2/d4/d6/db/d20/f5d [0,4194304] 0 2024-03-22T07:28:30.082 INFO:tasks.workunit.client.0.smithi134.stdout:1/167: dwrite f3 [0,4194304] 0 2024-03-22T07:28:30.084 INFO:tasks.workunit.client.1.smithi195.stdout:8/349: link f7 da/d17/d32/d61/d47/d53/f6c 0 2024-03-22T07:28:30.086 INFO:tasks.workunit.client.1.smithi195.stdout:0/322: read d1/d10/d19/d20/f48 [2359629,76894] 0 2024-03-22T07:28:30.087 INFO:tasks.workunit.client.1.smithi195.stdout:9/406: dread d2/d4/d6/db/f2c [0,4194304] 0 2024-03-22T07:28:30.087 INFO:tasks.workunit.client.1.smithi195.stdout:9/407: write d2/d4/f3b [4995908,35308] 0 2024-03-22T07:28:30.089 INFO:tasks.workunit.client.1.smithi195.stdout:4/355: fsync d13/d2a/f70 0 2024-03-22T07:28:30.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/291: creat d2/d1e/f64 x:0 0 0 2024-03-22T07:28:30.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/292: fdatasync d2/d3/d24/f39 0 2024-03-22T07:28:30.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/293: write d2/d3/d21/d40/f5b [502795,119371] 0 2024-03-22T07:28:30.093 INFO:tasks.workunit.client.1.smithi195.stdout:7/286: write d0/d13/f1e [3935770,14658] 0 2024-03-22T07:28:30.093 INFO:tasks.workunit.client.0.smithi134.stdout:1/168: write d5/da/f26 [208522,100394] 0 2024-03-22T07:28:30.100 INFO:tasks.workunit.client.0.smithi134.stdout:8/218: dwrite d1/d15/d42/d44/f3a [0,4194304] 0 2024-03-22T07:28:30.100 INFO:tasks.workunit.client.0.smithi134.stdout:8/219: write d1/d15/d42/d44/f3e [703065,29654] 0 2024-03-22T07:28:30.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/119: dread d4/d10/f11 [0,4194304] 0 2024-03-22T07:28:30.104 INFO:tasks.workunit.client.0.smithi134.stdout:8/220: mknod d1/d15/d42/d49/c4d 0 2024-03-22T07:28:30.106 INFO:tasks.workunit.client.0.smithi134.stdout:3/120: mkdir d4/d22/d29 0 2024-03-22T07:28:30.106 INFO:tasks.workunit.client.0.smithi134.stdout:3/121: chown d4/d8/f13 362330624 1 2024-03-22T07:28:30.106 INFO:tasks.workunit.client.0.smithi134.stdout:3/122: rename d4 to d4/d10/d2a 22 2024-03-22T07:28:30.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/323: mknod d1/d4/d22/d41/c5d 0 2024-03-22T07:28:30.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/324: readlink d1/d4/d12/l4e 0 2024-03-22T07:28:30.109 INFO:tasks.workunit.client.0.smithi134.stdout:1/169: dwrite d5/fb [0,4194304] 0 2024-03-22T07:28:30.113 INFO:tasks.workunit.client.0.smithi134.stdout:8/221: mknod d1/d15/d42/d12/d2a/c4e 0 2024-03-22T07:28:30.113 INFO:tasks.workunit.client.0.smithi134.stdout:0/145: rmdir dc/de 39 2024-03-22T07:28:30.114 INFO:tasks.workunit.client.1.smithi195.stdout:4/356: mknod d13/d63/d79/c80 0 2024-03-22T07:28:30.116 INFO:tasks.workunit.client.0.smithi134.stdout:3/123: link d4/d8/f12 d4/f2b 0 2024-03-22T07:28:30.116 INFO:tasks.workunit.client.0.smithi134.stdout:3/124: truncate d4/f2b 5528870 0 2024-03-22T07:28:30.116 INFO:tasks.workunit.client.0.smithi134.stdout:3/125: creat d4/d10/f2c x:0 0 0 2024-03-22T07:28:30.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/294: rmdir d2/d3/d7/d19/d22/d26/d3c 39 2024-03-22T07:28:30.120 INFO:tasks.workunit.client.0.smithi134.stdout:8/222: dread d1/d15/d42/d12/f35 [0,4194304] 0 2024-03-22T07:28:30.124 INFO:tasks.workunit.client.1.smithi195.stdout:0/325: link d1/d4/d12/l46 d1/d10/d19/d20/l5e 0 2024-03-22T07:28:30.124 INFO:tasks.workunit.client.1.smithi195.stdout:4/357: dread f6 [0,4194304] 0 2024-03-22T07:28:30.125 INFO:tasks.workunit.client.1.smithi195.stdout:4/358: chown d13/d2a/f28 0 1 2024-03-22T07:28:30.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/295: creat d2/d3/d7/da/de/f65 x:0 0 0 2024-03-22T07:28:30.128 INFO:tasks.workunit.client.1.smithi195.stdout:2/296: read - d2/d3/d1a/f37 zero size 2024-03-22T07:28:30.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/326: symlink d1/d4/d22/l5f 0 2024-03-22T07:28:30.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/146: creat dc/f29 x:0 0 0 2024-03-22T07:28:30.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/147: creat dc/d17/f2a x:0 0 0 2024-03-22T07:28:30.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/148: creat dc/d17/f2b x:0 0 0 2024-03-22T07:28:30.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/327: dread d1/d10/d1f/f2f [0,4194304] 0 2024-03-22T07:28:30.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/328: write d1/d4/dd/f3a [583384,94921] 0 2024-03-22T07:28:30.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/329: fdatasync d1/d4/dd/df/f16 0 2024-03-22T07:28:30.132 INFO:tasks.workunit.client.1.smithi195.stdout:4/359: mknod d13/d63/d36/c81 0 2024-03-22T07:28:30.134 INFO:tasks.workunit.client.1.smithi195.stdout:2/297: mknod d2/d3/d21/d40/c66 0 2024-03-22T07:28:30.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/298: creat d2/d3/d24/f67 x:0 0 0 2024-03-22T07:28:30.135 INFO:tasks.workunit.client.1.smithi195.stdout:2/299: write d2/f34 [472777,34600] 0 2024-03-22T07:28:30.137 INFO:tasks.workunit.client.1.smithi195.stdout:4/360: unlink d13/d63/d3e/d5c/l7b 0 2024-03-22T07:28:30.143 INFO:tasks.workunit.client.1.smithi195.stdout:2/300: mknod d2/d3/d7/d19/d22/c68 0 2024-03-22T07:28:30.143 INFO:tasks.workunit.client.1.smithi195.stdout:2/301: getdents d2/d3/d7/da/d1b 0 2024-03-22T07:28:30.146 INFO:tasks.workunit.client.0.smithi134.stdout:0/149: symlink dc/d17/l2c 0 2024-03-22T07:28:30.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/330: dwrite d1/d4/dd/f51 [0,4194304] 0 2024-03-22T07:28:30.147 INFO:tasks.workunit.client.1.smithi195.stdout:2/302: symlink d2/d3/l69 0 2024-03-22T07:28:30.150 INFO:tasks.workunit.client.0.smithi134.stdout:0/150: creat dc/f2d x:0 0 0 2024-03-22T07:28:30.150 INFO:tasks.workunit.client.0.smithi134.stdout:0/151: creat dc/d18/f2e x:0 0 0 2024-03-22T07:28:30.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/331: creat d1/d10/d1f/d40/d47/f60 x:0 0 0 2024-03-22T07:28:30.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/332: truncate d1/d4/d12/f37 1311918 0 2024-03-22T07:28:30.153 INFO:tasks.workunit.client.0.smithi134.stdout:2/111: rmdir d2 39 2024-03-22T07:28:30.153 INFO:tasks.workunit.client.0.smithi134.stdout:2/112: chown d2/d5/d8 47288782 1 2024-03-22T07:28:30.154 INFO:tasks.workunit.client.1.smithi195.stdout:4/361: dwrite d13/d63/d79/f45 [0,4194304] 0 2024-03-22T07:28:30.156 INFO:tasks.workunit.client.0.smithi134.stdout:2/113: unlink d2/c7 0 2024-03-22T07:28:30.157 INFO:tasks.workunit.client.1.smithi195.stdout:9/408: getdents d2/d4/d6/d18/d50 0 2024-03-22T07:28:30.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/362: rename d13/d63/f5a to d13/d63/d79/d68/f82 0 2024-03-22T07:28:30.166 INFO:tasks.workunit.client.0.smithi134.stdout:6/91: sync 2024-03-22T07:28:30.166 INFO:tasks.workunit.client.0.smithi134.stdout:9/97: sync 2024-03-22T07:28:30.167 INFO:tasks.workunit.client.1.smithi195.stdout:4/363: dread d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:30.167 INFO:tasks.workunit.client.1.smithi195.stdout:4/364: write d13/f1f [5042738,68662] 0 2024-03-22T07:28:30.168 INFO:tasks.workunit.client.0.smithi134.stdout:6/92: mkdir d2/d1b/d1d 0 2024-03-22T07:28:30.168 INFO:tasks.workunit.client.0.smithi134.stdout:6/93: chown d2/f1c 82129 1 2024-03-22T07:28:30.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/365: dread f11 [0,4194304] 0 2024-03-22T07:28:30.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/366: fdatasync d13/d63/d3e/f7f 0 2024-03-22T07:28:30.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/367: stat d13/d2a/d7e 0 2024-03-22T07:28:30.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/368: fsync d13/d63/d3e/f7f 0 2024-03-22T07:28:30.169 INFO:tasks.workunit.client.1.smithi195.stdout:9/409: mknod d2/d4/d6/d18/d50/c94 0 2024-03-22T07:28:30.173 INFO:tasks.workunit.client.1.smithi195.stdout:9/410: truncate d2/d4/f1a 1133190 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/98: dread d3/f4 [0,4194304] 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/99: creat d3/f25 x:0 0 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/100: creat d3/d9/df/f26 x:0 0 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/114: dwrite d2/d5/f10 [0,4194304] 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:2/115: truncate d2/d5/d8/f1b 1020396 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/101: creat d3/f27 x:0 0 0 2024-03-22T07:28:30.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/102: chown d3/d9/df/d12/d1b/c20 0 1 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/103: dread - d3/d9/df/d12/d1b/f24 zero size 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/104: write d3/d9/f18 [667768,36290] 0 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/105: fsync f0 0 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/106: creat d3/f28 x:0 0 0 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/107: creat d3/d9/df/d12/d1b/f29 x:0 0 0 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.1.smithi195.stdout:0/333: dwrite d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:30.176 INFO:tasks.workunit.client.1.smithi195.stdout:9/411: creat d2/d4/d6/d18/d50/d88/f95 x:0 0 0 2024-03-22T07:28:30.178 INFO:tasks.workunit.client.0.smithi134.stdout:6/94: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:30.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/412: link f1 d2/d4/d6/db/d20/d4a/f96 0 2024-03-22T07:28:30.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/413: chown d2/l45 4480620 1 2024-03-22T07:28:30.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/414: stat d2/d4/d32/d6d/d78 0 2024-03-22T07:28:30.183 INFO:tasks.workunit.client.1.smithi195.stdout:4/369: dwrite d13/d63/d3e/d5c/d65/f72 [0,4194304] 0 2024-03-22T07:28:30.184 INFO:tasks.workunit.client.1.smithi195.stdout:0/334: getdents d1/d10/d1f/d40/d43 0 2024-03-22T07:28:30.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/415: mkdir d2/d4/d32/d6d/d78/d79/d97 0 2024-03-22T07:28:30.194 INFO:tasks.workunit.client.0.smithi134.stdout:7/323: dwrite d1/de/d41/f49 [4194304,4194304] 0 2024-03-22T07:28:30.199 INFO:tasks.workunit.client.0.smithi134.stdout:9/108: rename d3/d9/df/f21 to d3/d9/df/d12/f2a 0 2024-03-22T07:28:30.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/95: mknod d2/c1e 0 2024-03-22T07:28:30.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/96: dread - d2/f1c zero size 2024-03-22T07:28:30.204 INFO:tasks.workunit.client.0.smithi134.stdout:2/116: mkdir d2/d5/d22 0 2024-03-22T07:28:30.207 INFO:tasks.workunit.client.0.smithi134.stdout:9/109: mknod d3/d9/df/c2b 0 2024-03-22T07:28:30.209 INFO:tasks.workunit.client.0.smithi134.stdout:6/97: mkdir d2/d1b/d1d/d1f 0 2024-03-22T07:28:30.209 INFO:tasks.workunit.client.1.smithi195.stdout:4/370: mkdir d13/d63/d36/d5f/d83 0 2024-03-22T07:28:30.209 INFO:tasks.workunit.client.1.smithi195.stdout:0/335: link d1/d4/dd/df/f16 d1/d10/d19/d20/f61 0 2024-03-22T07:28:30.209 INFO:tasks.workunit.client.1.smithi195.stdout:0/336: truncate d1/d10/d1f/d40/d47/f60 570447 0 2024-03-22T07:28:30.211 INFO:tasks.workunit.client.0.smithi134.stdout:2/117: creat d2/d5/d22/f23 x:0 0 0 2024-03-22T07:28:30.212 INFO:tasks.workunit.client.1.smithi195.stdout:9/416: dwrite d2/d4/d32/f54 [0,4194304] 0 2024-03-22T07:28:30.213 INFO:tasks.workunit.client.0.smithi134.stdout:9/110: mknod d3/d9/c2c 0 2024-03-22T07:28:30.215 INFO:tasks.workunit.client.0.smithi134.stdout:6/98: creat d2/d1b/d1d/d1f/f20 x:0 0 0 2024-03-22T07:28:30.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/118: stat d2/d5/d8/l15 0 2024-03-22T07:28:30.225 INFO:tasks.workunit.client.0.smithi134.stdout:2/119: rmdir d2/d5/d8 39 2024-03-22T07:28:30.226 INFO:tasks.workunit.client.1.smithi195.stdout:4/371: dwrite d13/d63/d79/f4e [0,4194304] 0 2024-03-22T07:28:30.226 INFO:tasks.workunit.client.0.smithi134.stdout:5/105: truncate d1/d4/f1a 2156927 0 2024-03-22T07:28:30.229 INFO:tasks.workunit.client.0.smithi134.stdout:5/106: rmdir d1/d13 39 2024-03-22T07:28:30.230 INFO:tasks.workunit.client.0.smithi134.stdout:3/126: getdents d4/d22 0 2024-03-22T07:28:30.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/107: link d1/d8/l1f d1/d13/l23 0 2024-03-22T07:28:30.232 INFO:tasks.workunit.client.1.smithi195.stdout:9/417: mknod d2/c98 0 2024-03-22T07:28:30.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/372: mknod d13/d63/d3e/d5c/d65/c84 0 2024-03-22T07:28:30.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/373: chown d13/d63/d79/l58 67498829 1 2024-03-22T07:28:30.237 INFO:tasks.workunit.client.1.smithi195.stdout:9/418: rename d2/d4/d6/d18/d50/d88/f95 to d2/d4/d32/d6d/d78/d79/f99 0 2024-03-22T07:28:30.237 INFO:tasks.workunit.client.1.smithi195.stdout:9/419: creat d2/d4/d6/d18/d50/d88/f9a x:0 0 0 2024-03-22T07:28:30.237 INFO:tasks.workunit.client.1.smithi195.stdout:4/374: mkdir d13/d2a/d7e/d85 0 2024-03-22T07:28:30.239 INFO:tasks.workunit.client.0.smithi134.stdout:1/170: truncate d5/fb 2148027 0 2024-03-22T07:28:30.239 INFO:tasks.workunit.client.0.smithi134.stdout:1/171: write d5/da/f26 [637687,48118] 0 2024-03-22T07:28:30.239 INFO:tasks.workunit.client.0.smithi134.stdout:1/172: dread - d5/da/d1b/f30 zero size 2024-03-22T07:28:30.239 INFO:tasks.workunit.client.0.smithi134.stdout:1/173: truncate d5/d1d/d2d/f32 213221 0 2024-03-22T07:28:30.239 INFO:tasks.workunit.client.0.smithi134.stdout:1/174: chown d5 16 1 2024-03-22T07:28:30.239 INFO:tasks.workunit.client.0.smithi134.stdout:1/175: write d5/fe [4709481,118619] 0 2024-03-22T07:28:30.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/420: mkdir d2/d4/d1d/d9b 0 2024-03-22T07:28:30.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/421: dread - d2/d4/d6/d18/d50/d88/f9a zero size 2024-03-22T07:28:30.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/422: creat d2/f9c x:0 0 0 2024-03-22T07:28:30.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/423: creat d2/d4/d6/db/f9d x:0 0 0 2024-03-22T07:28:30.241 INFO:tasks.workunit.client.0.smithi134.stdout:1/176: mknod d5/c3b 0 2024-03-22T07:28:30.245 INFO:tasks.workunit.client.0.smithi134.stdout:5/108: dread d1/d13/f1c [0,4194304] 0 2024-03-22T07:28:30.245 INFO:tasks.workunit.client.0.smithi134.stdout:7/324: dwrite d1/de/d11/d2b/d31/f43 [0,4194304] 0 2024-03-22T07:28:30.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/424: rename d2/d4/d6/db/d20/f5d to d2/d4/d32/d6d/f9e 0 2024-03-22T07:28:30.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/425: fsync d2/d4/d6/db/d20/d4a/f83 0 2024-03-22T07:28:30.248 INFO:tasks.workunit.client.0.smithi134.stdout:5/109: mknod d1/d8/c24 0 2024-03-22T07:28:30.250 INFO:tasks.workunit.client.0.smithi134.stdout:7/325: creat d1/de/d11/d48/d52/f71 x:0 0 0 2024-03-22T07:28:30.251 INFO:tasks.workunit.client.0.smithi134.stdout:7/326: chown d1/de/d11/d2b/c62 4 1 2024-03-22T07:28:30.251 INFO:tasks.workunit.client.0.smithi134.stdout:7/327: chown d1/de/d11/d2b/d31/f43 15002123 1 2024-03-22T07:28:30.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/99: dwrite d2/d1b/d1d/d1f/f20 [0,4194304] 0 2024-03-22T07:28:30.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/100: write d2/f17 [789633,111807] 0 2024-03-22T07:28:30.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/101: dread - d2/f1c zero size 2024-03-22T07:28:30.251 INFO:tasks.workunit.client.1.smithi195.stdout:0/337: dwrite d1/d4/f7 [0,4194304] 0 2024-03-22T07:28:30.252 INFO:tasks.workunit.client.1.smithi195.stdout:9/426: unlink d2/d4/d23/c42 0 2024-03-22T07:28:30.252 INFO:tasks.workunit.client.0.smithi134.stdout:3/127: dwrite d4/fd [0,4194304] 0 2024-03-22T07:28:30.254 INFO:tasks.workunit.client.0.smithi134.stdout:5/110: mknod d1/d8/c25 0 2024-03-22T07:28:30.256 INFO:tasks.workunit.client.0.smithi134.stdout:7/328: mknod d1/d19/c72 0 2024-03-22T07:28:30.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/338: creat d1/d10/d1f/d40/d43/f62 x:0 0 0 2024-03-22T07:28:30.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/375: dwrite d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:30.259 INFO:tasks.workunit.client.0.smithi134.stdout:1/177: dwrite d5/d1d/d2d/f32 [0,4194304] 0 2024-03-22T07:28:30.259 INFO:tasks.workunit.client.0.smithi134.stdout:7/329: dread d1/de/f5a [0,4194304] 0 2024-03-22T07:28:30.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/102: link d2/f1c d2/f21 0 2024-03-22T07:28:30.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/103: write d2/f21 [964916,69816] 0 2024-03-22T07:28:30.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/104: readlink d2/l18 0 2024-03-22T07:28:30.267 INFO:tasks.workunit.client.0.smithi134.stdout:5/111: symlink d1/d8/l26 0 2024-03-22T07:28:30.267 INFO:tasks.workunit.client.0.smithi134.stdout:5/112: dread - d1/d13/f1e zero size 2024-03-22T07:28:30.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/339: dread d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:30.269 INFO:tasks.workunit.client.0.smithi134.stdout:6/105: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:30.269 INFO:tasks.workunit.client.0.smithi134.stdout:6/106: chown d2/cc 36 1 2024-03-22T07:28:30.271 INFO:tasks.workunit.client.0.smithi134.stdout:1/178: write d5/d1d/d2d/f32 [2083279,24195] 0 2024-03-22T07:28:30.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/303: truncate d2/d3/d7/da/d1b/f29 2913588 0 2024-03-22T07:28:30.274 INFO:tasks.workunit.client.0.smithi134.stdout:6/107: dread d2/f1c [0,4194304] 0 2024-03-22T07:28:30.278 INFO:tasks.workunit.client.1.smithi195.stdout:4/376: dwrite d13/d63/f47 [0,4194304] 0 2024-03-22T07:28:30.278 INFO:tasks.workunit.client.1.smithi195.stdout:4/377: chown d13/d63/d36/c81 25 1 2024-03-22T07:28:30.278 INFO:tasks.workunit.client.1.smithi195.stdout:2/304: rename d2/d3/d24/f51 to d2/d3/d7/d19/f6a 0 2024-03-22T07:28:30.278 INFO:tasks.workunit.client.1.smithi195.stdout:2/305: creat d2/d3/d24/f6b x:0 0 0 2024-03-22T07:28:30.282 INFO:tasks.workunit.client.0.smithi134.stdout:7/330: mknod d1/de/d11/d2b/d69/c73 0 2024-03-22T07:28:30.283 INFO:tasks.workunit.client.1.smithi195.stdout:4/378: creat d13/d15/d6b/f86 x:0 0 0 2024-03-22T07:28:30.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/379: dread d13/d15/f1c [0,4194304] 0 2024-03-22T07:28:30.287 INFO:tasks.workunit.client.1.smithi195.stdout:2/306: truncate d2/d3/f5 1976882 0 2024-03-22T07:28:30.287 INFO:tasks.workunit.client.1.smithi195.stdout:2/307: fsync d2/d3/d21/d40/f5d 0 2024-03-22T07:28:30.287 INFO:tasks.workunit.client.0.smithi134.stdout:3/128: rmdir d4 39 2024-03-22T07:28:30.287 INFO:tasks.workunit.client.0.smithi134.stdout:3/129: write d4/d10/f14 [5194349,35132] 0 2024-03-22T07:28:30.288 INFO:tasks.workunit.client.1.smithi195.stdout:2/308: dread d2/d17/f44 [0,4194304] 0 2024-03-22T07:28:30.288 INFO:tasks.workunit.client.1.smithi195.stdout:4/380: readlink d13/d2a/l30 0 2024-03-22T07:28:30.293 INFO:tasks.workunit.client.1.smithi195.stdout:4/381: rename d13/d63/d79/f78 to d13/d2a/d7e/f87 0 2024-03-22T07:28:30.293 INFO:tasks.workunit.client.1.smithi195.stdout:4/382: write d13/d2a/d7e/f87 [526920,111325] 0 2024-03-22T07:28:30.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/179: mknod d5/da/c3c 0 2024-03-22T07:28:30.294 INFO:tasks.workunit.client.1.smithi195.stdout:2/309: rmdir d2/d3/d21/d40 39 2024-03-22T07:28:30.294 INFO:tasks.workunit.client.1.smithi195.stdout:2/310: stat d2/d3/d7/d19/d22/d26 0 2024-03-22T07:28:30.295 INFO:tasks.workunit.client.1.smithi195.stdout:2/311: read d2/d3/d24/f39 [740944,88107] 0 2024-03-22T07:28:30.296 INFO:tasks.workunit.client.1.smithi195.stdout:4/383: creat d13/d2a/f88 x:0 0 0 2024-03-22T07:28:30.297 INFO:tasks.workunit.client.0.smithi134.stdout:6/108: mknod d2/d1b/d1d/c22 0 2024-03-22T07:28:30.297 INFO:tasks.workunit.client.0.smithi134.stdout:6/109: chown d2/l9 357830856 1 2024-03-22T07:28:30.298 INFO:tasks.workunit.client.0.smithi134.stdout:7/331: mknod d1/de/d11/d48/d52/d46/c74 0 2024-03-22T07:28:30.299 INFO:tasks.workunit.client.1.smithi195.stdout:4/384: symlink d13/d63/d36/d5f/l89 0 2024-03-22T07:28:30.301 INFO:tasks.workunit.client.0.smithi134.stdout:1/180: symlink d5/l3d 0 2024-03-22T07:28:30.302 INFO:tasks.workunit.client.1.smithi195.stdout:4/385: symlink d13/d15/d64/l8a 0 2024-03-22T07:28:30.303 INFO:tasks.workunit.client.1.smithi195.stdout:0/340: rmdir d1/d10/d19/d20 39 2024-03-22T07:28:30.304 INFO:tasks.workunit.client.0.smithi134.stdout:9/111: getdents d3/d9/df 0 2024-03-22T07:28:30.304 INFO:tasks.workunit.client.0.smithi134.stdout:9/112: chown d3/f25 4709525 1 2024-03-22T07:28:30.304 INFO:tasks.workunit.client.0.smithi134.stdout:6/110: read d2/d1b/d1d/d1f/f20 [1727856,34382] 0 2024-03-22T07:28:30.304 INFO:tasks.workunit.client.0.smithi134.stdout:1/181: dread f1 [0,4194304] 0 2024-03-22T07:28:30.305 INFO:tasks.workunit.client.0.smithi134.stdout:6/111: mkdir d2/d1b/d23 0 2024-03-22T07:28:30.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/130: dwrite d4/f1a [0,4194304] 0 2024-03-22T07:28:30.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/131: chown d4/d22 3 1 2024-03-22T07:28:30.308 INFO:tasks.workunit.client.1.smithi195.stdout:0/341: dread d1/d4/dd/f3a [0,4194304] 0 2024-03-22T07:28:30.308 INFO:tasks.workunit.client.1.smithi195.stdout:0/342: write d1/d10/d1f/d40/d43/f62 [99172,69680] 0 2024-03-22T07:28:30.308 INFO:tasks.workunit.client.0.smithi134.stdout:1/182: creat d5/da/d13/d1e/d34/f3e x:0 0 0 2024-03-22T07:28:30.308 INFO:tasks.workunit.client.0.smithi134.stdout:1/183: write d5/f9 [169565,129538] 0 2024-03-22T07:28:30.308 INFO:tasks.workunit.client.0.smithi134.stdout:1/184: write d5/da/d13/d1e/d34/f3e [264987,100741] 0 2024-03-22T07:28:30.309 INFO:tasks.workunit.client.0.smithi134.stdout:6/112: unlink d2/lb 0 2024-03-22T07:28:30.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/343: mkdir d1/d4/dd/df/d2b/d63 0 2024-03-22T07:28:30.314 INFO:tasks.workunit.client.1.smithi195.stdout:0/344: chown d1/d10/d19/d20/f56 512556 1 2024-03-22T07:28:30.314 INFO:tasks.workunit.client.0.smithi134.stdout:3/132: rename d4/d10/l1d to d4/l2d 0 2024-03-22T07:28:30.314 INFO:tasks.workunit.client.0.smithi134.stdout:3/133: truncate d4/f1e 253156 0 2024-03-22T07:28:30.318 INFO:tasks.workunit.client.0.smithi134.stdout:7/332: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:30.318 INFO:tasks.workunit.client.0.smithi134.stdout:7/333: fsync d1/f3a 0 2024-03-22T07:28:30.319 INFO:tasks.workunit.client.0.smithi134.stdout:1/185: rename d5/da/f12 to d5/da/d13/f3f 0 2024-03-22T07:28:30.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/345: read d1/d10/d1f/d40/d43/f53 [1282819,69581] 0 2024-03-22T07:28:30.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/346: stat d1/d4/dd/f51 0 2024-03-22T07:28:30.322 INFO:tasks.workunit.client.0.smithi134.stdout:3/134: rename d4/f21 to d4/d22/d29/f2e 0 2024-03-22T07:28:30.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/427: getdents d2/d4/d32/d6d/d78/d79 0 2024-03-22T07:28:30.324 INFO:tasks.workunit.client.1.smithi195.stdout:9/428: stat d2/d4/d32/l77 0 2024-03-22T07:28:30.325 INFO:tasks.workunit.client.1.smithi195.stdout:0/347: link d1/d10/d1f/f2c d1/d10/d1f/f64 0 2024-03-22T07:28:30.326 INFO:tasks.workunit.client.1.smithi195.stdout:0/348: dread d1/d10/d1f/d40/d43/f4c [0,4194304] 0 2024-03-22T07:28:30.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/429: stat d2/d4/d6/l19 0 2024-03-22T07:28:30.328 INFO:tasks.workunit.client.0.smithi134.stdout:9/113: dwrite d3/d9/df/d12/d1b/f29 [0,4194304] 0 2024-03-22T07:28:30.329 INFO:tasks.workunit.client.0.smithi134.stdout:7/334: rename d1/d19/c3f to d1/d40/c75 0 2024-03-22T07:28:30.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/349: rename d1/d4/f39 to d1/d10/d19/f65 0 2024-03-22T07:28:30.331 INFO:tasks.workunit.client.1.smithi195.stdout:0/350: dread - d1/d10/d19/d20/f3c zero size 2024-03-22T07:28:30.331 INFO:tasks.workunit.client.1.smithi195.stdout:0/351: read d1/d10/d1f/d40/d43/f62 [108703,82011] 0 2024-03-22T07:28:30.331 INFO:tasks.workunit.client.0.smithi134.stdout:3/135: symlink d4/d8/d23/l2f 0 2024-03-22T07:28:30.332 INFO:tasks.workunit.client.1.smithi195.stdout:9/430: truncate d2/d4/d6/db/d20/d4a/f96 4050648 0 2024-03-22T07:28:30.332 INFO:tasks.workunit.client.0.smithi134.stdout:9/114: dread d3/f22 [0,4194304] 0 2024-03-22T07:28:30.333 INFO:tasks.workunit.client.0.smithi134.stdout:3/136: dread d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:30.334 INFO:tasks.workunit.client.1.smithi195.stdout:0/352: truncate d1/d10/d1f/f64 2877844 0 2024-03-22T07:28:30.338 INFO:tasks.workunit.client.0.smithi134.stdout:7/335: symlink d1/d19/d32/l76 0 2024-03-22T07:28:30.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/431: rename d2/d4/d6/db/d20/d4a/f71 to d2/d4/f9f 0 2024-03-22T07:28:30.342 INFO:tasks.workunit.client.0.smithi134.stdout:7/336: mknod d1/de/d41/c77 0 2024-03-22T07:28:30.343 INFO:tasks.workunit.client.0.smithi134.stdout:7/337: rename d1/d19/d32/c4a to d1/de/c78 0 2024-03-22T07:28:30.343 INFO:tasks.workunit.client.0.smithi134.stdout:7/338: chown d1/de/d41/c50 244569612 1 2024-03-22T07:28:30.343 INFO:tasks.workunit.client.0.smithi134.stdout:7/339: dread - d1/d19/f2f zero size 2024-03-22T07:28:30.358 INFO:tasks.workunit.client.0.smithi134.stdout:6/113: getdents d2/d1b/d1d 0 2024-03-22T07:28:30.377 INFO:tasks.workunit.client.1.smithi195.stdout:2/312: dwrite d2/d3/d7/da/d1b/f29 [0,4194304] 0 2024-03-22T07:28:30.418 INFO:tasks.workunit.client.1.smithi195.stdout:5/335: sync 2024-03-22T07:28:30.419 INFO:tasks.workunit.client.1.smithi195.stdout:3/343: sync 2024-03-22T07:28:30.419 INFO:tasks.workunit.client.1.smithi195.stdout:6/331: sync 2024-03-22T07:28:30.419 INFO:tasks.workunit.client.1.smithi195.stdout:6/332: stat d5/d5e/d34/d55/d3b/f50 0 2024-03-22T07:28:30.419 INFO:tasks.workunit.client.1.smithi195.stdout:6/333: truncate d5/d5e/d34/d55/d3b/f50 1031502 0 2024-03-22T07:28:30.419 INFO:tasks.workunit.client.1.smithi195.stdout:3/344: write d3/df/d15/d1d/d5c/d47/f4d [1036914,24621] 0 2024-03-22T07:28:30.419 INFO:tasks.workunit.client.1.smithi195.stdout:3/345: chown d3/df/l4b 167597 1 2024-03-22T07:28:30.420 INFO:tasks.workunit.client.1.smithi195.stdout:3/346: symlink d3/df/d15/d1d/d5c/d47/d67/l7a 0 2024-03-22T07:28:30.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/347: unlink d3/d22/d34/f42 0 2024-03-22T07:28:30.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/348: chown d3/df/d15/d1d/l38 2 1 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:7/287: sync 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:8/350: sync 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:8/351: stat da/d17/l1d 0 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/229: sync 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/230: stat d0/d2/fe 0 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/231: chown d0/d2/d27 70275296 1 2024-03-22T07:28:30.424 INFO:tasks.workunit.client.1.smithi195.stdout:3/349: mknod d3/d22/d37/c7b 0 2024-03-22T07:28:30.425 INFO:tasks.workunit.client.1.smithi195.stdout:7/288: creat d0/d13/d22/d52/f5e x:0 0 0 2024-03-22T07:28:30.426 INFO:tasks.workunit.client.1.smithi195.stdout:8/352: mknod da/d17/d32/d61/d47/d53/c6d 0 2024-03-22T07:28:30.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/289: creat d0/d13/d22/d52/d59/f5f x:0 0 0 2024-03-22T07:28:30.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/290: creat d0/d13/d14/d29/d35/f60 x:0 0 0 2024-03-22T07:28:30.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/291: write d0/d13/d22/d52/f5e [446060,34001] 0 2024-03-22T07:28:30.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/292: creat d0/d13/d14/d29/d35/d3a/f61 x:0 0 0 2024-03-22T07:28:30.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/293: chown d0/d13/d14/d2f/f43 0 1 2024-03-22T07:28:30.430 INFO:tasks.workunit.client.1.smithi195.stdout:8/353: creat da/dc/f6e x:0 0 0 2024-03-22T07:28:30.430 INFO:tasks.workunit.client.1.smithi195.stdout:8/354: write da/d17/d32/f59 [856507,26733] 0 2024-03-22T07:28:30.430 INFO:tasks.workunit.client.1.smithi195.stdout:1/232: write d0/d2/f14 [4640040,124091] 0 2024-03-22T07:28:30.432 INFO:tasks.workunit.client.0.smithi134.stdout:7/340: read d1/de/d11/f16 [246390,92288] 0 2024-03-22T07:28:30.438 INFO:tasks.workunit.client.1.smithi195.stdout:1/233: creat d0/d2/d6/d21/d41/d47/f49 x:0 0 0 2024-03-22T07:28:30.439 INFO:tasks.workunit.client.0.smithi134.stdout:7/341: dread d1/d19/d32/f4d [0,4194304] 0 2024-03-22T07:28:30.439 INFO:tasks.workunit.client.0.smithi134.stdout:7/342: fsync d1/d19/f2f 0 2024-03-22T07:28:30.440 INFO:tasks.workunit.client.1.smithi195.stdout:8/355: rename da/dc/f60 to da/dc/f6f 0 2024-03-22T07:28:30.440 INFO:tasks.workunit.client.1.smithi195.stdout:8/356: fdatasync da/d17/d32/f58 0 2024-03-22T07:28:30.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/137: getdents d4 0 2024-03-22T07:28:30.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/432: dwrite d2/d4/d1d/f40 [0,4194304] 0 2024-03-22T07:28:30.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/433: write d2/d4/f9f [1030234,90282] 0 2024-03-22T07:28:30.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/234: mkdir d0/d2/d6/d21/d41/d47/d4a 0 2024-03-22T07:28:30.441 INFO:tasks.workunit.client.0.smithi134.stdout:9/115: dwrite d3/f28 [0,4194304] 0 2024-03-22T07:28:30.442 INFO:tasks.workunit.client.1.smithi195.stdout:0/353: dwrite d1/d4/d12/f54 [0,4194304] 0 2024-03-22T07:28:30.442 INFO:tasks.workunit.client.1.smithi195.stdout:0/354: fsync d1/d4/dd/f13 0 2024-03-22T07:28:30.443 INFO:tasks.workunit.client.0.smithi134.stdout:3/138: creat d4/d22/d29/f30 x:0 0 0 2024-03-22T07:28:30.444 INFO:tasks.workunit.client.0.smithi134.stdout:6/114: dwrite d2/f17 [0,4194304] 0 2024-03-22T07:28:30.446 INFO:tasks.workunit.client.1.smithi195.stdout:8/357: rename da/d17/d32/l3d to da/d17/d32/d61/l70 0 2024-03-22T07:28:30.450 INFO:tasks.workunit.client.1.smithi195.stdout:3/350: dread d3/df/d15/d1d/d5c/d47/f66 [0,4194304] 0 2024-03-22T07:28:30.450 INFO:tasks.workunit.client.1.smithi195.stdout:3/351: stat d3/df/d15/d1d/d5c/f46 0 2024-03-22T07:28:30.450 INFO:tasks.workunit.client.1.smithi195.stdout:3/352: chown d3/d22/d34/f6d 128 1 2024-03-22T07:28:30.453 INFO:tasks.workunit.client.1.smithi195.stdout:5/336: dwrite d9/d2d/d58/f71 [0,4194304] 0 2024-03-22T07:28:30.453 INFO:tasks.workunit.client.1.smithi195.stdout:2/313: dwrite d2/d3/d7/da/de/f48 [0,4194304] 0 2024-03-22T07:28:30.455 INFO:tasks.workunit.client.1.smithi195.stdout:9/434: symlink d2/d4/d32/d6d/d78/la0 0 2024-03-22T07:28:30.456 INFO:tasks.workunit.client.1.smithi195.stdout:6/334: dwrite d5/d5e/d34/d55/d3b/d6e/d56/f77 [0,4194304] 0 2024-03-22T07:28:30.457 INFO:tasks.workunit.client.0.smithi134.stdout:9/116: unlink d3/d9/df/d12/d1b/f24 0 2024-03-22T07:28:30.458 INFO:tasks.workunit.client.1.smithi195.stdout:7/294: dwrite d0/d13/d14/d29/d35/d3a/f5d [0,4194304] 0 2024-03-22T07:28:30.468 INFO:tasks.workunit.client.1.smithi195.stdout:0/355: mkdir d1/d4/dd/d66 0 2024-03-22T07:28:30.469 INFO:tasks.workunit.client.0.smithi134.stdout:7/343: dwrite d1/de/f26 [0,4194304] 0 2024-03-22T07:28:30.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/115: creat d2/d1b/f24 x:0 0 0 2024-03-22T07:28:30.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/117: mkdir d3/d9/df/d12/d2d 0 2024-03-22T07:28:30.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/118: fdatasync d3/d9/df/d12/d1b/f29 0 2024-03-22T07:28:30.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/119: truncate d3/f27 1036854 0 2024-03-22T07:28:30.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/120: stat d3/d9/df/d12/d1b/f29 0 2024-03-22T07:28:30.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/121: creat d3/d9/df/d12/d1b/f2e x:0 0 0 2024-03-22T07:28:30.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/122: read d3/f22 [1048567,75311] 0 2024-03-22T07:28:30.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/123: creat d3/d9/df/d12/f2f x:0 0 0 2024-03-22T07:28:30.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/124: creat d3/d9/f30 x:0 0 0 2024-03-22T07:28:30.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/125: creat d3/f31 x:0 0 0 2024-03-22T07:28:30.475 INFO:tasks.workunit.client.0.smithi134.stdout:9/126: truncate d3/d9/df/f26 509637 0 2024-03-22T07:28:30.475 INFO:tasks.workunit.client.0.smithi134.stdout:6/116: write d2/f21 [758220,57629] 0 2024-03-22T07:28:30.475 INFO:tasks.workunit.client.0.smithi134.stdout:6/117: chown d2 218 1 2024-03-22T07:28:30.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/435: dread d2/d4/d32/f54 [0,4194304] 0 2024-03-22T07:28:30.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/436: truncate f1 4364109 0 2024-03-22T07:28:30.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/437: dread d2/d4/d32/f4b [0,4194304] 0 2024-03-22T07:28:30.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/344: symlink d1/de/d11/l79 0 2024-03-22T07:28:30.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/345: chown d1/de/d11/f55 218 1 2024-03-22T07:28:30.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/346: dread - d1/de/d11/d48/d52/f71 zero size 2024-03-22T07:28:30.477 INFO:tasks.workunit.client.1.smithi195.stdout:2/314: dwrite d2/d3/d7/da/de/f35 [0,4194304] 0 2024-03-22T07:28:30.477 INFO:tasks.workunit.client.0.smithi134.stdout:3/139: dwrite d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:30.477 INFO:tasks.workunit.client.0.smithi134.stdout:3/140: stat d4/d8/f13 0 2024-03-22T07:28:30.479 INFO:tasks.workunit.client.0.smithi134.stdout:4/210: sync 2024-03-22T07:28:30.480 INFO:tasks.workunit.client.0.smithi134.stdout:4/211: write d2/ff [3425869,19720] 0 2024-03-22T07:28:30.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/353: dwrite d3/df/d15/d1d/d5c/f3b [0,4194304] 0 2024-03-22T07:28:30.482 INFO:tasks.workunit.client.1.smithi195.stdout:3/354: stat d3/df/l4b 0 2024-03-22T07:28:30.487 INFO:tasks.workunit.client.0.smithi134.stdout:9/127: truncate d3/d9/f10 2135605 0 2024-03-22T07:28:30.489 INFO:tasks.workunit.client.1.smithi195.stdout:5/337: mkdir d9/d12/d1d/d36/d7d 0 2024-03-22T07:28:30.493 INFO:tasks.workunit.client.0.smithi134.stdout:2/120: sync 2024-03-22T07:28:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:0/152: sync 2024-03-22T07:28:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:8/223: sync 2024-03-22T07:28:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:0/153: dread - dc/f20 zero size 2024-03-22T07:28:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:8/224: chown d1/d15/d42/d44/f3e 16416039 1 2024-03-22T07:28:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:0/154: creat dc/d18/f2f x:0 0 0 2024-03-22T07:28:30.494 INFO:tasks.workunit.client.0.smithi134.stdout:0/155: chown dc/de/lf 138 1 2024-03-22T07:28:30.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/121: write d2/d5/fa [1795856,120837] 0 2024-03-22T07:28:30.495 INFO:tasks.workunit.client.1.smithi195.stdout:9/438: dwrite d2/d4/d23/d74/f76 [0,4194304] 0 2024-03-22T07:28:30.495 INFO:tasks.workunit.client.1.smithi195.stdout:9/439: fdatasync d2/d4/d1d/f3d 0 2024-03-22T07:28:30.497 INFO:tasks.workunit.client.1.smithi195.stdout:6/335: creat d5/d16/d5b/f79 x:0 0 0 2024-03-22T07:28:30.503 INFO:tasks.workunit.client.1.smithi195.stdout:7/295: symlink d0/d13/d22/d52/d59/l62 0 2024-03-22T07:28:30.503 INFO:tasks.workunit.client.1.smithi195.stdout:7/296: dread - d0/d13/d14/f4a zero size 2024-03-22T07:28:30.504 INFO:tasks.workunit.client.0.smithi134.stdout:7/347: dwrite d1/de/d11/d2b/d31/f5e [0,4194304] 0 2024-03-22T07:28:30.504 INFO:tasks.workunit.client.1.smithi195.stdout:2/315: dwrite d2/d3/d7/da/de/f48 [4194304,4194304] 0 2024-03-22T07:28:30.510 INFO:tasks.workunit.client.1.smithi195.stdout:1/235: rmdir d0/d2/d6 39 2024-03-22T07:28:30.510 INFO:tasks.workunit.client.1.smithi195.stdout:1/236: chown d0/d2/d6/cc 5722 1 2024-03-22T07:28:30.510 INFO:tasks.workunit.client.0.smithi134.stdout:6/118: getdents d2/d1b 0 2024-03-22T07:28:30.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/237: read d0/f26 [728500,30178] 0 2024-03-22T07:28:30.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/238: write d0/d2/f1f [2481845,37783] 0 2024-03-22T07:28:30.513 INFO:tasks.workunit.client.1.smithi195.stdout:1/239: write d0/f26 [459396,82340] 0 2024-03-22T07:28:30.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/336: write d5/d5e/d34/d55/f36 [1112000,19610] 0 2024-03-22T07:28:30.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/337: write d5/d5e/d34/d55/d4b/f4f [141271,11342] 0 2024-03-22T07:28:30.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/338: readlink d5/d5e/d34/d55/l66 0 2024-03-22T07:28:30.514 INFO:tasks.workunit.client.1.smithi195.stdout:6/339: truncate d5/d16/d45/d53/d17/d1a/f54 1336460 0 2024-03-22T07:28:30.515 INFO:tasks.workunit.client.0.smithi134.stdout:8/225: mknod d1/d15/d42/d12/d2a/c4f 0 2024-03-22T07:28:30.515 INFO:tasks.workunit.client.0.smithi134.stdout:8/226: chown d1/d4/d38/c3f 118429968 1 2024-03-22T07:28:30.516 INFO:tasks.workunit.client.0.smithi134.stdout:0/156: dwrite f4 [0,4194304] 0 2024-03-22T07:28:30.519 INFO:tasks.workunit.client.1.smithi195.stdout:7/297: write d0/d13/d22/f27 [3200673,59568] 0 2024-03-22T07:28:30.521 INFO:tasks.workunit.client.0.smithi134.stdout:8/227: dread d1/f24 [0,4194304] 0 2024-03-22T07:28:30.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/298: dread d0/d13/d22/d52/f5e [0,4194304] 0 2024-03-22T07:28:30.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/299: rename d0/d13/d14/d29 to d0/d13/d14/d29/d63 22 2024-03-22T07:28:30.524 INFO:tasks.workunit.client.1.smithi195.stdout:3/355: mknod d3/d22/d34/d70/c7c 0 2024-03-22T07:28:30.524 INFO:tasks.workunit.client.1.smithi195.stdout:3/356: creat d3/d22/d37/f7d x:0 0 0 2024-03-22T07:28:30.526 INFO:tasks.workunit.client.1.smithi195.stdout:3/357: write d3/df/d15/d1d/d5c/f2e [1047584,104836] 0 2024-03-22T07:28:30.527 INFO:tasks.workunit.client.0.smithi134.stdout:8/228: write d1/d15/d42/d12/f35 [3347734,66963] 0 2024-03-22T07:28:30.531 INFO:tasks.workunit.client.1.smithi195.stdout:8/358: mkdir da/dc/d71 0 2024-03-22T07:28:30.532 INFO:tasks.workunit.client.0.smithi134.stdout:7/348: symlink d1/de/d11/d48/d52/d46/l7a 0 2024-03-22T07:28:30.532 INFO:tasks.workunit.client.0.smithi134.stdout:7/349: readlink d1/d19/d32/l4c 0 2024-03-22T07:28:30.533 INFO:tasks.workunit.client.1.smithi195.stdout:5/338: rename d9/d12/d1d/d69/d78/f6b to d9/d12/d1d/d69/d78/f7e 0 2024-03-22T07:28:30.533 INFO:tasks.workunit.client.1.smithi195.stdout:5/339: fsync d9/f45 0 2024-03-22T07:28:30.535 INFO:tasks.workunit.client.0.smithi134.stdout:0/157: symlink dc/d18/l30 0 2024-03-22T07:28:30.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/158: unlink dc/f2d 0 2024-03-22T07:28:30.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/159: fdatasync f9 0 2024-03-22T07:28:30.539 INFO:tasks.workunit.client.1.smithi195.stdout:0/356: getdents d1/d10/d1f/d40/d47 0 2024-03-22T07:28:30.540 INFO:tasks.workunit.client.0.smithi134.stdout:0/160: mknod dc/d17/c31 0 2024-03-22T07:28:30.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/186: sync 2024-03-22T07:28:30.541 INFO:tasks.workunit.client.0.smithi134.stdout:5/113: sync 2024-03-22T07:28:30.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/187: write d5/da/d13/f3f [2324926,3993] 0 2024-03-22T07:28:30.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/188: write d5/da/d1b/f1c [1228557,54634] 0 2024-03-22T07:28:30.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/189: rename d5 to d5/da/d1b/d27/d39/d40 22 2024-03-22T07:28:30.541 INFO:tasks.workunit.client.0.smithi134.stdout:1/190: chown d5/c24 203513 1 2024-03-22T07:28:30.542 INFO:tasks.workunit.client.1.smithi195.stdout:1/240: link d0/d2/d6/f2f d0/d2/d6/f4b 0 2024-03-22T07:28:30.544 INFO:tasks.workunit.client.0.smithi134.stdout:5/114: rmdir d1/d4 39 2024-03-22T07:28:30.544 INFO:tasks.workunit.client.0.smithi134.stdout:5/115: getdents d1/d4 0 2024-03-22T07:28:30.544 INFO:tasks.workunit.client.1.smithi195.stdout:1/241: read d0/d2/d27/f30 [448856,96653] 0 2024-03-22T07:28:30.545 INFO:tasks.workunit.client.1.smithi195.stdout:1/242: chown d0/d2/l29 407941 1 2024-03-22T07:28:30.547 INFO:tasks.workunit.client.1.smithi195.stdout:7/300: unlink d0/d13/c17 0 2024-03-22T07:28:30.547 INFO:tasks.workunit.client.1.smithi195.stdout:7/301: write d0/d13/d14/d29/d35/f60 [619924,108303] 0 2024-03-22T07:28:30.547 INFO:tasks.workunit.client.1.smithi195.stdout:7/302: creat d0/d13/d22/d28/f64 x:0 0 0 2024-03-22T07:28:30.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/350: dread d1/f4 [0,4194304] 0 2024-03-22T07:28:30.548 INFO:tasks.workunit.client.0.smithi134.stdout:7/351: fdatasync d1/de/d11/d2b/d69/f6c 0 2024-03-22T07:28:30.548 INFO:tasks.workunit.client.0.smithi134.stdout:5/116: rename d1/d13/l22 to d1/d8/d20/l27 0 2024-03-22T07:28:30.551 INFO:tasks.workunit.client.0.smithi134.stdout:6/119: dwrite d2/f17 [0,4194304] 0 2024-03-22T07:28:30.552 INFO:tasks.workunit.client.1.smithi195.stdout:3/358: creat d3/df/d15/d1d/f7e x:0 0 0 2024-03-22T07:28:30.552 INFO:tasks.workunit.client.0.smithi134.stdout:5/117: truncate d1/d13/f15 791666 0 2024-03-22T07:28:30.554 INFO:tasks.workunit.client.1.smithi195.stdout:8/359: creat da/d17/d32/d61/f72 x:0 0 0 2024-03-22T07:28:30.554 INFO:tasks.workunit.client.1.smithi195.stdout:8/360: chown da/c69 2 1 2024-03-22T07:28:30.555 INFO:tasks.workunit.client.1.smithi195.stdout:2/316: dwrite d2/d3/d21/d40/f5d [0,4194304] 0 2024-03-22T07:28:30.555 INFO:tasks.workunit.client.1.smithi195.stdout:6/340: dwrite d5/d5e/d34/d55/d3b/d6e/d3c/f44 [4194304,4194304] 0 2024-03-22T07:28:30.559 INFO:tasks.workunit.client.0.smithi134.stdout:7/352: write d1/de/d11/d2b/d31/f5e [163165,14792] 0 2024-03-22T07:28:30.559 INFO:tasks.workunit.client.0.smithi134.stdout:2/122: dwrite d2/fe [0,4194304] 0 2024-03-22T07:28:30.559 INFO:tasks.workunit.client.0.smithi134.stdout:6/120: link d2/f1c d2/d1b/d1d/d1f/f25 0 2024-03-22T07:28:30.560 INFO:tasks.workunit.client.1.smithi195.stdout:9/440: getdents d2/d4/d23 0 2024-03-22T07:28:30.562 INFO:tasks.workunit.client.1.smithi195.stdout:0/357: stat d1/ce 0 2024-03-22T07:28:30.563 INFO:tasks.workunit.client.1.smithi195.stdout:8/361: dread da/f56 [0,4194304] 0 2024-03-22T07:28:30.564 INFO:tasks.workunit.client.0.smithi134.stdout:0/161: dwrite dc/d18/f26 [0,4194304] 0 2024-03-22T07:28:30.564 INFO:tasks.workunit.client.0.smithi134.stdout:5/118: unlink d1/d8/la 0 2024-03-22T07:28:30.567 INFO:tasks.workunit.client.1.smithi195.stdout:1/243: creat d0/d2/d6/d21/d41/d47/d4a/f4c x:0 0 0 2024-03-22T07:28:30.567 INFO:tasks.workunit.client.1.smithi195.stdout:1/244: readlink d0/l1c 0 2024-03-22T07:28:30.568 INFO:tasks.workunit.client.0.smithi134.stdout:1/191: dwrite d5/da/f2a [0,4194304] 0 2024-03-22T07:28:30.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/353: truncate d1/de/ff 2576304 0 2024-03-22T07:28:30.575 INFO:tasks.workunit.client.1.smithi195.stdout:2/317: read d2/d3/f31 [3440929,7504] 0 2024-03-22T07:28:30.575 INFO:tasks.workunit.client.0.smithi134.stdout:2/123: chown d2/d5/d8/f1b 1 1 2024-03-22T07:28:30.576 INFO:tasks.workunit.client.1.smithi195.stdout:7/303: truncate d0/d13/d14/f30 1919481 0 2024-03-22T07:28:30.577 INFO:tasks.workunit.client.1.smithi195.stdout:3/359: creat d3/df/f7f x:0 0 0 2024-03-22T07:28:30.577 INFO:tasks.workunit.client.1.smithi195.stdout:3/360: write d3/d22/d34/d70/f71 [287187,41715] 0 2024-03-22T07:28:30.578 INFO:tasks.workunit.client.0.smithi134.stdout:6/121: mknod d2/d1b/c26 0 2024-03-22T07:28:30.581 INFO:tasks.workunit.client.0.smithi134.stdout:5/119: dwrite d1/d4/f11 [0,4194304] 0 2024-03-22T07:28:30.588 INFO:tasks.workunit.client.0.smithi134.stdout:0/162: unlink dc/d18/f25 0 2024-03-22T07:28:30.594 INFO:tasks.workunit.client.0.smithi134.stdout:1/192: mknod d5/da/d13/d1e/d34/c41 0 2024-03-22T07:28:30.597 INFO:tasks.workunit.client.0.smithi134.stdout:6/122: rename d2/cc to d2/d1b/d1d/d1f/c27 0 2024-03-22T07:28:30.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/120: mknod d1/d8/d20/c28 0 2024-03-22T07:28:30.603 INFO:tasks.workunit.client.0.smithi134.stdout:0/163: creat dc/f32 x:0 0 0 2024-03-22T07:28:30.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/341: creat d5/d5e/d34/d55/f7a x:0 0 0 2024-03-22T07:28:30.606 INFO:tasks.workunit.client.0.smithi134.stdout:2/124: dwrite d2/d5/d8/f1b [0,4194304] 0 2024-03-22T07:28:30.608 INFO:tasks.workunit.client.1.smithi195.stdout:1/245: dwrite d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:30.609 INFO:tasks.workunit.client.1.smithi195.stdout:5/340: mkdir d9/d7f 0 2024-03-22T07:28:30.610 INFO:tasks.workunit.client.0.smithi134.stdout:1/193: mknod d5/c42 0 2024-03-22T07:28:30.612 INFO:tasks.workunit.client.1.smithi195.stdout:9/441: mknod d2/d4/d23/d74/ca1 0 2024-03-22T07:28:30.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/194: dread d5/d1d/d2d/f32 [0,4194304] 0 2024-03-22T07:28:30.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/195: write d5/fe [3896675,125715] 0 2024-03-22T07:28:30.618 INFO:tasks.workunit.client.1.smithi195.stdout:2/318: rename d2/d3/d21/d40/f5b to d2/d3/d7/d5c/f6c 0 2024-03-22T07:28:30.620 INFO:tasks.workunit.client.1.smithi195.stdout:7/304: truncate d0/d13/d14/d29/d35/f37 3064748 0 2024-03-22T07:28:30.620 INFO:tasks.workunit.client.1.smithi195.stdout:7/305: write d0/d13/d14/d20/f4b [70793,26608] 0 2024-03-22T07:28:30.621 INFO:tasks.workunit.client.0.smithi134.stdout:2/125: truncate d2/d5/f10 773283 0 2024-03-22T07:28:30.623 INFO:tasks.workunit.client.1.smithi195.stdout:3/361: getdents d3/df/d15/d1d/d5c/d47/d67 0 2024-03-22T07:28:30.626 INFO:tasks.workunit.client.0.smithi134.stdout:0/164: dwrite dc/f1f [0,4194304] 0 2024-03-22T07:28:30.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/342: write d5/d16/f43 [1648450,125239] 0 2024-03-22T07:28:30.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/341: dwrite d9/d12/d1d/d36/f49 [4194304,4194304] 0 2024-03-22T07:28:30.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/342: dread - d9/d22/d46/f63 zero size 2024-03-22T07:28:30.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/343: chown d9/d12/d1d/d69 352775123 1 2024-03-22T07:28:30.629 INFO:tasks.workunit.client.1.smithi195.stdout:5/344: stat d9/d22/d50/f76 0 2024-03-22T07:28:30.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/246: mknod d0/d2/d9/c4d 0 2024-03-22T07:28:30.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/247: chown d0/d2/d6 262711 1 2024-03-22T07:28:30.629 INFO:tasks.workunit.client.1.smithi195.stdout:1/248: write d0/d2/d9/f15 [4775493,5977] 0 2024-03-22T07:28:30.631 INFO:tasks.workunit.client.1.smithi195.stdout:9/442: truncate d2/d4/d6/d18/f3e 3467397 0 2024-03-22T07:28:30.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/306: creat d0/d13/d22/f65 x:0 0 0 2024-03-22T07:28:30.636 INFO:tasks.workunit.client.1.smithi195.stdout:3/362: unlink d3/d18/f39 0 2024-03-22T07:28:30.638 INFO:tasks.workunit.client.1.smithi195.stdout:6/343: creat d5/d6d/f7b x:0 0 0 2024-03-22T07:28:30.638 INFO:tasks.workunit.client.1.smithi195.stdout:6/344: creat d5/d16/d5b/f7c x:0 0 0 2024-03-22T07:28:30.638 INFO:tasks.workunit.client.1.smithi195.stdout:6/345: fsync d5/f51 0 2024-03-22T07:28:30.638 INFO:tasks.workunit.client.1.smithi195.stdout:7/307: dread d0/d13/d22/f27 [0,4194304] 0 2024-03-22T07:28:30.640 INFO:tasks.workunit.client.0.smithi134.stdout:2/126: dwrite d2/f1a [0,4194304] 0 2024-03-22T07:28:30.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/249: rename d0/d2/d27/l28 to d0/d2/l4e 0 2024-03-22T07:28:30.642 INFO:tasks.workunit.client.1.smithi195.stdout:5/345: write d9/d2d/d58/f71 [3062820,61905] 0 2024-03-22T07:28:30.642 INFO:tasks.workunit.client.1.smithi195.stdout:5/346: stat d9/d12/f47 0 2024-03-22T07:28:30.643 INFO:tasks.workunit.client.1.smithi195.stdout:9/443: rmdir d2/d4/d1d 39 2024-03-22T07:28:30.644 INFO:tasks.workunit.client.1.smithi195.stdout:3/363: dread d3/d22/d34/d70/f71 [0,4194304] 0 2024-03-22T07:28:30.644 INFO:tasks.workunit.client.1.smithi195.stdout:8/362: rmdir da/de/d62 0 2024-03-22T07:28:30.644 INFO:tasks.workunit.client.1.smithi195.stdout:8/363: creat da/d17/d32/d61/f73 x:0 0 0 2024-03-22T07:28:30.652 INFO:tasks.workunit.client.1.smithi195.stdout:9/444: mkdir d2/d4/d6/db/d20/d4a/da2 0 2024-03-22T07:28:30.655 INFO:tasks.workunit.client.1.smithi195.stdout:7/308: rmdir d0/d13/d14/d20/d40 39 2024-03-22T07:28:30.655 INFO:tasks.workunit.client.1.smithi195.stdout:1/250: read d0/d2/fe [3536745,15984] 0 2024-03-22T07:28:30.656 INFO:tasks.workunit.client.0.smithi134.stdout:6/123: rename d2/d1b/d1d/d1f to d2/d1b/d23/d28 0 2024-03-22T07:28:30.658 INFO:tasks.workunit.client.1.smithi195.stdout:9/445: link d2/d4/f3b d2/d4/d32/d6d/d78/fa3 0 2024-03-22T07:28:30.658 INFO:tasks.workunit.client.1.smithi195.stdout:5/347: dread d9/d12/d1d/d69/d78/f7e [4194304,4194304] 0 2024-03-22T07:28:30.659 INFO:tasks.workunit.client.1.smithi195.stdout:1/251: mknod d0/d2/d6/d21/d41/d47/c4f 0 2024-03-22T07:28:30.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/196: rename d5/d1d/d2d/f37 to d5/da/d13/d1e/d34/f43 0 2024-03-22T07:28:30.661 INFO:tasks.workunit.client.0.smithi134.stdout:1/197: readlink d5/l8 0 2024-03-22T07:28:30.661 INFO:tasks.workunit.client.0.smithi134.stdout:1/198: chown d5/da/d1b/f36 34 1 2024-03-22T07:28:30.661 INFO:tasks.workunit.client.1.smithi195.stdout:3/364: dread d3/fd [4194304,4194304] 0 2024-03-22T07:28:30.661 INFO:tasks.workunit.client.1.smithi195.stdout:8/364: dread da/f4e [0,4194304] 0 2024-03-22T07:28:30.662 INFO:tasks.workunit.client.1.smithi195.stdout:8/365: creat da/d17/d32/d61/f74 x:0 0 0 2024-03-22T07:28:30.664 INFO:tasks.workunit.client.1.smithi195.stdout:5/348: mknod d9/d12/d1d/d36/d7d/c80 0 2024-03-22T07:28:30.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/124: dread d2/f17 [0,4194304] 0 2024-03-22T07:28:30.666 INFO:tasks.workunit.client.0.smithi134.stdout:2/127: rename d2/d5/fa to d2/d5/d22/f24 0 2024-03-22T07:28:30.668 INFO:tasks.workunit.client.1.smithi195.stdout:1/252: mknod d0/d2/d9/c50 0 2024-03-22T07:28:30.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/386: sync 2024-03-22T07:28:30.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/199: creat d5/da/d13/d1e/f44 x:0 0 0 2024-03-22T07:28:30.670 INFO:tasks.workunit.client.0.smithi134.stdout:1/200: fsync d5/fc 0 2024-03-22T07:28:30.670 INFO:tasks.workunit.client.0.smithi134.stdout:1/201: readlink d5/ld 0 2024-03-22T07:28:30.670 INFO:tasks.workunit.client.0.smithi134.stdout:1/202: dread - d5/da/d1b/f30 zero size 2024-03-22T07:28:30.672 INFO:tasks.workunit.client.0.smithi134.stdout:6/125: dread d2/f8 [0,4194304] 0 2024-03-22T07:28:30.676 INFO:tasks.workunit.client.1.smithi195.stdout:7/309: dwrite d0/d13/d14/f30 [0,4194304] 0 2024-03-22T07:28:30.676 INFO:tasks.workunit.client.1.smithi195.stdout:7/310: write d0/d13/f1e [455747,105907] 0 2024-03-22T07:28:30.677 INFO:tasks.workunit.client.1.smithi195.stdout:7/311: write d0/d13/f1c [3585071,27197] 0 2024-03-22T07:28:30.677 INFO:tasks.workunit.client.1.smithi195.stdout:7/312: fsync d0/d13/d14/d29/d35/d3a/f5d 0 2024-03-22T07:28:30.677 INFO:tasks.workunit.client.0.smithi134.stdout:6/126: creat d2/d1b/f29 x:0 0 0 2024-03-22T07:28:30.681 INFO:tasks.workunit.client.1.smithi195.stdout:8/366: symlink da/d17/d32/d61/l75 0 2024-03-22T07:28:30.681 INFO:tasks.workunit.client.1.smithi195.stdout:5/349: creat d9/d7f/f81 x:0 0 0 2024-03-22T07:28:30.681 INFO:tasks.workunit.client.1.smithi195.stdout:4/387: symlink d13/d63/d3e/l8b 0 2024-03-22T07:28:30.681 INFO:tasks.workunit.client.1.smithi195.stdout:8/367: chown da/d17/d32/d61/d47/c5d 204471144 1 2024-03-22T07:28:30.681 INFO:tasks.workunit.client.0.smithi134.stdout:6/127: symlink d2/l2a 0 2024-03-22T07:28:30.681 INFO:tasks.workunit.client.0.smithi134.stdout:6/128: truncate d2/f8 4296313 0 2024-03-22T07:28:30.685 INFO:tasks.workunit.client.1.smithi195.stdout:9/446: dwrite d2/f9c [0,4194304] 0 2024-03-22T07:28:30.685 INFO:tasks.workunit.client.1.smithi195.stdout:9/447: creat d2/d4/d32/fa4 x:0 0 0 2024-03-22T07:28:30.685 INFO:tasks.workunit.client.1.smithi195.stdout:9/448: write d2/d4/d32/d6d/f6f [900719,16080] 0 2024-03-22T07:28:30.686 INFO:tasks.workunit.client.0.smithi134.stdout:6/129: mkdir d2/d1b/d1d/d2b 0 2024-03-22T07:28:30.687 INFO:tasks.workunit.client.1.smithi195.stdout:8/368: dread da/d17/d32/f40 [0,4194304] 0 2024-03-22T07:28:30.690 INFO:tasks.workunit.client.1.smithi195.stdout:4/388: mkdir d13/d2a/d7e/d8c 0 2024-03-22T07:28:30.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/130: creat d2/d1b/d23/f2c x:0 0 0 2024-03-22T07:28:30.691 INFO:tasks.workunit.client.0.smithi134.stdout:6/131: truncate d2/d1b/f29 348458 0 2024-03-22T07:28:30.693 INFO:tasks.workunit.client.1.smithi195.stdout:3/365: rename d3/d22/d37 to d3/df/d15/d1d/d5c/d47/d67/d80 0 2024-03-22T07:28:30.695 INFO:tasks.workunit.client.0.smithi134.stdout:1/203: dwrite d5/fe [0,4194304] 0 2024-03-22T07:28:30.695 INFO:tasks.workunit.client.0.smithi134.stdout:1/204: write d5/da/d1b/f1f [545421,106454] 0 2024-03-22T07:28:30.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/132: rename d2/d1b/d23/d28/c27 to d2/d1b/c2d 0 2024-03-22T07:28:30.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/133: creat d2/f2e x:0 0 0 2024-03-22T07:28:30.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/134: chown d2/l14 579 1 2024-03-22T07:28:30.697 INFO:tasks.workunit.client.0.smithi134.stdout:6/135: chown d2/d1b/c2d 212 1 2024-03-22T07:28:30.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/449: dread d2/d4/d1d/f22 [0,4194304] 0 2024-03-22T07:28:30.699 INFO:tasks.workunit.client.1.smithi195.stdout:8/369: write da/d17/f25 [1362719,70825] 0 2024-03-22T07:28:30.703 INFO:tasks.workunit.client.0.smithi134.stdout:2/128: dwrite d2/fe [4194304,4194304] 0 2024-03-22T07:28:30.703 INFO:tasks.workunit.client.0.smithi134.stdout:2/129: creat d2/d5/d22/f25 x:0 0 0 2024-03-22T07:28:30.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/205: mkdir d5/da/d13/d1e/d45 0 2024-03-22T07:28:30.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/206: truncate d5/da/d13/d1e/d34/f3e 925244 0 2024-03-22T07:28:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:30 smithi195 ceph-mon[36144]: pgmap v252: 65 pgs: 65 active+clean; 736 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 57 MiB/s rd, 80 MiB/s wr, 691 op/s 2024-03-22T07:28:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:30 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:30.706 INFO:tasks.workunit.client.1.smithi195.stdout:2/319: getdents d2/d3/d21/d40 0 2024-03-22T07:28:30.710 INFO:tasks.workunit.client.1.smithi195.stdout:4/389: dwrite d13/d63/d79/d68/f82 [0,4194304] 0 2024-03-22T07:28:30.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/136: rename d2/d1b/d23/f2c to d2/d1b/f2f 0 2024-03-22T07:28:30.711 INFO:tasks.workunit.client.0.smithi134.stdout:6/137: creat d2/d1b/d23/f30 x:0 0 0 2024-03-22T07:28:30.713 INFO:tasks.workunit.client.1.smithi195.stdout:1/253: rename d0/d2/d9/l1d to d0/d2/d6/d21/d41/d47/l51 0 2024-03-22T07:28:30.713 INFO:tasks.workunit.client.1.smithi195.stdout:1/254: write d0/d2/f1f [4838342,95759] 0 2024-03-22T07:28:30.718 INFO:tasks.workunit.client.1.smithi195.stdout:3/366: mknod d3/d22/d64/c81 0 2024-03-22T07:28:30.718 INFO:tasks.workunit.client.1.smithi195.stdout:3/367: write d3/df/d15/d1d/d5c/f44 [2153602,11648] 0 2024-03-22T07:28:30.720 INFO:tasks.workunit.client.1.smithi195.stdout:9/450: mknod d2/d4/d6/db/d20/d4a/ca5 0 2024-03-22T07:28:30.722 INFO:tasks.workunit.client.0.smithi134.stdout:1/207: symlink d5/da/d13/l46 0 2024-03-22T07:28:30.723 INFO:tasks.workunit.client.1.smithi195.stdout:8/370: getdents da/d17 0 2024-03-22T07:28:30.723 INFO:tasks.workunit.client.1.smithi195.stdout:8/371: write da/dc/f2b [1614507,86939] 0 2024-03-22T07:28:30.727 INFO:tasks.workunit.client.0.smithi134.stdout:6/138: mknod d2/d1b/d1d/d2b/c31 0 2024-03-22T07:28:30.733 INFO:tasks.workunit.client.1.smithi195.stdout:4/390: creat d13/d63/d36/f8d x:0 0 0 2024-03-22T07:28:30.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/255: mkdir d0/d2/d9/d52 0 2024-03-22T07:28:30.739 INFO:tasks.workunit.client.1.smithi195.stdout:1/256: creat d0/d2/d6/d21/d41/d47/d4a/f53 x:0 0 0 2024-03-22T07:28:30.740 INFO:tasks.workunit.client.1.smithi195.stdout:1/257: fsync d0/d2/f2e 0 2024-03-22T07:28:30.743 INFO:tasks.workunit.client.1.smithi195.stdout:1/258: dread d0/d2/d27/f30 [0,4194304] 0 2024-03-22T07:28:30.744 INFO:tasks.workunit.client.1.smithi195.stdout:1/259: fdatasync d0/d2/d6/f4b 0 2024-03-22T07:28:30.744 INFO:tasks.workunit.client.1.smithi195.stdout:7/313: rename d0/d13/d22/d28/l3b to d0/d13/d14/d2b/l66 0 2024-03-22T07:28:30.745 INFO:tasks.workunit.client.0.smithi134.stdout:1/208: symlink d5/da/d1b/l47 0 2024-03-22T07:28:30.747 INFO:tasks.workunit.client.0.smithi134.stdout:6/139: rename d2/f21 to d2/d1b/d23/f32 0 2024-03-22T07:28:30.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/368: mknod d3/df/d15/d1d/d5c/c82 0 2024-03-22T07:28:30.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/369: write d3/df/d15/d1d/f56 [2290691,110644] 0 2024-03-22T07:28:30.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/370: truncate d3/df/d15/d1d/d5c/d47/d67/d80/f78 422241 0 2024-03-22T07:28:30.749 INFO:tasks.workunit.client.1.smithi195.stdout:3/371: fsync d3/df/d15/d1d/d5c/f3b 0 2024-03-22T07:28:30.750 INFO:tasks.workunit.client.0.smithi134.stdout:6/140: unlink d2/d1b/d23/f30 0 2024-03-22T07:28:30.751 INFO:tasks.workunit.client.0.smithi134.stdout:1/209: dread d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:30.752 INFO:tasks.workunit.client.1.smithi195.stdout:9/451: truncate d2/d4/f9f 447928 0 2024-03-22T07:28:30.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/372: symlink da/d17/d32/d61/d47/d53/l76 0 2024-03-22T07:28:30.753 INFO:tasks.workunit.client.1.smithi195.stdout:8/373: chown da/l2c 56869 1 2024-03-22T07:28:30.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/210: symlink d5/da/d13/d1e/l48 0 2024-03-22T07:28:30.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/211: chown d5/f20 241 1 2024-03-22T07:28:30.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/212: chown d5/da/d13/d1e/f22 426 1 2024-03-22T07:28:30.755 INFO:tasks.workunit.client.0.smithi134.stdout:6/141: write d2/f17 [1693657,52238] 0 2024-03-22T07:28:30.755 INFO:tasks.workunit.client.0.smithi134.stdout:6/142: stat d2/d1b/f24 0 2024-03-22T07:28:30.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/213: mkdir d5/d1d/d49 0 2024-03-22T07:28:30.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/214: write d5/d1d/d2d/f38 [4091117,24203] 0 2024-03-22T07:28:30.759 INFO:tasks.workunit.client.1.smithi195.stdout:2/320: getdents d2/d1e 0 2024-03-22T07:28:30.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/391: creat d13/d2a/d7e/f8e x:0 0 0 2024-03-22T07:28:30.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/392: write d13/d63/d36/f50 [565892,86791] 0 2024-03-22T07:28:30.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/393: read d13/d15/f37 [1219,78622] 0 2024-03-22T07:28:30.762 INFO:tasks.workunit.client.0.smithi134.stdout:6/143: stat d2/l10 0 2024-03-22T07:28:30.764 INFO:tasks.workunit.client.0.smithi134.stdout:1/215: mknod d5/da/d13/c4a 0 2024-03-22T07:28:30.766 INFO:tasks.workunit.client.1.smithi195.stdout:1/260: mknod d0/d2/d9/d52/c54 0 2024-03-22T07:28:30.767 INFO:tasks.workunit.client.0.smithi134.stdout:6/144: creat d2/d1b/d23/d28/f33 x:0 0 0 2024-03-22T07:28:30.770 INFO:tasks.workunit.client.1.smithi195.stdout:3/372: dwrite d3/df/f7f [0,4194304] 0 2024-03-22T07:28:30.770 INFO:tasks.workunit.client.1.smithi195.stdout:3/373: truncate d3/d22/d34/f6d 368613 0 2024-03-22T07:28:30.770 INFO:tasks.workunit.client.1.smithi195.stdout:3/374: write d3/f35 [4095929,123152] 0 2024-03-22T07:28:30.770 INFO:tasks.workunit.client.1.smithi195.stdout:3/375: chown d3/df/d15/d1d/d5c/f46 2622 1 2024-03-22T07:28:30.770 INFO:tasks.workunit.client.1.smithi195.stdout:5/350: rename d9/d2d/l6e to d9/d12/d1d/l82 0 2024-03-22T07:28:30.771 INFO:tasks.workunit.client.1.smithi195.stdout:7/314: rename d0/d13 to d0/d13/d14/d5b/d67 22 2024-03-22T07:28:30.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/452: rename d2/d4/d23/c87 to d2/d4/d23/ca6 0 2024-03-22T07:28:30.772 INFO:tasks.workunit.client.1.smithi195.stdout:9/453: dread - d2/f63 zero size 2024-03-22T07:28:30.773 INFO:tasks.workunit.client.0.smithi134.stdout:6/145: mknod d2/c34 0 2024-03-22T07:28:30.774 INFO:tasks.workunit.client.0.smithi134.stdout:6/146: creat d2/f35 x:0 0 0 2024-03-22T07:28:30.774 INFO:tasks.workunit.client.1.smithi195.stdout:8/374: mknod da/de/c77 0 2024-03-22T07:28:30.774 INFO:tasks.workunit.client.1.smithi195.stdout:8/375: chown da/d17/l64 2 1 2024-03-22T07:28:30.775 INFO:tasks.workunit.client.1.smithi195.stdout:8/376: getdents da/dc/d71 0 2024-03-22T07:28:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/147: rename d2/c1a to d2/d1b/d23/d28/c36 0 2024-03-22T07:28:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/148: readlink d2/l2a 0 2024-03-22T07:28:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/149: truncate d2/f2e 568671 0 2024-03-22T07:28:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/150: truncate d2/d1b/f2f 167387 0 2024-03-22T07:28:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/151: write d2/f1c [805980,117157] 0 2024-03-22T07:28:30.781 INFO:tasks.workunit.client.0.smithi134.stdout:6/152: fsync d2/d1b/f24 0 2024-03-22T07:28:30.783 INFO:tasks.workunit.client.1.smithi195.stdout:3/376: rename d3/df/d15/d1d/f74 to d3/df/d15/d1d/d5c/f83 0 2024-03-22T07:28:30.783 INFO:tasks.workunit.client.1.smithi195.stdout:3/377: fsync d3/fd 0 2024-03-22T07:28:30.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/351: symlink d9/d12/d1d/d36/d7d/l83 0 2024-03-22T07:28:30.785 INFO:tasks.workunit.client.1.smithi195.stdout:5/352: readlink d9/d12/l18 0 2024-03-22T07:28:30.786 INFO:tasks.workunit.client.0.smithi134.stdout:1/216: dread d5/f23 [0,4194304] 0 2024-03-22T07:28:30.786 INFO:tasks.workunit.client.0.smithi134.stdout:6/153: rename d2/c34 to d2/d1b/d23/c37 0 2024-03-22T07:28:30.787 INFO:tasks.workunit.client.0.smithi134.stdout:6/154: fdatasync d2/d1b/d23/d28/f20 0 2024-03-22T07:28:30.787 INFO:tasks.workunit.client.0.smithi134.stdout:3/141: sync 2024-03-22T07:28:30.787 INFO:tasks.workunit.client.0.smithi134.stdout:4/212: sync 2024-03-22T07:28:30.789 INFO:tasks.workunit.client.1.smithi195.stdout:7/315: unlink d0/d13/d14/d20/d40/f4e 0 2024-03-22T07:28:30.789 INFO:tasks.workunit.client.1.smithi195.stdout:7/316: dread - d0/d13/d22/f65 zero size 2024-03-22T07:28:30.790 INFO:tasks.workunit.client.1.smithi195.stdout:7/317: readlink d0/d13/d14/d2f/l54 0 2024-03-22T07:28:30.790 INFO:tasks.workunit.client.1.smithi195.stdout:7/318: readlink d0/d13/d22/l2c 0 2024-03-22T07:28:30.790 INFO:tasks.workunit.client.1.smithi195.stdout:8/377: rmdir da/d17 39 2024-03-22T07:28:30.791 INFO:tasks.workunit.client.0.smithi134.stdout:6/155: rmdir d2/d1b/d1d 39 2024-03-22T07:28:30.793 INFO:tasks.workunit.client.1.smithi195.stdout:4/394: dwrite d13/d15/f6f [0,4194304] 0 2024-03-22T07:28:30.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/142: rename d4/d8/l28 to d4/d22/d29/l31 0 2024-03-22T07:28:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:30 smithi134 ceph-mon[29057]: pgmap v252: 65 pgs: 65 active+clean; 736 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 57 MiB/s rd, 80 MiB/s wr, 691 op/s 2024-03-22T07:28:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:30 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:30.795 INFO:tasks.workunit.client.1.smithi195.stdout:5/353: mkdir d9/d2d/d84 0 2024-03-22T07:28:30.796 INFO:tasks.workunit.client.0.smithi134.stdout:2/130: fsync d2/d5/d22/f24 0 2024-03-22T07:28:30.796 INFO:tasks.workunit.client.0.smithi134.stdout:2/131: truncate d2/d5/d22/f25 586274 0 2024-03-22T07:28:30.796 INFO:tasks.workunit.client.0.smithi134.stdout:2/132: fdatasync d2/f1c 0 2024-03-22T07:28:30.797 INFO:tasks.workunit.client.1.smithi195.stdout:2/321: dwrite d2/d3/d24/f5f [0,4194304] 0 2024-03-22T07:28:30.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/217: dread d5/da/d1b/f1f [0,4194304] 0 2024-03-22T07:28:30.797 INFO:tasks.workunit.client.1.smithi195.stdout:9/454: dwrite d2/d4/d6/db/f1f [0,4194304] 0 2024-03-22T07:28:30.797 INFO:tasks.workunit.client.0.smithi134.stdout:4/213: truncate d2/d15/f1b 1053443 0 2024-03-22T07:28:30.798 INFO:tasks.workunit.client.1.smithi195.stdout:3/378: dwrite d3/d18/f26 [0,4194304] 0 2024-03-22T07:28:30.798 INFO:tasks.workunit.client.1.smithi195.stdout:8/378: mkdir da/d17/d32/d78 0 2024-03-22T07:28:30.800 INFO:tasks.workunit.client.0.smithi134.stdout:6/156: dread d2/d1b/d23/f32 [0,4194304] 0 2024-03-22T07:28:30.800 INFO:tasks.workunit.client.0.smithi134.stdout:3/143: link d4/d8/f12 d4/d22/f32 0 2024-03-22T07:28:30.800 INFO:tasks.workunit.client.0.smithi134.stdout:6/157: dread d2/d1b/f2f [0,4194304] 0 2024-03-22T07:28:30.804 INFO:tasks.workunit.client.0.smithi134.stdout:2/133: chown d2/d5/d8/c12 19 1 2024-03-22T07:28:30.805 INFO:tasks.workunit.client.0.smithi134.stdout:2/134: creat d2/d5/d22/f26 x:0 0 0 2024-03-22T07:28:30.805 INFO:tasks.workunit.client.1.smithi195.stdout:4/395: creat d13/d63/d79/f8f x:0 0 0 2024-03-22T07:28:30.805 INFO:tasks.workunit.client.1.smithi195.stdout:4/396: creat d13/f90 x:0 0 0 2024-03-22T07:28:30.806 INFO:tasks.workunit.client.1.smithi195.stdout:5/354: creat d9/d22/d46/f85 x:0 0 0 2024-03-22T07:28:30.806 INFO:tasks.workunit.client.0.smithi134.stdout:1/218: mknod d5/d1d/d2d/c4b 0 2024-03-22T07:28:30.806 INFO:tasks.workunit.client.0.smithi134.stdout:1/219: truncate d5/f9 5027812 0 2024-03-22T07:28:30.806 INFO:tasks.workunit.client.0.smithi134.stdout:1/220: readlink d5/d1d/l25 0 2024-03-22T07:28:30.807 INFO:tasks.workunit.client.0.smithi134.stdout:4/214: rmdir d2/d1d 39 2024-03-22T07:28:30.807 INFO:tasks.workunit.client.1.smithi195.stdout:9/455: dread d2/f9 [0,4194304] 0 2024-03-22T07:28:30.807 INFO:tasks.workunit.client.1.smithi195.stdout:9/456: fdatasync d2/d4/d6/db/f30 0 2024-03-22T07:28:30.809 INFO:tasks.workunit.client.0.smithi134.stdout:6/158: write d2/f8 [2604785,85310] 0 2024-03-22T07:28:30.809 INFO:tasks.workunit.client.0.smithi134.stdout:6/159: read - d2/d1b/f24 zero size 2024-03-22T07:28:30.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/144: creat d4/d10/f33 x:0 0 0 2024-03-22T07:28:30.813 INFO:tasks.workunit.client.1.smithi195.stdout:2/322: creat d2/d3/d21/f6d x:0 0 0 2024-03-22T07:28:30.813 INFO:tasks.workunit.client.1.smithi195.stdout:2/323: creat d2/d3/d24/f6e x:0 0 0 2024-03-22T07:28:30.813 INFO:tasks.workunit.client.1.smithi195.stdout:2/324: write d2/d3/d21/d4c/f52 [1852994,34770] 0 2024-03-22T07:28:30.817 INFO:tasks.workunit.client.0.smithi134.stdout:1/221: symlink d5/da/d13/l4c 0 2024-03-22T07:28:30.819 INFO:tasks.workunit.client.0.smithi134.stdout:4/215: mknod d2/d15/d35/d37/c42 0 2024-03-22T07:28:30.820 INFO:tasks.workunit.client.0.smithi134.stdout:6/160: mknod d2/d1b/d1d/d2b/c38 0 2024-03-22T07:28:30.821 INFO:tasks.workunit.client.1.smithi195.stdout:8/379: dwrite da/d17/d32/d61/f74 [0,4194304] 0 2024-03-22T07:28:30.822 INFO:tasks.workunit.client.0.smithi134.stdout:2/135: mkdir d2/d5/d8/d27 0 2024-03-22T07:28:30.824 INFO:tasks.workunit.client.1.smithi195.stdout:3/379: creat d3/f84 x:0 0 0 2024-03-22T07:28:30.824 INFO:tasks.workunit.client.1.smithi195.stdout:4/397: dwrite d13/d63/d79/f53 [0,4194304] 0 2024-03-22T07:28:30.825 INFO:tasks.workunit.client.0.smithi134.stdout:4/216: mkdir d2/d15/d35/d37/d43 0 2024-03-22T07:28:30.827 INFO:tasks.workunit.client.0.smithi134.stdout:6/161: rename d2/c19 to d2/d1b/d1d/d2b/c39 0 2024-03-22T07:28:30.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/217: dread d2/ff [4194304,4194304] 0 2024-03-22T07:28:30.829 INFO:tasks.workunit.client.0.smithi134.stdout:3/145: dwrite d4/d10/f11 [0,4194304] 0 2024-03-22T07:28:30.830 INFO:tasks.workunit.client.0.smithi134.stdout:3/146: chown d4/ce 7 1 2024-03-22T07:28:30.830 INFO:tasks.workunit.client.0.smithi134.stdout:3/147: stat d4/d22/f25 0 2024-03-22T07:28:30.830 INFO:tasks.workunit.client.0.smithi134.stdout:3/148: fsync d4/d10/f11 0 2024-03-22T07:28:30.830 INFO:tasks.workunit.client.0.smithi134.stdout:2/136: rmdir d2/d5/d8/d27 0 2024-03-22T07:28:30.831 INFO:tasks.workunit.client.0.smithi134.stdout:1/222: dread f4 [0,4194304] 0 2024-03-22T07:28:30.831 INFO:tasks.workunit.client.0.smithi134.stdout:2/137: stat d2/d5/l20 0 2024-03-22T07:28:30.831 INFO:tasks.workunit.client.0.smithi134.stdout:1/223: truncate d5/f23 4743602 0 2024-03-22T07:28:30.832 INFO:tasks.workunit.client.0.smithi134.stdout:6/162: creat d2/d1b/d1d/d2b/f3a x:0 0 0 2024-03-22T07:28:30.833 INFO:tasks.workunit.client.1.smithi195.stdout:5/355: unlink d9/d12/c37 0 2024-03-22T07:28:30.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/356: write d9/f6f [426514,43989] 0 2024-03-22T07:28:30.834 INFO:tasks.workunit.client.1.smithi195.stdout:5/357: fsync d9/d2d/f40 0 2024-03-22T07:28:30.834 INFO:tasks.workunit.client.1.smithi195.stdout:4/398: dread d13/d2a/f28 [0,4194304] 0 2024-03-22T07:28:30.839 INFO:tasks.workunit.client.0.smithi134.stdout:4/218: rename d2/d15/d35/d37/c3a to d2/d25/c44 0 2024-03-22T07:28:30.841 INFO:tasks.workunit.client.1.smithi195.stdout:9/457: mknod d2/d4/d32/d6d/d78/d79/d97/ca7 0 2024-03-22T07:28:30.842 INFO:tasks.workunit.client.1.smithi195.stdout:5/358: read d9/fb [1524236,58237] 0 2024-03-22T07:28:30.842 INFO:tasks.workunit.client.1.smithi195.stdout:5/359: fdatasync d9/d12/d1d/d36/f49 0 2024-03-22T07:28:30.846 INFO:tasks.workunit.client.0.smithi134.stdout:1/224: dwrite d5/fe [0,4194304] 0 2024-03-22T07:28:30.847 INFO:tasks.workunit.client.0.smithi134.stdout:1/225: chown d5/da/f26 26928 1 2024-03-22T07:28:30.847 INFO:tasks.workunit.client.1.smithi195.stdout:2/325: rename d2/d3/d7/d19/f6a to d2/d3/d7/d19/d22/d26/f6f 0 2024-03-22T07:28:30.847 INFO:tasks.workunit.client.1.smithi195.stdout:2/326: chown d2/d3/d24/l4a 73530 1 2024-03-22T07:28:30.847 INFO:tasks.workunit.client.1.smithi195.stdout:2/327: dread - d2/d3/d7/da/d4e/f56 zero size 2024-03-22T07:28:30.852 INFO:tasks.workunit.client.1.smithi195.stdout:8/380: link da/c69 da/d17/d32/d78/c79 0 2024-03-22T07:28:30.852 INFO:tasks.workunit.client.1.smithi195.stdout:8/381: readlink da/dc/l28 0 2024-03-22T07:28:30.854 INFO:tasks.workunit.client.1.smithi195.stdout:3/380: rmdir d3/df/d50 39 2024-03-22T07:28:30.856 INFO:tasks.workunit.client.1.smithi195.stdout:1/261: truncate d0/d2/f1f 4316839 0 2024-03-22T07:28:30.856 INFO:tasks.workunit.client.1.smithi195.stdout:5/360: dwrite d9/f1c [4194304,4194304] 0 2024-03-22T07:28:30.856 INFO:tasks.workunit.client.1.smithi195.stdout:5/361: fdatasync d9/f28 0 2024-03-22T07:28:30.858 INFO:tasks.workunit.client.0.smithi134.stdout:6/163: link d2/l11 d2/l3b 0 2024-03-22T07:28:30.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/219: rename d2/l32 to d2/d2a/l45 0 2024-03-22T07:28:30.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/220: creat d2/f46 x:0 0 0 2024-03-22T07:28:30.861 INFO:tasks.workunit.client.0.smithi134.stdout:4/221: truncate d2/d15/f30 550608 0 2024-03-22T07:28:30.863 INFO:tasks.workunit.client.0.smithi134.stdout:1/226: getdents d5/da/d1b/d27 0 2024-03-22T07:28:30.863 INFO:tasks.workunit.client.0.smithi134.stdout:1/227: truncate d5/da/d13/d1e/d34/f3e 1850008 0 2024-03-22T07:28:30.863 INFO:tasks.workunit.client.0.smithi134.stdout:1/228: creat d5/f4d x:0 0 0 2024-03-22T07:28:30.863 INFO:tasks.workunit.client.0.smithi134.stdout:1/229: chown d5/da/f2a 694 1 2024-03-22T07:28:30.863 INFO:tasks.workunit.client.1.smithi195.stdout:0/358: sync 2024-03-22T07:28:30.864 INFO:tasks.workunit.client.1.smithi195.stdout:9/458: mkdir d2/d4/d6/db/da8 0 2024-03-22T07:28:30.865 INFO:tasks.workunit.client.1.smithi195.stdout:2/328: dread d2/f4d [0,4194304] 0 2024-03-22T07:28:30.865 INFO:tasks.workunit.client.1.smithi195.stdout:2/329: write d2/d3/f31 [2552756,70670] 0 2024-03-22T07:28:30.866 INFO:tasks.workunit.client.0.smithi134.stdout:6/164: mknod d2/d1b/d1d/d2b/c3c 0 2024-03-22T07:28:30.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/382: truncate da/d17/d32/d61/d47/d53/f6c 2639251 0 2024-03-22T07:28:30.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/383: write f9 [3286599,9707] 0 2024-03-22T07:28:30.868 INFO:tasks.workunit.client.1.smithi195.stdout:8/384: read da/dc/f6f [975265,55482] 0 2024-03-22T07:28:30.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/399: dwrite d13/d63/d79/d68/f82 [4194304,4194304] 0 2024-03-22T07:28:30.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/400: stat d13/d2a/f56 0 2024-03-22T07:28:30.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/381: creat d3/d22/d34/d76/f85 x:0 0 0 2024-03-22T07:28:30.873 INFO:tasks.workunit.client.1.smithi195.stdout:1/262: mknod d0/d2/d6/d21/d32/c55 0 2024-03-22T07:28:30.873 INFO:tasks.workunit.client.1.smithi195.stdout:1/263: truncate d0/d2/d6/d21/d41/d47/d4a/f4c 183247 0 2024-03-22T07:28:30.874 INFO:tasks.workunit.client.0.smithi134.stdout:4/222: mknod d2/d15/c47 0 2024-03-22T07:28:30.876 INFO:tasks.workunit.client.1.smithi195.stdout:5/362: symlink d9/d12/l86 0 2024-03-22T07:28:30.876 INFO:tasks.workunit.client.1.smithi195.stdout:5/363: read - d9/d2d/f65 zero size 2024-03-22T07:28:30.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/230: symlink d5/l4e 0 2024-03-22T07:28:30.877 INFO:tasks.workunit.client.1.smithi195.stdout:6/346: sync 2024-03-22T07:28:30.879 INFO:tasks.workunit.client.1.smithi195.stdout:9/459: unlink d2/d4/d32/d6d/d78/fa3 0 2024-03-22T07:28:30.879 INFO:tasks.workunit.client.1.smithi195.stdout:9/460: creat d2/d4/d6/db/d20/d4a/fa9 x:0 0 0 2024-03-22T07:28:30.881 INFO:tasks.workunit.client.1.smithi195.stdout:5/364: dread d9/d22/f2b [0,4194304] 0 2024-03-22T07:28:30.881 INFO:tasks.workunit.client.1.smithi195.stdout:5/365: fsync d9/f1c 0 2024-03-22T07:28:30.882 INFO:tasks.workunit.client.0.smithi134.stdout:4/223: mkdir d2/d25/d48 0 2024-03-22T07:28:30.884 INFO:tasks.workunit.client.1.smithi195.stdout:2/330: rename d2/d3/d7/f27 to d2/d17/f70 0 2024-03-22T07:28:30.886 INFO:tasks.workunit.client.0.smithi134.stdout:1/231: mknod d5/da/d1b/d27/c4f 0 2024-03-22T07:28:30.887 INFO:tasks.workunit.client.1.smithi195.stdout:0/359: dwrite d1/d4/d12/f55 [0,4194304] 0 2024-03-22T07:28:30.888 INFO:tasks.workunit.client.0.smithi134.stdout:9/128: sync 2024-03-22T07:28:30.888 INFO:tasks.workunit.client.0.smithi134.stdout:8/229: sync 2024-03-22T07:28:30.888 INFO:tasks.workunit.client.0.smithi134.stdout:9/129: stat d3/l5 0 2024-03-22T07:28:30.888 INFO:tasks.workunit.client.0.smithi134.stdout:9/130: fdatasync d3/d9/df/d12/f1d 0 2024-03-22T07:28:30.888 INFO:tasks.workunit.client.0.smithi134.stdout:4/224: symlink d2/l49 0 2024-03-22T07:28:30.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/401: dwrite d13/d63/d3e/d5c/d65/f72 [0,4194304] 0 2024-03-22T07:28:30.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/402: fdatasync d13/f3a 0 2024-03-22T07:28:30.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/382: mkdir d3/df/d15/d1d/d5c/d86 0 2024-03-22T07:28:30.894 INFO:tasks.workunit.client.1.smithi195.stdout:6/347: dwrite d5/d5e/d34/d55/d3b/d6e/d3c/f70 [0,4194304] 0 2024-03-22T07:28:30.895 INFO:tasks.workunit.client.1.smithi195.stdout:1/264: mknod d0/d2/d27/c56 0 2024-03-22T07:28:30.895 INFO:tasks.workunit.client.1.smithi195.stdout:1/265: readlink d0/d2/l23 0 2024-03-22T07:28:30.895 INFO:tasks.workunit.client.1.smithi195.stdout:1/266: fdatasync d0/d2/d6/f2f 0 2024-03-22T07:28:30.896 INFO:tasks.workunit.client.1.smithi195.stdout:1/267: stat d0/d2/d6/d21/d32 0 2024-03-22T07:28:30.898 INFO:tasks.workunit.client.1.smithi195.stdout:9/461: write d2/d4/d6/db/d20/d4a/f83 [3246454,85443] 0 2024-03-22T07:28:30.900 INFO:tasks.workunit.client.1.smithi195.stdout:5/366: symlink d9/d2d/d84/l87 0 2024-03-22T07:28:30.900 INFO:tasks.workunit.client.1.smithi195.stdout:5/367: write d9/d2d/f40 [331144,28023] 0 2024-03-22T07:28:30.900 INFO:tasks.workunit.client.1.smithi195.stdout:5/368: creat d9/d22/d46/f88 x:0 0 0 2024-03-22T07:28:30.902 INFO:tasks.workunit.client.0.smithi134.stdout:8/230: creat d1/f50 x:0 0 0 2024-03-22T07:28:30.902 INFO:tasks.workunit.client.0.smithi134.stdout:8/231: read - d1/d15/d42/f28 zero size 2024-03-22T07:28:30.904 INFO:tasks.workunit.client.1.smithi195.stdout:2/331: symlink d2/d17/l71 0 2024-03-22T07:28:30.907 INFO:tasks.workunit.client.1.smithi195.stdout:5/369: write d9/d12/d1d/d36/f49 [6233907,72293] 0 2024-03-22T07:28:30.908 INFO:tasks.workunit.client.0.smithi134.stdout:8/232: mknod d1/d4/d38/c51 0 2024-03-22T07:28:30.909 INFO:tasks.workunit.client.0.smithi134.stdout:8/233: write d1/d15/d42/d12/d20/d41/f48 [727867,46155] 0 2024-03-22T07:28:30.909 INFO:tasks.workunit.client.0.smithi134.stdout:8/234: stat d1/c43 0 2024-03-22T07:28:30.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/360: mkdir d1/d4/dd/df/d67 0 2024-03-22T07:28:30.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/361: fsync d1/d10/d1f/d40/d47/f60 0 2024-03-22T07:28:30.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/385: mknod da/dc/c7a 0 2024-03-22T07:28:30.913 INFO:tasks.workunit.client.1.smithi195.stdout:8/386: dread - da/d17/d32/d61/f72 zero size 2024-03-22T07:28:30.913 INFO:tasks.workunit.client.1.smithi195.stdout:8/387: fsync da/dc/f2b 0 2024-03-22T07:28:30.914 INFO:tasks.workunit.client.0.smithi134.stdout:9/131: rmdir d3/d9/df/d12/d1b 39 2024-03-22T07:28:30.914 INFO:tasks.workunit.client.0.smithi134.stdout:9/132: chown d3/d9/df/d12/f1d 2 1 2024-03-22T07:28:30.915 INFO:tasks.workunit.client.1.smithi195.stdout:4/403: symlink d13/d63/d21/l91 0 2024-03-22T07:28:30.915 INFO:tasks.workunit.client.1.smithi195.stdout:4/404: readlink d13/d15/d64/l8a 0 2024-03-22T07:28:30.915 INFO:tasks.workunit.client.1.smithi195.stdout:4/405: getdents d13/d2a/d7d 0 2024-03-22T07:28:30.917 INFO:tasks.workunit.client.0.smithi134.stdout:8/235: creat d1/d15/d42/d44/f52 x:0 0 0 2024-03-22T07:28:30.921 INFO:tasks.workunit.client.1.smithi195.stdout:6/348: stat c3 0 2024-03-22T07:28:30.923 INFO:tasks.workunit.client.1.smithi195.stdout:1/268: creat d0/d2/d9/d52/f57 x:0 0 0 2024-03-22T07:28:30.923 INFO:tasks.workunit.client.1.smithi195.stdout:3/383: dwrite d3/df/d15/d1d/f31 [0,4194304] 0 2024-03-22T07:28:30.925 INFO:tasks.workunit.client.1.smithi195.stdout:9/462: mknod d2/d4/d1d/d9b/caa 0 2024-03-22T07:28:30.925 INFO:tasks.workunit.client.1.smithi195.stdout:9/463: truncate d2/d4/d6/f49 5601600 0 2024-03-22T07:28:30.925 INFO:tasks.workunit.client.1.smithi195.stdout:9/464: creat d2/d4/d32/fab x:0 0 0 2024-03-22T07:28:30.925 INFO:tasks.workunit.client.1.smithi195.stdout:9/465: write d2/d4/d6/d18/d50/d88/f9a [71277,84199] 0 2024-03-22T07:28:30.925 INFO:tasks.workunit.client.1.smithi195.stdout:9/466: write d2/d4/d6/d18/f43 [1341172,14247] 0 2024-03-22T07:28:30.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/332: unlink d2/d3/f5 0 2024-03-22T07:28:30.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/333: fdatasync d2/d3/d24/f6b 0 2024-03-22T07:28:30.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/334: creat d2/d3/d7/da/f72 x:0 0 0 2024-03-22T07:28:30.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/335: readlink d2/l63 0 2024-03-22T07:28:30.928 INFO:tasks.workunit.client.1.smithi195.stdout:2/336: dread - d2/d3/d7/da/f72 zero size 2024-03-22T07:28:30.929 INFO:tasks.workunit.client.1.smithi195.stdout:0/362: rmdir d1/d4 39 2024-03-22T07:28:30.930 INFO:tasks.workunit.client.0.smithi134.stdout:1/232: dwrite d5/f4d [0,4194304] 0 2024-03-22T07:28:30.930 INFO:tasks.workunit.client.0.smithi134.stdout:1/233: getdents d5/da/d13/d1e/d45 0 2024-03-22T07:28:30.930 INFO:tasks.workunit.client.1.smithi195.stdout:5/370: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:30.931 INFO:tasks.workunit.client.1.smithi195.stdout:5/371: fdatasync d9/d22/d50/f6c 0 2024-03-22T07:28:30.931 INFO:tasks.workunit.client.1.smithi195.stdout:8/388: truncate da/de/f45 217317 0 2024-03-22T07:28:30.932 INFO:tasks.workunit.client.1.smithi195.stdout:4/406: symlink d13/d2a/d7e/d8c/l92 0 2024-03-22T07:28:30.933 INFO:tasks.workunit.client.0.smithi134.stdout:4/225: dwrite d2/d1d/f1f [0,4194304] 0 2024-03-22T07:28:30.935 INFO:tasks.workunit.client.1.smithi195.stdout:6/349: mknod d5/d16/d5b/c7d 0 2024-03-22T07:28:30.938 INFO:tasks.workunit.client.1.smithi195.stdout:3/384: mkdir d3/df/d15/d1d/d5c/d47/d67/d80/d87 0 2024-03-22T07:28:30.939 INFO:tasks.workunit.client.1.smithi195.stdout:3/385: stat d3/d18/f26 0 2024-03-22T07:28:30.941 INFO:tasks.workunit.client.0.smithi134.stdout:1/234: rename d5/da/d13/d1e/c2b to d5/da/d13/d1e/c50 0 2024-03-22T07:28:30.941 INFO:tasks.workunit.client.0.smithi134.stdout:1/235: stat d5/c42 0 2024-03-22T07:28:30.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/133: dwrite d3/d9/df/d12/d1b/f29 [0,4194304] 0 2024-03-22T07:28:30.944 INFO:tasks.workunit.client.0.smithi134.stdout:6/165: rename d2/d1b/d1d/d2b/c39 to d2/d1b/d23/d28/c3d 0 2024-03-22T07:28:30.945 INFO:tasks.workunit.client.0.smithi134.stdout:6/166: chown l1 54 1 2024-03-22T07:28:30.947 INFO:tasks.workunit.client.0.smithi134.stdout:4/226: symlink d2/l4a 0 2024-03-22T07:28:30.951 INFO:tasks.workunit.client.1.smithi195.stdout:9/467: dwrite d2/d4/d6/db/d20/d4a/f5e [0,4194304] 0 2024-03-22T07:28:30.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/468: write d2/d4/d6/d18/f44 [1342703,50879] 0 2024-03-22T07:28:30.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/469: chown d2/d4/d23 1 1 2024-03-22T07:28:30.952 INFO:tasks.workunit.client.1.smithi195.stdout:9/470: write d2/d4/f38 [4391871,46372] 0 2024-03-22T07:28:30.952 INFO:tasks.workunit.client.1.smithi195.stdout:2/337: dwrite d2/d3/d7/d19/f28 [0,4194304] 0 2024-03-22T07:28:30.952 INFO:tasks.workunit.client.1.smithi195.stdout:2/338: readlink d2/l1f 0 2024-03-22T07:28:30.952 INFO:tasks.workunit.client.1.smithi195.stdout:2/339: truncate d2/d3/d7/da/f58 702369 0 2024-03-22T07:28:30.953 INFO:tasks.workunit.client.0.smithi134.stdout:1/236: creat d5/da/d13/f51 x:0 0 0 2024-03-22T07:28:30.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/389: truncate da/d17/d32/f58 1766569 0 2024-03-22T07:28:30.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/390: fdatasync da/de/f2d 0 2024-03-22T07:28:30.957 INFO:tasks.workunit.client.1.smithi195.stdout:8/391: dread - da/dc/f6e zero size 2024-03-22T07:28:30.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/167: link d2/d1b/d1d/d2b/c31 d2/d1b/d23/d28/c3e 0 2024-03-22T07:28:30.959 INFO:tasks.workunit.client.1.smithi195.stdout:4/407: getdents d13/d63/d79/d68 0 2024-03-22T07:28:30.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/408: dread - d13/f4f zero size 2024-03-22T07:28:30.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/409: dread - d13/d63/d3e/f7f zero size 2024-03-22T07:28:30.960 INFO:tasks.workunit.client.1.smithi195.stdout:4/410: fdatasync d13/d63/d36/f5d 0 2024-03-22T07:28:30.962 INFO:tasks.workunit.client.0.smithi134.stdout:4/227: link d2/d15/f23 d2/d25/d48/f4b 0 2024-03-22T07:28:30.962 INFO:tasks.workunit.client.0.smithi134.stdout:4/228: readlink d2/d15/l10 0 2024-03-22T07:28:30.963 INFO:tasks.workunit.client.1.smithi195.stdout:6/350: creat d5/d5e/d34/d55/d3b/d6e/d3c/f7e x:0 0 0 2024-03-22T07:28:30.965 INFO:tasks.workunit.client.0.smithi134.stdout:1/237: rename d5/d1d/d2d/f38 to d5/d1d/d49/f52 0 2024-03-22T07:28:30.968 INFO:tasks.workunit.client.0.smithi134.stdout:2/138: truncate d2/d5/d22/f25 338590 0 2024-03-22T07:28:30.968 INFO:tasks.workunit.client.0.smithi134.stdout:2/139: fdatasync d2/f14 0 2024-03-22T07:28:30.968 INFO:tasks.workunit.client.0.smithi134.stdout:2/140: write d2/d5/d22/f24 [1663357,80462] 0 2024-03-22T07:28:30.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/471: creat d2/d4/d1d/d9b/fac x:0 0 0 2024-03-22T07:28:30.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/472: stat d2/d4/d1d/f40 0 2024-03-22T07:28:30.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/473: stat d2/d4/d6/d18/f2b 0 2024-03-22T07:28:30.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/229: mknod d2/d15/d35/c4c 0 2024-03-22T07:28:30.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/372: getdents d9/d7f 0 2024-03-22T07:28:30.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/373: read d9/d12/d1d/f32 [99786,124728] 0 2024-03-22T07:28:30.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/121: sync 2024-03-22T07:28:30.972 INFO:tasks.workunit.client.0.smithi134.stdout:7/354: sync 2024-03-22T07:28:30.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/122: readlink d1/d8/l1f 0 2024-03-22T07:28:30.972 INFO:tasks.workunit.client.0.smithi134.stdout:7/355: readlink d1/de/d11/d48/l56 0 2024-03-22T07:28:30.972 INFO:tasks.workunit.client.0.smithi134.stdout:7/356: readlink d1/l68 0 2024-03-22T07:28:30.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/363: dwrite d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:30.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/364: write d1/d4/f18 [9902123,32043] 0 2024-03-22T07:28:30.973 INFO:tasks.workunit.client.1.smithi195.stdout:0/365: write d1/d10/d19/d20/f56 [203855,49387] 0 2024-03-22T07:28:30.973 INFO:tasks.workunit.client.1.smithi195.stdout:6/351: dread - d5/d16/f48 zero size 2024-03-22T07:28:30.973 INFO:tasks.workunit.client.1.smithi195.stdout:6/352: write d5/d5e/d34/d55/d3b/d6e/fd [558672,35654] 0 2024-03-22T07:28:30.974 INFO:tasks.workunit.client.1.smithi195.stdout:3/386: dwrite d3/df/d15/d1d/d5c/f2e [0,4194304] 0 2024-03-22T07:28:30.974 INFO:tasks.workunit.client.0.smithi134.stdout:9/134: dwrite f1 [0,4194304] 0 2024-03-22T07:28:30.977 INFO:tasks.workunit.client.0.smithi134.stdout:1/238: mkdir d5/da/d13/d1e/d45/d53 0 2024-03-22T07:28:30.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/340: dread d2/d3/d21/d4c/f52 [0,4194304] 0 2024-03-22T07:28:30.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/341: readlink d2/d3/d21/d4c/l4f 0 2024-03-22T07:28:30.980 INFO:tasks.workunit.client.0.smithi134.stdout:1/239: dread d5/da/d13/d1e/d34/f3e [0,4194304] 0 2024-03-22T07:28:30.980 INFO:tasks.workunit.client.0.smithi134.stdout:2/141: creat d2/f28 x:0 0 0 2024-03-22T07:28:30.980 INFO:tasks.workunit.client.0.smithi134.stdout:2/142: stat d2/d5/d22 0 2024-03-22T07:28:30.980 INFO:tasks.workunit.client.0.smithi134.stdout:2/143: write d2/d5/d22/f24 [1011880,19814] 0 2024-03-22T07:28:30.982 INFO:tasks.workunit.client.1.smithi195.stdout:3/387: dread d3/d18/f26 [0,4194304] 0 2024-03-22T07:28:30.982 INFO:tasks.workunit.client.1.smithi195.stdout:9/474: mkdir d2/dad 0 2024-03-22T07:28:30.982 INFO:tasks.workunit.client.0.smithi134.stdout:7/357: write d1/de/f26 [1203277,90248] 0 2024-03-22T07:28:30.983 INFO:tasks.workunit.client.0.smithi134.stdout:4/230: creat d2/d2a/f4d x:0 0 0 2024-03-22T07:28:30.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/342: dread d2/f34 [0,4194304] 0 2024-03-22T07:28:30.985 INFO:tasks.workunit.client.0.smithi134.stdout:4/231: dread d2/d1d/f24 [0,4194304] 0 2024-03-22T07:28:30.985 INFO:tasks.workunit.client.0.smithi134.stdout:4/232: readlink d2/l49 0 2024-03-22T07:28:30.985 INFO:tasks.workunit.client.0.smithi134.stdout:4/233: write d2/d15/f1b [1452186,123099] 0 2024-03-22T07:28:30.986 INFO:tasks.workunit.client.1.smithi195.stdout:1/269: write d0/d2/f1f [3993859,37647] 0 2024-03-22T07:28:30.986 INFO:tasks.workunit.client.0.smithi134.stdout:5/123: rename d1/c17 to d1/c29 0 2024-03-22T07:28:30.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/366: creat d1/d10/d1f/d40/d47/f68 x:0 0 0 2024-03-22T07:28:30.989 INFO:tasks.workunit.client.0.smithi134.stdout:1/240: write d5/fe [828572,38941] 0 2024-03-22T07:28:30.989 INFO:tasks.workunit.client.1.smithi195.stdout:6/353: mkdir d5/d5e/d34/d55/d3b/d7f 0 2024-03-22T07:28:30.990 INFO:tasks.workunit.client.1.smithi195.stdout:6/354: chown d5/d16/d45/d53/d17/d1a/l24 0 1 2024-03-22T07:28:30.990 INFO:tasks.workunit.client.0.smithi134.stdout:5/124: read d1/d13/f15 [182864,48678] 0 2024-03-22T07:28:30.992 INFO:tasks.workunit.client.1.smithi195.stdout:9/475: write d2/d4/d6/db/f30 [1028734,126957] 0 2024-03-22T07:28:31.001 INFO:tasks.workunit.client.0.smithi134.stdout:2/144: unlink d2/d5/d22/f26 0 2024-03-22T07:28:31.001 INFO:tasks.workunit.client.0.smithi134.stdout:2/145: fdatasync d2/d5/f10 0 2024-03-22T07:28:31.003 INFO:tasks.workunit.client.1.smithi195.stdout:0/367: dwrite d1/d4/f2e [4194304,4194304] 0 2024-03-22T07:28:31.003 INFO:tasks.workunit.client.0.smithi134.stdout:5/125: dwrite d1/d4/f1a [0,4194304] 0 2024-03-22T07:28:31.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/234: creat d2/d25/d48/f4e x:0 0 0 2024-03-22T07:28:31.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/235: fdatasync d2/d2a/f4d 0 2024-03-22T07:28:31.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/236: readlink d2/d15/l8 0 2024-03-22T07:28:31.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/236: getdents d1 0 2024-03-22T07:28:31.011 INFO:tasks.workunit.client.0.smithi134.stdout:8/237: write d1/d15/f27 [976915,129906] 0 2024-03-22T07:28:31.011 INFO:tasks.workunit.client.0.smithi134.stdout:8/238: read d1/d15/f27 [258360,910] 0 2024-03-22T07:28:31.012 INFO:tasks.workunit.client.0.smithi134.stdout:1/241: link f3 d5/da/d1b/d27/d39/f54 0 2024-03-22T07:28:31.012 INFO:tasks.workunit.client.0.smithi134.stdout:8/239: dread d1/d15/d42/d44/f3e [0,4194304] 0 2024-03-22T07:28:31.016 INFO:tasks.workunit.client.0.smithi134.stdout:7/358: getdents d1/de/d11 0 2024-03-22T07:28:31.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/368: dwrite d1/d10/d1f/f57 [0,4194304] 0 2024-03-22T07:28:31.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/369: dread - d1/d10/d19/d20/f3c zero size 2024-03-22T07:28:31.018 INFO:tasks.workunit.client.1.smithi195.stdout:0/370: chown d1/d4 132324333 1 2024-03-22T07:28:31.019 INFO:tasks.workunit.client.0.smithi134.stdout:4/237: truncate d2/d15/f39 3444182 0 2024-03-22T07:28:31.019 INFO:tasks.workunit.client.0.smithi134.stdout:4/238: truncate d2/d25/f3e 416950 0 2024-03-22T07:28:31.019 INFO:tasks.workunit.client.0.smithi134.stdout:4/239: chown d2/d15/c38 3 1 2024-03-22T07:28:31.021 INFO:tasks.workunit.client.0.smithi134.stdout:8/240: getdents d1/d15/d42/d25 0 2024-03-22T07:28:31.021 INFO:tasks.workunit.client.0.smithi134.stdout:8/241: write d1/d15/f19 [3319047,1528] 0 2024-03-22T07:28:31.022 INFO:tasks.workunit.client.0.smithi134.stdout:4/240: dread d2/fd [0,4194304] 0 2024-03-22T07:28:31.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/146: mknod d2/d5/c29 0 2024-03-22T07:28:31.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/147: stat d2/d5/d8 0 2024-03-22T07:28:31.027 INFO:tasks.workunit.client.0.smithi134.stdout:7/359: unlink d1/de/d11/d48/d52/c45 0 2024-03-22T07:28:31.032 INFO:tasks.workunit.client.0.smithi134.stdout:8/242: mknod d1/d15/d42/d44/c53 0 2024-03-22T07:28:31.032 INFO:tasks.workunit.client.0.smithi134.stdout:8/243: fdatasync d1/d15/d42/d12/d2a/f23 0 2024-03-22T07:28:31.032 INFO:tasks.workunit.client.0.smithi134.stdout:8/244: fdatasync d1/d15/d42/f28 0 2024-03-22T07:28:31.034 INFO:tasks.workunit.client.0.smithi134.stdout:4/241: mknod d2/d2a/c4f 0 2024-03-22T07:28:31.035 INFO:tasks.workunit.client.0.smithi134.stdout:1/242: dwrite d5/fe [0,4194304] 0 2024-03-22T07:28:31.036 INFO:tasks.workunit.client.0.smithi134.stdout:8/245: dread d1/d15/d42/d12/d20/d41/f48 [0,4194304] 0 2024-03-22T07:28:31.040 INFO:tasks.workunit.client.1.smithi195.stdout:2/343: unlink d2/d3/d7/da/d18/l2a 0 2024-03-22T07:28:31.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/344: dread d2/d3/d7/da/f58 [0,4194304] 0 2024-03-22T07:28:31.043 INFO:tasks.workunit.client.1.smithi195.stdout:5/374: link d9/d12/c61 d9/c89 0 2024-03-22T07:28:31.048 INFO:tasks.workunit.client.1.smithi195.stdout:1/270: symlink d0/d2/l58 0 2024-03-22T07:28:31.049 INFO:tasks.workunit.client.1.smithi195.stdout:1/271: dread d0/d2/d6/d21/d41/d47/d4a/f4c [0,4194304] 0 2024-03-22T07:28:31.049 INFO:tasks.workunit.client.1.smithi195.stdout:1/272: readlink d0/l2b 0 2024-03-22T07:28:31.050 INFO:tasks.workunit.client.0.smithi134.stdout:7/360: dwrite d1/de/d11/d48/f1e [0,4194304] 0 2024-03-22T07:28:31.051 INFO:tasks.workunit.client.1.smithi195.stdout:8/392: write da/d17/d32/f58 [1059734,115084] 0 2024-03-22T07:28:31.051 INFO:tasks.workunit.client.1.smithi195.stdout:6/355: rename c1 to d5/d5e/d34/c80 0 2024-03-22T07:28:31.052 INFO:tasks.workunit.client.0.smithi134.stdout:1/243: mknod d5/d1d/d49/c55 0 2024-03-22T07:28:31.052 INFO:tasks.workunit.client.0.smithi134.stdout:1/244: write d5/d1d/d2d/f32 [5068119,35817] 0 2024-03-22T07:28:31.053 INFO:tasks.workunit.client.0.smithi134.stdout:0/165: sync 2024-03-22T07:28:31.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/242: dwrite d2/d25/d48/f4e [0,4194304] 0 2024-03-22T07:28:31.054 INFO:tasks.workunit.client.0.smithi134.stdout:8/246: link d1/d4/f4a d1/d4/f54 0 2024-03-22T07:28:31.054 INFO:tasks.workunit.client.0.smithi134.stdout:8/247: chown d1/d15/d42/d25/l33 0 1 2024-03-22T07:28:31.056 INFO:tasks.workunit.client.0.smithi134.stdout:6/168: rename d2/d1b/d23 to d2/d3f 0 2024-03-22T07:28:31.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/393: write da/d17/d32/d61/d47/f54 [955517,33751] 0 2024-03-22T07:28:31.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/371: mknod d1/d4/dd/df/d44/c69 0 2024-03-22T07:28:31.059 INFO:tasks.workunit.client.1.smithi195.stdout:0/372: read d1/d4/dd/f3a [396283,88217] 0 2024-03-22T07:28:31.061 INFO:tasks.workunit.client.1.smithi195.stdout:3/388: rmdir d3/df/d15/d1d 39 2024-03-22T07:28:31.061 INFO:tasks.workunit.client.0.smithi134.stdout:2/148: fsync d2/f28 0 2024-03-22T07:28:31.062 INFO:tasks.workunit.client.0.smithi134.stdout:7/361: symlink d1/de/d11/d48/d52/l7b 0 2024-03-22T07:28:31.065 INFO:tasks.workunit.client.1.smithi195.stdout:5/375: symlink d9/d3a/d5f/l8a 0 2024-03-22T07:28:31.065 INFO:tasks.workunit.client.0.smithi134.stdout:0/166: mknod dc/de/c33 0 2024-03-22T07:28:31.066 INFO:tasks.workunit.client.1.smithi195.stdout:1/273: rmdir d0/d2/d6/d21/d41 39 2024-03-22T07:28:31.066 INFO:tasks.workunit.client.1.smithi195.stdout:1/274: write d0/d2/d6/d21/d41/d47/f49 [305214,59961] 0 2024-03-22T07:28:31.068 INFO:tasks.workunit.client.1.smithi195.stdout:6/356: symlink d5/d5e/d34/l81 0 2024-03-22T07:28:31.068 INFO:tasks.workunit.client.0.smithi134.stdout:6/169: dread d2/d3f/d28/f20 [0,4194304] 0 2024-03-22T07:28:31.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/476: getdents d2 0 2024-03-22T07:28:31.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/477: read - d2/d4/d1d/d9b/fac zero size 2024-03-22T07:28:31.070 INFO:tasks.workunit.client.1.smithi195.stdout:1/275: dread d0/d2/d6/f4b [0,4194304] 0 2024-03-22T07:28:31.071 INFO:tasks.workunit.client.1.smithi195.stdout:1/276: write d0/d2/d6/f2f [4016450,5294] 0 2024-03-22T07:28:31.071 INFO:tasks.workunit.client.0.smithi134.stdout:4/243: unlink d2/d15/c41 0 2024-03-22T07:28:31.072 INFO:tasks.workunit.client.1.smithi195.stdout:1/277: dread d0/d2/d6/d21/d41/d47/d4a/f4c [0,4194304] 0 2024-03-22T07:28:31.073 INFO:tasks.workunit.client.0.smithi134.stdout:8/248: mknod d1/d15/d42/c55 0 2024-03-22T07:28:31.075 INFO:tasks.workunit.client.0.smithi134.stdout:9/135: rename d3/f31 to d3/d9/df/d12/d1b/f32 0 2024-03-22T07:28:31.075 INFO:tasks.workunit.client.1.smithi195.stdout:0/373: dwrite d1/d10/d19/f65 [0,4194304] 0 2024-03-22T07:28:31.075 INFO:tasks.workunit.client.1.smithi195.stdout:0/374: readlink d1/l2 0 2024-03-22T07:28:31.076 INFO:tasks.workunit.client.1.smithi195.stdout:8/394: truncate da/d17/d32/f40 378341 0 2024-03-22T07:28:31.076 INFO:tasks.workunit.client.1.smithi195.stdout:8/395: dread - da/dc/f6e zero size 2024-03-22T07:28:31.077 INFO:tasks.workunit.client.0.smithi134.stdout:8/249: dread d1/d15/d42/d12/d20/d41/f45 [0,4194304] 0 2024-03-22T07:28:31.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/149: truncate d2/f14 7134350 0 2024-03-22T07:28:31.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/150: fdatasync d2/d5/f10 0 2024-03-22T07:28:31.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/151: chown d2/d5/lf 762906 1 2024-03-22T07:28:31.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/152: truncate d2/d5/d22/f23 491532 0 2024-03-22T07:28:31.080 INFO:tasks.workunit.client.0.smithi134.stdout:7/362: unlink d1/de/d11/d48/c58 0 2024-03-22T07:28:31.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/167: dwrite dc/d17/f21 [0,4194304] 0 2024-03-22T07:28:31.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/168: stat f4 0 2024-03-22T07:28:31.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/169: fsync f9 0 2024-03-22T07:28:31.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/170: write f0 [9310846,98913] 0 2024-03-22T07:28:31.083 INFO:tasks.workunit.client.0.smithi134.stdout:7/363: read d1/de/f5a [273226,45093] 0 2024-03-22T07:28:31.085 INFO:tasks.workunit.client.0.smithi134.stdout:6/170: symlink d2/l40 0 2024-03-22T07:28:31.086 INFO:tasks.workunit.client.0.smithi134.stdout:6/171: dread d2/d1b/f2f [0,4194304] 0 2024-03-22T07:28:31.089 INFO:tasks.workunit.client.0.smithi134.stdout:4/244: mkdir d2/d2a/d50 0 2024-03-22T07:28:31.089 INFO:tasks.workunit.client.0.smithi134.stdout:4/245: chown d2/d25/l36 525628 1 2024-03-22T07:28:31.091 INFO:tasks.workunit.client.0.smithi134.stdout:9/136: link d3/d9/la d3/d9/df/d12/d2d/l33 0 2024-03-22T07:28:31.092 INFO:tasks.workunit.client.0.smithi134.stdout:7/364: write d1/de/d41/f49 [2590441,17011] 0 2024-03-22T07:28:31.093 INFO:tasks.workunit.client.1.smithi195.stdout:5/376: rename d9/d12/d1d/d36/c3e to d9/d12/d1d/d36/c8b 0 2024-03-22T07:28:31.093 INFO:tasks.workunit.client.0.smithi134.stdout:4/246: dread d2/d15/f40 [0,4194304] 0 2024-03-22T07:28:31.095 INFO:tasks.workunit.client.0.smithi134.stdout:5/126: rename d1/l7 to d1/d8/l2a 0 2024-03-22T07:28:31.095 INFO:tasks.workunit.client.0.smithi134.stdout:5/127: chown d1/d8/f21 467 1 2024-03-22T07:28:31.096 INFO:tasks.workunit.client.1.smithi195.stdout:6/357: truncate d5/d16/d45/f39 2936645 0 2024-03-22T07:28:31.096 INFO:tasks.workunit.client.1.smithi195.stdout:6/358: truncate d5/f6 5055538 0 2024-03-22T07:28:31.096 INFO:tasks.workunit.client.1.smithi195.stdout:6/359: chown d5/d5e/d34/d55 5584660 1 2024-03-22T07:28:31.097 INFO:tasks.workunit.client.0.smithi134.stdout:2/153: dwrite d2/fe [4194304,4194304] 0 2024-03-22T07:28:31.098 INFO:tasks.workunit.client.0.smithi134.stdout:8/250: symlink d1/d4/d38/l56 0 2024-03-22T07:28:31.099 INFO:tasks.workunit.client.1.smithi195.stdout:5/377: dread d9/f31 [0,4194304] 0 2024-03-22T07:28:31.101 INFO:tasks.workunit.client.1.smithi195.stdout:1/278: mknod d0/d2/d9/d52/c59 0 2024-03-22T07:28:31.101 INFO:tasks.workunit.client.1.smithi195.stdout:1/279: write d0/d2/d6/f2f [3113637,2377] 0 2024-03-22T07:28:31.104 INFO:tasks.workunit.client.1.smithi195.stdout:0/375: creat d1/d4/d22/d41/f6a x:0 0 0 2024-03-22T07:28:31.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/171: creat dc/f34 x:0 0 0 2024-03-22T07:28:31.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/172: readlink l6 0 2024-03-22T07:28:31.105 INFO:tasks.workunit.client.1.smithi195.stdout:8/396: dwrite da/f4e [0,4194304] 0 2024-03-22T07:28:31.106 INFO:tasks.workunit.client.1.smithi195.stdout:3/389: mkdir d3/d88 0 2024-03-22T07:28:31.106 INFO:tasks.workunit.client.1.smithi195.stdout:3/390: fsync d3/d22/d34/d70/f71 0 2024-03-22T07:28:31.108 INFO:tasks.workunit.client.1.smithi195.stdout:6/360: mkdir d5/d16/d45/d53/d17/d82 0 2024-03-22T07:28:31.109 INFO:tasks.workunit.client.0.smithi134.stdout:6/172: dwrite d2/d3f/d28/f33 [0,4194304] 0 2024-03-22T07:28:31.109 INFO:tasks.workunit.client.0.smithi134.stdout:6/173: write d2/d3f/d28/f25 [334116,78842] 0 2024-03-22T07:28:31.109 INFO:tasks.workunit.client.0.smithi134.stdout:9/137: symlink d3/l34 0 2024-03-22T07:28:31.110 INFO:tasks.workunit.client.1.smithi195.stdout:5/378: dread d9/d12/d1d/d69/d78/f7e [4194304,4194304] 0 2024-03-22T07:28:31.111 INFO:tasks.workunit.client.0.smithi134.stdout:7/365: stat d1/de/d11/d2b/d31/c5c 0 2024-03-22T07:28:31.112 INFO:tasks.workunit.client.0.smithi134.stdout:7/366: truncate d1/de/d11/d48/f3c 310270 0 2024-03-22T07:28:31.112 INFO:tasks.workunit.client.1.smithi195.stdout:1/280: getdents d0/d2/d9 0 2024-03-22T07:28:31.112 INFO:tasks.workunit.client.1.smithi195.stdout:1/281: write d0/d2/d6/f4b [3472075,114410] 0 2024-03-22T07:28:31.113 INFO:tasks.workunit.client.0.smithi134.stdout:1/245: rename d5/da/d13/c31 to d5/da/d13/d1e/d34/c56 0 2024-03-22T07:28:31.114 INFO:tasks.workunit.client.1.smithi195.stdout:8/397: dread da/f35 [0,4194304] 0 2024-03-22T07:28:31.115 INFO:tasks.workunit.client.1.smithi195.stdout:0/376: mkdir d1/d4/dd/df/d6b 0 2024-03-22T07:28:31.117 INFO:tasks.workunit.client.0.smithi134.stdout:5/128: creat d1/d4/f2b x:0 0 0 2024-03-22T07:28:31.117 INFO:tasks.workunit.client.0.smithi134.stdout:5/129: stat d1/d8/c24 0 2024-03-22T07:28:31.118 INFO:tasks.workunit.client.0.smithi134.stdout:1/246: dread d5/fc [0,4194304] 0 2024-03-22T07:28:31.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/154: stat d2/d5/d8/c19 0 2024-03-22T07:28:31.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/155: fdatasync d2/f28 0 2024-03-22T07:28:31.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/156: write d2/d5/d22/f23 [1020951,113005] 0 2024-03-22T07:28:31.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/157: write d2/d5/d22/f23 [878040,111122] 0 2024-03-22T07:28:31.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/158: creat d2/d5/d22/f2a x:0 0 0 2024-03-22T07:28:31.122 INFO:tasks.workunit.client.1.smithi195.stdout:5/379: dread d9/d12/d1d/d69/d78/f7e [0,4194304] 0 2024-03-22T07:28:31.122 INFO:tasks.workunit.client.0.smithi134.stdout:4/247: dwrite d2/d15/f12 [0,4194304] 0 2024-03-22T07:28:31.123 INFO:tasks.workunit.client.0.smithi134.stdout:4/248: creat d2/d15/f51 x:0 0 0 2024-03-22T07:28:31.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/173: creat dc/de/f35 x:0 0 0 2024-03-22T07:28:31.129 INFO:tasks.workunit.client.0.smithi134.stdout:9/138: dwrite f0 [0,4194304] 0 2024-03-22T07:28:31.129 INFO:tasks.workunit.client.0.smithi134.stdout:9/139: chown d3/f28 100504 1 2024-03-22T07:28:31.130 INFO:tasks.workunit.client.1.smithi195.stdout:6/361: truncate d5/f51 1498014 0 2024-03-22T07:28:31.130 INFO:tasks.workunit.client.1.smithi195.stdout:6/362: creat d5/d16/d45/f83 x:0 0 0 2024-03-22T07:28:31.130 INFO:tasks.workunit.client.0.smithi134.stdout:1/247: dread f3 [0,4194304] 0 2024-03-22T07:28:31.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/282: link d0/d2/f1f d0/d2/d6/d21/d41/f5a 0 2024-03-22T07:28:31.135 INFO:tasks.workunit.client.1.smithi195.stdout:1/283: dread d0/d2/f2e [0,4194304] 0 2024-03-22T07:28:31.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/319: sync 2024-03-22T07:28:31.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/320: truncate d0/d13/f1e 4626495 0 2024-03-22T07:28:31.136 INFO:tasks.workunit.client.0.smithi134.stdout:7/367: symlink d1/de/d11/d2b/d31/l7c 0 2024-03-22T07:28:31.136 INFO:tasks.workunit.client.0.smithi134.stdout:7/368: readlink d1/de/d11/d48/d52/l6e 0 2024-03-22T07:28:31.136 INFO:tasks.workunit.client.0.smithi134.stdout:7/369: fsync d1/de/d11/d48/d52/d46/f61 0 2024-03-22T07:28:31.137 INFO:tasks.workunit.client.1.smithi195.stdout:5/380: creat d9/d12/f8c x:0 0 0 2024-03-22T07:28:31.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/149: sync 2024-03-22T07:28:31.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/150: truncate d4/fc 5070441 0 2024-03-22T07:28:31.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/174: rename d2/cd to d2/d1b/c41 0 2024-03-22T07:28:31.141 INFO:tasks.workunit.client.1.smithi195.stdout:0/377: dwrite d1/d10/d1f/f21 [0,4194304] 0 2024-03-22T07:28:31.142 INFO:tasks.workunit.client.0.smithi134.stdout:2/159: dwrite d2/d5/d8/f1b [0,4194304] 0 2024-03-22T07:28:31.142 INFO:tasks.workunit.client.0.smithi134.stdout:3/151: dread d4/d22/f32 [4194304,4194304] 0 2024-03-22T07:28:31.143 INFO:tasks.workunit.client.1.smithi195.stdout:7/321: dread d0/d13/d14/d29/d35/d3a/f5d [0,4194304] 0 2024-03-22T07:28:31.144 INFO:tasks.workunit.client.0.smithi134.stdout:6/175: dread d2/d3f/d28/f25 [0,4194304] 0 2024-03-22T07:28:31.147 INFO:tasks.workunit.client.1.smithi195.stdout:6/363: creat d5/d5e/f84 x:0 0 0 2024-03-22T07:28:31.147 INFO:tasks.workunit.client.1.smithi195.stdout:6/364: chown d5/d5e/d34/d55/d3b/l58 668392519 1 2024-03-22T07:28:31.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/251: mkdir d1/d15/d57 0 2024-03-22T07:28:31.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/252: write d1/d15/f5 [4330881,16571] 0 2024-03-22T07:28:31.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/284: creat d0/d2/d9/d2a/f5b x:0 0 0 2024-03-22T07:28:31.151 INFO:tasks.workunit.client.1.smithi195.stdout:5/381: creat d9/d12/d1d/d69/d78/d41/f8d x:0 0 0 2024-03-22T07:28:31.153 INFO:tasks.workunit.client.0.smithi134.stdout:9/140: mknod d3/d9/df/d12/d1b/c35 0 2024-03-22T07:28:31.154 INFO:tasks.workunit.client.0.smithi134.stdout:9/141: stat d3/d9/df/d12/c19 0 2024-03-22T07:28:31.155 INFO:tasks.workunit.client.1.smithi195.stdout:0/378: mkdir d1/d4/d12/d6c 0 2024-03-22T07:28:31.155 INFO:tasks.workunit.client.0.smithi134.stdout:2/160: dwrite d2/d5/d22/f2a [0,4194304] 0 2024-03-22T07:28:31.157 INFO:tasks.workunit.client.0.smithi134.stdout:1/248: creat d5/d1d/d2d/f57 x:0 0 0 2024-03-22T07:28:31.157 INFO:tasks.workunit.client.0.smithi134.stdout:1/249: chown d5/d1d/d49/c55 0 1 2024-03-22T07:28:31.157 INFO:tasks.workunit.client.0.smithi134.stdout:1/250: readlink d5/da/d1b/l47 0 2024-03-22T07:28:31.158 INFO:tasks.workunit.client.0.smithi134.stdout:2/161: dread d2/d5/f10 [0,4194304] 0 2024-03-22T07:28:31.158 INFO:tasks.workunit.client.0.smithi134.stdout:2/162: fsync d2/f28 0 2024-03-22T07:28:31.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/251: fdatasync d5/d1d/d2d/f32 0 2024-03-22T07:28:31.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/252: dread - d5/d1d/d2d/f57 zero size 2024-03-22T07:28:31.159 INFO:tasks.workunit.client.0.smithi134.stdout:7/370: mkdir d1/de/d11/d2b/d69/d7d 0 2024-03-22T07:28:31.162 INFO:tasks.workunit.client.0.smithi134.stdout:5/130: rename d1/d4/f11 to d1/f2c 0 2024-03-22T07:28:31.162 INFO:tasks.workunit.client.0.smithi134.stdout:5/131: dread - d1/d8/f21 zero size 2024-03-22T07:28:31.166 INFO:tasks.workunit.client.0.smithi134.stdout:3/152: rmdir d4 39 2024-03-22T07:28:31.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/365: symlink d5/d5e/d34/d55/d4b/d5f/l85 0 2024-03-22T07:28:31.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/366: truncate d5/d16/d45/d53/d17/d1a/f71 1167458 0 2024-03-22T07:28:31.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/367: chown d5/d5e/d34/d55/c47 3896501 1 2024-03-22T07:28:31.168 INFO:tasks.workunit.client.1.smithi195.stdout:6/368: write d5/d16/d45/d53/d17/d1a/f4d [620933,118780] 0 2024-03-22T07:28:31.169 INFO:tasks.workunit.client.1.smithi195.stdout:1/285: truncate d0/d2/d6/d21/d41/f5a 3860856 0 2024-03-22T07:28:31.169 INFO:tasks.workunit.client.1.smithi195.stdout:1/286: write d0/d2/d6/d21/d32/f44 [101662,77595] 0 2024-03-22T07:28:31.170 INFO:tasks.workunit.client.0.smithi134.stdout:4/249: getdents d2/d2a 0 2024-03-22T07:28:31.171 INFO:tasks.workunit.client.0.smithi134.stdout:4/250: fdatasync d2/d15/f30 0 2024-03-22T07:28:31.172 INFO:tasks.workunit.client.1.smithi195.stdout:5/382: symlink d9/d22/d7b/l8e 0 2024-03-22T07:28:31.172 INFO:tasks.workunit.client.1.smithi195.stdout:5/383: write d9/d22/d50/f6c [973420,129976] 0 2024-03-22T07:28:31.172 INFO:tasks.workunit.client.1.smithi195.stdout:5/384: fsync d9/d53/f7a 0 2024-03-22T07:28:31.172 INFO:tasks.workunit.client.0.smithi134.stdout:8/253: mknod d1/d46/c58 0 2024-03-22T07:28:31.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/379: rmdir d1/d10/d1f/d40 39 2024-03-22T07:28:31.173 INFO:tasks.workunit.client.1.smithi195.stdout:0/380: chown d1 48937 1 2024-03-22T07:28:31.175 INFO:tasks.workunit.client.0.smithi134.stdout:0/174: mknod dc/c36 0 2024-03-22T07:28:31.177 INFO:tasks.workunit.client.1.smithi195.stdout:3/391: rename d3/d22/d34 to d3/d18/d89 0 2024-03-22T07:28:31.177 INFO:tasks.workunit.client.1.smithi195.stdout:3/392: creat d3/d22/f8a x:0 0 0 2024-03-22T07:28:31.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/393: write d3/df/d15/f1c [4509944,100828] 0 2024-03-22T07:28:31.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/394: readlink d3/d22/l4e 0 2024-03-22T07:28:31.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/395: readlink d3/d22/l61 0 2024-03-22T07:28:31.179 INFO:tasks.workunit.client.0.smithi134.stdout:7/371: dwrite d1/f4 [0,4194304] 0 2024-03-22T07:28:31.179 INFO:tasks.workunit.client.0.smithi134.stdout:9/142: link d3/d9/f10 d3/d9/f36 0 2024-03-22T07:28:31.179 INFO:tasks.workunit.client.0.smithi134.stdout:9/143: write d3/f14 [164815,56091] 0 2024-03-22T07:28:31.182 INFO:tasks.workunit.client.1.smithi195.stdout:6/369: mknod d5/d16/d5b/c86 0 2024-03-22T07:28:31.185 INFO:tasks.workunit.client.1.smithi195.stdout:1/287: rename d0/d2/d6/d21/d41/d47/d4a/f53 to d0/d2/d6/d21/d39/d40/f5c 0 2024-03-22T07:28:31.185 INFO:tasks.workunit.client.1.smithi195.stdout:1/288: fsync d0/d2/d27/f30 0 2024-03-22T07:28:31.185 INFO:tasks.workunit.client.1.smithi195.stdout:1/289: readlink d0/d2/d6/d21/l3c 0 2024-03-22T07:28:31.188 INFO:tasks.workunit.client.0.smithi134.stdout:1/253: truncate d5/da/f26 3839301 0 2024-03-22T07:28:31.188 INFO:tasks.workunit.client.0.smithi134.stdout:1/254: write d5/d1d/d2d/f57 [501071,92431] 0 2024-03-22T07:28:31.190 INFO:tasks.workunit.client.0.smithi134.stdout:5/132: symlink d1/d4/l2d 0 2024-03-22T07:28:31.191 INFO:tasks.workunit.client.1.smithi195.stdout:3/396: creat d3/f8b x:0 0 0 2024-03-22T07:28:31.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/153: mknod d4/d22/d29/c34 0 2024-03-22T07:28:31.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/154: write f0 [4647742,64765] 0 2024-03-22T07:28:31.193 INFO:tasks.workunit.client.0.smithi134.stdout:8/254: dwrite d1/f2d [0,4194304] 0 2024-03-22T07:28:31.193 INFO:tasks.workunit.client.0.smithi134.stdout:8/255: chown d1/d15/d42/d12/d20/d41/f45 734521800 1 2024-03-22T07:28:31.194 INFO:tasks.workunit.client.1.smithi195.stdout:6/370: dread d5/d16/d45/d53/d17/d4a/f5c [0,4194304] 0 2024-03-22T07:28:31.195 INFO:tasks.workunit.client.1.smithi195.stdout:5/385: dwrite d9/d2d/f65 [0,4194304] 0 2024-03-22T07:28:31.195 INFO:tasks.workunit.client.1.smithi195.stdout:0/381: rename d1/d4/d12/f37 to d1/d4/d22/f6d 0 2024-03-22T07:28:31.198 INFO:tasks.workunit.client.1.smithi195.stdout:1/290: symlink d0/d2/d6/d21/d39/d40/l5d 0 2024-03-22T07:28:31.198 INFO:tasks.workunit.client.1.smithi195.stdout:1/291: chown d0/d2/d6/d21/d41/d47/c4f 26048 1 2024-03-22T07:28:31.198 INFO:tasks.workunit.client.1.smithi195.stdout:4/411: sync 2024-03-22T07:28:31.198 INFO:tasks.workunit.client.1.smithi195.stdout:4/412: creat d13/d63/d3e/f93 x:0 0 0 2024-03-22T07:28:31.198 INFO:tasks.workunit.client.0.smithi134.stdout:4/251: mkdir d2/d25/d48/d52 0 2024-03-22T07:28:31.199 INFO:tasks.workunit.client.1.smithi195.stdout:3/397: dread d3/df/d15/d1d/f56 [0,4194304] 0 2024-03-22T07:28:31.199 INFO:tasks.workunit.client.1.smithi195.stdout:3/398: chown f0 87146 1 2024-03-22T07:28:31.199 INFO:tasks.workunit.client.1.smithi195.stdout:3/399: stat d3/df/d15/d1d/f31 0 2024-03-22T07:28:31.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/155: write f0 [517283,105768] 0 2024-03-22T07:28:31.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/156: creat d4/d10/f35 x:0 0 0 2024-03-22T07:28:31.205 INFO:tasks.workunit.client.0.smithi134.stdout:9/144: getdents d3/d9/df/d12/d2d 0 2024-03-22T07:28:31.209 INFO:tasks.workunit.client.0.smithi134.stdout:2/163: symlink d2/d5/l2b 0 2024-03-22T07:28:31.211 INFO:tasks.workunit.client.0.smithi134.stdout:1/255: truncate d5/f20 4151625 0 2024-03-22T07:28:31.211 INFO:tasks.workunit.client.0.smithi134.stdout:1/256: readlink d5/l8 0 2024-03-22T07:28:31.212 INFO:tasks.workunit.client.0.smithi134.stdout:6/176: getdents d2 0 2024-03-22T07:28:31.213 INFO:tasks.workunit.client.0.smithi134.stdout:5/133: symlink d1/d8/d20/l2e 0 2024-03-22T07:28:31.214 INFO:tasks.workunit.client.0.smithi134.stdout:4/252: dwrite d2/d25/d48/f4e [0,4194304] 0 2024-03-22T07:28:31.219 INFO:tasks.workunit.client.0.smithi134.stdout:8/256: creat d1/d15/d42/d25/f59 x:0 0 0 2024-03-22T07:28:31.221 INFO:tasks.workunit.client.1.smithi195.stdout:7/322: truncate d0/f2d 1841549 0 2024-03-22T07:28:31.221 INFO:tasks.workunit.client.1.smithi195.stdout:7/323: chown d0/d13/d14/c55 514358 1 2024-03-22T07:28:31.221 INFO:tasks.workunit.client.1.smithi195.stdout:5/386: mkdir d9/d2d/d8f 0 2024-03-22T07:28:31.223 INFO:tasks.workunit.client.0.smithi134.stdout:0/175: rename dc/c12 to dc/d18/c37 0 2024-03-22T07:28:31.223 INFO:tasks.workunit.client.0.smithi134.stdout:0/176: creat dc/d17/f38 x:0 0 0 2024-03-22T07:28:31.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/382: mknod d1/d10/d1f/d40/d47/c6e 0 2024-03-22T07:28:31.225 INFO:tasks.workunit.client.1.smithi195.stdout:0/383: getdents d1/d4/dd/d3f 0 2024-03-22T07:28:31.228 INFO:tasks.workunit.client.1.smithi195.stdout:1/292: rename d0/d2/d6/d21/d32/c3f to d0/d2/d27/c5e 0 2024-03-22T07:28:31.228 INFO:tasks.workunit.client.1.smithi195.stdout:1/293: read d0/d2/d6/f4b [3571225,30791] 0 2024-03-22T07:28:31.228 INFO:tasks.workunit.client.1.smithi195.stdout:1/294: read - d0/d2/d9/d2a/f5b zero size 2024-03-22T07:28:31.231 INFO:tasks.workunit.client.0.smithi134.stdout:7/372: getdents d1/de/d11/d48 0 2024-03-22T07:28:31.231 INFO:tasks.workunit.client.0.smithi134.stdout:4/253: dwrite d2/d25/f1c [0,4194304] 0 2024-03-22T07:28:31.232 INFO:tasks.workunit.client.0.smithi134.stdout:0/177: write dc/f20 [3253655,114996] 0 2024-03-22T07:28:31.232 INFO:tasks.workunit.client.0.smithi134.stdout:0/178: write dc/f29 [77269,72465] 0 2024-03-22T07:28:31.233 INFO:tasks.workunit.client.0.smithi134.stdout:4/254: write d2/ff [4373284,89664] 0 2024-03-22T07:28:31.233 INFO:tasks.workunit.client.1.smithi195.stdout:4/413: mknod d13/d63/d21/c94 0 2024-03-22T07:28:31.235 INFO:tasks.workunit.client.0.smithi134.stdout:9/145: mkdir d3/d9/d37 0 2024-03-22T07:28:31.237 INFO:tasks.workunit.client.1.smithi195.stdout:3/400: getdents d3/df/d15/d1d/d5c 0 2024-03-22T07:28:31.237 INFO:tasks.workunit.client.1.smithi195.stdout:3/401: chown d3/df/l6e 6936 1 2024-03-22T07:28:31.241 INFO:tasks.workunit.client.1.smithi195.stdout:1/295: dread d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:31.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/324: mknod d0/d13/d14/d29/c68 0 2024-03-22T07:28:31.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/325: chown d0/d13/d14/d2b/f42 297 1 2024-03-22T07:28:31.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/326: write d0/f25 [557812,130399] 0 2024-03-22T07:28:31.242 INFO:tasks.workunit.client.1.smithi195.stdout:7/327: chown d0/d13/d14/d29/d35/c5a 95882923 1 2024-03-22T07:28:31.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/257: creat d5/da/d1b/d27/d39/f58 x:0 0 0 2024-03-22T07:28:31.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/258: readlink d5/l35 0 2024-03-22T07:28:31.244 INFO:tasks.workunit.client.1.smithi195.stdout:5/387: mknod d9/d2d/c90 0 2024-03-22T07:28:31.245 INFO:tasks.workunit.client.1.smithi195.stdout:5/388: write d9/d22/d46/f85 [86644,111145] 0 2024-03-22T07:28:31.245 INFO:tasks.workunit.client.0.smithi134.stdout:6/177: mknod d2/d3f/c42 0 2024-03-22T07:28:31.247 INFO:tasks.workunit.client.1.smithi195.stdout:0/384: unlink d1/d4/d22/f29 0 2024-03-22T07:28:31.247 INFO:tasks.workunit.client.1.smithi195.stdout:0/385: readlink d1/d4/d12/l4e 0 2024-03-22T07:28:31.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/328: dread d0/d13/d14/d29/d35/f37 [0,4194304] 0 2024-03-22T07:28:31.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/329: readlink d0/d13/d14/d2f/l50 0 2024-03-22T07:28:31.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/330: truncate d0/ff 4529960 0 2024-03-22T07:28:31.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/414: symlink d13/d2a/d7d/l95 0 2024-03-22T07:28:31.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/257: mkdir d1/d15/d42/d12/d20/d5a 0 2024-03-22T07:28:31.252 INFO:tasks.workunit.client.1.smithi195.stdout:1/296: mkdir d0/d2/d6/d21/d32/d5f 0 2024-03-22T07:28:31.254 INFO:tasks.workunit.client.1.smithi195.stdout:5/389: rmdir d9/d22/d7b 39 2024-03-22T07:28:31.256 INFO:tasks.workunit.client.1.smithi195.stdout:0/386: getdents d1/d10/d19 0 2024-03-22T07:28:31.258 INFO:tasks.workunit.client.0.smithi134.stdout:8/258: dread d1/d15/d42/f2b [4194304,4194304] 0 2024-03-22T07:28:31.259 INFO:tasks.workunit.client.0.smithi134.stdout:7/373: mknod d1/de/c7e 0 2024-03-22T07:28:31.259 INFO:tasks.workunit.client.0.smithi134.stdout:7/374: write d1/f33 [2094503,65756] 0 2024-03-22T07:28:31.260 INFO:tasks.workunit.client.0.smithi134.stdout:8/259: dread d1/d15/d42/d44/f3e [0,4194304] 0 2024-03-22T07:28:31.261 INFO:tasks.workunit.client.1.smithi195.stdout:7/331: mknod d0/d13/d14/d2b/c69 0 2024-03-22T07:28:31.261 INFO:tasks.workunit.client.1.smithi195.stdout:3/402: dwrite d3/f14 [0,4194304] 0 2024-03-22T07:28:31.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/415: symlink d13/d2a/d7e/d8c/l96 0 2024-03-22T07:28:31.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/416: fdatasync f11 0 2024-03-22T07:28:31.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/417: creat d13/d63/d3e/f97 x:0 0 0 2024-03-22T07:28:31.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/418: read d13/d15/f37 [2497,57267] 0 2024-03-22T07:28:31.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/419: fsync d13/d63/d36/f8d 0 2024-03-22T07:28:31.267 INFO:tasks.workunit.client.1.smithi195.stdout:1/297: link d0/d2/d6/d21/l3c d0/d2/d6/d21/d39/d40/l60 0 2024-03-22T07:28:31.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/375: write d1/de/d11/d2b/d31/f43 [2315423,7901] 0 2024-03-22T07:28:31.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/376: creat d1/d40/f7f x:0 0 0 2024-03-22T07:28:31.271 INFO:tasks.workunit.client.0.smithi134.stdout:7/377: creat d1/de/d11/d48/d52/f80 x:0 0 0 2024-03-22T07:28:31.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/390: symlink d9/d2d/d8f/l91 0 2024-03-22T07:28:31.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/391: read d9/d12/d1d/d36/f49 [8036180,127557] 0 2024-03-22T07:28:31.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/392: chown d9/d12/d1d/l82 477953429 1 2024-03-22T07:28:31.272 INFO:tasks.workunit.client.1.smithi195.stdout:3/403: truncate d3/f24 5888231 0 2024-03-22T07:28:31.273 INFO:tasks.workunit.client.0.smithi134.stdout:9/146: symlink d3/d9/d37/l38 0 2024-03-22T07:28:31.274 INFO:tasks.workunit.client.1.smithi195.stdout:7/332: read d0/ff [1869723,105502] 0 2024-03-22T07:28:31.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/420: link d13/d15/f37 d13/d15/f98 0 2024-03-22T07:28:31.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/421: chown d13/f34 95255330 1 2024-03-22T07:28:31.278 INFO:tasks.workunit.client.0.smithi134.stdout:2/164: mkdir d2/d5/d8/d2c 0 2024-03-22T07:28:31.278 INFO:tasks.workunit.client.0.smithi134.stdout:2/165: dread - d2/f28 zero size 2024-03-22T07:28:31.280 INFO:tasks.workunit.client.1.smithi195.stdout:0/387: dwrite d1/d10/d1f/f2c [0,4194304] 0 2024-03-22T07:28:31.280 INFO:tasks.workunit.client.1.smithi195.stdout:0/388: chown d1/d4/c24 203798514 1 2024-03-22T07:28:31.280 INFO:tasks.workunit.client.1.smithi195.stdout:0/389: chown d1/d4/dd/f59 96187 1 2024-03-22T07:28:31.282 INFO:tasks.workunit.client.1.smithi195.stdout:1/298: unlink d0/d2/d6/d21/d32/f44 0 2024-03-22T07:28:31.283 INFO:tasks.workunit.client.0.smithi134.stdout:1/259: rmdir d5/d1d 39 2024-03-22T07:28:31.290 INFO:tasks.workunit.client.1.smithi195.stdout:3/404: mkdir d3/d18/d89/d8c 0 2024-03-22T07:28:31.291 INFO:tasks.workunit.client.0.smithi134.stdout:6/178: rmdir d2/d3f/d28 39 2024-03-22T07:28:31.291 INFO:tasks.workunit.client.0.smithi134.stdout:6/179: chown d2/d1b 2 1 2024-03-22T07:28:31.297 INFO:tasks.workunit.client.1.smithi195.stdout:2/345: sync 2024-03-22T07:28:31.297 INFO:tasks.workunit.client.1.smithi195.stdout:8/398: sync 2024-03-22T07:28:31.297 INFO:tasks.workunit.client.1.smithi195.stdout:9/478: sync 2024-03-22T07:28:31.297 INFO:tasks.workunit.client.1.smithi195.stdout:2/346: chown d2/d3/d24/f67 572503 1 2024-03-22T07:28:31.297 INFO:tasks.workunit.client.1.smithi195.stdout:8/399: chown da/d17/d32/d61/c49 1 1 2024-03-22T07:28:31.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/400: chown da/de/l4b 0 1 2024-03-22T07:28:31.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/347: truncate d2/d3/d1a/f37 61626 0 2024-03-22T07:28:31.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/401: write da/f6b [434880,29426] 0 2024-03-22T07:28:31.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/402: stat f7 0 2024-03-22T07:28:31.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/403: dread - da/d17/d32/d61/d47/f67 zero size 2024-03-22T07:28:31.298 INFO:tasks.workunit.client.1.smithi195.stdout:8/404: chown da/dc/l28 1 1 2024-03-22T07:28:31.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/299: unlink d0/d2/d6/d21/d39/d40/f5c 0 2024-03-22T07:28:31.302 INFO:tasks.workunit.client.1.smithi195.stdout:1/300: fdatasync d0/d2/d6/d21/d39/d40/f43 0 2024-03-22T07:28:31.303 INFO:tasks.workunit.client.1.smithi195.stdout:2/348: write d2/f4d [1469979,37446] 0 2024-03-22T07:28:31.303 INFO:tasks.workunit.client.1.smithi195.stdout:2/349: dread - d2/d1e/f64 zero size 2024-03-22T07:28:31.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/350: write d2/d3/d21/f14 [3635841,30970] 0 2024-03-22T07:28:31.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/351: truncate d2/d3/f31 4581245 0 2024-03-22T07:28:31.304 INFO:tasks.workunit.client.1.smithi195.stdout:5/393: getdents d9/d53 0 2024-03-22T07:28:31.305 INFO:tasks.workunit.client.0.smithi134.stdout:5/134: getdents d1/d4 0 2024-03-22T07:28:31.307 INFO:tasks.workunit.client.1.smithi195.stdout:9/479: mknod d2/d4/d6/db/d20/d47/cae 0 2024-03-22T07:28:31.308 INFO:tasks.workunit.client.1.smithi195.stdout:0/390: write d1/d10/d1f/d40/d43/f53 [2773178,99333] 0 2024-03-22T07:28:31.310 INFO:tasks.workunit.client.1.smithi195.stdout:0/391: dread d1/d10/d1f/d40/d43/f4c [0,4194304] 0 2024-03-22T07:28:31.314 INFO:tasks.workunit.client.0.smithi134.stdout:2/166: dwrite d2/d5/f10 [0,4194304] 0 2024-03-22T07:28:31.318 INFO:tasks.workunit.client.1.smithi195.stdout:9/480: link d2/d4/d6/db/l17 d2/d4/d32/d6d/d78/d79/d97/laf 0 2024-03-22T07:28:31.319 INFO:tasks.workunit.client.0.smithi134.stdout:3/157: truncate f0 3714968 0 2024-03-22T07:28:31.319 INFO:tasks.workunit.client.0.smithi134.stdout:3/158: creat d4/d10/f36 x:0 0 0 2024-03-22T07:28:31.319 INFO:tasks.workunit.client.0.smithi134.stdout:3/159: dread - d4/d22/d29/f30 zero size 2024-03-22T07:28:31.319 INFO:tasks.workunit.client.0.smithi134.stdout:3/160: chown d4/d22/d29/f30 5623 1 2024-03-22T07:28:31.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/481: dread d2/d4/d32/f4b [0,4194304] 0 2024-03-22T07:28:31.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/482: write d2/f82 [525823,55950] 0 2024-03-22T07:28:31.320 INFO:tasks.workunit.client.1.smithi195.stdout:9/483: chown d2/d4/d23/l80 121642004 1 2024-03-22T07:28:31.321 INFO:tasks.workunit.client.1.smithi195.stdout:8/405: link da/d17/d32/d61/d47/d53/f5e da/dc/f7b 0 2024-03-22T07:28:31.322 INFO:tasks.workunit.client.0.smithi134.stdout:7/378: unlink d1/de/d11/d2b/d31/f5e 0 2024-03-22T07:28:31.323 INFO:tasks.workunit.client.0.smithi134.stdout:7/379: write d1/de/d11/d48/f3c [76787,73487] 0 2024-03-22T07:28:31.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/392: mkdir d1/d4/dd/df/d44/d6f 0 2024-03-22T07:28:31.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/301: dwrite d0/d2/f1b [0,4194304] 0 2024-03-22T07:28:31.325 INFO:tasks.workunit.client.0.smithi134.stdout:6/180: rename d2/d3f/d28/f33 to d2/f43 0 2024-03-22T07:28:31.329 INFO:tasks.workunit.client.1.smithi195.stdout:7/333: dwrite d0/d13/d22/d52/d59/f5f [0,4194304] 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.1.smithi195.stdout:2/352: dwrite d2/d1e/f64 [0,4194304] 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.1.smithi195.stdout:4/422: dwrite d13/d15/f98 [0,4194304] 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.0.smithi134.stdout:1/260: dwrite d5/da/d13/f3f [0,4194304] 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.0.smithi134.stdout:1/261: chown d5/d1d/d2d 961 1 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.0.smithi134.stdout:1/262: creat d5/da/d13/d1e/d34/f59 x:0 0 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.0.smithi134.stdout:7/380: dread d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/147: dwrite d3/d9/df/f26 [0,4194304] 0 2024-03-22T07:28:31.330 INFO:tasks.workunit.client.0.smithi134.stdout:7/381: getdents d1/de/d11/d48 0 2024-03-22T07:28:31.331 INFO:tasks.workunit.client.0.smithi134.stdout:5/135: stat d1/d8/l2a 0 2024-03-22T07:28:31.333 INFO:tasks.workunit.client.1.smithi195.stdout:8/406: link da/d17/c36 da/de/c7c 0 2024-03-22T07:28:31.334 INFO:tasks.workunit.client.1.smithi195.stdout:9/484: dwrite d2/d4/d32/d6d/f9e [0,4194304] 0 2024-03-22T07:28:31.334 INFO:tasks.workunit.client.1.smithi195.stdout:9/485: dread - d2/d4/d6/db/d20/d4a/fa9 zero size 2024-03-22T07:28:31.334 INFO:tasks.workunit.client.1.smithi195.stdout:9/486: chown d2/d4/d6/d18/f2b 573781309 1 2024-03-22T07:28:31.335 INFO:tasks.workunit.client.0.smithi134.stdout:8/260: mkdir d1/d15/d5b 0 2024-03-22T07:28:31.335 INFO:tasks.workunit.client.0.smithi134.stdout:8/261: truncate d1/f2d 5046632 0 2024-03-22T07:28:31.336 INFO:tasks.workunit.client.1.smithi195.stdout:0/393: symlink d1/d4/d22/l70 0 2024-03-22T07:28:31.339 INFO:tasks.workunit.client.1.smithi195.stdout:1/302: creat d0/d2/d9/f61 x:0 0 0 2024-03-22T07:28:31.340 INFO:tasks.workunit.client.0.smithi134.stdout:2/167: truncate d2/d5/d8/f1b 1988880 0 2024-03-22T07:28:31.346 INFO:tasks.workunit.client.0.smithi134.stdout:3/161: mknod d4/d10/c37 0 2024-03-22T07:28:31.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/394: dread d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:31.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/395: stat d1/d4/d12/d6c 0 2024-03-22T07:28:31.348 INFO:tasks.workunit.client.1.smithi195.stdout:0/396: stat d1/d4/dd/df/d44/c69 0 2024-03-22T07:28:31.349 INFO:tasks.workunit.client.0.smithi134.stdout:6/181: symlink d2/d1b/d1d/d2b/l44 0 2024-03-22T07:28:31.350 INFO:tasks.workunit.client.1.smithi195.stdout:7/334: mknod d0/c6a 0 2024-03-22T07:28:31.352 INFO:tasks.workunit.client.1.smithi195.stdout:4/423: dwrite d13/f14 [0,4194304] 0 2024-03-22T07:28:31.356 INFO:tasks.workunit.client.0.smithi134.stdout:3/162: read d4/d8/f12 [623882,6663] 0 2024-03-22T07:28:31.356 INFO:tasks.workunit.client.0.smithi134.stdout:3/163: fsync d4/d10/f33 0 2024-03-22T07:28:31.356 INFO:tasks.workunit.client.0.smithi134.stdout:3/164: dread d4/f1e [0,4194304] 0 2024-03-22T07:28:31.357 INFO:tasks.workunit.client.0.smithi134.stdout:9/148: rename d3/d9/df/d12/l13 to d3/d9/df/d12/l39 0 2024-03-22T07:28:31.359 INFO:tasks.workunit.client.0.smithi134.stdout:7/382: truncate d1/d19/d32/f4d 377728 0 2024-03-22T07:28:31.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/353: truncate d2/f34 328546 0 2024-03-22T07:28:31.361 INFO:tasks.workunit.client.0.smithi134.stdout:5/136: link d1/d8/l26 d1/d13/l2f 0 2024-03-22T07:28:31.367 INFO:tasks.workunit.client.0.smithi134.stdout:7/383: symlink d1/de/d11/d48/d52/d46/l81 0 2024-03-22T07:28:31.367 INFO:tasks.workunit.client.0.smithi134.stdout:7/384: write d1/de/d11/d48/d52/f3e [1268190,22842] 0 2024-03-22T07:28:31.370 INFO:tasks.workunit.client.0.smithi134.stdout:5/137: dread d1/d13/f1c [0,4194304] 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:6/182: getdents d2/d1b 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:6/183: readlink d2/l16 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:6/184: readlink d2/l14 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:9/149: dwrite d3/d9/f18 [0,4194304] 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:3/165: dread f0 [0,4194304] 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:9/150: readlink d3/d9/df/d12/l39 0 2024-03-22T07:28:31.374 INFO:tasks.workunit.client.0.smithi134.stdout:3/166: truncate d4/f1e 279448 0 2024-03-22T07:28:31.376 INFO:tasks.workunit.client.0.smithi134.stdout:8/262: getdents d1/d15 0 2024-03-22T07:28:31.376 INFO:tasks.workunit.client.0.smithi134.stdout:8/263: truncate d1/d4/f4a 721165 0 2024-03-22T07:28:31.385 INFO:tasks.workunit.client.0.smithi134.stdout:3/167: mknod d4/d10/c38 0 2024-03-22T07:28:31.386 INFO:tasks.workunit.client.0.smithi134.stdout:3/168: creat d4/d22/d29/f39 x:0 0 0 2024-03-22T07:28:31.386 INFO:tasks.workunit.client.0.smithi134.stdout:3/169: write d4/d10/f36 [251335,46677] 0 2024-03-22T07:28:31.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/303: creat d0/d2/d6/f62 x:0 0 0 2024-03-22T07:28:31.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/304: chown d0/d2/f1b 6 1 2024-03-22T07:28:31.389 INFO:tasks.workunit.client.0.smithi134.stdout:8/264: symlink d1/d15/d42/d12/l5c 0 2024-03-22T07:28:31.389 INFO:tasks.workunit.client.0.smithi134.stdout:3/170: dread d4/d22/f32 [0,4194304] 0 2024-03-22T07:28:31.389 INFO:tasks.workunit.client.0.smithi134.stdout:3/171: fsync d4/fc 0 2024-03-22T07:28:31.391 INFO:tasks.workunit.client.0.smithi134.stdout:6/185: dwrite d2/f35 [0,4194304] 0 2024-03-22T07:28:31.391 INFO:tasks.workunit.client.0.smithi134.stdout:6/186: dread - d2/d1b/f24 zero size 2024-03-22T07:28:31.391 INFO:tasks.workunit.client.0.smithi134.stdout:5/138: dwrite d1/d13/f1c [0,4194304] 0 2024-03-22T07:28:31.394 INFO:tasks.workunit.client.1.smithi195.stdout:7/335: rename d0/d13/d22/c3d to d0/d13/d14/d20/d40/c6b 0 2024-03-22T07:28:31.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/265: creat d1/f5d x:0 0 0 2024-03-22T07:28:31.400 INFO:tasks.workunit.client.0.smithi134.stdout:6/187: dread d2/d3f/d28/f25 [0,4194304] 0 2024-03-22T07:28:31.400 INFO:tasks.workunit.client.1.smithi195.stdout:4/424: mknod d13/d15/d64/c99 0 2024-03-22T07:28:31.406 INFO:tasks.workunit.client.1.smithi195.stdout:8/407: getdents da/d17/d32/d61/d47 0 2024-03-22T07:28:31.407 INFO:tasks.workunit.client.0.smithi134.stdout:3/172: dwrite d4/f1a [0,4194304] 0 2024-03-22T07:28:31.411 INFO:tasks.workunit.client.0.smithi134.stdout:5/139: creat d1/d8/d20/f30 x:0 0 0 2024-03-22T07:28:31.413 INFO:tasks.workunit.client.1.smithi195.stdout:9/487: link d2/d4/d6/c14 d2/d4/d6/db/d20/d47/cb0 0 2024-03-22T07:28:31.416 INFO:tasks.workunit.client.0.smithi134.stdout:6/188: unlink d2/l16 0 2024-03-22T07:28:31.417 INFO:tasks.workunit.client.1.smithi195.stdout:1/305: mkdir d0/d2/d27/d63 0 2024-03-22T07:28:31.417 INFO:tasks.workunit.client.1.smithi195.stdout:1/306: fsync d0/d2/d27/f33 0 2024-03-22T07:28:31.419 INFO:tasks.workunit.client.1.smithi195.stdout:0/397: rmdir d1/d4/d12 39 2024-03-22T07:28:31.421 INFO:tasks.workunit.client.0.smithi134.stdout:3/173: creat d4/d8/d23/f3a x:0 0 0 2024-03-22T07:28:31.421 INFO:tasks.workunit.client.0.smithi134.stdout:3/174: stat d4/l6 0 2024-03-22T07:28:31.421 INFO:tasks.workunit.client.1.smithi195.stdout:7/336: dwrite d0/d13/d14/d29/f33 [0,4194304] 0 2024-03-22T07:28:31.422 INFO:tasks.workunit.client.0.smithi134.stdout:9/151: dwrite d3/d9/df/f26 [4194304,4194304] 0 2024-03-22T07:28:31.422 INFO:tasks.workunit.client.0.smithi134.stdout:8/266: dwrite d1/f24 [0,4194304] 0 2024-03-22T07:28:31.422 INFO:tasks.workunit.client.0.smithi134.stdout:8/267: getdents d1/d15/d5b 0 2024-03-22T07:28:31.422 INFO:tasks.workunit.client.0.smithi134.stdout:9/152: dread d3/d9/df/d12/f1d [0,4194304] 0 2024-03-22T07:28:31.423 INFO:tasks.workunit.client.1.smithi195.stdout:2/354: rename d2/d3/d1a/c3b to d2/d3/d21/d60/c73 0 2024-03-22T07:28:31.424 INFO:tasks.workunit.client.0.smithi134.stdout:5/140: mknod d1/d8/d20/c31 0 2024-03-22T07:28:31.426 INFO:tasks.workunit.client.1.smithi195.stdout:8/408: mkdir da/d17/d32/d7d 0 2024-03-22T07:28:31.428 INFO:tasks.workunit.client.0.smithi134.stdout:3/175: rename d4/d22/d29/f39 to d4/d8/d23/f3b 0 2024-03-22T07:28:31.429 INFO:tasks.workunit.client.1.smithi195.stdout:1/307: mkdir d0/d2/d6/d21/d39/d64 0 2024-03-22T07:28:31.434 INFO:tasks.workunit.client.1.smithi195.stdout:8/409: dread da/d17/d32/d61/d47/d53/f6c [0,4194304] 0 2024-03-22T07:28:31.434 INFO:tasks.workunit.client.1.smithi195.stdout:8/410: read f7 [345302,34309] 0 2024-03-22T07:28:31.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/411: dread da/f35 [0,4194304] 0 2024-03-22T07:28:31.437 INFO:tasks.workunit.client.0.smithi134.stdout:8/268: link d1/d15/l1d d1/d4/d38/l5e 0 2024-03-22T07:28:31.437 INFO:tasks.workunit.client.0.smithi134.stdout:8/269: stat d1/d15/d42/f2b 0 2024-03-22T07:28:31.437 INFO:tasks.workunit.client.0.smithi134.stdout:8/270: chown d1/d15/d42/f28 52356 1 2024-03-22T07:28:31.439 INFO:tasks.workunit.client.1.smithi195.stdout:7/337: dwrite d0/f11 [0,4194304] 0 2024-03-22T07:28:31.439 INFO:tasks.workunit.client.1.smithi195.stdout:7/338: fdatasync d0/d13/f46 0 2024-03-22T07:28:31.441 INFO:tasks.workunit.client.1.smithi195.stdout:9/488: rename d2/d4/d32/l77 to d2/d4/d6/db/da8/lb1 0 2024-03-22T07:28:31.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/489: write d2/d4/d1d/f41 [797255,347] 0 2024-03-22T07:28:31.442 INFO:tasks.workunit.client.1.smithi195.stdout:9/490: creat d2/d4/d6/d18/d50/d88/fb2 x:0 0 0 2024-03-22T07:28:31.443 INFO:tasks.workunit.client.0.smithi134.stdout:9/153: rename d3/d9/f30 to d3/d9/f3a 0 2024-03-22T07:28:31.443 INFO:tasks.workunit.client.0.smithi134.stdout:9/154: fsync f1 0 2024-03-22T07:28:31.445 INFO:tasks.workunit.client.1.smithi195.stdout:1/308: creat d0/d2/d6/d21/d39/f65 x:0 0 0 2024-03-22T07:28:31.448 INFO:tasks.workunit.client.1.smithi195.stdout:0/398: truncate d1/d10/d1f/f2c 1309210 0 2024-03-22T07:28:31.455 INFO:tasks.workunit.client.1.smithi195.stdout:9/491: rmdir d2/d4/d32/d6d/d78/d8c 0 2024-03-22T07:28:31.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/399: write d1/d4/dd/df/f3e [812734,8961] 0 2024-03-22T07:28:31.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/400: write d1/d4/d12/f54 [5058670,99047] 0 2024-03-22T07:28:31.455 INFO:tasks.workunit.client.1.smithi195.stdout:0/401: chown d1/d4/d12/f54 688054 1 2024-03-22T07:28:31.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/309: mkdir d0/d2/d6/d21/d41/d47/d4a/d66 0 2024-03-22T07:28:31.459 INFO:tasks.workunit.client.1.smithi195.stdout:7/339: rename d0/l36 to d0/d13/d14/l6c 0 2024-03-22T07:28:31.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/412: dwrite da/d17/d32/d61/f72 [0,4194304] 0 2024-03-22T07:28:31.460 INFO:tasks.workunit.client.1.smithi195.stdout:8/413: fsync da/f35 0 2024-03-22T07:28:31.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/414: write da/f6b [810775,18087] 0 2024-03-22T07:28:31.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/415: truncate da/dc/f6f 1288283 0 2024-03-22T07:28:31.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/416: creat da/d17/d32/f7e x:0 0 0 2024-03-22T07:28:31.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/417: chown da/d17/d32/d61/d47 516 1 2024-03-22T07:28:31.461 INFO:tasks.workunit.client.0.smithi134.stdout:5/141: dwrite d1/d4/f10 [4194304,4194304] 0 2024-03-22T07:28:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:5/142: chown d1/d4/f2b 89673678 1 2024-03-22T07:28:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:5/143: chown d1/d8/ce 179 1 2024-03-22T07:28:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:5/144: fdatasync d1/d13/f15 0 2024-03-22T07:28:31.462 INFO:tasks.workunit.client.0.smithi134.stdout:8/271: dwrite d1/d15/f27 [0,4194304] 0 2024-03-22T07:28:31.462 INFO:tasks.workunit.client.1.smithi195.stdout:9/492: link d2/d4/d1d/f22 d2/d4/d1d/fb3 0 2024-03-22T07:28:31.467 INFO:tasks.workunit.client.1.smithi195.stdout:0/402: dread d1/d10/d1f/f2f [0,4194304] 0 2024-03-22T07:28:31.468 INFO:tasks.workunit.client.1.smithi195.stdout:1/310: link d0/d2/d6/d21/d39/d40/l5d d0/d2/d27/l67 0 2024-03-22T07:28:31.469 INFO:tasks.workunit.client.0.smithi134.stdout:9/155: mkdir d3/d9/df/d12/d3b 0 2024-03-22T07:28:31.469 INFO:tasks.workunit.client.0.smithi134.stdout:9/156: truncate d3/d9/f3a 182408 0 2024-03-22T07:28:31.471 INFO:tasks.workunit.client.1.smithi195.stdout:7/340: mkdir d0/d13/d14/d29/d35/d6d 0 2024-03-22T07:28:31.471 INFO:tasks.workunit.client.1.smithi195.stdout:7/341: stat d0/d13/d14/d29/d35/f37 0 2024-03-22T07:28:31.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/371: sync 2024-03-22T07:28:31.478 INFO:tasks.workunit.client.0.smithi134.stdout:5/145: mknod d1/c32 0 2024-03-22T07:28:31.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/372: dread d5/d5e/d34/d55/f36 [0,4194304] 0 2024-03-22T07:28:31.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/272: creat d1/d15/d42/d49/f5f x:0 0 0 2024-03-22T07:28:31.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/493: mknod d2/d4/d1d/cb4 0 2024-03-22T07:28:31.486 INFO:tasks.workunit.client.1.smithi195.stdout:9/494: write d2/d4/d6/db/d20/d4a/f6a [944786,9090] 0 2024-03-22T07:28:31.487 INFO:tasks.workunit.client.1.smithi195.stdout:0/403: dwrite d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:31.488 INFO:tasks.workunit.client.0.smithi134.stdout:8/273: symlink d1/d15/d42/d12/l60 0 2024-03-22T07:28:31.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/342: mkdir d0/d13/d14/d29/d6e 0 2024-03-22T07:28:31.492 INFO:tasks.workunit.client.0.smithi134.stdout:8/274: mkdir d1/d4/d61 0 2024-03-22T07:28:31.495 INFO:tasks.workunit.client.1.smithi195.stdout:6/373: mkdir d5/d16/d45/d53/d59/d87 0 2024-03-22T07:28:31.496 INFO:tasks.workunit.client.0.smithi134.stdout:8/275: rename d1/f18 to d1/d46/f62 0 2024-03-22T07:28:31.498 INFO:tasks.workunit.client.1.smithi195.stdout:8/418: getdents da/dc 0 2024-03-22T07:28:31.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/276: symlink d1/d15/l63 0 2024-03-22T07:28:31.500 INFO:tasks.workunit.client.0.smithi134.stdout:5/146: dwrite d1/d8/d20/f30 [0,4194304] 0 2024-03-22T07:28:31.501 INFO:tasks.workunit.client.1.smithi195.stdout:6/374: symlink d5/d16/d45/d53/d59/l88 0 2024-03-22T07:28:31.502 INFO:tasks.workunit.client.1.smithi195.stdout:0/404: dwrite d1/d4/dd/f59 [0,4194304] 0 2024-03-22T07:28:31.502 INFO:tasks.workunit.client.0.smithi134.stdout:8/277: mknod d1/d4/d61/c64 0 2024-03-22T07:28:31.502 INFO:tasks.workunit.client.0.smithi134.stdout:8/278: fsync d1/d15/d42/d12/d20/f3c 0 2024-03-22T07:28:31.502 INFO:tasks.workunit.client.0.smithi134.stdout:8/279: fdatasync d1/f2e 0 2024-03-22T07:28:31.504 INFO:tasks.workunit.client.1.smithi195.stdout:8/419: unlink da/de/l11 0 2024-03-22T07:28:31.504 INFO:tasks.workunit.client.1.smithi195.stdout:8/420: read - da/d17/d32/d61/d47/f67 zero size 2024-03-22T07:28:31.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/375: dread d5/d5e/d34/d55/f2e [0,4194304] 0 2024-03-22T07:28:31.507 INFO:tasks.workunit.client.1.smithi195.stdout:9/495: mkdir d2/d4/d6/db5 0 2024-03-22T07:28:31.508 INFO:tasks.workunit.client.0.smithi134.stdout:5/147: symlink d1/d13/l33 0 2024-03-22T07:28:31.508 INFO:tasks.workunit.client.0.smithi134.stdout:5/148: fdatasync d1/d4/f1a 0 2024-03-22T07:28:31.510 INFO:tasks.workunit.client.0.smithi134.stdout:8/280: creat d1/d4/d61/f65 x:0 0 0 2024-03-22T07:28:31.510 INFO:tasks.workunit.client.0.smithi134.stdout:8/281: dread - d1/d15/d42/f28 zero size 2024-03-22T07:28:31.510 INFO:tasks.workunit.client.0.smithi134.stdout:8/282: readlink d1/d15/d42/d12/l4c 0 2024-03-22T07:28:31.524 INFO:tasks.workunit.client.1.smithi195.stdout:6/376: dwrite d5/f6 [0,4194304] 0 2024-03-22T07:28:31.525 INFO:tasks.workunit.client.1.smithi195.stdout:6/377: read d5/d5e/d34/d55/f2e [612300,5719] 0 2024-03-22T07:28:31.525 INFO:tasks.workunit.client.1.smithi195.stdout:6/378: read d5/d5e/d34/d55/f2e [561996,58423] 0 2024-03-22T07:28:31.567 INFO:tasks.workunit.client.1.smithi195.stdout:0/405: rename d1/d10/d19/d20/f48 to d1/d4/dd/df/d44/d6f/f71 0 2024-03-22T07:28:31.568 INFO:tasks.workunit.client.1.smithi195.stdout:8/421: mknod da/d17/d32/d61/d47/c7f 0 2024-03-22T07:28:31.569 INFO:tasks.workunit.client.1.smithi195.stdout:8/422: stat da/d17/d32/d7d 0 2024-03-22T07:28:31.570 INFO:tasks.workunit.client.0.smithi134.stdout:5/149: link d1/d13/l23 d1/d8/d20/l34 0 2024-03-22T07:28:31.570 INFO:tasks.workunit.client.0.smithi134.stdout:5/150: dread - d1/d8/f21 zero size 2024-03-22T07:28:31.570 INFO:tasks.workunit.client.1.smithi195.stdout:9/496: symlink d2/d4/d32/d6d/d78/d79/d97/lb6 0 2024-03-22T07:28:31.572 INFO:tasks.workunit.client.0.smithi134.stdout:8/283: rename d1/d15/d42/d12/d20/c2f to d1/d4/c66 0 2024-03-22T07:28:31.573 INFO:tasks.workunit.client.1.smithi195.stdout:8/423: dread da/de/f2d [0,4194304] 0 2024-03-22T07:28:31.576 INFO:tasks.workunit.client.0.smithi134.stdout:5/151: symlink d1/d8/d16/l35 0 2024-03-22T07:28:31.578 INFO:tasks.workunit.client.0.smithi134.stdout:5/152: rmdir d1 39 2024-03-22T07:28:31.579 INFO:tasks.workunit.client.1.smithi195.stdout:0/406: mknod d1/d4/d12/c72 0 2024-03-22T07:28:31.580 INFO:tasks.workunit.client.1.smithi195.stdout:9/497: mknod d2/d4/d32/cb7 0 2024-03-22T07:28:31.582 INFO:tasks.workunit.client.1.smithi195.stdout:8/424: creat da/dc/d71/f80 x:0 0 0 2024-03-22T07:28:31.582 INFO:tasks.workunit.client.1.smithi195.stdout:8/425: getdents da/dc 0 2024-03-22T07:28:31.589 INFO:tasks.workunit.client.1.smithi195.stdout:6/379: rmdir d5/d16/d45/d53 39 2024-03-22T07:28:31.589 INFO:tasks.workunit.client.1.smithi195.stdout:6/380: dread - d5/d16/d45/f83 zero size 2024-03-22T07:28:31.590 INFO:tasks.workunit.client.1.smithi195.stdout:0/407: read d1/d4/d12/f55 [3422810,15146] 0 2024-03-22T07:28:31.590 INFO:tasks.workunit.client.1.smithi195.stdout:9/498: getdents d2/d4/d6/db/da8 0 2024-03-22T07:28:31.591 INFO:tasks.workunit.client.1.smithi195.stdout:8/426: rmdir da/d17/d32/d61/d47 39 2024-03-22T07:28:31.595 INFO:tasks.workunit.client.0.smithi134.stdout:8/284: dwrite d1/d15/f27 [4194304,4194304] 0 2024-03-22T07:28:31.595 INFO:tasks.workunit.client.0.smithi134.stdout:8/285: readlink d1/d4/l30 0 2024-03-22T07:28:31.595 INFO:tasks.workunit.client.0.smithi134.stdout:5/153: dwrite d1/d13/f15 [0,4194304] 0 2024-03-22T07:28:31.596 INFO:tasks.workunit.client.1.smithi195.stdout:0/408: dread d1/d4/f18 [8388608,4194304] 0 2024-03-22T07:28:31.596 INFO:tasks.workunit.client.0.smithi134.stdout:8/286: dread d1/d15/d42/d44/f3e [0,4194304] 0 2024-03-22T07:28:31.596 INFO:tasks.workunit.client.0.smithi134.stdout:5/154: write d1/d8/f1b [492537,36921] 0 2024-03-22T07:28:31.599 INFO:tasks.workunit.client.1.smithi195.stdout:9/499: write d2/d4/f3b [2732997,113993] 0 2024-03-22T07:28:31.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/155: mknod d1/c36 0 2024-03-22T07:28:31.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/156: truncate d1/d4/f2b 227494 0 2024-03-22T07:28:31.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/157: dread - d1/d8/f21 zero size 2024-03-22T07:28:31.601 INFO:tasks.workunit.client.1.smithi195.stdout:8/427: rmdir da 39 2024-03-22T07:28:31.601 INFO:tasks.workunit.client.1.smithi195.stdout:8/428: stat da/d17/l37 0 2024-03-22T07:28:31.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/158: rename d1/d4/c19 to d1/d4/c37 0 2024-03-22T07:28:31.603 INFO:tasks.workunit.client.1.smithi195.stdout:0/409: mknod d1/d4/dd/df/d44/c73 0 2024-03-22T07:28:31.606 INFO:tasks.workunit.client.0.smithi134.stdout:5/159: creat d1/d8/d16/f38 x:0 0 0 2024-03-22T07:28:31.606 INFO:tasks.workunit.client.0.smithi134.stdout:5/160: write d1/d4/f2b [1106076,55819] 0 2024-03-22T07:28:31.606 INFO:tasks.workunit.client.0.smithi134.stdout:5/161: chown d1/d8 1718 1 2024-03-22T07:28:31.607 INFO:tasks.workunit.client.1.smithi195.stdout:9/500: creat d2/d4/fb8 x:0 0 0 2024-03-22T07:28:31.607 INFO:tasks.workunit.client.1.smithi195.stdout:9/501: creat d2/d4/d6/db/fb9 x:0 0 0 2024-03-22T07:28:31.607 INFO:tasks.workunit.client.1.smithi195.stdout:8/429: symlink da/l81 0 2024-03-22T07:28:31.609 INFO:tasks.workunit.client.0.smithi134.stdout:5/162: link d1/d13/f15 d1/d8/d20/f39 0 2024-03-22T07:28:31.612 INFO:tasks.workunit.client.0.smithi134.stdout:5/163: rmdir d1/d4 39 2024-03-22T07:28:31.612 INFO:tasks.workunit.client.0.smithi134.stdout:8/287: dwrite d1/d15/d42/d25/f59 [0,4194304] 0 2024-03-22T07:28:31.612 INFO:tasks.workunit.client.0.smithi134.stdout:0/179: sync 2024-03-22T07:28:31.612 INFO:tasks.workunit.client.0.smithi134.stdout:4/255: sync 2024-03-22T07:28:31.613 INFO:tasks.workunit.client.1.smithi195.stdout:9/502: rmdir d2 39 2024-03-22T07:28:31.613 INFO:tasks.workunit.client.1.smithi195.stdout:9/503: chown d2/d4/d6/d18 3 1 2024-03-22T07:28:31.614 INFO:tasks.workunit.client.1.smithi195.stdout:8/430: mkdir da/d82 0 2024-03-22T07:28:31.616 INFO:tasks.workunit.client.1.smithi195.stdout:0/410: rmdir d1/d10/d1f/d40 39 2024-03-22T07:28:31.617 INFO:tasks.workunit.client.0.smithi134.stdout:5/164: mknod d1/d4/c3a 0 2024-03-22T07:28:31.618 INFO:tasks.workunit.client.1.smithi195.stdout:9/504: link d2/d4/d32/l35 d2/d4/d23/d74/lba 0 2024-03-22T07:28:31.619 INFO:tasks.workunit.client.0.smithi134.stdout:4/256: mknod d2/d2a/d50/c53 0 2024-03-22T07:28:31.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/288: write d1/f24 [2687980,123100] 0 2024-03-22T07:28:31.621 INFO:tasks.workunit.client.1.smithi195.stdout:8/431: unlink da/d17/d32/d61/d47/f67 0 2024-03-22T07:28:31.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/180: symlink dc/d18/l39 0 2024-03-22T07:28:31.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/181: creat dc/d17/f3a x:0 0 0 2024-03-22T07:28:31.624 INFO:tasks.workunit.client.1.smithi195.stdout:0/411: mknod d1/d4/dd/df/c74 0 2024-03-22T07:28:31.625 INFO:tasks.workunit.client.0.smithi134.stdout:5/165: write d1/d4/f1a [3485545,43335] 0 2024-03-22T07:28:31.625 INFO:tasks.workunit.client.0.smithi134.stdout:5/166: creat d1/d8/d20/f3b x:0 0 0 2024-03-22T07:28:31.626 INFO:tasks.workunit.client.1.smithi195.stdout:3/405: sync 2024-03-22T07:28:31.626 INFO:tasks.workunit.client.1.smithi195.stdout:9/505: creat d2/d4/d6/db5/fbb x:0 0 0 2024-03-22T07:28:31.629 INFO:tasks.workunit.client.1.smithi195.stdout:3/406: creat d3/df/d15/d1d/d5c/d47/d67/f8d x:0 0 0 2024-03-22T07:28:31.633 INFO:tasks.workunit.client.1.smithi195.stdout:9/506: link d2/d4/d6/db/l85 d2/d4/d6/db/d20/d4a/da2/lbc 0 2024-03-22T07:28:31.633 INFO:tasks.workunit.client.1.smithi195.stdout:9/507: truncate d2/d4/f9f 1305100 0 2024-03-22T07:28:31.634 INFO:tasks.workunit.client.0.smithi134.stdout:8/289: rename d1/d15/d42/d12/f1a to d1/f67 0 2024-03-22T07:28:31.637 INFO:tasks.workunit.client.1.smithi195.stdout:9/508: rename d2/d4/d6/d18/f1e to d2/dad/fbd 0 2024-03-22T07:28:31.640 INFO:tasks.workunit.client.0.smithi134.stdout:5/167: mknod d1/d8/d16/c3c 0 2024-03-22T07:28:31.641 INFO:tasks.workunit.client.1.smithi195.stdout:9/509: truncate f0 2569837 0 2024-03-22T07:28:31.642 INFO:tasks.workunit.client.0.smithi134.stdout:5/168: mknod d1/d13/c3d 0 2024-03-22T07:28:31.642 INFO:tasks.workunit.client.0.smithi134.stdout:5/169: write d1/d8/d20/f39 [2699964,13039] 0 2024-03-22T07:28:31.642 INFO:tasks.workunit.client.0.smithi134.stdout:5/170: creat d1/d8/d20/f3e x:0 0 0 2024-03-22T07:28:31.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/510: rename d2/d4/d6/db/f1b to d2/fbe 0 2024-03-22T07:28:31.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/511: write d2/d4/d32/d6d/f6f [1651446,35219] 0 2024-03-22T07:28:31.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/512: creat d2/d4/d6/d18/fbf x:0 0 0 2024-03-22T07:28:31.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/513: creat d2/d4/d6/db/d20/fc0 x:0 0 0 2024-03-22T07:28:31.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/514: stat d2/d4/d1d/c21 0 2024-03-22T07:28:31.645 INFO:tasks.workunit.client.0.smithi134.stdout:0/182: dwrite dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:31.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/171: mkdir d1/d8/d3f 0 2024-03-22T07:28:31.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/172: creat d1/d8/d16/f40 x:0 0 0 2024-03-22T07:28:31.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/173: readlink d1/d13/l33 0 2024-03-22T07:28:31.654 INFO:tasks.workunit.client.0.smithi134.stdout:5/174: creat d1/d8/d3f/f41 x:0 0 0 2024-03-22T07:28:31.654 INFO:tasks.workunit.client.0.smithi134.stdout:5/175: creat d1/d8/f42 x:0 0 0 2024-03-22T07:28:31.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/432: dwrite da/d17/d32/d61/f74 [0,4194304] 0 2024-03-22T07:28:31.658 INFO:tasks.workunit.client.1.smithi195.stdout:3/407: getdents d3/df/d15/d1d/d5c/d47/d67 0 2024-03-22T07:28:31.658 INFO:tasks.workunit.client.1.smithi195.stdout:3/408: fdatasync d3/d18/d89/d76/f85 0 2024-03-22T07:28:31.660 INFO:tasks.workunit.client.1.smithi195.stdout:3/409: rmdir d3/d88 0 2024-03-22T07:28:31.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/410: mkdir d3/d18/d89/d70/d8e 0 2024-03-22T07:28:31.663 INFO:tasks.workunit.client.1.smithi195.stdout:3/411: unlink d3/l75 0 2024-03-22T07:28:31.665 INFO:tasks.workunit.client.1.smithi195.stdout:3/412: creat d3/df/d15/d1d/d5c/d47/d67/d80/f8f x:0 0 0 2024-03-22T07:28:31.666 INFO:tasks.workunit.client.0.smithi134.stdout:5/176: dread d1/d4/f10 [4194304,4194304] 0 2024-03-22T07:28:31.667 INFO:tasks.workunit.client.1.smithi195.stdout:3/413: creat d3/d18/d89/f90 x:0 0 0 2024-03-22T07:28:31.667 INFO:tasks.workunit.client.1.smithi195.stdout:0/412: dwrite d1/d4/f7 [0,4194304] 0 2024-03-22T07:28:31.667 INFO:tasks.workunit.client.1.smithi195.stdout:0/413: chown d1/d10/d19/d20/f61 391769774 1 2024-03-22T07:28:31.668 INFO:tasks.workunit.client.0.smithi134.stdout:0/183: dwrite dc/d17/f38 [0,4194304] 0 2024-03-22T07:28:31.668 INFO:tasks.workunit.client.0.smithi134.stdout:0/184: chown dc 4089300 1 2024-03-22T07:28:31.669 INFO:tasks.workunit.client.0.smithi134.stdout:4/257: dwrite d2/d15/f51 [0,4194304] 0 2024-03-22T07:28:31.669 INFO:tasks.workunit.client.0.smithi134.stdout:5/177: unlink d1/d8/d16/f38 0 2024-03-22T07:28:31.671 INFO:tasks.workunit.client.1.smithi195.stdout:3/414: creat d3/f91 x:0 0 0 2024-03-22T07:28:31.674 INFO:tasks.workunit.client.1.smithi195.stdout:8/433: dwrite da/dc/d71/f80 [0,4194304] 0 2024-03-22T07:28:31.679 INFO:tasks.workunit.client.1.smithi195.stdout:3/415: mkdir d3/d18/d89/d92 0 2024-03-22T07:28:31.679 INFO:tasks.workunit.client.1.smithi195.stdout:9/515: write f1 [895623,54206] 0 2024-03-22T07:28:31.686 INFO:tasks.workunit.client.0.smithi134.stdout:5/178: unlink d1/d4/c3a 0 2024-03-22T07:28:31.687 INFO:tasks.workunit.client.1.smithi195.stdout:8/434: creat da/d17/d32/d61/d47/f83 x:0 0 0 2024-03-22T07:28:31.687 INFO:tasks.workunit.client.1.smithi195.stdout:8/435: write da/dc/f2b [1388524,115170] 0 2024-03-22T07:28:31.688 INFO:tasks.workunit.client.1.smithi195.stdout:3/416: rename d3/d22/d64 to d3/df/d15/d1d/d5c/d47/d67/d93 0 2024-03-22T07:28:31.688 INFO:tasks.workunit.client.0.smithi134.stdout:5/179: truncate d1/d8/d20/f30 126199 0 2024-03-22T07:28:31.691 INFO:tasks.workunit.client.0.smithi134.stdout:5/180: rename d1/f2c to d1/d13/f43 0 2024-03-22T07:28:31.693 INFO:tasks.workunit.client.1.smithi195.stdout:3/417: mkdir d3/d22/d94 0 2024-03-22T07:28:31.694 INFO:tasks.workunit.client.0.smithi134.stdout:5/181: symlink d1/d8/d3f/l44 0 2024-03-22T07:28:31.696 INFO:tasks.workunit.client.1.smithi195.stdout:9/516: unlink d2/d4/d6/la 0 2024-03-22T07:28:31.696 INFO:tasks.workunit.client.0.smithi134.stdout:5/182: mknod d1/c45 0 2024-03-22T07:28:31.697 INFO:tasks.workunit.client.1.smithi195.stdout:9/517: mknod d2/d4/d6/db/d20/d47/cc1 0 2024-03-22T07:28:31.699 INFO:tasks.workunit.client.1.smithi195.stdout:9/518: dread d2/d4/d1d/f41 [0,4194304] 0 2024-03-22T07:28:31.699 INFO:tasks.workunit.client.1.smithi195.stdout:9/519: chown d2/d4/c90 967 1 2024-03-22T07:28:31.711 INFO:tasks.workunit.client.0.smithi134.stdout:0/185: dwrite dc/de/f23 [0,4194304] 0 2024-03-22T07:28:31.711 INFO:tasks.workunit.client.0.smithi134.stdout:0/186: readlink dc/d18/l30 0 2024-03-22T07:28:31.712 INFO:tasks.workunit.client.0.smithi134.stdout:0/187: read dc/f20 [2393945,111956] 0 2024-03-22T07:28:31.712 INFO:tasks.workunit.client.0.smithi134.stdout:0/188: write dc/f29 [865340,30671] 0 2024-03-22T07:28:31.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/189: symlink dc/de/l3b 0 2024-03-22T07:28:31.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/190: fsync dc/de/f35 0 2024-03-22T07:28:31.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/191: truncate f9 2466730 0 2024-03-22T07:28:31.715 INFO:tasks.workunit.client.0.smithi134.stdout:0/192: link dc/d17/f38 dc/f3c 0 2024-03-22T07:28:31.715 INFO:tasks.workunit.client.0.smithi134.stdout:0/193: chown dc/d18/l39 11 1 2024-03-22T07:28:31.715 INFO:tasks.workunit.client.0.smithi134.stdout:0/194: readlink dc/l22 0 2024-03-22T07:28:31.716 INFO:tasks.workunit.client.0.smithi134.stdout:0/195: mknod dc/d18/c3d 0 2024-03-22T07:28:31.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/520: dread d2/d4/d6/db/d20/d4a/f83 [0,4194304] 0 2024-03-22T07:28:31.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/521: chown d2/d4/d6/db/d20/l34 764961 1 2024-03-22T07:28:31.716 INFO:tasks.workunit.client.1.smithi195.stdout:9/522: readlink d2/d4/d6/db/d20/d4a/l7e 0 2024-03-22T07:28:31.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/523: chown d2/d4/d6/db/l17 5 1 2024-03-22T07:28:31.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/524: unlink d2/d4/d1d/f3d 0 2024-03-22T07:28:31.718 INFO:tasks.workunit.client.1.smithi195.stdout:9/525: symlink d2/d4/d6/db/d20/lc2 0 2024-03-22T07:28:31.724 INFO:tasks.workunit.client.0.smithi134.stdout:4/258: dwrite d2/f33 [0,4194304] 0 2024-03-22T07:28:31.725 INFO:tasks.workunit.client.1.smithi195.stdout:0/414: dwrite d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:31.725 INFO:tasks.workunit.client.1.smithi195.stdout:8/436: dwrite da/f56 [4194304,4194304] 0 2024-03-22T07:28:31.725 INFO:tasks.workunit.client.0.smithi134.stdout:5/183: dwrite d1/d13/f43 [0,4194304] 0 2024-03-22T07:28:31.725 INFO:tasks.workunit.client.0.smithi134.stdout:5/184: write d1/d13/f1c [5195544,87144] 0 2024-03-22T07:28:31.726 INFO:tasks.workunit.client.0.smithi134.stdout:5/185: write d1/d8/d20/f3e [26605,83543] 0 2024-03-22T07:28:31.726 INFO:tasks.workunit.client.1.smithi195.stdout:3/418: dwrite d3/d18/f51 [0,4194304] 0 2024-03-22T07:28:31.726 INFO:tasks.workunit.client.1.smithi195.stdout:3/419: chown d3/df/d15/d1d/d5c/d47/d67/d80 250181 1 2024-03-22T07:28:31.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/259: rename d2/d1d/f1f to d2/d1d/f54 0 2024-03-22T07:28:31.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/260: fsync d2/d15/f39 0 2024-03-22T07:28:31.732 INFO:tasks.workunit.client.1.smithi195.stdout:8/437: dread da/d17/d32/d61/f72 [0,4194304] 0 2024-03-22T07:28:31.741 INFO:tasks.workunit.client.0.smithi134.stdout:4/261: rename d2/d15/f12 to d2/d15/d35/d37/f55 0 2024-03-22T07:28:31.741 INFO:tasks.workunit.client.0.smithi134.stdout:4/262: write d2/d1d/f54 [5114492,96683] 0 2024-03-22T07:28:31.744 INFO:tasks.workunit.client.0.smithi134.stdout:0/196: dwrite dc/f32 [0,4194304] 0 2024-03-22T07:28:31.745 INFO:tasks.workunit.client.0.smithi134.stdout:4/263: rename d2/d1d/c34 to d2/d15/d35/d37/d43/c56 0 2024-03-22T07:28:31.749 INFO:tasks.workunit.client.0.smithi134.stdout:1/263: sync 2024-03-22T07:28:31.749 INFO:tasks.workunit.client.0.smithi134.stdout:2/168: sync 2024-03-22T07:28:31.751 INFO:tasks.workunit.client.1.smithi195.stdout:4/425: sync 2024-03-22T07:28:31.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/394: sync 2024-03-22T07:28:31.752 INFO:tasks.workunit.client.1.smithi195.stdout:8/438: unlink da/f56 0 2024-03-22T07:28:31.754 INFO:tasks.workunit.client.1.smithi195.stdout:0/415: mknod d1/d10/d1f/c75 0 2024-03-22T07:28:31.759 INFO:tasks.workunit.client.1.smithi195.stdout:5/395: mkdir d9/d2d/d84/d92 0 2024-03-22T07:28:31.759 INFO:tasks.workunit.client.1.smithi195.stdout:5/396: creat d9/d2d/d58/f93 x:0 0 0 2024-03-22T07:28:31.759 INFO:tasks.workunit.client.1.smithi195.stdout:5/397: readlink d9/d12/d1d/d69/d78/d41/l66 0 2024-03-22T07:28:31.761 INFO:tasks.workunit.client.0.smithi134.stdout:5/186: dwrite d1/d8/f21 [0,4194304] 0 2024-03-22T07:28:31.761 INFO:tasks.workunit.client.0.smithi134.stdout:5/187: creat d1/d8/f46 x:0 0 0 2024-03-22T07:28:31.761 INFO:tasks.workunit.client.1.smithi195.stdout:8/439: symlink da/l84 0 2024-03-22T07:28:31.761 INFO:tasks.workunit.client.1.smithi195.stdout:9/526: dwrite d2/d4/d32/d6d/f6f [0,4194304] 0 2024-03-22T07:28:31.765 INFO:tasks.workunit.client.1.smithi195.stdout:3/420: dwrite d3/df/d15/d1d/d5c/d47/f66 [4194304,4194304] 0 2024-03-22T07:28:31.765 INFO:tasks.workunit.client.1.smithi195.stdout:8/440: dread da/d17/d32/f58 [0,4194304] 0 2024-03-22T07:28:31.765 INFO:tasks.workunit.client.1.smithi195.stdout:8/441: readlink da/d17/d32/d61/l70 0 2024-03-22T07:28:31.765 INFO:tasks.workunit.client.1.smithi195.stdout:8/442: chown f9 13791 1 2024-03-22T07:28:31.766 INFO:tasks.workunit.client.0.smithi134.stdout:5/188: dread d1/d4/f10 [4194304,4194304] 0 2024-03-22T07:28:31.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/398: link d9/d12/d1d/c24 d9/d2d/d8f/c94 0 2024-03-22T07:28:31.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/399: write d9/d12/d1d/d69/d78/f7e [8634903,36443] 0 2024-03-22T07:28:31.770 INFO:tasks.workunit.client.0.smithi134.stdout:5/189: dread d1/d4/f2b [0,4194304] 0 2024-03-22T07:28:31.770 INFO:tasks.workunit.client.0.smithi134.stdout:4/264: unlink d2/d1d/l3c 0 2024-03-22T07:28:31.774 INFO:tasks.workunit.client.1.smithi195.stdout:9/527: rename d2/d4/d6/db/d20/d4a/da2/lbc to d2/lc3 0 2024-03-22T07:28:31.774 INFO:tasks.workunit.client.1.smithi195.stdout:4/426: dwrite d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:31.775 INFO:tasks.workunit.client.1.smithi195.stdout:0/416: dwrite d1/d4/dd/df/f3e [0,4194304] 0 2024-03-22T07:28:31.775 INFO:tasks.workunit.client.0.smithi134.stdout:2/169: truncate d2/f14 6256694 0 2024-03-22T07:28:31.779 INFO:tasks.workunit.client.1.smithi195.stdout:3/421: unlink d3/df/d15/c32 0 2024-03-22T07:28:31.780 INFO:tasks.workunit.client.1.smithi195.stdout:8/443: getdents da/d17/d32/d78 0 2024-03-22T07:28:31.785 INFO:tasks.workunit.client.1.smithi195.stdout:9/528: creat d2/d4/d6/db/d20/d4a/da2/fc4 x:0 0 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/197: rename dc/d17/f3a to dc/f3e 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/265: dwrite d2/d15/f1e [0,4194304] 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/198: creat dc/d17/f3f x:0 0 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/266: stat d2/d15 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/267: truncate d2/f46 304798 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/268: write d2/ff [1488961,44444] 0 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/269: chown d2/d15/c2c 14896 1 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/270: chown d2/d25/f3e 0 1 2024-03-22T07:28:31.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/271: readlink d2/d25/l1a 0 2024-03-22T07:28:31.789 INFO:tasks.workunit.client.0.smithi134.stdout:4/272: creat d2/d25/d48/f57 x:0 0 0 2024-03-22T07:28:31.789 INFO:tasks.workunit.client.1.smithi195.stdout:6/381: sync 2024-03-22T07:28:31.789 INFO:tasks.workunit.client.1.smithi195.stdout:1/311: sync 2024-03-22T07:28:31.789 INFO:tasks.workunit.client.1.smithi195.stdout:7/343: sync 2024-03-22T07:28:31.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/355: sync 2024-03-22T07:28:31.789 INFO:tasks.workunit.client.1.smithi195.stdout:2/356: dread d2/d3/d1a/f3a [0,4194304] 0 2024-03-22T07:28:31.791 INFO:tasks.workunit.client.0.smithi134.stdout:2/170: mknod d2/c2d 0 2024-03-22T07:28:31.795 INFO:tasks.workunit.client.1.smithi195.stdout:4/427: rename d13/d63/d36/d5f/l6e to d13/d15/d6b/l9a 0 2024-03-22T07:28:31.801 INFO:tasks.workunit.client.0.smithi134.stdout:5/190: rename d1/d8/l2a to d1/d4/l47 0 2024-03-22T07:28:31.801 INFO:tasks.workunit.client.0.smithi134.stdout:5/191: chown d1/d13 7153 1 2024-03-22T07:28:31.805 INFO:tasks.workunit.client.0.smithi134.stdout:2/171: write d2/f1a [2138400,130093] 0 2024-03-22T07:28:31.805 INFO:tasks.workunit.client.0.smithi134.stdout:5/192: dread d1/d8/d20/f30 [0,4194304] 0 2024-03-22T07:28:31.806 INFO:tasks.workunit.client.0.smithi134.stdout:5/193: readlink d1/d4/l2d 0 2024-03-22T07:28:31.806 INFO:tasks.workunit.client.0.smithi134.stdout:7/385: sync 2024-03-22T07:28:31.807 INFO:tasks.workunit.client.0.smithi134.stdout:3/176: sync 2024-03-22T07:28:31.807 INFO:tasks.workunit.client.0.smithi134.stdout:7/386: chown d1/de/d11/d2b/d31/l5f 29 1 2024-03-22T07:28:31.807 INFO:tasks.workunit.client.0.smithi134.stdout:6/189: sync 2024-03-22T07:28:31.807 INFO:tasks.workunit.client.0.smithi134.stdout:9/157: sync 2024-03-22T07:28:31.807 INFO:tasks.workunit.client.0.smithi134.stdout:9/158: fsync d3/d9/df/d12/f1f 0 2024-03-22T07:28:31.807 INFO:tasks.workunit.client.1.smithi195.stdout:2/357: write d2/d3/d7/da/d1b/f29 [1451839,47995] 0 2024-03-22T07:28:31.808 INFO:tasks.workunit.client.1.smithi195.stdout:2/358: chown d2/d3/d21/d40/f5d 0 1 2024-03-22T07:28:31.808 INFO:tasks.workunit.client.1.smithi195.stdout:3/422: dwrite d3/df/d15/d1d/d5c/d47/f4d [0,4194304] 0 2024-03-22T07:28:31.808 INFO:tasks.workunit.client.1.smithi195.stdout:8/444: creat da/d17/d32/d7d/f85 x:0 0 0 2024-03-22T07:28:31.808 INFO:tasks.workunit.client.0.smithi134.stdout:9/159: dread d3/f14 [0,4194304] 0 2024-03-22T07:28:31.810 INFO:tasks.workunit.client.1.smithi195.stdout:8/445: dread f7 [0,4194304] 0 2024-03-22T07:28:31.813 INFO:tasks.workunit.client.1.smithi195.stdout:6/382: chown d5/d16/c38 5 1 2024-03-22T07:28:31.813 INFO:tasks.workunit.client.1.smithi195.stdout:6/383: creat d5/d5e/d34/d55/d3b/d6e/d56/f89 x:0 0 0 2024-03-22T07:28:31.814 INFO:tasks.workunit.client.0.smithi134.stdout:0/199: dwrite f9 [0,4194304] 0 2024-03-22T07:28:31.814 INFO:tasks.workunit.client.0.smithi134.stdout:0/200: chown dc/de/l3b 75 1 2024-03-22T07:28:31.815 INFO:tasks.workunit.client.1.smithi195.stdout:1/312: creat d0/d2/d6/d21/d39/f68 x:0 0 0 2024-03-22T07:28:31.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/344: link d0/d13/d14/d29/d35/c5a d0/d13/d14/d29/d35/d3a/c6f 0 2024-03-22T07:28:31.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/345: chown d0/d13/d22/d28 29248893 1 2024-03-22T07:28:31.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/346: chown d0/d13/f1e 45743560 1 2024-03-22T07:28:31.818 INFO:tasks.workunit.client.1.smithi195.stdout:7/347: fdatasync d0/d13/f1c 0 2024-03-22T07:28:31.820 INFO:tasks.workunit.client.0.smithi134.stdout:2/172: rename d2/c2d to d2/d5/d8/d2c/c2e 0 2024-03-22T07:28:31.822 INFO:tasks.workunit.client.1.smithi195.stdout:9/529: dwrite d2/d4/f1a [0,4194304] 0 2024-03-22T07:28:31.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/428: creat d13/d2a/d7e/d85/f9b x:0 0 0 2024-03-22T07:28:31.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/429: write f9 [66070,88399] 0 2024-03-22T07:28:31.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/430: write d13/d15/f1c [1343173,42061] 0 2024-03-22T07:28:31.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/431: fsync d13/f1f 0 2024-03-22T07:28:31.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/432: write d13/d63/d3e/f97 [252273,39141] 0 2024-03-22T07:28:31.823 INFO:tasks.workunit.client.1.smithi195.stdout:4/433: truncate d13/f3a 1036638 0 2024-03-22T07:28:31.824 INFO:tasks.workunit.client.0.smithi134.stdout:3/177: truncate d4/d8/f12 3070465 0 2024-03-22T07:28:31.825 INFO:tasks.workunit.client.1.smithi195.stdout:2/359: creat d2/d3/f74 x:0 0 0 2024-03-22T07:28:31.825 INFO:tasks.workunit.client.0.smithi134.stdout:4/273: dwrite d2/d15/f40 [0,4194304] 0 2024-03-22T07:28:31.827 INFO:tasks.workunit.client.0.smithi134.stdout:7/387: symlink d1/de/d41/l82 0 2024-03-22T07:28:31.827 INFO:tasks.workunit.client.0.smithi134.stdout:7/388: chown d1 6371676 1 2024-03-22T07:28:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:8/290: sync 2024-03-22T07:28:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:8/291: dread - d1/d15/d42/d44/f52 zero size 2024-03-22T07:28:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:8/292: fdatasync d1/d4/f47 0 2024-03-22T07:28:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:9/160: mkdir d3/d9/d37/d3c 0 2024-03-22T07:28:31.831 INFO:tasks.workunit.client.0.smithi134.stdout:9/161: write d3/f25 [214183,25173] 0 2024-03-22T07:28:31.833 INFO:tasks.workunit.client.1.smithi195.stdout:0/417: dwrite d1/d10/d1f/f57 [0,4194304] 0 2024-03-22T07:28:31.833 INFO:tasks.workunit.client.1.smithi195.stdout:2/360: dread d2/d1e/f64 [0,4194304] 0 2024-03-22T07:28:31.835 INFO:tasks.workunit.client.1.smithi195.stdout:8/446: dwrite da/f35 [0,4194304] 0 2024-03-22T07:28:31.835 INFO:tasks.workunit.client.0.smithi134.stdout:0/201: link dc/d18/f1a dc/d17/f40 0 2024-03-22T07:28:31.837 INFO:tasks.workunit.client.1.smithi195.stdout:6/384: creat d5/d16/d45/d53/f8a x:0 0 0 2024-03-22T07:28:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/178: dwrite d4/f1e [0,4194304] 0 2024-03-22T07:28:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/179: readlink d4/d8/d23/l2f 0 2024-03-22T07:28:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/180: fdatasync f3 0 2024-03-22T07:28:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/181: fsync f3 0 2024-03-22T07:28:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/182: truncate d4/d8/fa 9283522 0 2024-03-22T07:28:31.840 INFO:tasks.workunit.client.0.smithi134.stdout:0/202: dread dc/f29 [0,4194304] 0 2024-03-22T07:28:31.841 INFO:tasks.workunit.client.1.smithi195.stdout:1/313: rename d0/d2/l4e to d0/d2/d27/l69 0 2024-03-22T07:28:31.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/423: read d3/df/d15/d1d/f30 [7188359,110659] 0 2024-03-22T07:28:31.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/424: write d3/df/d15/d1d/d5c/f72 [94431,78425] 0 2024-03-22T07:28:31.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/314: dread d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:31.850 INFO:tasks.workunit.client.1.smithi195.stdout:9/530: symlink d2/d4/d6/db/da8/lc5 0 2024-03-22T07:28:31.850 INFO:tasks.workunit.client.1.smithi195.stdout:9/531: chown d2/dad 58747882 1 2024-03-22T07:28:31.850 INFO:tasks.workunit.client.1.smithi195.stdout:9/532: read d2/d4/d32/f4b [148450,58479] 0 2024-03-22T07:28:31.851 INFO:tasks.workunit.client.0.smithi134.stdout:4/274: link d2/d15/c2c d2/d2a/c58 0 2024-03-22T07:28:31.853 INFO:tasks.workunit.client.0.smithi134.stdout:7/389: getdents d1/de 0 2024-03-22T07:28:31.853 INFO:tasks.workunit.client.1.smithi195.stdout:6/385: dread d5/d5e/d34/d55/d3b/d6e/d3c/f44 [0,4194304] 0 2024-03-22T07:28:31.856 INFO:tasks.workunit.client.1.smithi195.stdout:4/434: unlink d13/d2a/d7e/d8c/l92 0 2024-03-22T07:28:31.856 INFO:tasks.workunit.client.1.smithi195.stdout:4/435: readlink d13/d15/l2b 0 2024-03-22T07:28:31.856 INFO:tasks.workunit.client.1.smithi195.stdout:4/436: chown c10 48 1 2024-03-22T07:28:31.856 INFO:tasks.workunit.client.1.smithi195.stdout:4/437: creat d13/f9c x:0 0 0 2024-03-22T07:28:31.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/400: truncate d9/d12/d1d/d69/d78/f7e 2326249 0 2024-03-22T07:28:31.858 INFO:tasks.workunit.client.0.smithi134.stdout:6/190: creat d2/d1b/f45 x:0 0 0 2024-03-22T07:28:31.861 INFO:tasks.workunit.client.0.smithi134.stdout:0/203: dwrite f5 [0,4194304] 0 2024-03-22T07:28:31.861 INFO:tasks.workunit.client.0.smithi134.stdout:8/293: truncate d1/d4/f54 207830 0 2024-03-22T07:28:31.862 INFO:tasks.workunit.client.1.smithi195.stdout:2/361: rmdir d2/d3/d7/d19/d22 39 2024-03-22T07:28:31.863 INFO:tasks.workunit.client.1.smithi195.stdout:0/418: dwrite d1/d4/f2e [0,4194304] 0 2024-03-22T07:28:31.864 INFO:tasks.workunit.client.0.smithi134.stdout:4/275: write d2/d1d/f54 [2499553,41819] 0 2024-03-22T07:28:31.864 INFO:tasks.workunit.client.0.smithi134.stdout:9/162: unlink d3/d9/df/d12/d1b/c35 0 2024-03-22T07:28:31.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/438: dread d13/d2a/f2e [0,4194304] 0 2024-03-22T07:28:31.871 INFO:tasks.workunit.client.1.smithi195.stdout:7/348: rename d0/d13/d22/c4f to d0/d13/d22/d28/c70 0 2024-03-22T07:28:31.872 INFO:tasks.workunit.client.0.smithi134.stdout:3/183: rmdir d4 39 2024-03-22T07:28:31.872 INFO:tasks.workunit.client.0.smithi134.stdout:3/184: chown d4/d22/d29/c34 6560647 1 2024-03-22T07:28:31.872 INFO:tasks.workunit.client.0.smithi134.stdout:3/185: write d4/d10/f2c [528795,65844] 0 2024-03-22T07:28:31.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/425: truncate d3/df/d15/d1d/d5c/d47/d67/d80/f78 253545 0 2024-03-22T07:28:31.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/426: chown d3/d18/l1b 7115352 1 2024-03-22T07:28:31.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/427: write d3/df/d15/d1d/f31 [8936758,63163] 0 2024-03-22T07:28:31.874 INFO:tasks.workunit.client.1.smithi195.stdout:3/428: write d3/f58 [49448,90769] 0 2024-03-22T07:28:31.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/173: getdents d2/d5/d22 0 2024-03-22T07:28:31.878 INFO:tasks.workunit.client.1.smithi195.stdout:9/533: symlink d2/d4/d32/d6d/lc6 0 2024-03-22T07:28:31.879 INFO:tasks.workunit.client.1.smithi195.stdout:6/386: symlink d5/d6d/l8b 0 2024-03-22T07:28:31.881 INFO:tasks.workunit.client.1.smithi195.stdout:0/419: write d1/d4/d12/f27 [1140190,127416] 0 2024-03-22T07:28:31.881 INFO:tasks.workunit.client.1.smithi195.stdout:0/420: write d1/d4/dd/df/f3e [4282604,123593] 0 2024-03-22T07:28:31.885 INFO:tasks.workunit.client.1.smithi195.stdout:2/362: symlink d2/d3/d1a/l75 0 2024-03-22T07:28:31.886 INFO:tasks.workunit.client.0.smithi134.stdout:7/390: dwrite d1/f17 [4194304,4194304] 0 2024-03-22T07:28:31.887 INFO:tasks.workunit.client.0.smithi134.stdout:7/391: creat d1/de/d11/d2b/d31/f83 x:0 0 0 2024-03-22T07:28:31.887 INFO:tasks.workunit.client.1.smithi195.stdout:1/315: dwrite d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:31.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/439: write d13/d15/f6f [264072,68996] 0 2024-03-22T07:28:31.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/440: chown d13/f1f 4883 1 2024-03-22T07:28:31.888 INFO:tasks.workunit.client.0.smithi134.stdout:2/174: dread d2/d5/f10 [0,4194304] 0 2024-03-22T07:28:31.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/447: rename da/d17/d32/d61/d47/d53/c6d to da/d17/d32/d61/d47/c86 0 2024-03-22T07:28:31.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/448: creat da/d17/d32/d61/d47/f87 x:0 0 0 2024-03-22T07:28:31.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/449: stat f9 0 2024-03-22T07:28:31.893 INFO:tasks.workunit.client.0.smithi134.stdout:0/204: rename dc/de/f15 to dc/d17/f41 0 2024-03-22T07:28:31.893 INFO:tasks.workunit.client.0.smithi134.stdout:0/205: write dc/f29 [1575666,113829] 0 2024-03-22T07:28:31.896 INFO:tasks.workunit.client.1.smithi195.stdout:3/429: symlink d3/df/l95 0 2024-03-22T07:28:31.896 INFO:tasks.workunit.client.1.smithi195.stdout:3/430: creat d3/df/f96 x:0 0 0 2024-03-22T07:28:31.896 INFO:tasks.workunit.client.1.smithi195.stdout:3/431: write d3/fd [2165685,18776] 0 2024-03-22T07:28:31.899 INFO:tasks.workunit.client.0.smithi134.stdout:3/186: dwrite f3 [0,4194304] 0 2024-03-22T07:28:31.899 INFO:tasks.workunit.client.0.smithi134.stdout:3/187: chown d4/d10/c37 40234790 1 2024-03-22T07:28:31.899 INFO:tasks.workunit.client.0.smithi134.stdout:8/294: creat d1/d15/d57/f68 x:0 0 0 2024-03-22T07:28:31.901 INFO:tasks.workunit.client.1.smithi195.stdout:6/387: creat d5/d16/d45/d53/d17/d4a/f8c x:0 0 0 2024-03-22T07:28:31.902 INFO:tasks.workunit.client.1.smithi195.stdout:6/388: dread d5/d5e/d34/d55/d3b/f50 [0,4194304] 0 2024-03-22T07:28:31.902 INFO:tasks.workunit.client.1.smithi195.stdout:6/389: stat d5/d5e/d34/d55/f36 0 2024-03-22T07:28:31.906 INFO:tasks.workunit.client.1.smithi195.stdout:2/363: creat d2/d3/d7/d19/d22/d26/f76 x:0 0 0 2024-03-22T07:28:31.906 INFO:tasks.workunit.client.0.smithi134.stdout:4/276: creat d2/d2a/d50/f59 x:0 0 0 2024-03-22T07:28:31.907 INFO:tasks.workunit.client.1.smithi195.stdout:1/316: mkdir d0/d2/d6/d21/d32/d6a 0 2024-03-22T07:28:31.907 INFO:tasks.workunit.client.1.smithi195.stdout:1/317: dread - d0/d2/d6/d21/d39/d40/f43 zero size 2024-03-22T07:28:31.908 INFO:tasks.workunit.client.1.smithi195.stdout:1/318: chown d0/d2/d6/c3d 23973011 1 2024-03-22T07:28:31.908 INFO:tasks.workunit.client.1.smithi195.stdout:1/319: getdents d0/d2/d27/d63 0 2024-03-22T07:28:31.909 INFO:tasks.workunit.client.0.smithi134.stdout:9/163: symlink d3/d9/df/d12/d1b/l3d 0 2024-03-22T07:28:31.911 INFO:tasks.workunit.client.1.smithi195.stdout:1/320: dread d0/d2/d6/f4b [0,4194304] 0 2024-03-22T07:28:31.911 INFO:tasks.workunit.client.0.smithi134.stdout:6/191: rmdir d2/d3f 39 2024-03-22T07:28:31.914 INFO:tasks.workunit.client.1.smithi195.stdout:5/401: rename d9/d22/d50/f76 to d9/d12/d1d/f95 0 2024-03-22T07:28:31.914 INFO:tasks.workunit.client.1.smithi195.stdout:5/402: write d9/d12/d14/f4b [551953,123441] 0 2024-03-22T07:28:31.915 INFO:tasks.workunit.client.0.smithi134.stdout:0/206: dread dc/d18/f1d [4194304,4194304] 0 2024-03-22T07:28:31.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/450: mkdir da/d17/d32/d61/d88 0 2024-03-22T07:28:31.919 INFO:tasks.workunit.client.0.smithi134.stdout:7/392: rmdir d1/de/d11/d2b/d69/d7d 0 2024-03-22T07:28:31.926 INFO:tasks.workunit.client.1.smithi195.stdout:3/432: creat d3/df/d15/d1d/d5c/d86/f97 x:0 0 0 2024-03-22T07:28:31.926 INFO:tasks.workunit.client.1.smithi195.stdout:3/433: chown d3/f58 865 1 2024-03-22T07:28:31.931 INFO:tasks.workunit.client.0.smithi134.stdout:3/188: mkdir d4/d22/d3c 0 2024-03-22T07:28:31.932 INFO:tasks.workunit.client.0.smithi134.stdout:4/277: symlink d2/d15/d35/d37/l5a 0 2024-03-22T07:28:31.934 INFO:tasks.workunit.client.0.smithi134.stdout:9/164: symlink d3/d9/d37/d3c/l3e 0 2024-03-22T07:28:31.934 INFO:tasks.workunit.client.0.smithi134.stdout:9/165: truncate d3/f22 2192974 0 2024-03-22T07:28:31.934 INFO:tasks.workunit.client.0.smithi134.stdout:9/166: chown d3/d9/df/d12/d1b/l1e 669182999 1 2024-03-22T07:28:31.934 INFO:tasks.workunit.client.1.smithi195.stdout:6/390: rmdir d5/d5e/d34/d55/d4b/d5f 39 2024-03-22T07:28:31.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/421: dwrite d1/d4/dd/f51 [0,4194304] 0 2024-03-22T07:28:31.935 INFO:tasks.workunit.client.1.smithi195.stdout:0/422: fdatasync d1/d10/d1f/d40/d43/f53 0 2024-03-22T07:28:31.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/534: dwrite d2/d4/d6/db/d20/d4a/f6a [0,4194304] 0 2024-03-22T07:28:31.935 INFO:tasks.workunit.client.1.smithi195.stdout:9/535: stat d2/d4/d1d 0 2024-03-22T07:28:31.936 INFO:tasks.workunit.client.0.smithi134.stdout:8/295: dwrite d1/d15/d42/f2b [4194304,4194304] 0 2024-03-22T07:28:31.936 INFO:tasks.workunit.client.0.smithi134.stdout:8/296: write d1/d15/d57/f68 [1026086,73296] 0 2024-03-22T07:28:31.936 INFO:tasks.workunit.client.0.smithi134.stdout:8/297: chown d1/d15/d42/c32 4 1 2024-03-22T07:28:31.936 INFO:tasks.workunit.client.0.smithi134.stdout:2/175: dwrite d2/d5/f10 [0,4194304] 0 2024-03-22T07:28:31.936 INFO:tasks.workunit.client.0.smithi134.stdout:0/207: dwrite dc/d17/f2a [0,4194304] 0 2024-03-22T07:28:31.940 INFO:tasks.workunit.client.0.smithi134.stdout:7/393: creat d1/de/d11/d48/d52/d46/f84 x:0 0 0 2024-03-22T07:28:31.940 INFO:tasks.workunit.client.0.smithi134.stdout:9/167: dread d3/f8 [0,4194304] 0 2024-03-22T07:28:31.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/364: unlink d2/d3/d7/d19/d22/c68 0 2024-03-22T07:28:31.942 INFO:tasks.workunit.client.0.smithi134.stdout:3/189: mknod d4/d22/d3c/c3d 0 2024-03-22T07:28:31.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/434: dwrite d3/df/f96 [0,4194304] 0 2024-03-22T07:28:31.943 INFO:tasks.workunit.client.1.smithi195.stdout:3/435: dread - d3/d22/f8a zero size 2024-03-22T07:28:31.944 INFO:tasks.workunit.client.1.smithi195.stdout:1/321: mkdir d0/d2/d6/d21/d32/d6b 0 2024-03-22T07:28:31.944 INFO:tasks.workunit.client.1.smithi195.stdout:1/322: creat d0/d2/d9/f6c x:0 0 0 2024-03-22T07:28:31.946 INFO:tasks.workunit.client.0.smithi134.stdout:4/278: rename d2/c3f to d2/d25/d48/c5b 0 2024-03-22T07:28:31.946 INFO:tasks.workunit.client.0.smithi134.stdout:4/279: write d2/ff [2026492,22220] 0 2024-03-22T07:28:31.948 INFO:tasks.workunit.client.1.smithi195.stdout:7/349: rename d0/d13/d22/f27 to d0/f71 0 2024-03-22T07:28:31.948 INFO:tasks.workunit.client.0.smithi134.stdout:6/192: dread d2/f17 [0,4194304] 0 2024-03-22T07:28:31.950 INFO:tasks.workunit.client.0.smithi134.stdout:0/208: dread f9 [0,4194304] 0 2024-03-22T07:28:31.950 INFO:tasks.workunit.client.0.smithi134.stdout:0/209: stat f4 0 2024-03-22T07:28:31.950 INFO:tasks.workunit.client.0.smithi134.stdout:0/210: stat dc/d17/f40 0 2024-03-22T07:28:31.951 INFO:tasks.workunit.client.0.smithi134.stdout:4/280: dread d2/d25/f3e [0,4194304] 0 2024-03-22T07:28:31.951 INFO:tasks.workunit.client.1.smithi195.stdout:5/403: creat d9/f96 x:0 0 0 2024-03-22T07:28:31.951 INFO:tasks.workunit.client.1.smithi195.stdout:5/404: write f0 [1362012,108763] 0 2024-03-22T07:28:31.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/451: unlink da/d17/c1f 0 2024-03-22T07:28:31.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/452: chown da/d17/d32/d61/d47/c5d 940 1 2024-03-22T07:28:31.954 INFO:tasks.workunit.client.1.smithi195.stdout:8/453: fdatasync da/d17/d32/d61/d47/d53/f6c 0 2024-03-22T07:28:31.955 INFO:tasks.workunit.client.0.smithi134.stdout:8/298: mkdir d1/d15/d42/d12/d20/d69 0 2024-03-22T07:28:31.956 INFO:tasks.workunit.client.0.smithi134.stdout:8/299: dread - d1/d15/f2c zero size 2024-03-22T07:28:31.956 INFO:tasks.workunit.client.0.smithi134.stdout:8/300: chown d1/d15/f19 813856148 1 2024-03-22T07:28:31.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/365: dwrite d2/d1e/f64 [0,4194304] 0 2024-03-22T07:28:31.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/366: chown d2/f34 398 1 2024-03-22T07:28:31.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/367: write d2/d3/d1a/f37 [269574,37245] 0 2024-03-22T07:28:31.960 INFO:tasks.workunit.client.0.smithi134.stdout:4/281: dread d2/d15/f1e [0,4194304] 0 2024-03-22T07:28:31.960 INFO:tasks.workunit.client.0.smithi134.stdout:4/282: write d2/ff [6013158,60692] 0 2024-03-22T07:28:31.961 INFO:tasks.workunit.client.0.smithi134.stdout:4/283: dread - d2/d2a/f4d zero size 2024-03-22T07:28:31.962 INFO:tasks.workunit.client.1.smithi195.stdout:0/423: link d1/d4/dd/df/d44/c73 d1/d10/d1f/d40/d47/c76 0 2024-03-22T07:28:31.962 INFO:tasks.workunit.client.1.smithi195.stdout:0/424: fdatasync d1/d10/d19/d20/f4f 0 2024-03-22T07:28:31.963 INFO:tasks.workunit.client.0.smithi134.stdout:0/211: write dc/d17/f21 [2514414,6954] 0 2024-03-22T07:28:31.963 INFO:tasks.workunit.client.0.smithi134.stdout:0/212: fdatasync dc/d18/f1a 0 2024-03-22T07:28:31.964 INFO:tasks.workunit.client.1.smithi195.stdout:5/405: dread f3 [0,4194304] 0 2024-03-22T07:28:31.964 INFO:tasks.workunit.client.1.smithi195.stdout:5/406: write d9/d22/f2b [701835,9124] 0 2024-03-22T07:28:31.965 INFO:tasks.workunit.client.0.smithi134.stdout:7/394: mkdir d1/de/d11/d2b/d31/d85 0 2024-03-22T07:28:31.965 INFO:tasks.workunit.client.0.smithi134.stdout:7/395: stat d1/de/d11/d48 0 2024-03-22T07:28:31.967 INFO:tasks.workunit.client.0.smithi134.stdout:8/301: dread d1/d15/d42/d25/f59 [0,4194304] 0 2024-03-22T07:28:31.967 INFO:tasks.workunit.client.0.smithi134.stdout:3/190: creat d4/d22/f3e x:0 0 0 2024-03-22T07:28:31.967 INFO:tasks.workunit.client.0.smithi134.stdout:3/191: fdatasync d4/d8/f13 0 2024-03-22T07:28:31.968 INFO:tasks.workunit.client.0.smithi134.stdout:3/192: dread - d4/d10/f33 zero size 2024-03-22T07:28:31.968 INFO:tasks.workunit.client.0.smithi134.stdout:8/302: dread d1/d15/d42/d12/d20/d41/f48 [0,4194304] 0 2024-03-22T07:28:31.969 INFO:tasks.workunit.client.0.smithi134.stdout:8/303: chown d1/d15/f19 30 1 2024-03-22T07:28:31.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/536: mknod d2/d4/d6/db/d20/d4a/da2/cc7 0 2024-03-22T07:28:31.969 INFO:tasks.workunit.client.1.smithi195.stdout:9/537: stat d2/d4/d6/d18/c3c 0 2024-03-22T07:28:31.971 INFO:tasks.workunit.client.0.smithi134.stdout:0/213: dread dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:31.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/264: sync 2024-03-22T07:28:31.975 INFO:tasks.workunit.client.0.smithi134.stdout:7/396: unlink d1/de/d11/d48/d52/f80 0 2024-03-22T07:28:31.975 INFO:tasks.workunit.client.0.smithi134.stdout:7/397: stat d1/c27 0 2024-03-22T07:28:31.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/193: dread d4/f1a [0,4194304] 0 2024-03-22T07:28:31.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/176: rename d2/d5/f10 to d2/d5/d8/f2f 0 2024-03-22T07:28:31.978 INFO:tasks.workunit.client.0.smithi134.stdout:6/193: getdents d2/d1b/d1d/d2b 0 2024-03-22T07:28:31.980 INFO:tasks.workunit.client.0.smithi134.stdout:0/214: dread dc/f20 [0,4194304] 0 2024-03-22T07:28:31.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/215: fsync dc/d17/f2a 0 2024-03-22T07:28:31.981 INFO:tasks.workunit.client.0.smithi134.stdout:1/265: symlink d5/d1d/l5a 0 2024-03-22T07:28:31.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/177: dread d2/f1a [0,4194304] 0 2024-03-22T07:28:31.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/398: truncate d1/f3b 31082 0 2024-03-22T07:28:31.984 INFO:tasks.workunit.client.0.smithi134.stdout:7/399: truncate d1/de/d11/d2b/d69/f6c 545301 0 2024-03-22T07:28:31.985 INFO:tasks.workunit.client.0.smithi134.stdout:7/400: readlink d1/de/d11/d48/d52/l6e 0 2024-03-22T07:28:31.987 INFO:tasks.workunit.client.0.smithi134.stdout:3/194: mknod d4/d8/d23/c3f 0 2024-03-22T07:28:31.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/168: rename d3/d9/la to d3/d9/df/d12/d2d/l3f 0 2024-03-22T07:28:31.995 INFO:tasks.workunit.client.0.smithi134.stdout:6/194: creat d2/d1b/d1d/d2b/f46 x:0 0 0 2024-03-22T07:28:31.996 INFO:tasks.workunit.client.1.smithi195.stdout:1/323: rename d0/d2/f14 to d0/d2/d6/d21/d41/d47/d4a/d66/f6d 0 2024-03-22T07:28:31.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/324: read d0/d2/f1f [1788926,95375] 0 2024-03-22T07:28:31.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/325: fsync d0/d2/fe 0 2024-03-22T07:28:31.998 INFO:tasks.workunit.client.0.smithi134.stdout:0/216: symlink dc/d17/l42 0 2024-03-22T07:28:32.000 INFO:tasks.workunit.client.0.smithi134.stdout:1/266: truncate d5/da/d1b/f1f 2505221 0 2024-03-22T07:28:32.001 INFO:tasks.workunit.client.0.smithi134.stdout:5/194: sync 2024-03-22T07:28:32.002 INFO:tasks.workunit.client.1.smithi195.stdout:8/454: rmdir da/de 39 2024-03-22T07:28:32.002 INFO:tasks.workunit.client.1.smithi195.stdout:8/455: fsync da/d17/f25 0 2024-03-22T07:28:32.002 INFO:tasks.workunit.client.0.smithi134.stdout:7/401: dwrite d1/de/d11/d48/d52/d46/f61 [0,4194304] 0 2024-03-22T07:28:32.004 INFO:tasks.workunit.client.1.smithi195.stdout:6/391: creat d5/d16/d5a/f8d x:0 0 0 2024-03-22T07:28:32.007 INFO:tasks.workunit.client.0.smithi134.stdout:3/195: dwrite d4/d22/d29/f2e [0,4194304] 0 2024-03-22T07:28:32.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/368: symlink d2/d3/d7/d19/d22/l77 0 2024-03-22T07:28:32.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/369: stat d2/d17/l71 0 2024-03-22T07:28:32.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/370: dread - d2/d3/d24/f6e zero size 2024-03-22T07:28:32.012 INFO:tasks.workunit.client.1.smithi195.stdout:2/371: dread - d2/d3/d1a/f50 zero size 2024-03-22T07:28:32.014 INFO:tasks.workunit.client.0.smithi134.stdout:9/169: unlink d3/d9/df/d12/l39 0 2024-03-22T07:28:32.014 INFO:tasks.workunit.client.1.smithi195.stdout:0/425: mknod d1/d4/d12/d6c/c77 0 2024-03-22T07:28:32.016 INFO:tasks.workunit.client.0.smithi134.stdout:4/284: rename d2/d15/f23 to d2/d2a/d50/f5c 0 2024-03-22T07:28:32.017 INFO:tasks.workunit.client.1.smithi195.stdout:5/407: creat d9/d12/d1d/d69/d78/f97 x:0 0 0 2024-03-22T07:28:32.017 INFO:tasks.workunit.client.1.smithi195.stdout:5/408: fdatasync d9/d12/d14/f4b 0 2024-03-22T07:28:32.018 INFO:tasks.workunit.client.1.smithi195.stdout:9/538: symlink d2/d4/d6/db/d20/d4a/da2/lc8 0 2024-03-22T07:28:32.019 INFO:tasks.workunit.client.0.smithi134.stdout:0/217: symlink dc/d17/l43 0 2024-03-22T07:28:32.021 INFO:tasks.workunit.client.1.smithi195.stdout:3/436: mkdir d3/d98 0 2024-03-22T07:28:32.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/426: dread d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:32.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/427: fsync d1/d4/dd/f51 0 2024-03-22T07:28:32.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/195: symlink d1/d13/l48 0 2024-03-22T07:28:32.022 INFO:tasks.workunit.client.0.smithi134.stdout:5/196: readlink d1/d8/d20/l27 0 2024-03-22T07:28:32.024 INFO:tasks.workunit.client.1.smithi195.stdout:7/350: mknod d0/d13/d14/c72 0 2024-03-22T07:28:32.025 INFO:tasks.workunit.client.0.smithi134.stdout:7/402: dwrite d1/d19/f2f [0,4194304] 0 2024-03-22T07:28:32.028 INFO:tasks.workunit.client.1.smithi195.stdout:8/456: dwrite da/dc/f7b [0,4194304] 0 2024-03-22T07:28:32.029 INFO:tasks.workunit.client.0.smithi134.stdout:3/196: dwrite d4/d10/f2c [0,4194304] 0 2024-03-22T07:28:32.029 INFO:tasks.workunit.client.0.smithi134.stdout:3/197: chown d4/d10/f2c 123057 1 2024-03-22T07:28:32.030 INFO:tasks.workunit.client.0.smithi134.stdout:3/198: write d4/d22/f25 [7068,49799] 0 2024-03-22T07:28:32.032 INFO:tasks.workunit.client.0.smithi134.stdout:9/170: unlink d3/f4 0 2024-03-22T07:28:32.032 INFO:tasks.workunit.client.0.smithi134.stdout:9/171: readlink d3/d9/df/d12/d1b/l3d 0 2024-03-22T07:28:32.032 INFO:tasks.workunit.client.0.smithi134.stdout:9/172: write d3/d9/df/d12/f2f [259996,18750] 0 2024-03-22T07:28:32.033 INFO:tasks.workunit.client.0.smithi134.stdout:0/218: write dc/d17/f38 [2041527,104067] 0 2024-03-22T07:28:32.036 INFO:tasks.workunit.client.0.smithi134.stdout:8/304: rename d1/d4/c3d to d1/d15/d42/c6a 0 2024-03-22T07:28:32.036 INFO:tasks.workunit.client.0.smithi134.stdout:8/305: chown d1/d15/d42/d12/l4c 3 1 2024-03-22T07:28:32.037 INFO:tasks.workunit.client.0.smithi134.stdout:9/173: dread d3/fe [0,4194304] 0 2024-03-22T07:28:32.037 INFO:tasks.workunit.client.0.smithi134.stdout:9/174: write d3/d9/df/d12/d1b/f32 [314006,111801] 0 2024-03-22T07:28:32.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/372: unlink d2/d17/l71 0 2024-03-22T07:28:32.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/457: dread da/d17/d32/d61/d47/d53/f5e [0,4194304] 0 2024-03-22T07:28:32.039 INFO:tasks.workunit.client.1.smithi195.stdout:8/458: readlink l6 0 2024-03-22T07:28:32.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/306: dread d1/d46/f62 [0,4194304] 0 2024-03-22T07:28:32.040 INFO:tasks.workunit.client.0.smithi134.stdout:4/285: creat d2/d15/d35/f5d x:0 0 0 2024-03-22T07:28:32.041 INFO:tasks.workunit.client.0.smithi134.stdout:5/197: dwrite d1/d8/f1b [0,4194304] 0 2024-03-22T07:28:32.042 INFO:tasks.workunit.client.1.smithi195.stdout:5/409: truncate f3 2605420 0 2024-03-22T07:28:32.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/195: mknod d2/c47 0 2024-03-22T07:28:32.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/196: creat d2/d1b/f48 x:0 0 0 2024-03-22T07:28:32.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/175: dread d3/f22 [0,4194304] 0 2024-03-22T07:28:32.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/176: chown d3/d9/c2c 19 1 2024-03-22T07:28:32.043 INFO:tasks.workunit.client.0.smithi134.stdout:4/286: read d2/d15/f1b [851423,89686] 0 2024-03-22T07:28:32.046 INFO:tasks.workunit.client.1.smithi195.stdout:0/428: creat d1/d4/dd/d66/f78 x:0 0 0 2024-03-22T07:28:32.048 INFO:tasks.workunit.client.1.smithi195.stdout:7/351: creat d0/d13/f73 x:0 0 0 2024-03-22T07:28:32.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/392: getdents d5/d16/d5a 0 2024-03-22T07:28:32.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/393: write d5/d5e/d34/d55/f7a [141820,34686] 0 2024-03-22T07:28:32.054 INFO:tasks.workunit.client.0.smithi134.stdout:3/199: link d4/f2b d4/d10/f40 0 2024-03-22T07:28:32.056 INFO:tasks.workunit.client.0.smithi134.stdout:0/219: truncate dc/f1f 2260960 0 2024-03-22T07:28:32.057 INFO:tasks.workunit.client.1.smithi195.stdout:8/459: creat da/d17/d32/d61/d47/d53/f89 x:0 0 0 2024-03-22T07:28:32.059 INFO:tasks.workunit.client.0.smithi134.stdout:1/267: rename d5/da/d1b/l47 to d5/d1d/l5b 0 2024-03-22T07:28:32.061 INFO:tasks.workunit.client.1.smithi195.stdout:5/410: mkdir d9/d22/d7b/d98 0 2024-03-22T07:28:32.061 INFO:tasks.workunit.client.1.smithi195.stdout:5/411: fdatasync d9/d12/d1d/d69/d78/d41/f8d 0 2024-03-22T07:28:32.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/307: dwrite d1/d4/f22 [0,4194304] 0 2024-03-22T07:28:32.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/308: fdatasync d1/d15/d42/d49/f5f 0 2024-03-22T07:28:32.064 INFO:tasks.workunit.client.1.smithi195.stdout:9/539: mkdir d2/d4/d6/d18/d50/dc9 0 2024-03-22T07:28:32.064 INFO:tasks.workunit.client.1.smithi195.stdout:9/540: stat d2/dad 0 2024-03-22T07:28:32.064 INFO:tasks.workunit.client.1.smithi195.stdout:9/541: dread - d2/d4/d6/d18/fbf zero size 2024-03-22T07:28:32.066 INFO:tasks.workunit.client.1.smithi195.stdout:0/429: creat d1/d4/dd/df/d44/d6f/f79 x:0 0 0 2024-03-22T07:28:32.066 INFO:tasks.workunit.client.1.smithi195.stdout:0/430: chown d1/d4/dd/df/d44/c69 11231 1 2024-03-22T07:28:32.066 INFO:tasks.workunit.client.1.smithi195.stdout:0/431: write d1/d10/d19/f65 [4333444,41181] 0 2024-03-22T07:28:32.066 INFO:tasks.workunit.client.1.smithi195.stdout:4/441: sync 2024-03-22T07:28:32.069 INFO:tasks.workunit.client.1.smithi195.stdout:6/394: creat d5/d5e/d34/d55/d3b/f8e x:0 0 0 2024-03-22T07:28:32.069 INFO:tasks.workunit.client.1.smithi195.stdout:5/412: read d9/d3a/f3c [3603698,96822] 0 2024-03-22T07:28:32.072 INFO:tasks.workunit.client.1.smithi195.stdout:2/373: getdents d2/d3 0 2024-03-22T07:28:32.072 INFO:tasks.workunit.client.1.smithi195.stdout:2/374: dread - d2/d3/d7/d19/d22/d26/f6f zero size 2024-03-22T07:28:32.072 INFO:tasks.workunit.client.1.smithi195.stdout:2/375: fsync d2/d1e/f64 0 2024-03-22T07:28:32.074 INFO:tasks.workunit.client.1.smithi195.stdout:8/460: symlink da/d82/l8a 0 2024-03-22T07:28:32.074 INFO:tasks.workunit.client.1.smithi195.stdout:8/461: chown da/d17/d32/d61/d47/f83 76959 1 2024-03-22T07:28:32.075 INFO:tasks.workunit.client.0.smithi134.stdout:0/220: dwrite dc/d18/f1d [4194304,4194304] 0 2024-03-22T07:28:32.075 INFO:tasks.workunit.client.0.smithi134.stdout:0/221: creat dc/d18/f44 x:0 0 0 2024-03-22T07:28:32.075 INFO:tasks.workunit.client.0.smithi134.stdout:0/222: creat dc/d18/f45 x:0 0 0 2024-03-22T07:28:32.075 INFO:tasks.workunit.client.0.smithi134.stdout:5/198: creat d1/f49 x:0 0 0 2024-03-22T07:28:32.076 INFO:tasks.workunit.client.1.smithi195.stdout:9/542: mknod d2/d4/d6/db/d20/d47/cca 0 2024-03-22T07:28:32.076 INFO:tasks.workunit.client.1.smithi195.stdout:9/543: fsync d2/d4/d6/db/d20/d4a/f83 0 2024-03-22T07:28:32.078 INFO:tasks.workunit.client.1.smithi195.stdout:0/432: symlink d1/d4/d42/l7a 0 2024-03-22T07:28:32.078 INFO:tasks.workunit.client.1.smithi195.stdout:0/433: write d1/d10/d19/d20/f56 [1039892,30834] 0 2024-03-22T07:28:32.078 INFO:tasks.workunit.client.1.smithi195.stdout:0/434: read - d1/d4/dd/df/d44/f50 zero size 2024-03-22T07:28:32.078 INFO:tasks.workunit.client.0.smithi134.stdout:6/197: symlink d2/d3f/l49 0 2024-03-22T07:28:32.079 INFO:tasks.workunit.client.1.smithi195.stdout:4/442: symlink d13/d63/d36/d5f/l9d 0 2024-03-22T07:28:32.080 INFO:tasks.workunit.client.1.smithi195.stdout:0/435: dread d1/d10/d1f/d40/d43/f62 [0,4194304] 0 2024-03-22T07:28:32.080 INFO:tasks.workunit.client.0.smithi134.stdout:9/177: creat d3/d9/d37/f40 x:0 0 0 2024-03-22T07:28:32.081 INFO:tasks.workunit.client.0.smithi134.stdout:9/178: creat d3/d9/d37/f41 x:0 0 0 2024-03-22T07:28:32.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/352: rmdir d0/d13/d14/d29/d35/d3a 39 2024-03-22T07:28:32.082 INFO:tasks.workunit.client.0.smithi134.stdout:4/287: creat d2/d1d/f5e x:0 0 0 2024-03-22T07:28:32.082 INFO:tasks.workunit.client.0.smithi134.stdout:4/288: chown d2/f46 59 1 2024-03-22T07:28:32.083 INFO:tasks.workunit.client.1.smithi195.stdout:5/413: unlink d9/d2d/d58/f71 0 2024-03-22T07:28:32.084 INFO:tasks.workunit.client.0.smithi134.stdout:5/199: dread d1/d13/f1c [0,4194304] 0 2024-03-22T07:28:32.084 INFO:tasks.workunit.client.0.smithi134.stdout:5/200: fdatasync d1/d8/d20/f3b 0 2024-03-22T07:28:32.084 INFO:tasks.workunit.client.0.smithi134.stdout:5/201: dread - d1/d8/d20/f3b zero size 2024-03-22T07:28:32.086 INFO:tasks.workunit.client.1.smithi195.stdout:6/395: mkdir d5/d5e/d34/d55/d3b/d6e/d56/d8f 0 2024-03-22T07:28:32.086 INFO:tasks.workunit.client.1.smithi195.stdout:6/396: readlink d5/le 0 2024-03-22T07:28:32.086 INFO:tasks.workunit.client.1.smithi195.stdout:6/397: write d5/d5e/d34/d55/d4b/f68 [1956351,85563] 0 2024-03-22T07:28:32.088 INFO:tasks.workunit.client.0.smithi134.stdout:7/403: rename d1/de/d11/d2b/c2d to d1/de/c86 0 2024-03-22T07:28:32.089 INFO:tasks.workunit.client.0.smithi134.stdout:4/289: dread d2/d2a/d50/f5c [0,4194304] 0 2024-03-22T07:28:32.090 INFO:tasks.workunit.client.1.smithi195.stdout:2/376: rename d2/d3/d7/d19/d22/d26/f76 to d2/d3/d7/f78 0 2024-03-22T07:28:32.091 INFO:tasks.workunit.client.1.smithi195.stdout:8/462: symlink da/dc/d71/l8b 0 2024-03-22T07:28:32.091 INFO:tasks.workunit.client.1.smithi195.stdout:8/463: chown da 0 1 2024-03-22T07:28:32.094 INFO:tasks.workunit.client.0.smithi134.stdout:8/309: stat d1/d15/c26 0 2024-03-22T07:28:32.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/443: unlink d13/l29 0 2024-03-22T07:28:32.096 INFO:tasks.workunit.client.1.smithi195.stdout:4/444: dread - d13/f9c zero size 2024-03-22T07:28:32.099 INFO:tasks.workunit.client.1.smithi195.stdout:0/436: mkdir d1/d4/d12/d6c/d7b 0 2024-03-22T07:28:32.099 INFO:tasks.workunit.client.1.smithi195.stdout:0/437: write d1/d4/d12/f2d [488372,125658] 0 2024-03-22T07:28:32.099 INFO:tasks.workunit.client.1.smithi195.stdout:0/438: fdatasync d1/d10/d19/d20/f61 0 2024-03-22T07:28:32.102 INFO:tasks.workunit.client.1.smithi195.stdout:7/353: symlink d0/d13/d14/d2f/l74 0 2024-03-22T07:28:32.102 INFO:tasks.workunit.client.1.smithi195.stdout:2/377: dwrite d2/d3/d24/f6e [0,4194304] 0 2024-03-22T07:28:32.104 INFO:tasks.workunit.client.1.smithi195.stdout:5/414: link d9/d3a/l48 d9/d22/d50/l99 0 2024-03-22T07:28:32.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/398: symlink d5/d5e/d34/d55/d4b/l90 0 2024-03-22T07:28:32.106 INFO:tasks.workunit.client.0.smithi134.stdout:6/198: write d2/d1b/d1d/d2b/f3a [706264,42749] 0 2024-03-22T07:28:32.107 INFO:tasks.workunit.client.1.smithi195.stdout:8/464: dwrite da/d17/d32/d61/d47/d53/f5e [0,4194304] 0 2024-03-22T07:28:32.108 INFO:tasks.workunit.client.1.smithi195.stdout:8/465: stat da/d17/d32/d61/l46 0 2024-03-22T07:28:32.108 INFO:tasks.workunit.client.1.smithi195.stdout:9/544: getdents d2/d4/d6/db/d20 0 2024-03-22T07:28:32.110 INFO:tasks.workunit.client.1.smithi195.stdout:4/445: mkdir d13/d63/d36/d9e 0 2024-03-22T07:28:32.110 INFO:tasks.workunit.client.0.smithi134.stdout:9/179: truncate f0 2301940 0 2024-03-22T07:28:32.110 INFO:tasks.workunit.client.0.smithi134.stdout:9/180: chown d3/d9/df/d12/d3b 6033 1 2024-03-22T07:28:32.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/202: mkdir d1/d8/d16/d4a 0 2024-03-22T07:28:32.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/203: chown d1/c36 30 1 2024-03-22T07:28:32.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/204: write d1/d8/d20/f3b [866009,119578] 0 2024-03-22T07:28:32.113 INFO:tasks.workunit.client.0.smithi134.stdout:5/205: truncate d1/d4/f2b 2019615 0 2024-03-22T07:28:32.116 INFO:tasks.workunit.client.0.smithi134.stdout:3/200: rmdir d4/d22/d29 39 2024-03-22T07:28:32.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/404: unlink d1/de/d11/d48/d52/f71 0 2024-03-22T07:28:32.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/405: stat d1/f17 0 2024-03-22T07:28:32.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/406: write d1/de/d11/d2b/d31/f54 [1684390,103272] 0 2024-03-22T07:28:32.119 INFO:tasks.workunit.client.1.smithi195.stdout:5/415: dwrite d9/d12/d1d/d69/d78/f7e [0,4194304] 0 2024-03-22T07:28:32.119 INFO:tasks.workunit.client.1.smithi195.stdout:7/354: unlink d0/d13/d14/l48 0 2024-03-22T07:28:32.120 INFO:tasks.workunit.client.0.smithi134.stdout:4/290: truncate d2/d1d/f54 4614816 0 2024-03-22T07:28:32.121 INFO:tasks.workunit.client.0.smithi134.stdout:3/201: dread f0 [0,4194304] 0 2024-03-22T07:28:32.121 INFO:tasks.workunit.client.0.smithi134.stdout:3/202: chown d4/l6 4316680 1 2024-03-22T07:28:32.122 INFO:tasks.workunit.client.0.smithi134.stdout:3/203: write d4/d8/f19 [426681,14023] 0 2024-03-22T07:28:32.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/378: creat d2/d3/f79 x:0 0 0 2024-03-22T07:28:32.122 INFO:tasks.workunit.client.1.smithi195.stdout:2/379: read d2/f4d [3549303,56340] 0 2024-03-22T07:28:32.124 INFO:tasks.workunit.client.0.smithi134.stdout:8/310: symlink d1/d15/d42/d49/l6b 0 2024-03-22T07:28:32.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/223: mknod dc/c46 0 2024-03-22T07:28:32.128 INFO:tasks.workunit.client.0.smithi134.stdout:6/199: dread d2/f2e [0,4194304] 0 2024-03-22T07:28:32.129 INFO:tasks.workunit.client.1.smithi195.stdout:6/399: creat d5/d16/d45/d53/d17/f91 x:0 0 0 2024-03-22T07:28:32.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/181: getdents d3/d9/df/d12/d2d 0 2024-03-22T07:28:32.130 INFO:tasks.workunit.client.0.smithi134.stdout:9/182: truncate d3/d9/d37/f40 665837 0 2024-03-22T07:28:32.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/206: link d1/d13/f1e d1/d8/d16/d4a/f4b 0 2024-03-22T07:28:32.134 INFO:tasks.workunit.client.0.smithi134.stdout:7/407: dwrite d1/de/d11/d48/d52/f7 [4194304,4194304] 0 2024-03-22T07:28:32.135 INFO:tasks.workunit.client.0.smithi134.stdout:4/291: unlink d2/d15/c2c 0 2024-03-22T07:28:32.135 INFO:tasks.workunit.client.0.smithi134.stdout:4/292: fdatasync d2/d15/f1b 0 2024-03-22T07:28:32.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/466: creat da/d82/f8c x:0 0 0 2024-03-22T07:28:32.137 INFO:tasks.workunit.client.0.smithi134.stdout:3/204: symlink d4/d22/d3c/l41 0 2024-03-22T07:28:32.138 INFO:tasks.workunit.client.1.smithi195.stdout:9/545: creat d2/d4/d32/d6d/d78/fcb x:0 0 0 2024-03-22T07:28:32.138 INFO:tasks.workunit.client.0.smithi134.stdout:8/311: rmdir d1/d4/d38 39 2024-03-22T07:28:32.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/446: rename f6 to d13/d2a/d7e/d8c/f9f 0 2024-03-22T07:28:32.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/447: write d13/f73 [869910,74747] 0 2024-03-22T07:28:32.145 INFO:tasks.workunit.client.1.smithi195.stdout:7/355: symlink d0/d13/d14/d29/d35/d3a/l75 0 2024-03-22T07:28:32.147 INFO:tasks.workunit.client.0.smithi134.stdout:0/224: link dc/d18/c3d dc/d17/c47 0 2024-03-22T07:28:32.149 INFO:tasks.workunit.client.1.smithi195.stdout:2/380: mknod d2/d3/d7/da/d4e/c7a 0 2024-03-22T07:28:32.151 INFO:tasks.workunit.client.1.smithi195.stdout:6/400: mkdir d5/d16/d45/d53/d92 0 2024-03-22T07:28:32.155 INFO:tasks.workunit.client.1.smithi195.stdout:8/467: mkdir da/d17/d32/d61/d47/d53/d8d 0 2024-03-22T07:28:32.155 INFO:tasks.workunit.client.1.smithi195.stdout:8/468: write da/dc/f2b [173098,88899] 0 2024-03-22T07:28:32.155 INFO:tasks.workunit.client.1.smithi195.stdout:8/469: dread da/dc/f6f [0,4194304] 0 2024-03-22T07:28:32.156 INFO:tasks.workunit.client.0.smithi134.stdout:6/200: symlink d2/d1b/l4a 0 2024-03-22T07:28:32.157 INFO:tasks.workunit.client.1.smithi195.stdout:4/448: link lc d13/d63/d3e/d5c/la0 0 2024-03-22T07:28:32.157 INFO:tasks.workunit.client.1.smithi195.stdout:4/449: creat d13/d2a/d7e/d85/fa1 x:0 0 0 2024-03-22T07:28:32.158 INFO:tasks.workunit.client.0.smithi134.stdout:9/183: creat d3/d9/df/d12/d3b/f42 x:0 0 0 2024-03-22T07:28:32.159 INFO:tasks.workunit.client.1.smithi195.stdout:5/416: getdents d9/d22/d50 0 2024-03-22T07:28:32.159 INFO:tasks.workunit.client.1.smithi195.stdout:5/417: readlink d9/d12/d1d/d69/d78/d41/l66 0 2024-03-22T07:28:32.161 INFO:tasks.workunit.client.1.smithi195.stdout:7/356: dwrite d0/d13/d14/d29/d35/f37 [0,4194304] 0 2024-03-22T07:28:32.161 INFO:tasks.workunit.client.1.smithi195.stdout:9/546: dwrite d2/d4/d1d/f8b [0,4194304] 0 2024-03-22T07:28:32.162 INFO:tasks.workunit.client.0.smithi134.stdout:5/207: rmdir d1/d13 39 2024-03-22T07:28:32.163 INFO:tasks.workunit.client.1.smithi195.stdout:6/401: symlink d5/d5e/d34/d55/d4b/l93 0 2024-03-22T07:28:32.165 INFO:tasks.workunit.client.1.smithi195.stdout:8/470: mkdir da/d17/d32/d7d/d8e 0 2024-03-22T07:28:32.165 INFO:tasks.workunit.client.1.smithi195.stdout:8/471: creat da/d17/d32/d61/d47/d53/f8f x:0 0 0 2024-03-22T07:28:32.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/293: rename d2/ff to d2/f5f 0 2024-03-22T07:28:32.169 INFO:tasks.workunit.client.1.smithi195.stdout:4/450: creat d13/d63/d36/d5f/d83/fa2 x:0 0 0 2024-03-22T07:28:32.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/451: chown d13/d63/d79/c4c 5163684 1 2024-03-22T07:28:32.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/205: mknod d4/d22/c42 0 2024-03-22T07:28:32.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/206: dread - d4/d22/d29/f30 zero size 2024-03-22T07:28:32.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/207: write f0 [5206035,41804] 0 2024-03-22T07:28:32.173 INFO:tasks.workunit.client.1.smithi195.stdout:5/418: rename d9/d2d/c57 to d9/d2d/d84/d92/c9a 0 2024-03-22T07:28:32.174 INFO:tasks.workunit.client.0.smithi134.stdout:8/312: mknod d1/d15/d42/c6c 0 2024-03-22T07:28:32.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/225: unlink dc/d17/f2a 0 2024-03-22T07:28:32.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/226: creat dc/d17/f48 x:0 0 0 2024-03-22T07:28:32.180 INFO:tasks.workunit.client.0.smithi134.stdout:6/201: creat d2/f4b x:0 0 0 2024-03-22T07:28:32.180 INFO:tasks.workunit.client.0.smithi134.stdout:6/202: truncate d2/d1b/f48 287679 0 2024-03-22T07:28:32.180 INFO:tasks.workunit.client.0.smithi134.stdout:6/203: fsync d2/f17 0 2024-03-22T07:28:32.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/381: getdents d2/d3/d7/da/de 0 2024-03-22T07:28:32.184 INFO:tasks.workunit.client.0.smithi134.stdout:9/184: dwrite f0 [0,4194304] 0 2024-03-22T07:28:32.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/402: creat d5/d16/d45/d53/d59/d87/f94 x:0 0 0 2024-03-22T07:28:32.185 INFO:tasks.workunit.client.1.smithi195.stdout:6/403: stat d5/d16/d45/d53/l23 0 2024-03-22T07:28:32.185 INFO:tasks.workunit.client.1.smithi195.stdout:7/357: dwrite d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:32.185 INFO:tasks.workunit.client.1.smithi195.stdout:7/358: chown d0/d13/f1c 182694 1 2024-03-22T07:28:32.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/408: getdents d1/d19/d32 0 2024-03-22T07:28:32.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/409: write d1/de/d11/d48/f6b [634081,50626] 0 2024-03-22T07:28:32.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/410: chown d1/de/d11/d48/d52/d46/c74 2206298 1 2024-03-22T07:28:32.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/547: dwrite d2/d4/d32/f5f [0,4194304] 0 2024-03-22T07:28:32.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/548: fsync d2/d4/d6/d18/fbf 0 2024-03-22T07:28:32.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/549: chown d2/d4/f5 228626 1 2024-03-22T07:28:32.187 INFO:tasks.workunit.client.1.smithi195.stdout:9/550: fsync d2/d4/d6/f49 0 2024-03-22T07:28:32.188 INFO:tasks.workunit.client.0.smithi134.stdout:4/294: rename d2/d25/d48/c5b to d2/d1d/c60 0 2024-03-22T07:28:32.188 INFO:tasks.workunit.client.0.smithi134.stdout:4/295: creat d2/d15/f61 x:0 0 0 2024-03-22T07:28:32.188 INFO:tasks.workunit.client.0.smithi134.stdout:4/296: creat d2/f62 x:0 0 0 2024-03-22T07:28:32.192 INFO:tasks.workunit.client.0.smithi134.stdout:3/208: creat d4/d22/d3c/f43 x:0 0 0 2024-03-22T07:28:32.193 INFO:tasks.workunit.client.0.smithi134.stdout:0/227: dwrite dc/d18/f2f [4194304,4194304] 0 2024-03-22T07:28:32.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/419: unlink d9/d3a/d5f/l8a 0 2024-03-22T07:28:32.194 INFO:tasks.workunit.client.1.smithi195.stdout:5/420: fdatasync d9/d12/d1d/d69/d78/f7e 0 2024-03-22T07:28:32.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/359: read d0/d13/d14/d2f/f43 [2044657,79403] 0 2024-03-22T07:28:32.195 INFO:tasks.workunit.client.1.smithi195.stdout:5/421: dread d9/f25 [0,4194304] 0 2024-03-22T07:28:32.195 INFO:tasks.workunit.client.0.smithi134.stdout:8/313: creat d1/d15/d5b/f6d x:0 0 0 2024-03-22T07:28:32.195 INFO:tasks.workunit.client.0.smithi134.stdout:8/314: chown d1/d15/d42/d12/d2a/c4e 16 1 2024-03-22T07:28:32.198 INFO:tasks.workunit.client.0.smithi134.stdout:5/208: truncate d1/d4/f2b 1897830 0 2024-03-22T07:28:32.200 INFO:tasks.workunit.client.1.smithi195.stdout:6/404: dwrite d5/d16/d5b/f79 [0,4194304] 0 2024-03-22T07:28:32.200 INFO:tasks.workunit.client.1.smithi195.stdout:2/382: truncate d2/d3/d7/d19/f33 1961827 0 2024-03-22T07:28:32.205 INFO:tasks.workunit.client.1.smithi195.stdout:9/551: rename d2/d4/d32/d6d/f9e to d2/d4/d23/d74/fcc 0 2024-03-22T07:28:32.206 INFO:tasks.workunit.client.1.smithi195.stdout:9/552: truncate d2/d4/d6/db/d20/fc0 359289 0 2024-03-22T07:28:32.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/360: dwrite d0/d13/d22/d52/f5e [0,4194304] 0 2024-03-22T07:28:32.211 INFO:tasks.workunit.client.0.smithi134.stdout:9/185: mknod d3/d9/d37/c43 0 2024-03-22T07:28:32.212 INFO:tasks.workunit.client.1.smithi195.stdout:4/452: rmdir d13/d2a 39 2024-03-22T07:28:32.212 INFO:tasks.workunit.client.1.smithi195.stdout:4/453: dread - d13/d63/d3e/f7f zero size 2024-03-22T07:28:32.212 INFO:tasks.workunit.client.1.smithi195.stdout:4/454: read d13/d63/f33 [758670,19267] 0 2024-03-22T07:28:32.215 INFO:tasks.workunit.client.1.smithi195.stdout:7/361: dread d0/f25 [0,4194304] 0 2024-03-22T07:28:32.215 INFO:tasks.workunit.client.1.smithi195.stdout:7/362: readlink d0/l24 0 2024-03-22T07:28:32.215 INFO:tasks.workunit.client.1.smithi195.stdout:7/363: fsync d0/d13/d14/d29/d35/f37 0 2024-03-22T07:28:32.218 INFO:tasks.workunit.client.1.smithi195.stdout:6/405: mkdir d5/d6d/d95 0 2024-03-22T07:28:32.219 INFO:tasks.workunit.client.0.smithi134.stdout:2/178: sync 2024-03-22T07:28:32.219 INFO:tasks.workunit.client.0.smithi134.stdout:2/179: chown d2/d5/d8/d2c/c2e 290 1 2024-03-22T07:28:32.221 INFO:tasks.workunit.client.1.smithi195.stdout:2/383: creat d2/d17/f7b x:0 0 0 2024-03-22T07:28:32.221 INFO:tasks.workunit.client.1.smithi195.stdout:2/384: read d2/d3/d7/da/d1b/f29 [1499693,29026] 0 2024-03-22T07:28:32.222 INFO:tasks.workunit.client.0.smithi134.stdout:4/297: getdents d2/d15/d35/d37 0 2024-03-22T07:28:32.222 INFO:tasks.workunit.client.0.smithi134.stdout:4/298: creat d2/d15/d35/f63 x:0 0 0 2024-03-22T07:28:32.224 INFO:tasks.workunit.client.1.smithi195.stdout:5/422: rename d9/d12/l27 to d9/d73/l9b 0 2024-03-22T07:28:32.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/553: symlink d2/d4/d6/db/d20/d4a/da2/lcd 0 2024-03-22T07:28:32.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/554: chown d2/d4/d32/d6d/d78/d79/f99 30586 1 2024-03-22T07:28:32.226 INFO:tasks.workunit.client.1.smithi195.stdout:9/555: write d2/f82 [555868,89668] 0 2024-03-22T07:28:32.228 INFO:tasks.workunit.client.0.smithi134.stdout:5/209: dwrite d1/d4/f2b [0,4194304] 0 2024-03-22T07:28:32.234 INFO:tasks.workunit.client.0.smithi134.stdout:0/228: symlink dc/d18/l49 0 2024-03-22T07:28:32.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/364: symlink d0/d13/d14/d29/d35/d6d/l76 0 2024-03-22T07:28:32.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/365: chown d0/d13/d14/l19 7 1 2024-03-22T07:28:32.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/366: chown d0/d13/d22/f23 820241094 1 2024-03-22T07:28:32.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/315: mkdir d1/d4/d6e 0 2024-03-22T07:28:32.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/316: chown d1/d15/d42/d25/l33 986456 1 2024-03-22T07:28:32.238 INFO:tasks.workunit.client.1.smithi195.stdout:6/406: mknod d5/d16/d45/d53/d59/c96 0 2024-03-22T07:28:32.238 INFO:tasks.workunit.client.0.smithi134.stdout:9/186: mknod d3/d9/df/d12/d3b/c44 0 2024-03-22T07:28:32.239 INFO:tasks.workunit.client.0.smithi134.stdout:7/411: rmdir d1/d40 39 2024-03-22T07:28:32.240 INFO:tasks.workunit.client.1.smithi195.stdout:5/423: truncate d9/f1c 1399985 0 2024-03-22T07:28:32.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/204: rename d2/d3f/c42 to d2/c4c 0 2024-03-22T07:28:32.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/205: write d2/d1b/f29 [736230,116133] 0 2024-03-22T07:28:32.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/268: sync 2024-03-22T07:28:32.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/269: fsync d5/da/d13/f51 0 2024-03-22T07:28:32.244 INFO:tasks.workunit.client.1.smithi195.stdout:2/385: dwrite d2/d3/d1a/f37 [0,4194304] 0 2024-03-22T07:28:32.244 INFO:tasks.workunit.client.0.smithi134.stdout:2/180: dwrite d2/fe [0,4194304] 0 2024-03-22T07:28:32.245 INFO:tasks.workunit.client.0.smithi134.stdout:2/181: creat d2/f30 x:0 0 0 2024-03-22T07:28:32.245 INFO:tasks.workunit.client.0.smithi134.stdout:2/182: dread - d2/f30 zero size 2024-03-22T07:28:32.245 INFO:tasks.workunit.client.0.smithi134.stdout:5/210: symlink d1/d8/d16/d4a/l4c 0 2024-03-22T07:28:32.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/317: mkdir d1/d15/d42/d25/d6f 0 2024-03-22T07:28:32.251 INFO:tasks.workunit.client.1.smithi195.stdout:2/386: write d2/d3/d7/d19/d22/d26/f2c [2899663,32932] 0 2024-03-22T07:28:32.251 INFO:tasks.workunit.client.1.smithi195.stdout:2/387: readlink d2/d3/d7/l55 0 2024-03-22T07:28:32.252 INFO:tasks.workunit.client.0.smithi134.stdout:9/187: mknod d3/d9/c45 0 2024-03-22T07:28:32.255 INFO:tasks.workunit.client.0.smithi134.stdout:5/211: dread d1/d13/f18 [0,4194304] 0 2024-03-22T07:28:32.256 INFO:tasks.workunit.client.0.smithi134.stdout:5/212: truncate d1/d8/f46 609413 0 2024-03-22T07:28:32.256 INFO:tasks.workunit.client.0.smithi134.stdout:7/412: mkdir d1/de/d41/d87 0 2024-03-22T07:28:32.257 INFO:tasks.workunit.client.0.smithi134.stdout:2/183: dwrite d2/f1c [0,4194304] 0 2024-03-22T07:28:32.259 INFO:tasks.workunit.client.0.smithi134.stdout:3/209: rename d4/d22/d29/c34 to d4/d10/c44 0 2024-03-22T07:28:32.259 INFO:tasks.workunit.client.0.smithi134.stdout:3/210: readlink d4/d8/d23/l2f 0 2024-03-22T07:28:32.260 INFO:tasks.workunit.client.0.smithi134.stdout:7/413: dread d1/de/d11/d2b/d31/f54 [0,4194304] 0 2024-03-22T07:28:32.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/206: readlink d2/l14 0 2024-03-22T07:28:32.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/270: creat d5/d1d/d49/f5c x:0 0 0 2024-03-22T07:28:32.264 INFO:tasks.workunit.client.1.smithi195.stdout:4/455: rmdir d13 39 2024-03-22T07:28:32.267 INFO:tasks.workunit.client.0.smithi134.stdout:0/229: getdents dc 0 2024-03-22T07:28:32.267 INFO:tasks.workunit.client.0.smithi134.stdout:0/230: chown dc/d18/l49 124217104 1 2024-03-22T07:28:32.267 INFO:tasks.workunit.client.1.smithi195.stdout:7/367: unlink d0/d13/d14/l19 0 2024-03-22T07:28:32.267 INFO:tasks.workunit.client.1.smithi195.stdout:7/368: chown d0/lb 526555705 1 2024-03-22T07:28:32.268 INFO:tasks.workunit.client.1.smithi195.stdout:6/407: mkdir d5/d5e/d34/d55/d3b/d6e/d97 0 2024-03-22T07:28:32.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/318: unlink d1/d4/d38/l5e 0 2024-03-22T07:28:32.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/319: readlink d1/d15/lb 0 2024-03-22T07:28:32.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/320: chown d1/f50 117237651 1 2024-03-22T07:28:32.269 INFO:tasks.workunit.client.0.smithi134.stdout:8/321: getdents d1/d15/d42/d12/d20/d5a 0 2024-03-22T07:28:32.270 INFO:tasks.workunit.client.1.smithi195.stdout:5/424: mknod d9/d22/c9c 0 2024-03-22T07:28:32.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/425: stat d9/d12/d1d/d36/f44 0 2024-03-22T07:28:32.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/426: chown d9/d12/d1d/d36/l4c 7229873 1 2024-03-22T07:28:32.271 INFO:tasks.workunit.client.1.smithi195.stdout:5/427: fsync f3 0 2024-03-22T07:28:32.271 INFO:tasks.workunit.client.1.smithi195.stdout:9/556: getdents d2/d4/d6/db5 0 2024-03-22T07:28:32.271 INFO:tasks.workunit.client.0.smithi134.stdout:3/211: read d4/d8/fa [7565303,35038] 0 2024-03-22T07:28:32.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/369: dread d0/d13/d14/d2b/f42 [0,4194304] 0 2024-03-22T07:28:32.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/370: write d0/d13/d14/f30 [4632059,40230] 0 2024-03-22T07:28:32.273 INFO:tasks.workunit.client.0.smithi134.stdout:1/271: dread d5/da/d1b/f1f [0,4194304] 0 2024-03-22T07:28:32.273 INFO:tasks.workunit.client.0.smithi134.stdout:1/272: creat d5/da/d1b/f5d x:0 0 0 2024-03-22T07:28:32.274 INFO:tasks.workunit.client.0.smithi134.stdout:4/299: rename d2/f33 to d2/d25/d48/f64 0 2024-03-22T07:28:32.276 INFO:tasks.workunit.client.0.smithi134.stdout:5/213: dwrite d1/d8/d16/d4a/f4b [0,4194304] 0 2024-03-22T07:28:32.277 INFO:tasks.workunit.client.0.smithi134.stdout:5/214: stat d1/l1d 0 2024-03-22T07:28:32.277 INFO:tasks.workunit.client.0.smithi134.stdout:7/414: mknod d1/de/d41/c88 0 2024-03-22T07:28:32.277 INFO:tasks.workunit.client.0.smithi134.stdout:9/188: dwrite d3/d9/df/f26 [4194304,4194304] 0 2024-03-22T07:28:32.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/207: mkdir d2/d1b/d4d 0 2024-03-22T07:28:32.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/208: chown d2/d1b/f29 7 1 2024-03-22T07:28:32.278 INFO:tasks.workunit.client.0.smithi134.stdout:9/189: readlink d3/l1c 0 2024-03-22T07:28:32.278 INFO:tasks.workunit.client.0.smithi134.stdout:0/231: mknod dc/de/c4a 0 2024-03-22T07:28:32.279 INFO:tasks.workunit.client.0.smithi134.stdout:0/232: readlink dc/de/l28 0 2024-03-22T07:28:32.279 INFO:tasks.workunit.client.0.smithi134.stdout:0/233: fdatasync dc/d17/f21 0 2024-03-22T07:28:32.280 INFO:tasks.workunit.client.0.smithi134.stdout:3/212: dread d4/d8/f12 [0,4194304] 0 2024-03-22T07:28:32.280 INFO:tasks.workunit.client.0.smithi134.stdout:3/213: chown d4/d10/f2c 988108603 1 2024-03-22T07:28:32.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/415: dread d1/de/f5a [0,4194304] 0 2024-03-22T07:28:32.282 INFO:tasks.workunit.client.0.smithi134.stdout:1/273: rename d5/d1d/l5a to d5/d1d/d2d/l5e 0 2024-03-22T07:28:32.282 INFO:tasks.workunit.client.0.smithi134.stdout:1/274: write d5/da/f21 [2734616,127135] 0 2024-03-22T07:28:32.283 INFO:tasks.workunit.client.0.smithi134.stdout:7/416: dread d1/d19/f53 [0,4194304] 0 2024-03-22T07:28:32.283 INFO:tasks.workunit.client.0.smithi134.stdout:7/417: read - d1/de/d11/d48/d52/d46/f84 zero size 2024-03-22T07:28:32.283 INFO:tasks.workunit.client.0.smithi134.stdout:7/418: getdents d1/de/d11 0 2024-03-22T07:28:32.284 INFO:tasks.workunit.client.1.smithi195.stdout:2/388: mkdir d2/d3/d21/d60/d7c 0 2024-03-22T07:28:32.285 INFO:tasks.workunit.client.0.smithi134.stdout:0/234: symlink dc/de/l4b 0 2024-03-22T07:28:32.288 INFO:tasks.workunit.client.1.smithi195.stdout:6/408: rename d5/d16/d45/d53/d59/c74 to d5/d5e/c98 0 2024-03-22T07:28:32.288 INFO:tasks.workunit.client.1.smithi195.stdout:6/409: chown d5/d5e/d34/d55/f7a 77 1 2024-03-22T07:28:32.288 INFO:tasks.workunit.client.1.smithi195.stdout:6/410: stat d5/f1e 0 2024-03-22T07:28:32.288 INFO:tasks.workunit.client.0.smithi134.stdout:8/322: rmdir d1/d15/d42/d44 39 2024-03-22T07:28:32.289 INFO:tasks.workunit.client.0.smithi134.stdout:8/323: chown d1/d15/d42/d12/d2a 23663534 1 2024-03-22T07:28:32.289 INFO:tasks.workunit.client.0.smithi134.stdout:5/215: dread d1/d8/d16/d4a/f4b [0,4194304] 0 2024-03-22T07:28:32.289 INFO:tasks.workunit.client.0.smithi134.stdout:0/235: dread dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:32.289 INFO:tasks.workunit.client.0.smithi134.stdout:0/236: fdatasync dc/f3c 0 2024-03-22T07:28:32.290 INFO:tasks.workunit.client.1.smithi195.stdout:5/428: creat d9/d2d/d84/f9d x:0 0 0 2024-03-22T07:28:32.291 INFO:tasks.workunit.client.0.smithi134.stdout:3/214: mkdir d4/d8/d45 0 2024-03-22T07:28:32.292 INFO:tasks.workunit.client.1.smithi195.stdout:9/557: unlink d2/d4/d6/d18/f4f 0 2024-03-22T07:28:32.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/275: read d5/fc [2519192,33684] 0 2024-03-22T07:28:32.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/276: creat d5/da/d13/d1e/d34/f5f x:0 0 0 2024-03-22T07:28:32.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/277: write d5/da/d1b/f1f [732744,31706] 0 2024-03-22T07:28:32.294 INFO:tasks.workunit.client.1.smithi195.stdout:4/456: dwrite d13/d2a/d7e/d85/f9b [0,4194304] 0 2024-03-22T07:28:32.294 INFO:tasks.workunit.client.0.smithi134.stdout:6/209: rename d2/d1b/d1d/c22 to d2/d3f/c4e 0 2024-03-22T07:28:32.294 INFO:tasks.workunit.client.0.smithi134.stdout:5/216: stat d1/d8/l26 0 2024-03-22T07:28:32.296 INFO:tasks.workunit.client.1.smithi195.stdout:2/389: rename d2/d3/d7/da/de/c43 to d2/d3/d21/d60/c7d 0 2024-03-22T07:28:32.299 INFO:tasks.workunit.client.0.smithi134.stdout:4/300: dwrite d2/d15/f1b [0,4194304] 0 2024-03-22T07:28:32.299 INFO:tasks.workunit.client.1.smithi195.stdout:9/558: creat d2/d4/d1d/fce x:0 0 0 2024-03-22T07:28:32.300 INFO:tasks.workunit.client.0.smithi134.stdout:0/237: symlink dc/d18/l4c 0 2024-03-22T07:28:32.303 INFO:tasks.workunit.client.0.smithi134.stdout:3/215: creat d4/d22/d29/f46 x:0 0 0 2024-03-22T07:28:32.303 INFO:tasks.workunit.client.0.smithi134.stdout:3/216: fdatasync d4/f1a 0 2024-03-22T07:28:32.308 INFO:tasks.workunit.client.1.smithi195.stdout:4/457: unlink d13/d2a/d7e/d85/fa1 0 2024-03-22T07:28:32.311 INFO:tasks.workunit.client.1.smithi195.stdout:6/411: rename d5/d16/d45/d53/f40 to d5/d16/d5a/f99 0 2024-03-22T07:28:32.311 INFO:tasks.workunit.client.1.smithi195.stdout:5/429: dwrite d9/d12/d1d/d36/f5a [0,4194304] 0 2024-03-22T07:28:32.311 INFO:tasks.workunit.client.1.smithi195.stdout:5/430: readlink d9/d12/d1d/d69/d78/l54 0 2024-03-22T07:28:32.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/431: fsync f8 0 2024-03-22T07:28:32.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/432: getdents d9/d7f 0 2024-03-22T07:28:32.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/433: chown d9/d2d/d84/f9d 99646 1 2024-03-22T07:28:32.312 INFO:tasks.workunit.client.0.smithi134.stdout:1/278: getdents d5/da/d13/d1e/d45 0 2024-03-22T07:28:32.313 INFO:tasks.workunit.client.1.smithi195.stdout:2/390: mknod d2/d3/d21/c7e 0 2024-03-22T07:28:32.313 INFO:tasks.workunit.client.1.smithi195.stdout:2/391: dread - d2/d3/f79 zero size 2024-03-22T07:28:32.313 INFO:tasks.workunit.client.0.smithi134.stdout:9/190: dwrite d3/d9/df/d12/f2a [0,4194304] 0 2024-03-22T07:28:32.315 INFO:tasks.workunit.client.1.smithi195.stdout:9/559: creat d2/d4/d32/d6d/d78/d79/d97/fcf x:0 0 0 2024-03-22T07:28:32.315 INFO:tasks.workunit.client.1.smithi195.stdout:9/560: chown d2/d4/d6/d18/f43 7410 1 2024-03-22T07:28:32.316 INFO:tasks.workunit.client.1.smithi195.stdout:9/561: read d2/d4/d6/db/f6c [78110,114345] 0 2024-03-22T07:28:32.317 INFO:tasks.workunit.client.0.smithi134.stdout:5/217: stat d1/d8/d20/l27 0 2024-03-22T07:28:32.317 INFO:tasks.workunit.client.0.smithi134.stdout:5/218: fdatasync d1/d8/d20/f39 0 2024-03-22T07:28:32.317 INFO:tasks.workunit.client.0.smithi134.stdout:5/219: dread - d1/d8/d16/f40 zero size 2024-03-22T07:28:32.317 INFO:tasks.workunit.client.0.smithi134.stdout:7/419: dwrite d1/de/d11/d48/d52/f3e [0,4194304] 0 2024-03-22T07:28:32.317 INFO:tasks.workunit.client.1.smithi195.stdout:3/437: sync 2024-03-22T07:28:32.317 INFO:tasks.workunit.client.1.smithi195.stdout:1/326: sync 2024-03-22T07:28:32.321 INFO:tasks.workunit.client.1.smithi195.stdout:5/434: rename d9/d53/f7a to d9/d12/f9e 0 2024-03-22T07:28:32.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/472: sync 2024-03-22T07:28:32.322 INFO:tasks.workunit.client.1.smithi195.stdout:0/439: sync 2024-03-22T07:28:32.323 INFO:tasks.workunit.client.1.smithi195.stdout:8/473: stat da/d17/d32 0 2024-03-22T07:28:32.323 INFO:tasks.workunit.client.1.smithi195.stdout:2/392: mknod d2/d3/d7/d19/c7f 0 2024-03-22T07:28:32.324 INFO:tasks.workunit.client.0.smithi134.stdout:1/279: dread d5/da/f21 [0,4194304] 0 2024-03-22T07:28:32.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/562: rmdir d2/d4/d23 39 2024-03-22T07:28:32.327 INFO:tasks.workunit.client.0.smithi134.stdout:3/217: symlink d4/d22/d29/l47 0 2024-03-22T07:28:32.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/438: truncate f0 3028730 0 2024-03-22T07:28:32.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/439: readlink d3/df/d15/d1d/d5c/d47/d67/l7a 0 2024-03-22T07:28:32.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/440: dread - d3/d22/f8a zero size 2024-03-22T07:28:32.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/210: mkdir d2/d1b/d1d/d2b/d4f 0 2024-03-22T07:28:32.329 INFO:tasks.workunit.client.0.smithi134.stdout:2/184: dwrite d2/f1c [4194304,4194304] 0 2024-03-22T07:28:32.330 INFO:tasks.workunit.client.1.smithi195.stdout:5/435: mknod d9/d22/c9f 0 2024-03-22T07:28:32.330 INFO:tasks.workunit.client.1.smithi195.stdout:5/436: truncate d9/d22/d46/f63 973619 0 2024-03-22T07:28:32.330 INFO:tasks.workunit.client.1.smithi195.stdout:5/437: dread - d9/d12/f8c zero size 2024-03-22T07:28:32.330 INFO:tasks.workunit.client.1.smithi195.stdout:5/438: fsync d9/fb 0 2024-03-22T07:28:32.333 INFO:tasks.workunit.client.1.smithi195.stdout:8/474: symlink da/de/l90 0 2024-03-22T07:28:32.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/475: read da/f6b [297565,10354] 0 2024-03-22T07:28:32.335 INFO:tasks.workunit.client.0.smithi134.stdout:9/191: creat d3/d9/d37/d3c/f46 x:0 0 0 2024-03-22T07:28:32.335 INFO:tasks.workunit.client.0.smithi134.stdout:9/192: fdatasync d3/d9/df/d12/f2a 0 2024-03-22T07:28:32.335 INFO:tasks.workunit.client.0.smithi134.stdout:9/193: creat d3/d9/d37/f47 x:0 0 0 2024-03-22T07:28:32.336 INFO:tasks.workunit.client.1.smithi195.stdout:2/393: mknod d2/d3/d7/d19/d22/d26/c80 0 2024-03-22T07:28:32.338 INFO:tasks.workunit.client.0.smithi134.stdout:9/194: dread d3/f22 [0,4194304] 0 2024-03-22T07:28:32.338 INFO:tasks.workunit.client.0.smithi134.stdout:9/195: truncate d3/d9/d37/f47 1045148 0 2024-03-22T07:28:32.338 INFO:tasks.workunit.client.0.smithi134.stdout:5/220: link d1/d4/f2b d1/d8/d16/f4d 0 2024-03-22T07:28:32.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/563: link d2/d4/d32/d6d/lc6 d2/d4/d6/db/d20/d47/ld0 0 2024-03-22T07:28:32.343 INFO:tasks.workunit.client.1.smithi195.stdout:3/441: getdents d3/df/d15/d1d/d5c/d47/d67 0 2024-03-22T07:28:32.348 INFO:tasks.workunit.client.1.smithi195.stdout:8/476: mkdir da/d17/d32/d61/d88/d91 0 2024-03-22T07:28:32.349 INFO:tasks.workunit.client.0.smithi134.stdout:4/301: rmdir d2/d25 39 2024-03-22T07:28:32.352 INFO:tasks.workunit.client.0.smithi134.stdout:1/280: mkdir d5/da/d1b/d27/d60 0 2024-03-22T07:28:32.354 INFO:tasks.workunit.client.1.smithi195.stdout:3/442: mknod d3/df/d15/d1d/d5c/d47/d67/d93/c99 0 2024-03-22T07:28:32.356 INFO:tasks.workunit.client.1.smithi195.stdout:5/439: getdents d9 0 2024-03-22T07:28:32.357 INFO:tasks.workunit.client.0.smithi134.stdout:0/238: rmdir dc/d17 39 2024-03-22T07:28:32.357 INFO:tasks.workunit.client.0.smithi134.stdout:4/302: write d2/fd [184181,77225] 0 2024-03-22T07:28:32.357 INFO:tasks.workunit.client.0.smithi134.stdout:4/303: chown d2/d1d/c21 164462971 1 2024-03-22T07:28:32.357 INFO:tasks.workunit.client.0.smithi134.stdout:4/304: chown d2/d25/c22 30806528 1 2024-03-22T07:28:32.358 INFO:tasks.workunit.client.1.smithi195.stdout:8/477: creat da/d17/d32/d61/d47/d53/d8d/f92 x:0 0 0 2024-03-22T07:28:32.359 INFO:tasks.workunit.client.0.smithi134.stdout:3/218: creat d4/f48 x:0 0 0 2024-03-22T07:28:32.360 INFO:tasks.workunit.client.1.smithi195.stdout:9/564: mkdir d2/d4/d6/dd1 0 2024-03-22T07:28:32.361 INFO:tasks.workunit.client.0.smithi134.stdout:6/211: creat d2/d1b/d1d/d2b/f50 x:0 0 0 2024-03-22T07:28:32.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/443: mknod d3/df/d15/d1d/d5c/c9a 0 2024-03-22T07:28:32.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/444: write d3/df/d15/d1d/d5c/f83 [304805,44674] 0 2024-03-22T07:28:32.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/445: fsync d3/f14 0 2024-03-22T07:28:32.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/446: fsync d3/d18/d89/f6d 0 2024-03-22T07:28:32.365 INFO:tasks.workunit.client.1.smithi195.stdout:2/394: dwrite d2/d3/d1a/f37 [0,4194304] 0 2024-03-22T07:28:32.365 INFO:tasks.workunit.client.1.smithi195.stdout:2/395: stat d2/d3/d21/d40/c5e 0 2024-03-22T07:28:32.365 INFO:tasks.workunit.client.1.smithi195.stdout:0/440: dwrite d1/d10/d1f/f64 [0,4194304] 0 2024-03-22T07:28:32.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/441: readlink d1/d4/d12/l46 0 2024-03-22T07:28:32.366 INFO:tasks.workunit.client.1.smithi195.stdout:0/442: fsync d1/d10/d19/d20/f4f 0 2024-03-22T07:28:32.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/440: mkdir d9/d22/d7b/d98/da0 0 2024-03-22T07:28:32.370 INFO:tasks.workunit.client.1.smithi195.stdout:9/565: rename d2/d4/d1d/d9b/fac to d2/d4/d1d/d9b/fd2 0 2024-03-22T07:28:32.372 INFO:tasks.workunit.client.0.smithi134.stdout:9/196: link d3/l5 d3/d9/df/d12/l48 0 2024-03-22T07:28:32.373 INFO:tasks.workunit.client.1.smithi195.stdout:3/447: mknod d3/df/d15/d1d/c9b 0 2024-03-22T07:28:32.373 INFO:tasks.workunit.client.1.smithi195.stdout:3/448: write d3/df/d15/d1d/d5c/f6f [200440,31283] 0 2024-03-22T07:28:32.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/221: mknod d1/d13/c4e 0 2024-03-22T07:28:32.377 INFO:tasks.workunit.client.1.smithi195.stdout:8/478: dwrite da/d17/d32/d61/f73 [0,4194304] 0 2024-03-22T07:28:32.377 INFO:tasks.workunit.client.1.smithi195.stdout:8/479: creat da/d17/d32/d61/d47/f93 x:0 0 0 2024-03-22T07:28:32.377 INFO:tasks.workunit.client.0.smithi134.stdout:1/281: rmdir d5/da 39 2024-03-22T07:28:32.379 INFO:tasks.workunit.client.1.smithi195.stdout:2/396: truncate d2/d3/f31 3859650 0 2024-03-22T07:28:32.381 INFO:tasks.workunit.client.0.smithi134.stdout:0/239: truncate dc/d17/f38 2721904 0 2024-03-22T07:28:32.382 INFO:tasks.workunit.client.0.smithi134.stdout:0/240: write dc/f29 [1839396,81492] 0 2024-03-22T07:28:32.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/219: dwrite d4/d8/f19 [0,4194304] 0 2024-03-22T07:28:32.385 INFO:tasks.workunit.client.1.smithi195.stdout:0/443: dwrite d1/d10/d19/f65 [0,4194304] 0 2024-03-22T07:28:32.388 INFO:tasks.workunit.client.0.smithi134.stdout:4/305: symlink d2/d15/d35/d37/d43/l65 0 2024-03-22T07:28:32.390 INFO:tasks.workunit.client.0.smithi134.stdout:6/212: symlink d2/d3f/l51 0 2024-03-22T07:28:32.390 INFO:tasks.workunit.client.0.smithi134.stdout:6/213: getdents d2/d1b/d4d 0 2024-03-22T07:28:32.393 INFO:tasks.workunit.client.0.smithi134.stdout:2/185: mkdir d2/d5/d8/d31 0 2024-03-22T07:28:32.393 INFO:tasks.workunit.client.0.smithi134.stdout:2/186: dread - d2/f28 zero size 2024-03-22T07:28:32.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/222: mknod d1/d8/d20/c4f 0 2024-03-22T07:28:32.399 INFO:tasks.workunit.client.0.smithi134.stdout:5/223: stat d1/d8 0 2024-03-22T07:28:32.400 INFO:tasks.workunit.client.1.smithi195.stdout:3/449: dwrite d3/df/d15/d1d/d5c/f44 [0,4194304] 0 2024-03-22T07:28:32.400 INFO:tasks.workunit.client.1.smithi195.stdout:3/450: fdatasync d3/df/d15/f6a 0 2024-03-22T07:28:32.400 INFO:tasks.workunit.client.1.smithi195.stdout:3/451: readlink d3/df/d15/l17 0 2024-03-22T07:28:32.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/480: symlink da/dc/l94 0 2024-03-22T07:28:32.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/481: truncate da/d82/f8c 881529 0 2024-03-22T07:28:32.402 INFO:tasks.workunit.client.1.smithi195.stdout:2/397: dwrite d2/d3/d7/d19/d22/d26/f6f [0,4194304] 0 2024-03-22T07:28:32.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/282: unlink d5/da/d13/c14 0 2024-03-22T07:28:32.404 INFO:tasks.workunit.client.1.smithi195.stdout:5/441: rename d9/d3a to d9/d73/da1 0 2024-03-22T07:28:32.405 INFO:tasks.workunit.client.0.smithi134.stdout:0/241: symlink dc/d18/l4d 0 2024-03-22T07:28:32.405 INFO:tasks.workunit.client.0.smithi134.stdout:0/242: fdatasync dc/d17/f21 0 2024-03-22T07:28:32.405 INFO:tasks.workunit.client.0.smithi134.stdout:0/243: fsync dc/d18/f1d 0 2024-03-22T07:28:32.406 INFO:tasks.workunit.client.1.smithi195.stdout:5/442: dread f0 [0,4194304] 0 2024-03-22T07:28:32.408 INFO:tasks.workunit.client.1.smithi195.stdout:8/482: symlink da/d17/d32/d61/d47/d53/d8d/l95 0 2024-03-22T07:28:32.414 INFO:tasks.workunit.client.0.smithi134.stdout:4/306: rmdir d2/d25/d48/d52 0 2024-03-22T07:28:32.416 INFO:tasks.workunit.client.0.smithi134.stdout:6/214: rename d2/d3f/d28/c3d to d2/d1b/c52 0 2024-03-22T07:28:32.416 INFO:tasks.workunit.client.0.smithi134.stdout:6/215: chown d2/d1b/f48 202805 1 2024-03-22T07:28:32.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/398: mkdir d2/d3/d21/d60/d81 0 2024-03-22T07:28:32.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/399: chown d2/d3/d21/f14 928 1 2024-03-22T07:28:32.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/400: dread - d2/d3/d21/f6d zero size 2024-03-22T07:28:32.417 INFO:tasks.workunit.client.0.smithi134.stdout:9/197: getdents d3/d9 0 2024-03-22T07:28:32.419 INFO:tasks.workunit.client.1.smithi195.stdout:9/566: rename d2/d4/f5 to d2/d4/d23/d74/fd3 0 2024-03-22T07:28:32.420 INFO:tasks.workunit.client.0.smithi134.stdout:5/224: unlink d1/d8/d16/l14 0 2024-03-22T07:28:32.420 INFO:tasks.workunit.client.0.smithi134.stdout:5/225: creat d1/d8/d20/f50 x:0 0 0 2024-03-22T07:28:32.421 INFO:tasks.workunit.client.0.smithi134.stdout:5/226: creat d1/d8/d3f/f51 x:0 0 0 2024-03-22T07:28:32.421 INFO:tasks.workunit.client.0.smithi134.stdout:5/227: chown d1/c32 79602 1 2024-03-22T07:28:32.422 INFO:tasks.workunit.client.1.smithi195.stdout:8/483: link da/dc/f6f da/d17/d32/d61/d47/d53/f96 0 2024-03-22T07:28:32.422 INFO:tasks.workunit.client.1.smithi195.stdout:8/484: readlink da/de/l52 0 2024-03-22T07:28:32.423 INFO:tasks.workunit.client.0.smithi134.stdout:2/187: dwrite d2/d5/fc [0,4194304] 0 2024-03-22T07:28:32.425 INFO:tasks.workunit.client.1.smithi195.stdout:0/444: rename d1/d4/dd/df/d44/c73 to d1/d10/c7c 0 2024-03-22T07:28:32.425 INFO:tasks.workunit.client.1.smithi195.stdout:0/445: stat d1/d4/d12/d6c/c77 0 2024-03-22T07:28:32.427 INFO:tasks.workunit.client.1.smithi195.stdout:8/485: truncate da/d17/d32/d61/d47/d53/f5e 3649282 0 2024-03-22T07:28:32.427 INFO:tasks.workunit.client.0.smithi134.stdout:3/220: dwrite d4/d22/d29/f30 [0,4194304] 0 2024-03-22T07:28:32.429 INFO:tasks.workunit.client.0.smithi134.stdout:2/188: dread d2/d5/d22/f24 [0,4194304] 0 2024-03-22T07:28:32.431 INFO:tasks.workunit.client.1.smithi195.stdout:0/446: symlink d1/d4/dd/df/d2b/l7d 0 2024-03-22T07:28:32.433 INFO:tasks.workunit.client.1.smithi195.stdout:9/567: getdents d2/d4/d6/db/d20/d47 0 2024-03-22T07:28:32.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/443: dwrite f7 [0,4194304] 0 2024-03-22T07:28:32.434 INFO:tasks.workunit.client.1.smithi195.stdout:5/444: read d9/d12/f47 [3533772,59328] 0 2024-03-22T07:28:32.435 INFO:tasks.workunit.client.0.smithi134.stdout:5/228: write d1/d8/f21 [4124618,11602] 0 2024-03-22T07:28:32.435 INFO:tasks.workunit.client.0.smithi134.stdout:5/229: read - d1/d8/d20/f50 zero size 2024-03-22T07:28:32.436 INFO:tasks.workunit.client.1.smithi195.stdout:5/445: dread d9/d22/d46/f63 [0,4194304] 0 2024-03-22T07:28:32.436 INFO:tasks.workunit.client.0.smithi134.stdout:2/189: write d2/d5/d8/f1b [1410414,24331] 0 2024-03-22T07:28:32.436 INFO:tasks.workunit.client.0.smithi134.stdout:9/198: dwrite d3/d9/df/d12/d1b/f29 [4194304,4194304] 0 2024-03-22T07:28:32.437 INFO:tasks.workunit.client.1.smithi195.stdout:3/452: rename d3/l6 to d3/df/d15/d1d/d5c/d47/d67/d80/d87/l9c 0 2024-03-22T07:28:32.438 INFO:tasks.workunit.client.1.smithi195.stdout:3/453: fsync d3/f8b 0 2024-03-22T07:28:32.438 INFO:tasks.workunit.client.1.smithi195.stdout:2/401: dwrite d2/d3/d7/d19/f33 [0,4194304] 0 2024-03-22T07:28:32.439 INFO:tasks.workunit.client.1.smithi195.stdout:3/454: dread d3/f2d [0,4194304] 0 2024-03-22T07:28:32.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/568: read d2/d4/d32/f3a [678737,30432] 0 2024-03-22T07:28:32.439 INFO:tasks.workunit.client.1.smithi195.stdout:9/569: write d2/d4/d1d/f8b [4824085,19839] 0 2024-03-22T07:28:32.440 INFO:tasks.workunit.client.1.smithi195.stdout:3/455: read d3/df/d15/f6a [237583,24942] 0 2024-03-22T07:28:32.440 INFO:tasks.workunit.client.0.smithi134.stdout:1/283: mkdir d5/da/d61 0 2024-03-22T07:28:32.443 INFO:tasks.workunit.client.0.smithi134.stdout:4/307: mkdir d2/d15/d66 0 2024-03-22T07:28:32.443 INFO:tasks.workunit.client.0.smithi134.stdout:4/308: chown d2/d15/l2b 23595949 1 2024-03-22T07:28:32.443 INFO:tasks.workunit.client.0.smithi134.stdout:4/309: dread - d2/d1d/f5e zero size 2024-03-22T07:28:32.447 INFO:tasks.workunit.client.0.smithi134.stdout:0/244: rename dc/d17/f3f to dc/f4e 0 2024-03-22T07:28:32.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/245: truncate dc/d17/f41 869526 0 2024-03-22T07:28:32.449 INFO:tasks.workunit.client.0.smithi134.stdout:6/216: creat d2/d1b/d1d/d2b/f53 x:0 0 0 2024-03-22T07:28:32.450 INFO:tasks.workunit.client.0.smithi134.stdout:6/217: dread - d2/d1b/d1d/d2b/f50 zero size 2024-03-22T07:28:32.456 INFO:tasks.workunit.client.1.smithi195.stdout:5/446: mknod d9/d12/d1d/d69/ca2 0 2024-03-22T07:28:32.456 INFO:tasks.workunit.client.1.smithi195.stdout:9/570: dread d2/d4/d6/d18/f3e [0,4194304] 0 2024-03-22T07:28:32.460 INFO:tasks.workunit.client.1.smithi195.stdout:0/447: rename d1/d4/d22/c33 to d1/d4/d22/d41/c7e 0 2024-03-22T07:28:32.462 INFO:tasks.workunit.client.0.smithi134.stdout:3/221: creat d4/d8/f49 x:0 0 0 2024-03-22T07:28:32.462 INFO:tasks.workunit.client.0.smithi134.stdout:1/284: dwrite d5/da/d13/d1e/f44 [0,4194304] 0 2024-03-22T07:28:32.465 INFO:tasks.workunit.client.0.smithi134.stdout:5/230: mkdir d1/d8/d16/d4a/d52 0 2024-03-22T07:28:32.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/456: mkdir d3/d18/d89/d8c/d9d 0 2024-03-22T07:28:32.471 INFO:tasks.workunit.client.0.smithi134.stdout:9/199: creat d3/d9/df/f49 x:0 0 0 2024-03-22T07:28:32.471 INFO:tasks.workunit.client.0.smithi134.stdout:9/200: stat d3/d9/df/d12/d1b/l3d 0 2024-03-22T07:28:32.472 INFO:tasks.workunit.client.0.smithi134.stdout:0/246: dwrite dc/d17/f41 [0,4194304] 0 2024-03-22T07:28:32.473 INFO:tasks.workunit.client.1.smithi195.stdout:9/571: rename d2/d4/d23/c8f to d2/d4/d6/db/d20/d4a/cd4 0 2024-03-22T07:28:32.474 INFO:tasks.workunit.client.0.smithi134.stdout:4/310: symlink d2/d15/d35/d37/l67 0 2024-03-22T07:28:32.475 INFO:tasks.workunit.client.1.smithi195.stdout:5/447: dwrite d9/d12/d1d/d36/f44 [0,4194304] 0 2024-03-22T07:28:32.475 INFO:tasks.workunit.client.1.smithi195.stdout:5/448: truncate d9/d12/d1d/d69/d78/d41/f8d 611901 0 2024-03-22T07:28:32.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/449: dread f0 [0,4194304] 0 2024-03-22T07:28:32.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/450: creat d9/d12/d1d/d36/fa3 x:0 0 0 2024-03-22T07:28:32.478 INFO:tasks.workunit.client.1.smithi195.stdout:2/402: rmdir d2/d3/d7/da/d4e 39 2024-03-22T07:28:32.478 INFO:tasks.workunit.client.1.smithi195.stdout:7/371: sync 2024-03-22T07:28:32.479 INFO:tasks.workunit.client.1.smithi195.stdout:3/457: rmdir d3/d18/d89/d70 39 2024-03-22T07:28:32.481 INFO:tasks.workunit.client.1.smithi195.stdout:9/572: creat d2/d4/fd5 x:0 0 0 2024-03-22T07:28:32.482 INFO:tasks.workunit.client.0.smithi134.stdout:1/285: mkdir d5/da/d13/d1e/d62 0 2024-03-22T07:28:32.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/222: dwrite d4/d8/d23/f3a [0,4194304] 0 2024-03-22T07:28:32.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/223: readlink d4/l2d 0 2024-03-22T07:28:32.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/224: creat d4/d10/f4a x:0 0 0 2024-03-22T07:28:32.486 INFO:tasks.workunit.client.0.smithi134.stdout:5/231: rmdir d1/d8/d16/d4a/d52 0 2024-03-22T07:28:32.486 INFO:tasks.workunit.client.0.smithi134.stdout:5/232: truncate d1/d8/d3f/f41 189831 0 2024-03-22T07:28:32.489 INFO:tasks.workunit.client.0.smithi134.stdout:6/218: write d2/f35 [2023031,47423] 0 2024-03-22T07:28:32.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/372: write d0/d13/d14/f8 [2811593,60606] 0 2024-03-22T07:28:32.490 INFO:tasks.workunit.client.1.smithi195.stdout:1/327: sync 2024-03-22T07:28:32.490 INFO:tasks.workunit.client.1.smithi195.stdout:4/458: sync 2024-03-22T07:28:32.490 INFO:tasks.workunit.client.1.smithi195.stdout:1/328: chown d0/d2/d27/l36 34 1 2024-03-22T07:28:32.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/190: mknod d2/d5/c32 0 2024-03-22T07:28:32.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/191: getdents d2/d5/d8/d31 0 2024-03-22T07:28:32.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/192: chown d2/d5/fc 638242509 1 2024-03-22T07:28:32.491 INFO:tasks.workunit.client.1.smithi195.stdout:6/412: sync 2024-03-22T07:28:32.491 INFO:tasks.workunit.client.1.smithi195.stdout:1/329: write d0/d2/d6/d21/d39/f65 [792976,129324] 0 2024-03-22T07:28:32.491 INFO:tasks.workunit.client.1.smithi195.stdout:9/573: dread d2/d4/d6/db/d20/d47/f73 [0,4194304] 0 2024-03-22T07:28:32.492 INFO:tasks.workunit.client.0.smithi134.stdout:9/201: mknod d3/d9/d37/c4a 0 2024-03-22T07:28:32.492 INFO:tasks.workunit.client.0.smithi134.stdout:9/202: write d3/d9/df/d12/f2f [954105,38829] 0 2024-03-22T07:28:32.493 INFO:tasks.workunit.client.1.smithi195.stdout:4/459: dread d13/d63/d79/f48 [0,4194304] 0 2024-03-22T07:28:32.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/458: readlink d3/l5 0 2024-03-22T07:28:32.496 INFO:tasks.workunit.client.1.smithi195.stdout:5/451: dwrite d9/d22/d46/f88 [0,4194304] 0 2024-03-22T07:28:32.497 INFO:tasks.workunit.client.1.smithi195.stdout:0/448: dwrite d1/d10/d1f/f21 [8388608,4194304] 0 2024-03-22T07:28:32.497 INFO:tasks.workunit.client.1.smithi195.stdout:0/449: chown d1/d10/d1f/f21 15 1 2024-03-22T07:28:32.500 INFO:tasks.workunit.client.1.smithi195.stdout:7/373: mknod d0/d13/d14/d29/d35/c77 0 2024-03-22T07:28:32.501 INFO:tasks.workunit.client.1.smithi195.stdout:7/374: creat d0/d13/d14/d20/f78 x:0 0 0 2024-03-22T07:28:32.501 INFO:tasks.workunit.client.1.smithi195.stdout:6/413: read d5/d5e/f33 [1647143,85152] 0 2024-03-22T07:28:32.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/330: mknod d0/d2/d6/d21/d41/d47/d4a/d66/c6e 0 2024-03-22T07:28:32.505 INFO:tasks.workunit.client.1.smithi195.stdout:9/574: creat d2/d4/fd6 x:0 0 0 2024-03-22T07:28:32.507 INFO:tasks.workunit.client.1.smithi195.stdout:2/403: mkdir d2/d3/db/d82 0 2024-03-22T07:28:32.508 INFO:tasks.workunit.client.0.smithi134.stdout:9/203: dwrite d3/d9/df/d12/f1d [0,4194304] 0 2024-03-22T07:28:32.508 INFO:tasks.workunit.client.0.smithi134.stdout:0/247: truncate dc/f3c 1498977 0 2024-03-22T07:28:32.510 INFO:tasks.workunit.client.1.smithi195.stdout:0/450: dread d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:32.510 INFO:tasks.workunit.client.1.smithi195.stdout:4/460: link d13/d63/d3e/d5c/la0 d13/d63/d36/d5f/la3 0 2024-03-22T07:28:32.513 INFO:tasks.workunit.client.1.smithi195.stdout:3/459: mknod d3/df/d15/d1d/d5c/c9e 0 2024-03-22T07:28:32.514 INFO:tasks.workunit.client.0.smithi134.stdout:1/286: mkdir d5/da/d13/d1e/d63 0 2024-03-22T07:28:32.515 INFO:tasks.workunit.client.0.smithi134.stdout:1/287: write d5/da/d13/d1e/d34/f3e [1271751,17368] 0 2024-03-22T07:28:32.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/452: symlink d9/d12/d1d/d36/d7d/la4 0 2024-03-22T07:28:32.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/453: chown d9/d12/d1d/d36/f49 488 1 2024-03-22T07:28:32.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/454: fdatasync d9/d12/d1d/d69/d78/f97 0 2024-03-22T07:28:32.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/455: write d9/d12/f47 [4292568,118263] 0 2024-03-22T07:28:32.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/456: chown d9/c2f 7127 1 2024-03-22T07:28:32.518 INFO:tasks.workunit.client.1.smithi195.stdout:5/457: stat d9/d22/c59 0 2024-03-22T07:28:32.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/458: dread d9/d22/d46/f63 [0,4194304] 0 2024-03-22T07:28:32.520 INFO:tasks.workunit.client.1.smithi195.stdout:5/459: stat d9/d12/d14/f4b 0 2024-03-22T07:28:32.524 INFO:tasks.workunit.client.1.smithi195.stdout:7/375: rmdir d0/d13/d22/d52/d59 39 2024-03-22T07:28:32.525 INFO:tasks.workunit.client.0.smithi134.stdout:3/225: mkdir d4/d10/d4b 0 2024-03-22T07:28:32.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/324: sync 2024-03-22T07:28:32.526 INFO:tasks.workunit.client.1.smithi195.stdout:6/414: getdents d5/d5e/d34 0 2024-03-22T07:28:32.528 INFO:tasks.workunit.client.0.smithi134.stdout:5/233: creat d1/d13/f53 x:0 0 0 2024-03-22T07:28:32.528 INFO:tasks.workunit.client.0.smithi134.stdout:1/288: dread f1 [0,4194304] 0 2024-03-22T07:28:32.529 INFO:tasks.workunit.client.0.smithi134.stdout:3/226: dread d4/d10/f36 [0,4194304] 0 2024-03-22T07:28:32.532 INFO:tasks.workunit.client.1.smithi195.stdout:2/404: rename d2/d3/d7/da/de/f48 to d2/d3/d7/da/d4e/f83 0 2024-03-22T07:28:32.533 INFO:tasks.workunit.client.1.smithi195.stdout:1/331: dwrite d0/d2/fe [0,4194304] 0 2024-03-22T07:28:32.533 INFO:tasks.workunit.client.1.smithi195.stdout:1/332: read - d0/d2/d6/d21/d39/d40/f43 zero size 2024-03-22T07:28:32.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/451: link d1/d10/d1f/d40/c5c d1/d4/c7f 0 2024-03-22T07:28:32.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/452: readlink d1/d4/d12/l15 0 2024-03-22T07:28:32.534 INFO:tasks.workunit.client.0.smithi134.stdout:2/193: creat d2/d5/d8/f33 x:0 0 0 2024-03-22T07:28:32.535 INFO:tasks.workunit.client.1.smithi195.stdout:3/460: unlink d3/df/d15/d1d/d5c/d47/c5a 0 2024-03-22T07:28:32.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/420: sync 2024-03-22T07:28:32.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/421: write d1/d19/d32/f4d [77742,123604] 0 2024-03-22T07:28:32.538 INFO:tasks.workunit.client.1.smithi195.stdout:4/461: dwrite d13/d63/f33 [4194304,4194304] 0 2024-03-22T07:28:32.539 INFO:tasks.workunit.client.1.smithi195.stdout:7/376: mkdir d0/d13/d22/d52/d59/d79 0 2024-03-22T07:28:32.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/219: dread d2/f43 [0,4194304] 0 2024-03-22T07:28:32.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/220: truncate d2/f17 4828451 0 2024-03-22T07:28:32.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/221: write d2/f17 [5362471,110991] 0 2024-03-22T07:28:32.542 INFO:tasks.workunit.client.1.smithi195.stdout:6/415: unlink d5/d16/d45/d53/l20 0 2024-03-22T07:28:32.545 INFO:tasks.workunit.client.1.smithi195.stdout:1/333: write d0/d2/f1b [2269088,89162] 0 2024-03-22T07:28:32.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/248: rename dc/d17/f40 to dc/de/f4f 0 2024-03-22T07:28:32.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/249: dread - dc/f3e zero size 2024-03-22T07:28:32.546 INFO:tasks.workunit.client.0.smithi134.stdout:0/250: fdatasync dc/d18/f1d 0 2024-03-22T07:28:32.546 INFO:tasks.workunit.client.1.smithi195.stdout:9/575: rmdir d2/d4/d6/d18/d50/d88 39 2024-03-22T07:28:32.547 INFO:tasks.workunit.client.0.smithi134.stdout:7/422: dread d1/de/d11/d48/d52/f7 [0,4194304] 0 2024-03-22T07:28:32.547 INFO:tasks.workunit.client.0.smithi134.stdout:7/423: chown d1/de/d11/d48/d52/d46/c57 18107025 1 2024-03-22T07:28:32.548 INFO:tasks.workunit.client.1.smithi195.stdout:2/405: creat d2/d3/d21/d60/d81/f84 x:0 0 0 2024-03-22T07:28:32.549 INFO:tasks.workunit.client.1.smithi195.stdout:2/406: write d2/f34 [139044,77992] 0 2024-03-22T07:28:32.549 INFO:tasks.workunit.client.0.smithi134.stdout:0/251: dread dc/d17/f38 [0,4194304] 0 2024-03-22T07:28:32.549 INFO:tasks.workunit.client.0.smithi134.stdout:0/252: chown dc/d17/c31 0 1 2024-03-22T07:28:32.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/325: link d1/d15/d42/d12/d20/d41/f48 d1/d15/d42/d12/d20/f70 0 2024-03-22T07:28:32.554 INFO:tasks.workunit.client.0.smithi134.stdout:5/234: getdents d1/d8/d16/d4a 0 2024-03-22T07:28:32.554 INFO:tasks.workunit.client.0.smithi134.stdout:5/235: creat d1/d8/d20/f54 x:0 0 0 2024-03-22T07:28:32.556 INFO:tasks.workunit.client.1.smithi195.stdout:3/461: link d3/df/d15/d1d/l41 d3/df/d15/d1d/d5c/d47/d67/d80/l9f 0 2024-03-22T07:28:32.559 INFO:tasks.workunit.client.0.smithi134.stdout:3/227: creat d4/d10/d4b/f4c x:0 0 0 2024-03-22T07:28:32.563 INFO:tasks.workunit.client.0.smithi134.stdout:0/253: dwrite dc/d18/f1a [0,4194304] 0 2024-03-22T07:28:32.563 INFO:tasks.workunit.client.0.smithi134.stdout:0/254: creat dc/de/f50 x:0 0 0 2024-03-22T07:28:32.563 INFO:tasks.workunit.client.0.smithi134.stdout:2/194: symlink d2/l34 0 2024-03-22T07:28:32.565 INFO:tasks.workunit.client.0.smithi134.stdout:0/255: dread dc/f3c [0,4194304] 0 2024-03-22T07:28:32.565 INFO:tasks.workunit.client.0.smithi134.stdout:0/256: chown dc/d18/f1b 591 1 2024-03-22T07:28:32.567 INFO:tasks.workunit.client.0.smithi134.stdout:9/204: getdents d3/d9/d37/d3c 0 2024-03-22T07:28:32.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/222: creat d2/d1b/d4d/f54 x:0 0 0 2024-03-22T07:28:32.578 INFO:tasks.workunit.client.1.smithi195.stdout:6/416: creat d5/d5e/d34/d55/d3b/d6e/d97/f9a x:0 0 0 2024-03-22T07:28:32.578 INFO:tasks.workunit.client.1.smithi195.stdout:6/417: chown d5/d5e/d34/l49 21556079 1 2024-03-22T07:28:32.578 INFO:tasks.workunit.client.0.smithi134.stdout:9/205: dread d3/fe [0,4194304] 0 2024-03-22T07:28:32.579 INFO:tasks.workunit.client.0.smithi134.stdout:7/424: rename d1/d19/d32/c42 to d1/de/d41/c89 0 2024-03-22T07:28:32.580 INFO:tasks.workunit.client.0.smithi134.stdout:0/257: dwrite dc/d18/f44 [0,4194304] 0 2024-03-22T07:28:32.581 INFO:tasks.workunit.client.0.smithi134.stdout:4/311: getdents d2/d2a/d50 0 2024-03-22T07:28:32.582 INFO:tasks.workunit.client.1.smithi195.stdout:1/334: mkdir d0/d2/d9/d2a/d6f 0 2024-03-22T07:28:32.583 INFO:tasks.workunit.client.1.smithi195.stdout:1/335: chown d0/d2/d6/d21 187829 1 2024-03-22T07:28:32.583 INFO:tasks.workunit.client.1.smithi195.stdout:1/336: read d0/d2/d6/d21/d41/d47/d4a/f4c [89047,30900] 0 2024-03-22T07:28:32.585 INFO:tasks.workunit.client.0.smithi134.stdout:8/326: mknod d1/d15/d42/d25/d6f/c71 0 2024-03-22T07:28:32.589 INFO:tasks.workunit.client.0.smithi134.stdout:2/195: dwrite d2/fe [8388608,4194304] 0 2024-03-22T07:28:32.590 INFO:tasks.workunit.client.1.smithi195.stdout:2/407: creat d2/d3/d21/d60/f85 x:0 0 0 2024-03-22T07:28:32.590 INFO:tasks.workunit.client.1.smithi195.stdout:2/408: chown d2/d1e/l41 8 1 2024-03-22T07:28:32.590 INFO:tasks.workunit.client.0.smithi134.stdout:9/206: write d3/f28 [3629735,101493] 0 2024-03-22T07:28:32.592 INFO:tasks.workunit.client.0.smithi134.stdout:5/236: unlink d1/f49 0 2024-03-22T07:28:32.592 INFO:tasks.workunit.client.0.smithi134.stdout:5/237: stat d1/d8/d3f/f51 0 2024-03-22T07:28:32.595 INFO:tasks.workunit.client.1.smithi195.stdout:3/462: rmdir d3/d18/d89/d70/d8e 0 2024-03-22T07:28:32.596 INFO:tasks.workunit.client.1.smithi195.stdout:7/377: rmdir d0/d13/d22/d28 39 2024-03-22T07:28:32.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/289: rmdir d5/da/d13 39 2024-03-22T07:28:32.598 INFO:tasks.workunit.client.0.smithi134.stdout:1/290: write d5/d1d/d2d/f57 [314941,49284] 0 2024-03-22T07:28:32.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/418: symlink d5/d16/d5a/l9b 0 2024-03-22T07:28:32.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/419: truncate d5/d16/d45/f39 3014312 0 2024-03-22T07:28:32.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/420: write d5/d5e/d34/d55/d3b/d6e/d3c/f3d [1140223,94285] 0 2024-03-22T07:28:32.599 INFO:tasks.workunit.client.1.smithi195.stdout:9/576: symlink d2/d4/d6/d18/d50/ld7 0 2024-03-22T07:28:32.602 INFO:tasks.workunit.client.0.smithi134.stdout:9/207: read d3/d9/df/d12/d1b/f29 [2391898,101567] 0 2024-03-22T07:28:32.602 INFO:tasks.workunit.client.1.smithi195.stdout:0/453: rename d1/d4/d22/d41 to d1/d4/dd/d66/d80 0 2024-03-22T07:28:32.604 INFO:tasks.workunit.client.0.smithi134.stdout:6/223: chown d2/d1b/d1d/d2b/c31 1358589 1 2024-03-22T07:28:32.604 INFO:tasks.workunit.client.0.smithi134.stdout:6/224: fdatasync d2/d1b/f29 0 2024-03-22T07:28:32.605 INFO:tasks.workunit.client.1.smithi195.stdout:7/378: truncate d0/f25 539619 0 2024-03-22T07:28:32.606 INFO:tasks.workunit.client.0.smithi134.stdout:7/425: getdents d1/d40 0 2024-03-22T07:28:32.606 INFO:tasks.workunit.client.0.smithi134.stdout:7/426: fsync d1/f17 0 2024-03-22T07:28:32.606 INFO:tasks.workunit.client.0.smithi134.stdout:7/427: creat d1/de/d11/d2b/d31/f8a x:0 0 0 2024-03-22T07:28:32.607 INFO:tasks.workunit.client.0.smithi134.stdout:0/258: dwrite dc/de/f4f [0,4194304] 0 2024-03-22T07:28:32.607 INFO:tasks.workunit.client.0.smithi134.stdout:0/259: fdatasync dc/d17/f38 0 2024-03-22T07:28:32.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/327: dwrite d1/d15/f5 [0,4194304] 0 2024-03-22T07:28:32.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/196: dread d2/d5/d22/f2a [0,4194304] 0 2024-03-22T07:28:32.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/328: write d1/d15/d42/d49/f5f [880359,108769] 0 2024-03-22T07:28:32.609 INFO:tasks.workunit.client.0.smithi134.stdout:9/208: dread d3/d9/f36 [0,4194304] 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:3/463: dread d3/df/d15/d1d/d5c/f3b [0,4194304] 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:3/464: readlink d3/d22/l61 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/337: dwrite d0/d2/d6/d21/d39/f68 [0,4194304] 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/338: fdatasync d0/d2/d6/d21/d39/d40/f43 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/339: write d0/d2/d9/f61 [1020679,97684] 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:1/340: fdatasync d0/d2/d9/d2a/f5b 0 2024-03-22T07:28:32.610 INFO:tasks.workunit.client.1.smithi195.stdout:6/421: link d5/d5e/d34/d55/d3b/d6e/l1b d5/d5e/d34/d55/d3b/d6e/d56/l9c 0 2024-03-22T07:28:32.611 INFO:tasks.workunit.client.0.smithi134.stdout:4/312: getdents d2/d2a 0 2024-03-22T07:28:32.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/409: rename d2/d3/d7/l55 to d2/d3/d21/d4c/l86 0 2024-03-22T07:28:32.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/410: readlink d2/d3/d7/d19/l30 0 2024-03-22T07:28:32.612 INFO:tasks.workunit.client.1.smithi195.stdout:2/411: dread - d2/d3/d21/d60/d81/f84 zero size 2024-03-22T07:28:32.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/422: dread d5/d16/d45/d53/d17/d1a/f4d [0,4194304] 0 2024-03-22T07:28:32.616 INFO:tasks.workunit.client.1.smithi195.stdout:7/379: link d0/d13/d22/f23 d0/d13/d14/d29/d35/d6d/f7a 0 2024-03-22T07:28:32.617 INFO:tasks.workunit.client.1.smithi195.stdout:7/380: write d0/d13/d14/d20/f4b [947013,26156] 0 2024-03-22T07:28:32.617 INFO:tasks.workunit.client.1.smithi195.stdout:7/381: chown d0/d13/d14/d2f 1849706259 1 2024-03-22T07:28:32.621 INFO:tasks.workunit.client.0.smithi134.stdout:5/238: symlink d1/d8/d16/l55 0 2024-03-22T07:28:32.622 INFO:tasks.workunit.client.1.smithi195.stdout:2/412: write d2/d3/d7/da/de/f35 [299167,56052] 0 2024-03-22T07:28:32.623 INFO:tasks.workunit.client.0.smithi134.stdout:1/291: mknod d5/da/d13/d1e/c64 0 2024-03-22T07:28:32.624 INFO:tasks.workunit.client.0.smithi134.stdout:1/292: stat d5/da/d13/d1e/f44 0 2024-03-22T07:28:32.624 INFO:tasks.workunit.client.0.smithi134.stdout:1/293: dread - d5/da/d13/d1e/f22 zero size 2024-03-22T07:28:32.624 INFO:tasks.workunit.client.0.smithi134.stdout:7/428: dread d1/d19/f2f [0,4194304] 0 2024-03-22T07:28:32.624 INFO:tasks.workunit.client.0.smithi134.stdout:7/429: write d1/de/d11/f55 [471287,24943] 0 2024-03-22T07:28:32.626 INFO:tasks.workunit.client.1.smithi195.stdout:3/465: mkdir d3/df/d15/d1d/d5c/d86/da0 0 2024-03-22T07:28:32.626 INFO:tasks.workunit.client.1.smithi195.stdout:3/466: getdents d3/d98 0 2024-03-22T07:28:32.626 INFO:tasks.workunit.client.1.smithi195.stdout:3/467: fsync d3/df/d15/d1d/d5c/f46 0 2024-03-22T07:28:32.628 INFO:tasks.workunit.client.0.smithi134.stdout:6/225: rename d2/d1b/f48 to d2/d1b/d1d/f55 0 2024-03-22T07:28:32.628 INFO:tasks.workunit.client.0.smithi134.stdout:6/226: chown d2/d1b/c2d 0 1 2024-03-22T07:28:32.630 INFO:tasks.workunit.client.1.smithi195.stdout:0/454: getdents d1/d4/dd 0 2024-03-22T07:28:32.632 INFO:tasks.workunit.client.0.smithi134.stdout:8/329: symlink d1/d46/l72 0 2024-03-22T07:28:32.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/430: creat d1/de/d11/d48/f8b x:0 0 0 2024-03-22T07:28:32.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/431: creat d1/de/d11/d2b/d69/f8c x:0 0 0 2024-03-22T07:28:32.636 INFO:tasks.workunit.client.0.smithi134.stdout:0/260: rename dc/de/lf to dc/l51 0 2024-03-22T07:28:32.639 INFO:tasks.workunit.client.1.smithi195.stdout:6/423: mknod d5/d5e/d34/d55/d3b/d6e/d56/d8f/c9d 0 2024-03-22T07:28:32.639 INFO:tasks.workunit.client.0.smithi134.stdout:9/209: dwrite d3/f14 [0,4194304] 0 2024-03-22T07:28:32.640 INFO:tasks.workunit.client.0.smithi134.stdout:6/227: chown d2/cf 65127 1 2024-03-22T07:28:32.641 INFO:tasks.workunit.client.0.smithi134.stdout:4/313: dwrite d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:32.642 INFO:tasks.workunit.client.1.smithi195.stdout:1/341: dwrite d0/d2/f2e [0,4194304] 0 2024-03-22T07:28:32.642 INFO:tasks.workunit.client.1.smithi195.stdout:3/468: creat d3/df/d15/d1d/d5c/d86/da0/fa1 x:0 0 0 2024-03-22T07:28:32.643 INFO:tasks.workunit.client.0.smithi134.stdout:8/330: link d1/d15/d42/d12/f37 d1/d4/d6e/f73 0 2024-03-22T07:28:32.643 INFO:tasks.workunit.client.0.smithi134.stdout:8/331: readlink d1/d15/d42/d12/l60 0 2024-03-22T07:28:32.644 INFO:tasks.workunit.client.1.smithi195.stdout:0/455: creat d1/d4/dd/df/d6b/f81 x:0 0 0 2024-03-22T07:28:32.647 INFO:tasks.workunit.client.1.smithi195.stdout:2/413: dread d2/d3/d7/da/de/f35 [0,4194304] 0 2024-03-22T07:28:32.647 INFO:tasks.workunit.client.1.smithi195.stdout:2/414: fdatasync d2/d3/d7/d19/d22/d26/d3c/f47 0 2024-03-22T07:28:32.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/197: rename d2/d5/l21 to d2/l35 0 2024-03-22T07:28:32.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/198: readlink d2/d5/l2b 0 2024-03-22T07:28:32.648 INFO:tasks.workunit.client.0.smithi134.stdout:2/199: readlink d2/l16 0 2024-03-22T07:28:32.649 INFO:tasks.workunit.client.1.smithi195.stdout:2/415: dread d2/d17/f70 [0,4194304] 0 2024-03-22T07:28:32.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/424: write d5/f1e [1615383,41886] 0 2024-03-22T07:28:32.651 INFO:tasks.workunit.client.0.smithi134.stdout:5/239: dwrite d1/d13/f53 [0,4194304] 0 2024-03-22T07:28:32.652 INFO:tasks.workunit.client.1.smithi195.stdout:3/469: mkdir d3/df/d15/d1d/d5c/d47/d67/d93/da2 0 2024-03-22T07:28:32.653 INFO:tasks.workunit.client.1.smithi195.stdout:0/456: rmdir d1/d10 39 2024-03-22T07:28:32.654 INFO:tasks.workunit.client.0.smithi134.stdout:9/210: link d3/l34 d3/d9/df/d12/l4b 0 2024-03-22T07:28:32.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/470: truncate d3/df/d15/d1d/f30 9884697 0 2024-03-22T07:28:32.659 INFO:tasks.workunit.client.1.smithi195.stdout:3/471: write d3/d18/d89/d70/f71 [1246830,88026] 0 2024-03-22T07:28:32.660 INFO:tasks.workunit.client.0.smithi134.stdout:4/314: symlink d2/d15/d35/d37/l68 0 2024-03-22T07:28:32.660 INFO:tasks.workunit.client.0.smithi134.stdout:4/315: stat d2/d1d/f54 0 2024-03-22T07:28:32.662 INFO:tasks.workunit.client.1.smithi195.stdout:0/457: mknod d1/d4/d12/d6c/c82 0 2024-03-22T07:28:32.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/342: rename d0/d2/d6/d21/d32 to d0/d70 0 2024-03-22T07:28:32.665 INFO:tasks.workunit.client.0.smithi134.stdout:7/432: dwrite d1/de/d11/d48/f1e [4194304,4194304] 0 2024-03-22T07:28:32.666 INFO:tasks.workunit.client.0.smithi134.stdout:0/261: rename dc/d18/c37 to dc/c52 0 2024-03-22T07:28:32.666 INFO:tasks.workunit.client.0.smithi134.stdout:0/262: chown dc/de/l28 81948 1 2024-03-22T07:28:32.666 INFO:tasks.workunit.client.0.smithi134.stdout:0/263: write dc/d17/f48 [379768,129025] 0 2024-03-22T07:28:32.666 INFO:tasks.workunit.client.0.smithi134.stdout:0/264: chown dc/f20 7977552 1 2024-03-22T07:28:32.667 INFO:tasks.workunit.client.1.smithi195.stdout:2/416: dread d2/d3/d7/d19/f28 [0,4194304] 0 2024-03-22T07:28:32.669 INFO:tasks.workunit.client.1.smithi195.stdout:6/425: dwrite d5/d16/d45/f6f [0,4194304] 0 2024-03-22T07:28:32.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/417: truncate d2/d1e/f64 3440799 0 2024-03-22T07:28:32.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/418: readlink d2/d3/d1a/l75 0 2024-03-22T07:28:32.670 INFO:tasks.workunit.client.1.smithi195.stdout:2/419: write d2/d3/d21/f6d [677059,58210] 0 2024-03-22T07:28:32.671 INFO:tasks.workunit.client.1.smithi195.stdout:7/382: dwrite d0/d13/d14/d20/f4b [0,4194304] 0 2024-03-22T07:28:32.672 INFO:tasks.workunit.client.0.smithi134.stdout:8/332: dwrite d1/d15/d42/d12/d20/d41/f48 [0,4194304] 0 2024-03-22T07:28:32.672 INFO:tasks.workunit.client.0.smithi134.stdout:6/228: dwrite d2/d3f/d28/f25 [0,4194304] 0 2024-03-22T07:28:32.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/240: mknod d1/d8/c56 0 2024-03-22T07:28:32.676 INFO:tasks.workunit.client.1.smithi195.stdout:2/420: symlink d2/d1e/l87 0 2024-03-22T07:28:32.676 INFO:tasks.workunit.client.1.smithi195.stdout:2/421: stat d2/d3/d21/d60/f85 0 2024-03-22T07:28:32.676 INFO:tasks.workunit.client.1.smithi195.stdout:2/422: read - d2/d17/f7b zero size 2024-03-22T07:28:32.691 INFO:tasks.workunit.client.0.smithi134.stdout:9/211: link d3/f8 d3/d9/df/d12/f4c 0 2024-03-22T07:28:32.694 INFO:tasks.workunit.client.1.smithi195.stdout:7/383: mkdir d0/d13/d22/d57/d7b 0 2024-03-22T07:28:32.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/433: mkdir d1/de/d8d 0 2024-03-22T07:28:32.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/434: write d1/de/d11/f13 [1947273,20777] 0 2024-03-22T07:28:32.697 INFO:tasks.workunit.client.1.smithi195.stdout:2/423: stat d2/d3/d7/d19/d22/d26/d3c/l61 0 2024-03-22T07:28:32.698 INFO:tasks.workunit.client.0.smithi134.stdout:0/265: symlink dc/l53 0 2024-03-22T07:28:32.698 INFO:tasks.workunit.client.0.smithi134.stdout:0/266: chown dc/d17/l42 804882 1 2024-03-22T07:28:32.698 INFO:tasks.workunit.client.0.smithi134.stdout:0/267: chown dc/d17/f48 12292753 1 2024-03-22T07:28:32.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/435: dread d1/d19/d32/f4d [0,4194304] 0 2024-03-22T07:28:32.702 INFO:tasks.workunit.client.0.smithi134.stdout:7/436: chown d1/de/c60 0 1 2024-03-22T07:28:32.702 INFO:tasks.workunit.client.0.smithi134.stdout:7/437: creat d1/de/d11/d2b/d31/f8e x:0 0 0 2024-03-22T07:28:32.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/200: rename d2/d5/d8/c19 to d2/d5/d22/c36 0 2024-03-22T07:28:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:32 smithi195 ceph-mon[36144]: pgmap v253: 65 pgs: 65 active+clean; 843 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 68 MiB/s rd, 96 MiB/s wr, 664 op/s 2024-03-22T07:28:32.708 INFO:tasks.workunit.client.1.smithi195.stdout:2/424: link d2/f4d d2/d3/db/f88 0 2024-03-22T07:28:32.711 INFO:tasks.workunit.client.0.smithi134.stdout:4/316: dwrite d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:32.712 INFO:tasks.workunit.client.0.smithi134.stdout:6/229: unlink d2/d1b/c41 0 2024-03-22T07:28:32.712 INFO:tasks.workunit.client.0.smithi134.stdout:6/230: fdatasync d2/d1b/d1d/d2b/f3a 0 2024-03-22T07:28:32.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/268: rename dc/c1c to dc/de/c54 0 2024-03-22T07:28:32.714 INFO:tasks.workunit.client.0.smithi134.stdout:0/269: chown dc/f4e 11 1 2024-03-22T07:28:32.715 INFO:tasks.workunit.client.0.smithi134.stdout:2/201: truncate d2/d5/d8/f1b 125355 0 2024-03-22T07:28:32.715 INFO:tasks.workunit.client.0.smithi134.stdout:2/202: dread d2/d5/d22/f25 [0,4194304] 0 2024-03-22T07:28:32.716 INFO:tasks.workunit.client.0.smithi134.stdout:6/231: mknod d2/d1b/d4d/c56 0 2024-03-22T07:28:32.718 INFO:tasks.workunit.client.0.smithi134.stdout:2/203: link d2/d5/c32 d2/c37 0 2024-03-22T07:28:32.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/204: readlink d2/d5/l20 0 2024-03-22T07:28:32.719 INFO:tasks.workunit.client.0.smithi134.stdout:6/232: mknod d2/d3f/d28/c57 0 2024-03-22T07:28:32.719 INFO:tasks.workunit.client.0.smithi134.stdout:6/233: write d2/f17 [2667077,38287] 0 2024-03-22T07:28:32.719 INFO:tasks.workunit.client.0.smithi134.stdout:6/234: chown d2/c47 389846 1 2024-03-22T07:28:32.720 INFO:tasks.workunit.client.0.smithi134.stdout:2/205: truncate d2/f1a 3266574 0 2024-03-22T07:28:32.720 INFO:tasks.workunit.client.1.smithi195.stdout:3/472: dwrite d3/df/d15/d1d/d5c/d47/f59 [0,4194304] 0 2024-03-22T07:28:32.721 INFO:tasks.workunit.client.0.smithi134.stdout:6/235: symlink d2/d3f/d28/l58 0 2024-03-22T07:28:32.722 INFO:tasks.workunit.client.0.smithi134.stdout:4/317: rmdir d2 39 2024-03-22T07:28:32.724 INFO:tasks.workunit.client.0.smithi134.stdout:2/206: write d2/f14 [5192983,54215] 0 2024-03-22T07:28:32.726 INFO:tasks.workunit.client.0.smithi134.stdout:0/270: write f4 [3521088,57333] 0 2024-03-22T07:28:32.726 INFO:tasks.workunit.client.0.smithi134.stdout:6/236: rename d2/d1b/d4d/c56 to d2/d3f/d28/c59 0 2024-03-22T07:28:32.727 INFO:tasks.workunit.client.0.smithi134.stdout:7/438: dwrite d1/de/d11/f6a [0,4194304] 0 2024-03-22T07:28:32.727 INFO:tasks.workunit.client.0.smithi134.stdout:8/333: dwrite d1/d15/d42/d12/d20/d41/f45 [0,4194304] 0 2024-03-22T07:28:32.728 INFO:tasks.workunit.client.0.smithi134.stdout:5/241: dwrite d1/d13/f18 [0,4194304] 0 2024-03-22T07:28:32.728 INFO:tasks.workunit.client.1.smithi195.stdout:1/343: dwrite d0/d2/d6/f42 [0,4194304] 0 2024-03-22T07:28:32.728 INFO:tasks.workunit.client.1.smithi195.stdout:1/344: creat d0/d2/d6/f71 x:0 0 0 2024-03-22T07:28:32.729 INFO:tasks.workunit.client.0.smithi134.stdout:9/212: dwrite d3/d9/d37/d3c/f46 [0,4194304] 0 2024-03-22T07:28:32.729 INFO:tasks.workunit.client.0.smithi134.stdout:9/213: creat d3/d9/df/d12/d3b/f4d x:0 0 0 2024-03-22T07:28:32.729 INFO:tasks.workunit.client.1.smithi195.stdout:7/384: dwrite d0/f71 [4194304,4194304] 0 2024-03-22T07:28:32.729 INFO:tasks.workunit.client.1.smithi195.stdout:3/473: mknod d3/df/d15/d1d/d5c/d47/d67/d93/ca3 0 2024-03-22T07:28:32.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/242: read d1/d8/d20/f3b [662372,27006] 0 2024-03-22T07:28:32.730 INFO:tasks.workunit.client.0.smithi134.stdout:5/243: chown d1/d8/d3f/f41 768888 1 2024-03-22T07:28:32.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/318: creat d2/d15/d35/d37/d43/f69 x:0 0 0 2024-03-22T07:28:32.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/319: write d2/f5f [794491,71109] 0 2024-03-22T07:28:32.731 INFO:tasks.workunit.client.0.smithi134.stdout:2/207: stat d2/l35 0 2024-03-22T07:28:32.738 INFO:tasks.workunit.client.0.smithi134.stdout:0/271: write dc/d18/f1d [8098275,5849] 0 2024-03-22T07:28:32.741 INFO:tasks.workunit.client.0.smithi134.stdout:7/439: mkdir d1/de/d41/d87/d8f 0 2024-03-22T07:28:32.745 INFO:tasks.workunit.client.1.smithi195.stdout:3/474: mknod d3/df/d15/d1d/d5c/d47/d67/d80/ca4 0 2024-03-22T07:28:32.747 INFO:tasks.workunit.client.1.smithi195.stdout:1/345: rename d0/d2/d9/c50 to d0/d2/d6/d21/c72 0 2024-03-22T07:28:32.748 INFO:tasks.workunit.client.0.smithi134.stdout:8/334: creat d1/d15/d42/d12/d20/f74 x:0 0 0 2024-03-22T07:28:32.748 INFO:tasks.workunit.client.1.smithi195.stdout:5/460: sync 2024-03-22T07:28:32.748 INFO:tasks.workunit.client.1.smithi195.stdout:4/462: sync 2024-03-22T07:28:32.749 INFO:tasks.workunit.client.1.smithi195.stdout:5/461: dread - d9/d12/f9e zero size 2024-03-22T07:28:32.749 INFO:tasks.workunit.client.1.smithi195.stdout:8/486: sync 2024-03-22T07:28:32.749 INFO:tasks.workunit.client.0.smithi134.stdout:5/244: dwrite d1/d8/d20/f54 [0,4194304] 0 2024-03-22T07:28:32.750 INFO:tasks.workunit.client.1.smithi195.stdout:7/385: dwrite d0/d13/d22/d28/f64 [0,4194304] 0 2024-03-22T07:28:32.750 INFO:tasks.workunit.client.1.smithi195.stdout:1/346: creat d0/d2/d9/d2a/d6f/f73 x:0 0 0 2024-03-22T07:28:32.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/462: mknod d9/d12/d1d/ca5 0 2024-03-22T07:28:32.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/463: read d9/d12/d14/f4b [106450,127117] 0 2024-03-22T07:28:32.753 INFO:tasks.workunit.client.0.smithi134.stdout:6/237: dwrite d2/d1b/d1d/f55 [0,4194304] 0 2024-03-22T07:28:32.753 INFO:tasks.workunit.client.1.smithi195.stdout:5/464: read f0 [643815,38996] 0 2024-03-22T07:28:32.753 INFO:tasks.workunit.client.1.smithi195.stdout:5/465: write d9/d12/f8c [875155,18654] 0 2024-03-22T07:28:32.753 INFO:tasks.workunit.client.1.smithi195.stdout:5/466: chown d9/d12/d1d/d69/d78/d41/c4f 778 1 2024-03-22T07:28:32.753 INFO:tasks.workunit.client.1.smithi195.stdout:5/467: chown d9/d73 4 1 2024-03-22T07:28:32.756 INFO:tasks.workunit.client.0.smithi134.stdout:9/214: mknod d3/c4e 0 2024-03-22T07:28:32.756 INFO:tasks.workunit.client.0.smithi134.stdout:9/215: creat d3/d9/d37/f4f x:0 0 0 2024-03-22T07:28:32.756 INFO:tasks.workunit.client.0.smithi134.stdout:9/216: creat d3/d9/df/d12/d3b/f50 x:0 0 0 2024-03-22T07:28:32.758 INFO:tasks.workunit.client.1.smithi195.stdout:7/386: truncate d0/ff 1101962 0 2024-03-22T07:28:32.759 INFO:tasks.workunit.client.1.smithi195.stdout:7/387: write d0/d13/d14/d29/d35/f60 [486484,41991] 0 2024-03-22T07:28:32.759 INFO:tasks.workunit.client.0.smithi134.stdout:4/320: creat d2/d25/f6a x:0 0 0 2024-03-22T07:28:32.760 INFO:tasks.workunit.client.1.smithi195.stdout:3/475: read d3/df/d15/d1d/d5c/d47/f4d [2503747,98181] 0 2024-03-22T07:28:32.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/440: dwrite d1/de/d11/f6a [0,4194304] 0 2024-03-22T07:28:32.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/441: write d1/de/d11/d2b/d31/f8a [932593,27320] 0 2024-03-22T07:28:32.761 INFO:tasks.workunit.client.1.smithi195.stdout:1/347: link d0/d2/d6/d21/l3c d0/d2/d6/d21/d41/d47/d4a/d66/l74 0 2024-03-22T07:28:32.766 INFO:tasks.workunit.client.0.smithi134.stdout:9/217: write d3/d9/df/d12/f2a [80762,2689] 0 2024-03-22T07:28:32.766 INFO:tasks.workunit.client.0.smithi134.stdout:9/218: write d3/d9/f10 [2637314,69166] 0 2024-03-22T07:28:32.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/487: write da/f4f [392644,114094] 0 2024-03-22T07:28:32.768 INFO:tasks.workunit.client.1.smithi195.stdout:8/488: write da/d17/d32/f58 [785709,28119] 0 2024-03-22T07:28:32.770 INFO:tasks.workunit.client.1.smithi195.stdout:7/388: creat d0/d13/d22/d52/d59/f7c x:0 0 0 2024-03-22T07:28:32.770 INFO:tasks.workunit.client.0.smithi134.stdout:8/335: mkdir d1/d46/d75 0 2024-03-22T07:28:32.772 INFO:tasks.workunit.client.1.smithi195.stdout:3/476: mkdir d3/df/d15/d1d/d5c/d86/da0/da5 0 2024-03-22T07:28:32.772 INFO:tasks.workunit.client.1.smithi195.stdout:3/477: fsync d3/df/d15/d1d/d5c/d47/d67/d80/f8f 0 2024-03-22T07:28:32.779 INFO:tasks.workunit.client.0.smithi134.stdout:9/219: dread d3/d9/df/d12/f2a [0,4194304] 0 2024-03-22T07:28:32.779 INFO:tasks.workunit.client.0.smithi134.stdout:5/245: truncate d1/d13/f53 3586733 0 2024-03-22T07:28:32.781 INFO:tasks.workunit.client.0.smithi134.stdout:7/442: dwrite d1/f3b [0,4194304] 0 2024-03-22T07:28:32.782 INFO:tasks.workunit.client.1.smithi195.stdout:5/468: rmdir d9/d2d/d58 39 2024-03-22T07:28:32.784 INFO:tasks.workunit.client.1.smithi195.stdout:8/489: getdents da/dc 0 2024-03-22T07:28:32.785 INFO:tasks.workunit.client.1.smithi195.stdout:7/389: symlink d0/d13/d14/d2f/l7d 0 2024-03-22T07:28:32.788 INFO:tasks.workunit.client.1.smithi195.stdout:9/577: sync 2024-03-22T07:28:32.788 INFO:tasks.workunit.client.1.smithi195.stdout:3/478: link d3/d18/d89/c3a d3/d18/d89/d76/ca6 0 2024-03-22T07:28:32.789 INFO:tasks.workunit.client.0.smithi134.stdout:5/246: write d1/d8/d16/f4d [2236750,20582] 0 2024-03-22T07:28:32.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/469: getdents d9/d22 0 2024-03-22T07:28:32.793 INFO:tasks.workunit.client.0.smithi134.stdout:4/321: link d2/d15/l2b d2/d15/d66/l6b 0 2024-03-22T07:28:32.793 INFO:tasks.workunit.client.0.smithi134.stdout:4/322: write d2/d15/d35/f5d [1028152,110332] 0 2024-03-22T07:28:32.793 INFO:tasks.workunit.client.0.smithi134.stdout:4/323: write d2/d2a/d50/f59 [9875,115682] 0 2024-03-22T07:28:32.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/490: mkdir da/d17/d32/d7d/d8e/d97 0 2024-03-22T07:28:32.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/491: chown da/d17/l4c 7 1 2024-03-22T07:28:32.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/492: read da/de/f2d [587403,27800] 0 2024-03-22T07:28:32.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/493: chown f9 189989 1 2024-03-22T07:28:32.794 INFO:tasks.workunit.client.1.smithi195.stdout:8/494: read f7 [2560408,27469] 0 2024-03-22T07:28:32.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:32 smithi134 ceph-mon[29057]: pgmap v253: 65 pgs: 65 active+clean; 843 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 68 MiB/s rd, 96 MiB/s wr, 664 op/s 2024-03-22T07:28:32.797 INFO:tasks.workunit.client.0.smithi134.stdout:8/336: dwrite d1/d15/f27 [0,4194304] 0 2024-03-22T07:28:32.797 INFO:tasks.workunit.client.0.smithi134.stdout:8/337: fdatasync d1/f50 0 2024-03-22T07:28:32.797 INFO:tasks.workunit.client.0.smithi134.stdout:8/338: write d1/d15/d42/d12/d20/f3c [985912,96751] 0 2024-03-22T07:28:32.797 INFO:tasks.workunit.client.0.smithi134.stdout:8/339: dread - d1/d15/d42/d44/f52 zero size 2024-03-22T07:28:32.797 INFO:tasks.workunit.client.1.smithi195.stdout:7/390: truncate d0/d13/d14/d2f/f43 2386854 0 2024-03-22T07:28:32.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/391: write d0/d13/f73 [783258,114044] 0 2024-03-22T07:28:32.798 INFO:tasks.workunit.client.1.smithi195.stdout:7/392: read d0/f2d [235965,23471] 0 2024-03-22T07:28:32.798 INFO:tasks.workunit.client.1.smithi195.stdout:1/348: dwrite d0/d2/d9/f61 [0,4194304] 0 2024-03-22T07:28:32.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/578: symlink d2/d4/d6/d18/ld8 0 2024-03-22T07:28:32.804 INFO:tasks.workunit.client.1.smithi195.stdout:3/479: symlink d3/df/d15/la7 0 2024-03-22T07:28:32.806 INFO:tasks.workunit.client.1.smithi195.stdout:8/495: symlink da/de/l98 0 2024-03-22T07:28:32.806 INFO:tasks.workunit.client.1.smithi195.stdout:8/496: truncate da/d82/f8c 1704342 0 2024-03-22T07:28:32.812 INFO:tasks.workunit.client.1.smithi195.stdout:1/349: unlink d0/d2/d27/f33 0 2024-03-22T07:28:32.812 INFO:tasks.workunit.client.1.smithi195.stdout:1/350: fsync d0/d2/d6/f4b 0 2024-03-22T07:28:32.814 INFO:tasks.workunit.client.1.smithi195.stdout:9/579: mknod d2/d4/d23/cd9 0 2024-03-22T07:28:32.814 INFO:tasks.workunit.client.1.smithi195.stdout:9/580: stat d2/d4/d6/db/f2c 0 2024-03-22T07:28:32.815 INFO:tasks.workunit.client.0.smithi134.stdout:2/208: mknod d2/d5/d8/c38 0 2024-03-22T07:28:32.815 INFO:tasks.workunit.client.0.smithi134.stdout:2/209: chown d2 1 1 2024-03-22T07:28:32.817 INFO:tasks.workunit.client.1.smithi195.stdout:3/480: rmdir d3/d22/d94 0 2024-03-22T07:28:32.820 INFO:tasks.workunit.client.0.smithi134.stdout:0/272: truncate f4 3305790 0 2024-03-22T07:28:32.822 INFO:tasks.workunit.client.0.smithi134.stdout:9/220: rename d3/d9/d37/f41 to d3/f51 0 2024-03-22T07:28:32.822 INFO:tasks.workunit.client.0.smithi134.stdout:9/221: chown d3/d9/df/d12/l4b 496 1 2024-03-22T07:28:32.822 INFO:tasks.workunit.client.1.smithi195.stdout:9/581: dread d2/d4/d6/db/f1f [0,4194304] 0 2024-03-22T07:28:32.825 INFO:tasks.workunit.client.1.smithi195.stdout:9/582: unlink d2/d4/d1d/f41 0 2024-03-22T07:28:32.827 INFO:tasks.workunit.client.0.smithi134.stdout:7/443: symlink d1/de/d11/d2b/d31/l90 0 2024-03-22T07:28:32.829 INFO:tasks.workunit.client.1.smithi195.stdout:5/470: dwrite d9/d2d/f65 [0,4194304] 0 2024-03-22T07:28:32.829 INFO:tasks.workunit.client.0.smithi134.stdout:0/273: read dc/d17/f41 [185176,58869] 0 2024-03-22T07:28:32.830 INFO:tasks.workunit.client.0.smithi134.stdout:6/238: link d2/l3b d2/d3f/d28/l5a 0 2024-03-22T07:28:32.830 INFO:tasks.workunit.client.0.smithi134.stdout:6/239: chown d2/d3f/c4e 1955043 1 2024-03-22T07:28:32.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/583: unlink d2/d4/d32/d6d/d78/la0 0 2024-03-22T07:28:32.833 INFO:tasks.workunit.client.0.smithi134.stdout:8/340: dwrite d1/d15/d42/d12/d20/f70 [4194304,4194304] 0 2024-03-22T07:28:32.833 INFO:tasks.workunit.client.0.smithi134.stdout:5/247: dwrite d1/d8/f1b [0,4194304] 0 2024-03-22T07:28:32.834 INFO:tasks.workunit.client.0.smithi134.stdout:2/210: symlink d2/d5/d8/d31/l39 0 2024-03-22T07:28:32.835 INFO:tasks.workunit.client.1.smithi195.stdout:9/584: chown d2/d4/d6/d18/d50/f59 111660 1 2024-03-22T07:28:32.835 INFO:tasks.workunit.client.1.smithi195.stdout:1/351: dwrite d0/d2/d6/f2f [4194304,4194304] 0 2024-03-22T07:28:32.836 INFO:tasks.workunit.client.1.smithi195.stdout:3/481: dwrite d3/df/d15/d1d/d5c/d47/d67/d80/f7d [0,4194304] 0 2024-03-22T07:28:32.837 INFO:tasks.workunit.client.0.smithi134.stdout:4/324: rename d2/d15/d35/d37/d43/l65 to d2/d2a/l6c 0 2024-03-22T07:28:32.838 INFO:tasks.workunit.client.0.smithi134.stdout:9/222: mknod d3/d9/df/c52 0 2024-03-22T07:28:32.839 INFO:tasks.workunit.client.0.smithi134.stdout:2/211: dread d2/d5/d22/f24 [0,4194304] 0 2024-03-22T07:28:32.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/585: symlink d2/d4/d6/d18/lda 0 2024-03-22T07:28:32.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/586: truncate d2/d4/f9f 1874873 0 2024-03-22T07:28:32.840 INFO:tasks.workunit.client.1.smithi195.stdout:9/587: chown d2/d4/d6/db/f1f 327711 1 2024-03-22T07:28:32.842 INFO:tasks.workunit.client.0.smithi134.stdout:7/444: link d1/d19/f23 d1/de/d11/d2b/d31/f91 0 2024-03-22T07:28:32.846 INFO:tasks.workunit.client.1.smithi195.stdout:7/393: write d0/d13/d14/d2f/f43 [2366441,118883] 0 2024-03-22T07:28:32.847 INFO:tasks.workunit.client.0.smithi134.stdout:0/274: mkdir dc/de/d55 0 2024-03-22T07:28:32.848 INFO:tasks.workunit.client.0.smithi134.stdout:6/240: readlink d2/l9 0 2024-03-22T07:28:32.849 INFO:tasks.workunit.client.0.smithi134.stdout:6/241: dread d2/f2e [0,4194304] 0 2024-03-22T07:28:32.856 INFO:tasks.workunit.client.0.smithi134.stdout:7/445: read d1/de/d11/d48/fc [880566,81915] 0 2024-03-22T07:28:32.856 INFO:tasks.workunit.client.0.smithi134.stdout:5/248: unlink d1/d8/d20/l2e 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.0.smithi134.stdout:8/341: mkdir d1/d15/d42/d76 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.0.smithi134.stdout:8/342: write d1/d15/d57/f68 [2121676,100594] 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.0.smithi134.stdout:8/343: creat d1/f77 x:0 0 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/471: dwrite d9/d7f/f81 [0,4194304] 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.1.smithi195.stdout:3/482: unlink d3/f35 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.1.smithi195.stdout:3/483: fsync d3/df/d15/d1d/d5c/d47/f4d 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.1.smithi195.stdout:9/588: write d2/d4/d6/db/d20/d4a/f51 [2373540,47322] 0 2024-03-22T07:28:32.857 INFO:tasks.workunit.client.1.smithi195.stdout:5/472: dread f3 [0,4194304] 0 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.1.smithi195.stdout:5/473: truncate d9/f28 4539817 0 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.1.smithi195.stdout:7/394: read d0/d13/d14/d2b/f42 [754931,109217] 0 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.1.smithi195.stdout:9/589: dread d2/d4/d32/f3a [0,4194304] 0 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.0.smithi134.stdout:0/275: dread dc/d18/f2f [4194304,4194304] 0 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.0.smithi134.stdout:5/249: dread d1/d8/d3f/f41 [0,4194304] 0 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.0.smithi134.stdout:0/276: chown dc/c36 711878005 1 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.0.smithi134.stdout:0/277: chown dc/l11 2710 1 2024-03-22T07:28:32.858 INFO:tasks.workunit.client.0.smithi134.stdout:5/250: creat d1/f57 x:0 0 0 2024-03-22T07:28:32.859 INFO:tasks.workunit.client.0.smithi134.stdout:4/325: truncate d2/d15/f13 2411697 0 2024-03-22T07:28:32.859 INFO:tasks.workunit.client.0.smithi134.stdout:4/326: readlink d2/d15/l29 0 2024-03-22T07:28:32.860 INFO:tasks.workunit.client.1.smithi195.stdout:1/352: dwrite d0/d2/d9/f6c [0,4194304] 0 2024-03-22T07:28:32.862 INFO:tasks.workunit.client.0.smithi134.stdout:9/223: symlink d3/d9/df/d12/l53 0 2024-03-22T07:28:32.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/484: rmdir d3/d18/d89/d76 39 2024-03-22T07:28:32.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/395: write d0/d13/d22/d52/f5e [45375,26957] 0 2024-03-22T07:28:32.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/396: write d0/fc [623008,109143] 0 2024-03-22T07:28:32.865 INFO:tasks.workunit.client.1.smithi195.stdout:7/397: dread - d0/d13/d14/f4a zero size 2024-03-22T07:28:32.865 INFO:tasks.workunit.client.0.smithi134.stdout:2/212: unlink d2/fe 0 2024-03-22T07:28:32.865 INFO:tasks.workunit.client.0.smithi134.stdout:8/344: dread d1/d15/d42/d12/d20/d41/f45 [0,4194304] 0 2024-03-22T07:28:32.867 INFO:tasks.workunit.client.1.smithi195.stdout:5/474: link d9/d12/d1d/d69/d78/f7e d9/d12/d1d/d36/fa6 0 2024-03-22T07:28:32.868 INFO:tasks.workunit.client.0.smithi134.stdout:0/278: dread dc/de/f4f [0,4194304] 0 2024-03-22T07:28:32.868 INFO:tasks.workunit.client.0.smithi134.stdout:0/279: readlink dc/d18/l4c 0 2024-03-22T07:28:32.868 INFO:tasks.workunit.client.0.smithi134.stdout:0/280: truncate dc/d18/f2e 117947 0 2024-03-22T07:28:32.871 INFO:tasks.workunit.client.0.smithi134.stdout:6/242: rename d2/d3f/d28/f25 to d2/d1b/d1d/d2b/d4f/f5b 0 2024-03-22T07:28:32.872 INFO:tasks.workunit.client.1.smithi195.stdout:7/398: write d0/d13/d22/d52/d59/f5f [2138766,30692] 0 2024-03-22T07:28:32.872 INFO:tasks.workunit.client.1.smithi195.stdout:9/590: mkdir d2/dad/ddb 0 2024-03-22T07:28:32.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/446: truncate d1/de/d11/d48/d52/d46/f61 2499783 0 2024-03-22T07:28:32.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/447: chown d1/de/c7e 2214 1 2024-03-22T07:28:32.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/448: write d1/de/ff [2616866,115428] 0 2024-03-22T07:28:32.873 INFO:tasks.workunit.client.0.smithi134.stdout:7/449: write f0 [5041907,36633] 0 2024-03-22T07:28:32.877 INFO:tasks.workunit.client.0.smithi134.stdout:3/228: sync 2024-03-22T07:28:32.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/294: sync 2024-03-22T07:28:32.878 INFO:tasks.workunit.client.0.smithi134.stdout:4/327: mknod d2/d25/c6d 0 2024-03-22T07:28:32.879 INFO:tasks.workunit.client.1.smithi195.stdout:9/591: write d2/d4/d23/f69 [2708386,36277] 0 2024-03-22T07:28:32.879 INFO:tasks.workunit.client.1.smithi195.stdout:9/592: dread - d2/d4/d32/fab zero size 2024-03-22T07:28:32.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/593: dread d2/d4/d6/db/d20/fc0 [0,4194304] 0 2024-03-22T07:28:32.880 INFO:tasks.workunit.client.1.smithi195.stdout:9/594: chown d2/d4/d6/db/l85 202326 1 2024-03-22T07:28:32.881 INFO:tasks.workunit.client.0.smithi134.stdout:1/295: dread d5/da/d13/d1e/d34/f3e [0,4194304] 0 2024-03-22T07:28:32.881 INFO:tasks.workunit.client.0.smithi134.stdout:1/296: dread - d5/d1d/d49/f5c zero size 2024-03-22T07:28:32.881 INFO:tasks.workunit.client.0.smithi134.stdout:9/224: truncate d3/d9/d37/f47 393768 0 2024-03-22T07:28:32.883 INFO:tasks.workunit.client.1.smithi195.stdout:9/595: dread d2/d4/f3b [0,4194304] 0 2024-03-22T07:28:32.883 INFO:tasks.workunit.client.1.smithi195.stdout:3/485: symlink d3/df/d15/d1d/d5c/d47/d67/d93/la8 0 2024-03-22T07:28:32.884 INFO:tasks.workunit.client.0.smithi134.stdout:5/251: dwrite d1/d8/f1b [4194304,4194304] 0 2024-03-22T07:28:32.884 INFO:tasks.workunit.client.0.smithi134.stdout:2/213: dwrite d2/f30 [0,4194304] 0 2024-03-22T07:28:32.885 INFO:tasks.workunit.client.0.smithi134.stdout:2/214: creat d2/f3a x:0 0 0 2024-03-22T07:28:32.889 INFO:tasks.workunit.client.0.smithi134.stdout:0/281: unlink l6 0 2024-03-22T07:28:32.889 INFO:tasks.workunit.client.0.smithi134.stdout:0/282: dread - dc/f4e zero size 2024-03-22T07:28:32.900 INFO:tasks.workunit.client.0.smithi134.stdout:1/297: dwrite d5/d1d/d49/f5c [0,4194304] 0 2024-03-22T07:28:32.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/225: unlink d3/d9/df/d12/d3b/c44 0 2024-03-22T07:28:32.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/226: readlink d3/d9/d37/l38 0 2024-03-22T07:28:32.906 INFO:tasks.workunit.client.1.smithi195.stdout:7/399: mkdir d0/d13/d14/d29/d35/d3a/d7e 0 2024-03-22T07:28:32.909 INFO:tasks.workunit.client.0.smithi134.stdout:2/215: link d2/d5/d8/f2f d2/f3b 0 2024-03-22T07:28:32.910 INFO:tasks.workunit.client.0.smithi134.stdout:8/345: rmdir d1/d15/d57 39 2024-03-22T07:28:32.914 INFO:tasks.workunit.client.0.smithi134.stdout:0/283: truncate dc/f3c 415130 0 2024-03-22T07:28:32.917 INFO:tasks.workunit.client.0.smithi134.stdout:6/243: link d2/d1b/c52 d2/d1b/d1d/d2b/c5c 0 2024-03-22T07:28:32.919 INFO:tasks.workunit.client.0.smithi134.stdout:6/244: dread d2/d1b/d1d/d2b/f3a [0,4194304] 0 2024-03-22T07:28:32.919 INFO:tasks.workunit.client.0.smithi134.stdout:6/245: truncate d2/d3f/f32 5105839 0 2024-03-22T07:28:32.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/229: dwrite d4/f48 [0,4194304] 0 2024-03-22T07:28:32.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/230: dread - d4/d10/d4b/f4c zero size 2024-03-22T07:28:32.922 INFO:tasks.workunit.client.0.smithi134.stdout:2/216: dread d2/d5/fc [0,4194304] 0 2024-03-22T07:28:32.923 INFO:tasks.workunit.client.0.smithi134.stdout:5/252: dwrite d1/f57 [0,4194304] 0 2024-03-22T07:28:32.923 INFO:tasks.workunit.client.1.smithi195.stdout:3/486: dwrite d3/d18/f26 [4194304,4194304] 0 2024-03-22T07:28:32.924 INFO:tasks.workunit.client.1.smithi195.stdout:9/596: mkdir d2/d4/d1d/ddc 0 2024-03-22T07:28:32.924 INFO:tasks.workunit.client.1.smithi195.stdout:9/597: stat d2/d4/d6/d18/c2f 0 2024-03-22T07:28:32.924 INFO:tasks.workunit.client.1.smithi195.stdout:9/598: write d2/d4/d32/d6d/f89 [4624217,33934] 0 2024-03-22T07:28:32.924 INFO:tasks.workunit.client.1.smithi195.stdout:9/599: write d2/d4/d6/f49 [280357,75661] 0 2024-03-22T07:28:32.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/475: getdents d9/d12/d14 0 2024-03-22T07:28:32.926 INFO:tasks.workunit.client.1.smithi195.stdout:5/476: readlink d9/d12/d1d/d36/d7d/la4 0 2024-03-22T07:28:32.928 INFO:tasks.workunit.client.0.smithi134.stdout:1/298: mknod d5/d1d/d49/c65 0 2024-03-22T07:28:32.928 INFO:tasks.workunit.client.0.smithi134.stdout:1/299: fsync f4 0 2024-03-22T07:28:32.928 INFO:tasks.workunit.client.0.smithi134.stdout:1/300: stat d5/da/d13/d1e/d45/d53 0 2024-03-22T07:28:32.930 INFO:tasks.workunit.client.0.smithi134.stdout:9/227: mkdir d3/d9/df/d12/d1b/d54 0 2024-03-22T07:28:32.930 INFO:tasks.workunit.client.0.smithi134.stdout:7/450: write d1/de/d11/d48/d52/d46/f61 [805880,35547] 0 2024-03-22T07:28:32.932 INFO:tasks.workunit.client.1.smithi195.stdout:1/353: rmdir d0/d2/d27/d63 0 2024-03-22T07:28:32.933 INFO:tasks.workunit.client.0.smithi134.stdout:0/284: truncate dc/d18/f2f 1122115 0 2024-03-22T07:28:32.933 INFO:tasks.workunit.client.0.smithi134.stdout:7/451: dread d1/de/f5a [0,4194304] 0 2024-03-22T07:28:32.933 INFO:tasks.workunit.client.0.smithi134.stdout:7/452: stat d1/d40 0 2024-03-22T07:28:32.933 INFO:tasks.workunit.client.0.smithi134.stdout:0/285: write dc/d18/f45 [511677,54178] 0 2024-03-22T07:28:32.936 INFO:tasks.workunit.client.0.smithi134.stdout:4/328: rename d2/d15/d35/d37/d43 to d2/d25/d48/d6e 0 2024-03-22T07:28:32.943 INFO:tasks.workunit.client.1.smithi195.stdout:9/600: rename d2/d4/d6/d18/c2f to d2/d4/d6/db/d20/cdd 0 2024-03-22T07:28:32.945 INFO:tasks.workunit.client.1.smithi195.stdout:7/400: symlink d0/d13/d14/l7f 0 2024-03-22T07:28:32.948 INFO:tasks.workunit.client.1.smithi195.stdout:1/354: symlink d0/d2/d6/l75 0 2024-03-22T07:28:32.950 INFO:tasks.workunit.client.1.smithi195.stdout:9/601: mknod d2/d4/d23/cde 0 2024-03-22T07:28:32.953 INFO:tasks.workunit.client.0.smithi134.stdout:3/231: mknod d4/d10/d4b/c4d 0 2024-03-22T07:28:32.955 INFO:tasks.workunit.client.1.smithi195.stdout:1/355: link d0/l1c d0/d2/d6/d21/d41/d47/d4a/l76 0 2024-03-22T07:28:32.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/602: creat d2/d4/d6/d18/d50/d88/fdf x:0 0 0 2024-03-22T07:28:32.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/603: read d2/d4/d32/f3a [4160523,47982] 0 2024-03-22T07:28:32.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/604: chown d2/d4/d1d/fb3 555613427 1 2024-03-22T07:28:32.958 INFO:tasks.workunit.client.1.smithi195.stdout:9/605: chown d2/d4/d1d/l75 97446 1 2024-03-22T07:28:32.959 INFO:tasks.workunit.client.1.smithi195.stdout:7/401: mkdir d0/d13/d14/d80 0 2024-03-22T07:28:32.959 INFO:tasks.workunit.client.1.smithi195.stdout:7/402: write d0/d13/f1c [414317,97728] 0 2024-03-22T07:28:32.960 INFO:tasks.workunit.client.0.smithi134.stdout:7/453: dwrite d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:32.960 INFO:tasks.workunit.client.0.smithi134.stdout:1/301: dwrite d5/d1d/d49/f5c [0,4194304] 0 2024-03-22T07:28:32.960 INFO:tasks.workunit.client.1.smithi195.stdout:5/477: dwrite d9/d12/d1d/d36/f49 [0,4194304] 0 2024-03-22T07:28:32.961 INFO:tasks.workunit.client.0.smithi134.stdout:2/217: truncate d2/f1a 1107017 0 2024-03-22T07:28:32.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/356: creat d0/d70/f77 x:0 0 0 2024-03-22T07:28:32.962 INFO:tasks.workunit.client.1.smithi195.stdout:1/357: truncate d0/d2/d6/f62 599591 0 2024-03-22T07:28:32.964 INFO:tasks.workunit.client.1.smithi195.stdout:9/606: creat d2/d4/d6/d18/d50/fe0 x:0 0 0 2024-03-22T07:28:32.964 INFO:tasks.workunit.client.1.smithi195.stdout:9/607: dread - d2/d4/d1d/fce zero size 2024-03-22T07:28:32.964 INFO:tasks.workunit.client.1.smithi195.stdout:9/608: dread - d2/d4/d1d/d9b/fd2 zero size 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:0/458: sync 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:6/426: sync 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/425: sync 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:8/497: sync 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:4/463: sync 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/426: fdatasync d2/d3/d21/d4c/f52 0 2024-03-22T07:28:32.965 INFO:tasks.workunit.client.1.smithi195.stdout:2/427: read - d2/d17/f7b zero size 2024-03-22T07:28:32.966 INFO:tasks.workunit.client.1.smithi195.stdout:8/498: write da/dc/d71/f80 [5101812,12249] 0 2024-03-22T07:28:32.966 INFO:tasks.workunit.client.1.smithi195.stdout:4/464: write d13/d2a/f70 [1738741,44370] 0 2024-03-22T07:28:32.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/403: creat d0/d13/d14/d5b/f81 x:0 0 0 2024-03-22T07:28:32.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/404: fsync d0/d13/d22/f65 0 2024-03-22T07:28:32.970 INFO:tasks.workunit.client.1.smithi195.stdout:5/478: mknod d9/d12/d14/ca7 0 2024-03-22T07:28:32.971 INFO:tasks.workunit.client.1.smithi195.stdout:5/479: read f0 [646915,128610] 0 2024-03-22T07:28:32.971 INFO:tasks.workunit.client.0.smithi134.stdout:5/253: rename d1/l9 to d1/l58 0 2024-03-22T07:28:32.972 INFO:tasks.workunit.client.0.smithi134.stdout:5/254: write d1/d4/f2b [1307166,77854] 0 2024-03-22T07:28:32.974 INFO:tasks.workunit.client.1.smithi195.stdout:9/609: write d2/d4/d6/d18/d50/f91 [5199,6707] 0 2024-03-22T07:28:32.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/427: symlink d5/d5e/d34/d55/d3b/d6e/d3c/l9e 0 2024-03-22T07:28:32.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/428: chown d5/d16/d45/d53/d59/c96 6351547 1 2024-03-22T07:28:32.976 INFO:tasks.workunit.client.1.smithi195.stdout:6/429: readlink d5/l46 0 2024-03-22T07:28:32.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/428: rename d2/d3/d21/d60/c7d to d2/d3/db/d82/c89 0 2024-03-22T07:28:32.979 INFO:tasks.workunit.client.1.smithi195.stdout:2/429: fdatasync d2/d3/d7/d19/d22/d26/f6f 0 2024-03-22T07:28:32.980 INFO:tasks.workunit.client.0.smithi134.stdout:0/286: truncate dc/f1f 892320 0 2024-03-22T07:28:32.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/287: chown dc/de/c4a 757363 1 2024-03-22T07:28:32.981 INFO:tasks.workunit.client.0.smithi134.stdout:0/288: dread - dc/f3e zero size 2024-03-22T07:28:32.983 INFO:tasks.workunit.client.1.smithi195.stdout:7/405: mkdir d0/d13/d14/d20/d40/d82 0 2024-03-22T07:28:32.984 INFO:tasks.workunit.client.1.smithi195.stdout:0/459: dread d1/d4/d12/f27 [0,4194304] 0 2024-03-22T07:28:32.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/246: mknod d2/c5d 0 2024-03-22T07:28:32.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/247: write d2/d1b/f2f [914976,114469] 0 2024-03-22T07:28:32.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/430: dread d5/d5e/d34/d55/d3b/d6e/fd [4194304,4194304] 0 2024-03-22T07:28:32.987 INFO:tasks.workunit.client.0.smithi134.stdout:4/329: mkdir d2/d15/d6f 0 2024-03-22T07:28:32.988 INFO:tasks.workunit.client.1.smithi195.stdout:2/430: dread d2/d3/d7/d19/f28 [0,4194304] 0 2024-03-22T07:28:32.990 INFO:tasks.workunit.client.1.smithi195.stdout:1/358: dwrite d0/d2/f1b [0,4194304] 0 2024-03-22T07:28:32.991 INFO:tasks.workunit.client.0.smithi134.stdout:2/218: dwrite d2/f28 [0,4194304] 0 2024-03-22T07:28:32.991 INFO:tasks.workunit.client.0.smithi134.stdout:7/454: link d1/d19/f23 d1/d19/d32/f92 0 2024-03-22T07:28:32.994 INFO:tasks.workunit.client.0.smithi134.stdout:0/289: read f5 [348685,56298] 0 2024-03-22T07:28:32.994 INFO:tasks.workunit.client.1.smithi195.stdout:4/465: dwrite f12 [0,4194304] 0 2024-03-22T07:28:32.995 INFO:tasks.workunit.client.0.smithi134.stdout:1/302: rmdir d5/da/d13/d1e/d45 39 2024-03-22T07:28:32.998 INFO:tasks.workunit.client.0.smithi134.stdout:5/255: rename d1/d4/f10 to d1/d8/d16/f59 0 2024-03-22T07:28:33.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/406: rename d0/d13/d22/d28/l4c to d0/d13/d14/d2f/l83 0 2024-03-22T07:28:33.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/407: readlink d0/d13/d14/l6c 0 2024-03-22T07:28:33.001 INFO:tasks.workunit.client.0.smithi134.stdout:9/228: getdents d3/d9/df 0 2024-03-22T07:28:33.003 INFO:tasks.workunit.client.0.smithi134.stdout:7/455: dread d1/de/d11/d48/f65 [0,4194304] 0 2024-03-22T07:28:33.003 INFO:tasks.workunit.client.1.smithi195.stdout:0/460: mkdir d1/d4/d83 0 2024-03-22T07:28:33.004 INFO:tasks.workunit.client.0.smithi134.stdout:0/290: read dc/d18/f44 [2305319,41439] 0 2024-03-22T07:28:33.004 INFO:tasks.workunit.client.0.smithi134.stdout:0/291: write dc/d18/f26 [4194038,47464] 0 2024-03-22T07:28:33.005 INFO:tasks.workunit.client.1.smithi195.stdout:0/461: dread d1/d4/d22/f6d [0,4194304] 0 2024-03-22T07:28:33.007 INFO:tasks.workunit.client.0.smithi134.stdout:4/330: dwrite d2/d1d/f24 [0,4194304] 0 2024-03-22T07:28:33.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/431: unlink d5/d5e/f31 0 2024-03-22T07:28:33.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/432: creat d5/d16/d45/d53/d59/d87/f9f x:0 0 0 2024-03-22T07:28:33.009 INFO:tasks.workunit.client.1.smithi195.stdout:6/433: creat d5/d5e/d34/d55/d3b/d6e/d3c/fa0 x:0 0 0 2024-03-22T07:28:33.010 INFO:tasks.workunit.client.0.smithi134.stdout:3/232: getdents d4/d8 0 2024-03-22T07:28:33.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/431: unlink d2/d3/d21/f6d 0 2024-03-22T07:28:33.016 INFO:tasks.workunit.client.0.smithi134.stdout:2/219: mkdir d2/d5/d8/d2c/d3c 0 2024-03-22T07:28:33.016 INFO:tasks.workunit.client.0.smithi134.stdout:2/220: truncate d2/d5/d22/f25 370234 0 2024-03-22T07:28:33.019 INFO:tasks.workunit.client.1.smithi195.stdout:4/466: mknod d13/d63/d36/d9e/ca4 0 2024-03-22T07:28:33.019 INFO:tasks.workunit.client.1.smithi195.stdout:4/467: write d13/f3a [1422814,15580] 0 2024-03-22T07:28:33.019 INFO:tasks.workunit.client.1.smithi195.stdout:4/468: write d13/d63/d79/f48 [1535515,3513] 0 2024-03-22T07:28:33.021 INFO:tasks.workunit.client.0.smithi134.stdout:1/303: rmdir d5/da/d13/d1e/d45/d53 0 2024-03-22T07:28:33.022 INFO:tasks.workunit.client.0.smithi134.stdout:1/304: write d5/da/d13/d1e/d34/f5f [642389,18086] 0 2024-03-22T07:28:33.022 INFO:tasks.workunit.client.1.smithi195.stdout:7/408: creat d0/d13/d22/d57/f84 x:0 0 0 2024-03-22T07:28:33.024 INFO:tasks.workunit.client.1.smithi195.stdout:0/462: write d1/d10/d1f/f2f [1030708,37354] 0 2024-03-22T07:28:33.025 INFO:tasks.workunit.client.1.smithi195.stdout:0/463: readlink d1/l2 0 2024-03-22T07:28:33.025 INFO:tasks.workunit.client.1.smithi195.stdout:0/464: chown d1/d4/c7f 12740467 1 2024-03-22T07:28:33.029 INFO:tasks.workunit.client.1.smithi195.stdout:6/434: mknod d5/d5e/d34/d55/d3b/d6e/d97/ca1 0 2024-03-22T07:28:33.031 INFO:tasks.workunit.client.1.smithi195.stdout:2/432: creat d2/d3/db/d82/f8a x:0 0 0 2024-03-22T07:28:33.033 INFO:tasks.workunit.client.1.smithi195.stdout:4/469: symlink d13/la5 0 2024-03-22T07:28:33.036 INFO:tasks.workunit.client.1.smithi195.stdout:1/359: rename d0/d2/d6/c3d to d0/d2/d6/d21/c78 0 2024-03-22T07:28:33.036 INFO:tasks.workunit.client.1.smithi195.stdout:1/360: creat d0/d2/d9/d52/f79 x:0 0 0 2024-03-22T07:28:33.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/256: dwrite d1/d13/f1c [0,4194304] 0 2024-03-22T07:28:33.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/257: fdatasync d1/d13/f43 0 2024-03-22T07:28:33.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/258: creat d1/d8/d16/f5a x:0 0 0 2024-03-22T07:28:33.040 INFO:tasks.workunit.client.1.smithi195.stdout:0/465: rmdir d1/d10/d1f/d40 39 2024-03-22T07:28:33.041 INFO:tasks.workunit.client.0.smithi134.stdout:0/292: creat dc/de/d55/f56 x:0 0 0 2024-03-22T07:28:33.042 INFO:tasks.workunit.client.0.smithi134.stdout:5/259: dread d1/d8/f21 [0,4194304] 0 2024-03-22T07:28:33.042 INFO:tasks.workunit.client.0.smithi134.stdout:5/260: chown d1/d8/d16/f4d 330 1 2024-03-22T07:28:33.043 INFO:tasks.workunit.client.0.smithi134.stdout:5/261: read d1/d8/d20/f3e [22575,56561] 0 2024-03-22T07:28:33.043 INFO:tasks.workunit.client.0.smithi134.stdout:9/229: dwrite d3/d9/f36 [0,4194304] 0 2024-03-22T07:28:33.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/230: chown d3/c15 3203 1 2024-03-22T07:28:33.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/231: creat d3/f55 x:0 0 0 2024-03-22T07:28:33.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/232: chown d3/d9/df/d12/d1b/f29 1 1 2024-03-22T07:28:33.044 INFO:tasks.workunit.client.0.smithi134.stdout:7/456: dwrite d1/de/f5a [0,4194304] 0 2024-03-22T07:28:33.044 INFO:tasks.workunit.client.0.smithi134.stdout:3/233: dwrite d4/f2b [0,4194304] 0 2024-03-22T07:28:33.045 INFO:tasks.workunit.client.1.smithi195.stdout:2/433: chown d2/d3/db/c15 2475 1 2024-03-22T07:28:33.046 INFO:tasks.workunit.client.1.smithi195.stdout:0/466: dread d1/d10/d1f/f2c [0,4194304] 0 2024-03-22T07:28:33.048 INFO:tasks.workunit.client.1.smithi195.stdout:4/470: mkdir d13/d15/d6b/da6 0 2024-03-22T07:28:33.049 INFO:tasks.workunit.client.0.smithi134.stdout:4/331: symlink d2/d25/d48/l70 0 2024-03-22T07:28:33.049 INFO:tasks.workunit.client.0.smithi134.stdout:4/332: fdatasync d2/f5f 0 2024-03-22T07:28:33.051 INFO:tasks.workunit.client.0.smithi134.stdout:2/221: chown d2/d5/d8/l17 10890225 1 2024-03-22T07:28:33.053 INFO:tasks.workunit.client.0.smithi134.stdout:1/305: creat d5/da/d1b/d27/d60/f66 x:0 0 0 2024-03-22T07:28:33.055 INFO:tasks.workunit.client.1.smithi195.stdout:7/409: getdents d0/d13/d14/d29/d35 0 2024-03-22T07:28:33.055 INFO:tasks.workunit.client.1.smithi195.stdout:7/410: truncate d0/d13/d22/d52/d59/f7c 479996 0 2024-03-22T07:28:33.056 INFO:tasks.workunit.client.0.smithi134.stdout:7/457: dread d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:33.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/467: write d1/d4/f7 [3554013,37247] 0 2024-03-22T07:28:33.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/468: write d1/d4/dd/d66/f78 [805975,112787] 0 2024-03-22T07:28:33.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/469: creat d1/d10/d1f/d40/d47/f84 x:0 0 0 2024-03-22T07:28:33.062 INFO:tasks.workunit.client.0.smithi134.stdout:0/293: truncate f0 3150133 0 2024-03-22T07:28:33.062 INFO:tasks.workunit.client.0.smithi134.stdout:0/294: readlink dc/l51 0 2024-03-22T07:28:33.064 INFO:tasks.workunit.client.0.smithi134.stdout:5/262: mkdir d1/d13/d5b 0 2024-03-22T07:28:33.064 INFO:tasks.workunit.client.0.smithi134.stdout:5/263: dread - d1/d8/d16/f5a zero size 2024-03-22T07:28:33.064 INFO:tasks.workunit.client.0.smithi134.stdout:9/233: dwrite d3/f55 [0,4194304] 0 2024-03-22T07:28:33.071 INFO:tasks.workunit.client.1.smithi195.stdout:4/471: creat d13/d2a/d7e/d85/fa7 x:0 0 0 2024-03-22T07:28:33.072 INFO:tasks.workunit.client.0.smithi134.stdout:3/234: truncate d4/d10/f14 1453091 0 2024-03-22T07:28:33.072 INFO:tasks.workunit.client.0.smithi134.stdout:3/235: fdatasync d4/d22/f20 0 2024-03-22T07:28:33.074 INFO:tasks.workunit.client.0.smithi134.stdout:4/333: stat d2/d15/l29 0 2024-03-22T07:28:33.076 INFO:tasks.workunit.client.0.smithi134.stdout:2/222: mknod d2/d5/d8/d2c/d3c/c3d 0 2024-03-22T07:28:33.079 INFO:tasks.workunit.client.0.smithi134.stdout:1/306: mkdir d5/da/d13/d1e/d67 0 2024-03-22T07:28:33.081 INFO:tasks.workunit.client.1.smithi195.stdout:0/470: mkdir d1/d4/dd/df/d2b/d63/d85 0 2024-03-22T07:28:33.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/411: dwrite d0/d13/f46 [0,4194304] 0 2024-03-22T07:28:33.082 INFO:tasks.workunit.client.1.smithi195.stdout:7/412: fdatasync d0/ff 0 2024-03-22T07:28:33.082 INFO:tasks.workunit.client.0.smithi134.stdout:3/236: write d4/f2b [2327239,47151] 0 2024-03-22T07:28:33.086 INFO:tasks.workunit.client.0.smithi134.stdout:0/295: rename f4 to dc/f57 0 2024-03-22T07:28:33.088 INFO:tasks.workunit.client.0.smithi134.stdout:5/264: stat d1/d4/c37 0 2024-03-22T07:28:33.088 INFO:tasks.workunit.client.0.smithi134.stdout:5/265: creat d1/d8/d20/f5c x:0 0 0 2024-03-22T07:28:33.091 INFO:tasks.workunit.client.0.smithi134.stdout:4/334: link d2/d25/f3e d2/f71 0 2024-03-22T07:28:33.093 INFO:tasks.workunit.client.0.smithi134.stdout:9/234: dwrite d3/d9/df/d12/f1f [0,4194304] 0 2024-03-22T07:28:33.094 INFO:tasks.workunit.client.0.smithi134.stdout:0/296: dread dc/f29 [0,4194304] 0 2024-03-22T07:28:33.094 INFO:tasks.workunit.client.0.smithi134.stdout:1/307: mkdir d5/da/d68 0 2024-03-22T07:28:33.094 INFO:tasks.workunit.client.0.smithi134.stdout:1/308: creat d5/da/d1b/d27/d39/f69 x:0 0 0 2024-03-22T07:28:33.096 INFO:tasks.workunit.client.1.smithi195.stdout:2/434: rmdir d2/d3/d7/d19 39 2024-03-22T07:28:33.096 INFO:tasks.workunit.client.0.smithi134.stdout:2/223: dwrite d2/d5/d22/f24 [0,4194304] 0 2024-03-22T07:28:33.096 INFO:tasks.workunit.client.0.smithi134.stdout:2/224: read d2/d5/d22/f25 [84347,29402] 0 2024-03-22T07:28:33.096 INFO:tasks.workunit.client.0.smithi134.stdout:2/225: read - d2/d5/d8/f33 zero size 2024-03-22T07:28:33.097 INFO:tasks.workunit.client.0.smithi134.stdout:2/226: creat d2/f3e x:0 0 0 2024-03-22T07:28:33.097 INFO:tasks.workunit.client.1.smithi195.stdout:2/435: dread d2/d3/d7/da/f58 [0,4194304] 0 2024-03-22T07:28:33.099 INFO:tasks.workunit.client.0.smithi134.stdout:5/266: write d1/d13/f53 [1875014,68618] 0 2024-03-22T07:28:33.099 INFO:tasks.workunit.client.1.smithi195.stdout:4/472: unlink d13/d63/f33 0 2024-03-22T07:28:33.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/235: write d3/d9/f18 [1300254,54788] 0 2024-03-22T07:28:33.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/236: read - d3/d9/df/d12/d1b/f2e zero size 2024-03-22T07:28:33.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/237: chown d3/d9/d37/l38 394 1 2024-03-22T07:28:33.103 INFO:tasks.workunit.client.0.smithi134.stdout:9/238: chown d3/f55 63566 1 2024-03-22T07:28:33.104 INFO:tasks.workunit.client.0.smithi134.stdout:4/335: creat d2/d1d/f72 x:0 0 0 2024-03-22T07:28:33.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/297: write dc/de/f4f [2908279,19311] 0 2024-03-22T07:28:33.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/298: dread - dc/f4e zero size 2024-03-22T07:28:33.105 INFO:tasks.workunit.client.0.smithi134.stdout:0/299: stat dc/d17/f21 0 2024-03-22T07:28:33.105 INFO:tasks.workunit.client.0.smithi134.stdout:4/336: write d2/f46 [250856,96223] 0 2024-03-22T07:28:33.105 INFO:tasks.workunit.client.0.smithi134.stdout:4/337: fsync d2/d15/d35/d37/f55 0 2024-03-22T07:28:33.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/435: rename d5/d16/d45/d53/d17 to d5/d5e/d34/d55/d4b/da2 0 2024-03-22T07:28:33.108 INFO:tasks.workunit.client.1.smithi195.stdout:0/471: creat d1/d4/dd/df/d2b/d63/d85/f86 x:0 0 0 2024-03-22T07:28:33.108 INFO:tasks.workunit.client.0.smithi134.stdout:2/227: write d2/f14 [2205240,55114] 0 2024-03-22T07:28:33.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/237: dwrite d4/f48 [0,4194304] 0 2024-03-22T07:28:33.111 INFO:tasks.workunit.client.0.smithi134.stdout:0/300: dread dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:33.112 INFO:tasks.workunit.client.1.smithi195.stdout:7/413: creat d0/d13/d22/d28/f85 x:0 0 0 2024-03-22T07:28:33.114 INFO:tasks.workunit.client.0.smithi134.stdout:1/309: rename d5/d1d/d2d/f32 to d5/da/d1b/d27/f6a 0 2024-03-22T07:28:33.117 INFO:tasks.workunit.client.0.smithi134.stdout:2/228: write d2/f28 [3947984,9596] 0 2024-03-22T07:28:33.118 INFO:tasks.workunit.client.1.smithi195.stdout:2/436: truncate d2/d3/d21/d4c/f52 331006 0 2024-03-22T07:28:33.118 INFO:tasks.workunit.client.1.smithi195.stdout:2/437: write d2/d3/d7/da/de/f5a [4218755,16379] 0 2024-03-22T07:28:33.118 INFO:tasks.workunit.client.1.smithi195.stdout:2/438: fdatasync d2/d3/d7/d19/d22/d26/d3c/f47 0 2024-03-22T07:28:33.118 INFO:tasks.workunit.client.1.smithi195.stdout:2/439: truncate d2/d3/d24/f6b 693648 0 2024-03-22T07:28:33.119 INFO:tasks.workunit.client.1.smithi195.stdout:4/473: rmdir d13/d15/d64 39 2024-03-22T07:28:33.125 INFO:tasks.workunit.client.0.smithi134.stdout:1/310: dread f3 [0,4194304] 0 2024-03-22T07:28:33.125 INFO:tasks.workunit.client.0.smithi134.stdout:1/311: write d5/da/d1b/f5d [26279,41443] 0 2024-03-22T07:28:33.125 INFO:tasks.workunit.client.1.smithi195.stdout:0/472: unlink d1/d4/d22/l70 0 2024-03-22T07:28:33.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/267: symlink d1/d8/d16/d4a/l5d 0 2024-03-22T07:28:33.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/268: chown d1/lc 16310955 1 2024-03-22T07:28:33.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/269: chown d1/d13/f1c 15122472 1 2024-03-22T07:28:33.126 INFO:tasks.workunit.client.0.smithi134.stdout:5/270: write d1/d8/d3f/f51 [201729,12304] 0 2024-03-22T07:28:33.136 INFO:tasks.workunit.client.0.smithi134.stdout:0/301: symlink dc/l58 0 2024-03-22T07:28:33.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/473: mkdir d1/d4/d12/d6c/d87 0 2024-03-22T07:28:33.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/361: rename d0/d2/d9/d52 to d0/d2/d6/d21/d39/d64/d7a 0 2024-03-22T07:28:33.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/362: stat d0/d70/d5f 0 2024-03-22T07:28:33.143 INFO:tasks.workunit.client.1.smithi195.stdout:1/363: write d0/f26 [1084871,122814] 0 2024-03-22T07:28:33.144 INFO:tasks.workunit.client.0.smithi134.stdout:5/271: dwrite d1/d4/f1a [0,4194304] 0 2024-03-22T07:28:33.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/440: dwrite d2/d3/d24/f5f [0,4194304] 0 2024-03-22T07:28:33.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/441: read - d2/d3/d24/f67 zero size 2024-03-22T07:28:33.145 INFO:tasks.workunit.client.1.smithi195.stdout:2/442: write d2/d3/d24/f67 [633174,119786] 0 2024-03-22T07:28:33.146 INFO:tasks.workunit.client.0.smithi134.stdout:9/239: rename d3/c4e to d3/d9/df/c56 0 2024-03-22T07:28:33.149 INFO:tasks.workunit.client.1.smithi195.stdout:1/364: rmdir d0/d70/d5f 0 2024-03-22T07:28:33.150 INFO:tasks.workunit.client.1.smithi195.stdout:0/474: write d1/d4/dd/df/f11 [2486205,38149] 0 2024-03-22T07:28:33.151 INFO:tasks.workunit.client.0.smithi134.stdout:1/312: creat d5/da/d68/f6b x:0 0 0 2024-03-22T07:28:33.151 INFO:tasks.workunit.client.0.smithi134.stdout:1/313: chown d5/da/f26 763885 1 2024-03-22T07:28:33.153 INFO:tasks.workunit.client.1.smithi195.stdout:0/475: dread d1/d4/d22/f6d [0,4194304] 0 2024-03-22T07:28:33.153 INFO:tasks.workunit.client.1.smithi195.stdout:0/476: readlink d1/d4/d22/l5f 0 2024-03-22T07:28:33.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/414: rename d0/d13/d22/f65 to d0/d13/d14/d2f/f86 0 2024-03-22T07:28:33.154 INFO:tasks.workunit.client.0.smithi134.stdout:0/302: dwrite dc/d17/f21 [0,4194304] 0 2024-03-22T07:28:33.156 INFO:tasks.workunit.client.0.smithi134.stdout:5/272: unlink d1/c45 0 2024-03-22T07:28:33.159 INFO:tasks.workunit.client.0.smithi134.stdout:4/338: rename d2/d25/d48/f4e to d2/d25/d48/d6e/f73 0 2024-03-22T07:28:33.160 INFO:tasks.workunit.client.1.smithi195.stdout:0/477: rmdir d1/d10 39 2024-03-22T07:28:33.160 INFO:tasks.workunit.client.1.smithi195.stdout:0/478: chown d1/d4/d12/l15 214 1 2024-03-22T07:28:33.160 INFO:tasks.workunit.client.1.smithi195.stdout:1/365: dread d0/d2/d6/f42 [0,4194304] 0 2024-03-22T07:28:33.161 INFO:tasks.workunit.client.0.smithi134.stdout:9/240: mkdir d3/d9/df/d57 0 2024-03-22T07:28:33.161 INFO:tasks.workunit.client.0.smithi134.stdout:9/241: creat d3/d9/df/d12/f58 x:0 0 0 2024-03-22T07:28:33.163 INFO:tasks.workunit.client.1.smithi195.stdout:7/415: mknod d0/d13/d14/d29/d6e/c87 0 2024-03-22T07:28:33.166 INFO:tasks.workunit.client.0.smithi134.stdout:1/314: creat d5/da/d13/f6c x:0 0 0 2024-03-22T07:28:33.167 INFO:tasks.workunit.client.1.smithi195.stdout:2/443: dwrite d2/d3/f31 [0,4194304] 0 2024-03-22T07:28:33.168 INFO:tasks.workunit.client.1.smithi195.stdout:0/479: dread d1/d4/dd/d66/f78 [0,4194304] 0 2024-03-22T07:28:33.168 INFO:tasks.workunit.client.1.smithi195.stdout:5/480: sync 2024-03-22T07:28:33.168 INFO:tasks.workunit.client.1.smithi195.stdout:9/610: sync 2024-03-22T07:28:33.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/499: sync 2024-03-22T07:28:33.168 INFO:tasks.workunit.client.1.smithi195.stdout:3/487: sync 2024-03-22T07:28:33.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/500: fsync da/d17/d32/d7d/f85 0 2024-03-22T07:28:33.173 INFO:tasks.workunit.client.1.smithi195.stdout:7/416: mknod d0/d13/d22/d52/d59/d79/c88 0 2024-03-22T07:28:33.173 INFO:tasks.workunit.client.1.smithi195.stdout:7/417: fsync d0/d13/d14/d2b/f42 0 2024-03-22T07:28:33.176 INFO:tasks.workunit.client.1.smithi195.stdout:2/444: link d2/d3/db/c36 d2/d3/d7/da/c8b 0 2024-03-22T07:28:33.180 INFO:tasks.workunit.client.0.smithi134.stdout:0/303: mknod dc/d17/c59 0 2024-03-22T07:28:33.180 INFO:tasks.workunit.client.0.smithi134.stdout:0/304: creat dc/d18/f5a x:0 0 0 2024-03-22T07:28:33.181 INFO:tasks.workunit.client.0.smithi134.stdout:0/305: chown dc/d18/f1d 118479857 1 2024-03-22T07:28:33.181 INFO:tasks.workunit.client.0.smithi134.stdout:0/306: write dc/de/f4f [3738855,84692] 0 2024-03-22T07:28:33.182 INFO:tasks.workunit.client.1.smithi195.stdout:9/611: dread d2/d4/d6/db/d20/d4a/f51 [0,4194304] 0 2024-03-22T07:28:33.184 INFO:tasks.workunit.client.1.smithi195.stdout:8/501: creat da/d17/f99 x:0 0 0 2024-03-22T07:28:33.184 INFO:tasks.workunit.client.1.smithi195.stdout:8/502: creat da/d82/f9a x:0 0 0 2024-03-22T07:28:33.186 INFO:tasks.workunit.client.0.smithi134.stdout:5/273: unlink d1/d8/c25 0 2024-03-22T07:28:33.188 INFO:tasks.workunit.client.1.smithi195.stdout:7/418: creat d0/d13/d14/d29/f89 x:0 0 0 2024-03-22T07:28:33.188 INFO:tasks.workunit.client.1.smithi195.stdout:7/419: write d0/d13/d14/d20/f78 [428573,23349] 0 2024-03-22T07:28:33.190 INFO:tasks.workunit.client.1.smithi195.stdout:2/445: creat d2/d3/d21/d40/f8c x:0 0 0 2024-03-22T07:28:33.194 INFO:tasks.workunit.client.0.smithi134.stdout:3/238: rename d4/fd to d4/d8/f4e 0 2024-03-22T07:28:33.196 INFO:tasks.workunit.client.1.smithi195.stdout:9/612: dread d2/d4/d32/d6d/f6f [0,4194304] 0 2024-03-22T07:28:33.196 INFO:tasks.workunit.client.1.smithi195.stdout:9/613: write d2/d4/d6/db/d20/d4a/da2/fc4 [667948,56756] 0 2024-03-22T07:28:33.196 INFO:tasks.workunit.client.1.smithi195.stdout:9/614: truncate d2/d4/d6/d18/d50/d88/fdf 911041 0 2024-03-22T07:28:33.197 INFO:tasks.workunit.client.1.smithi195.stdout:5/481: rmdir d9/d12 39 2024-03-22T07:28:33.200 INFO:tasks.workunit.client.0.smithi134.stdout:2/229: rename d2/d5/l20 to d2/d5/d8/d31/l3f 0 2024-03-22T07:28:33.200 INFO:tasks.workunit.client.0.smithi134.stdout:2/230: chown d2/d5/d8/d2c/c2e 45062 1 2024-03-22T07:28:33.200 INFO:tasks.workunit.client.0.smithi134.stdout:2/231: creat d2/f40 x:0 0 0 2024-03-22T07:28:33.200 INFO:tasks.workunit.client.0.smithi134.stdout:2/232: write d2/f14 [3150449,55191] 0 2024-03-22T07:28:33.201 INFO:tasks.workunit.client.0.smithi134.stdout:3/239: truncate d4/d8/f4e 921821 0 2024-03-22T07:28:33.201 INFO:tasks.workunit.client.0.smithi134.stdout:3/240: creat d4/d10/f4f x:0 0 0 2024-03-22T07:28:33.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/503: unlink da/d17/l64 0 2024-03-22T07:28:33.204 INFO:tasks.workunit.client.1.smithi195.stdout:8/504: dread da/d17/d32/f59 [0,4194304] 0 2024-03-22T07:28:33.205 INFO:tasks.workunit.client.1.smithi195.stdout:7/420: unlink d0/f2d 0 2024-03-22T07:28:33.207 INFO:tasks.workunit.client.1.smithi195.stdout:9/615: symlink d2/d4/d6/db/d20/le1 0 2024-03-22T07:28:33.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/616: write d2/dad/fbd [2640856,81644] 0 2024-03-22T07:28:33.208 INFO:tasks.workunit.client.1.smithi195.stdout:9/617: getdents d2/d4/d1d/ddc 0 2024-03-22T07:28:33.209 INFO:tasks.workunit.client.1.smithi195.stdout:8/505: unlink da/l84 0 2024-03-22T07:28:33.209 INFO:tasks.workunit.client.1.smithi195.stdout:8/506: write da/d17/d32/d61/d47/f54 [6738,14948] 0 2024-03-22T07:28:33.209 INFO:tasks.workunit.client.0.smithi134.stdout:5/274: dread d1/d8/d20/f39 [0,4194304] 0 2024-03-22T07:28:33.211 INFO:tasks.workunit.client.1.smithi195.stdout:7/421: unlink d0/d13/d14/d2f/l7d 0 2024-03-22T07:28:33.211 INFO:tasks.workunit.client.1.smithi195.stdout:1/366: dwrite d0/d2/f1f [4194304,4194304] 0 2024-03-22T07:28:33.213 INFO:tasks.workunit.client.1.smithi195.stdout:9/618: stat d2/d4/d6/c56 0 2024-03-22T07:28:33.213 INFO:tasks.workunit.client.0.smithi134.stdout:2/233: write d2/d5/d8/f2f [3130158,116996] 0 2024-03-22T07:28:33.213 INFO:tasks.workunit.client.0.smithi134.stdout:5/275: symlink d1/d8/d20/l5e 0 2024-03-22T07:28:33.217 INFO:tasks.workunit.client.1.smithi195.stdout:7/422: link d0/d13/d14/d29/d6e/c87 d0/d13/d22/d57/c8a 0 2024-03-22T07:28:33.218 INFO:tasks.workunit.client.0.smithi134.stdout:5/276: dread d1/d8/d20/f30 [0,4194304] 0 2024-03-22T07:28:33.219 INFO:tasks.workunit.client.1.smithi195.stdout:3/488: dwrite d3/f3f [0,4194304] 0 2024-03-22T07:28:33.219 INFO:tasks.workunit.client.1.smithi195.stdout:3/489: chown d3/df/d15/d1d/d5c/d47/d67/d80/f7d 8213503 1 2024-03-22T07:28:33.219 INFO:tasks.workunit.client.1.smithi195.stdout:3/490: creat d3/d22/fa9 x:0 0 0 2024-03-22T07:28:33.219 INFO:tasks.workunit.client.1.smithi195.stdout:3/491: read - d3/df/d15/d1d/d5c/d86/f97 zero size 2024-03-22T07:28:33.220 INFO:tasks.workunit.client.0.smithi134.stdout:4/339: dwrite d2/d2a/d50/f59 [0,4194304] 0 2024-03-22T07:28:33.220 INFO:tasks.workunit.client.0.smithi134.stdout:5/277: mkdir d1/d4/d5f 0 2024-03-22T07:28:33.220 INFO:tasks.workunit.client.0.smithi134.stdout:5/278: chown d1/f57 1 1 2024-03-22T07:28:33.220 INFO:tasks.workunit.client.0.smithi134.stdout:5/279: chown d1/d8/l1f 621265 1 2024-03-22T07:28:33.223 INFO:tasks.workunit.client.0.smithi134.stdout:9/242: dwrite d3/d9/df/d12/f1f [0,4194304] 0 2024-03-22T07:28:33.223 INFO:tasks.workunit.client.0.smithi134.stdout:9/243: read d3/fe [2573124,53953] 0 2024-03-22T07:28:33.224 INFO:tasks.workunit.client.1.smithi195.stdout:9/619: dread d2/d4/d32/d6d/f6f [0,4194304] 0 2024-03-22T07:28:33.224 INFO:tasks.workunit.client.1.smithi195.stdout:0/480: dwrite d1/d4/dd/d66/d80/f6a [0,4194304] 0 2024-03-22T07:28:33.224 INFO:tasks.workunit.client.1.smithi195.stdout:0/481: creat d1/d4/dd/d66/f88 x:0 0 0 2024-03-22T07:28:33.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/423: mknod d0/d13/d22/c8b 0 2024-03-22T07:28:33.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/424: write d0/d13/d14/f4a [240122,96761] 0 2024-03-22T07:28:33.233 INFO:tasks.workunit.client.0.smithi134.stdout:5/280: rmdir d1/d13/d5b 0 2024-03-22T07:28:33.233 INFO:tasks.workunit.client.0.smithi134.stdout:5/281: chown d1/d8/d16/d4a/l5d 10963 1 2024-03-22T07:28:33.234 INFO:tasks.workunit.client.1.smithi195.stdout:5/482: dwrite d9/d2d/f72 [0,4194304] 0 2024-03-22T07:28:33.235 INFO:tasks.workunit.client.0.smithi134.stdout:8/346: sync 2024-03-22T07:28:33.236 INFO:tasks.workunit.client.1.smithi195.stdout:5/483: dread d9/d12/d1d/d69/d78/d41/f8d [0,4194304] 0 2024-03-22T07:28:33.237 INFO:tasks.workunit.client.0.smithi134.stdout:0/307: getdents dc/d17 0 2024-03-22T07:28:33.237 INFO:tasks.workunit.client.0.smithi134.stdout:0/308: rename dc to dc/de/d5b 22 2024-03-22T07:28:33.237 INFO:tasks.workunit.client.0.smithi134.stdout:4/340: write d2/d15/f1b [3403682,47848] 0 2024-03-22T07:28:33.238 INFO:tasks.workunit.client.1.smithi195.stdout:3/492: mknod d3/d18/d89/d8c/d9d/caa 0 2024-03-22T07:28:33.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/347: truncate d1/d15/d42/d49/f5f 648939 0 2024-03-22T07:28:33.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/348: chown d1/d15/f2c 1200277478 1 2024-03-22T07:28:33.244 INFO:tasks.workunit.client.0.smithi134.stdout:0/309: truncate dc/f32 293424 0 2024-03-22T07:28:33.246 INFO:tasks.workunit.client.0.smithi134.stdout:8/349: creat d1/d15/d42/d76/f78 x:0 0 0 2024-03-22T07:28:33.247 INFO:tasks.workunit.client.0.smithi134.stdout:5/282: dread d1/d13/f18 [0,4194304] 0 2024-03-22T07:28:33.247 INFO:tasks.workunit.client.0.smithi134.stdout:5/283: creat d1/f60 x:0 0 0 2024-03-22T07:28:33.247 INFO:tasks.workunit.client.0.smithi134.stdout:5/284: creat d1/d13/f61 x:0 0 0 2024-03-22T07:28:33.247 INFO:tasks.workunit.client.0.smithi134.stdout:5/285: fdatasync d1/d8/d16/f40 0 2024-03-22T07:28:33.247 INFO:tasks.workunit.client.1.smithi195.stdout:8/507: dwrite da/d17/f99 [0,4194304] 0 2024-03-22T07:28:33.247 INFO:tasks.workunit.client.1.smithi195.stdout:5/484: dread d9/f31 [0,4194304] 0 2024-03-22T07:28:33.248 INFO:tasks.workunit.client.1.smithi195.stdout:3/493: dread d3/d18/f51 [0,4194304] 0 2024-03-22T07:28:33.248 INFO:tasks.workunit.client.0.smithi134.stdout:8/350: rmdir d1/d46 39 2024-03-22T07:28:33.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/620: mkdir d2/d4/d6/db5/de2 0 2024-03-22T07:28:33.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/621: write d2/d4/d32/f3a [2385060,39060] 0 2024-03-22T07:28:33.250 INFO:tasks.workunit.client.1.smithi195.stdout:9/622: chown d2/d4/d6/db/d20/d4a/da2/lcd 30278 1 2024-03-22T07:28:33.253 INFO:tasks.workunit.client.1.smithi195.stdout:7/425: mkdir d0/d13/d22/d57/d7b/d8c 0 2024-03-22T07:28:33.256 INFO:tasks.workunit.client.1.smithi195.stdout:3/494: write d3/d18/f26 [1428418,27128] 0 2024-03-22T07:28:33.260 INFO:tasks.workunit.client.0.smithi134.stdout:8/351: read d1/d15/d42/d12/f37 [2349809,102643] 0 2024-03-22T07:28:33.260 INFO:tasks.workunit.client.0.smithi134.stdout:8/352: readlink d1/d15/d42/d12/l60 0 2024-03-22T07:28:33.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/248: sync 2024-03-22T07:28:33.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/458: sync 2024-03-22T07:28:33.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/459: write d1/de/d11/d48/f1e [9300700,106165] 0 2024-03-22T07:28:33.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/460: getdents d1/de/d8d 0 2024-03-22T07:28:33.261 INFO:tasks.workunit.client.1.smithi195.stdout:8/508: symlink da/d17/l9b 0 2024-03-22T07:28:33.261 INFO:tasks.workunit.client.1.smithi195.stdout:1/367: dwrite d0/d2/d9/d2a/f5b [0,4194304] 0 2024-03-22T07:28:33.262 INFO:tasks.workunit.client.1.smithi195.stdout:5/485: mkdir d9/da8 0 2024-03-22T07:28:33.264 INFO:tasks.workunit.client.0.smithi134.stdout:6/249: mkdir d2/d1b/d1d/d5e 0 2024-03-22T07:28:33.265 INFO:tasks.workunit.client.1.smithi195.stdout:9/623: mkdir d2/d4/d6/db5/de3 0 2024-03-22T07:28:33.265 INFO:tasks.workunit.client.1.smithi195.stdout:9/624: dread - d2/d4/d6/db/f9d zero size 2024-03-22T07:28:33.267 INFO:tasks.workunit.client.1.smithi195.stdout:7/426: symlink d0/d13/d14/d20/d40/l8d 0 2024-03-22T07:28:33.267 INFO:tasks.workunit.client.0.smithi134.stdout:7/461: dread d1/de/d11/d48/f65 [0,4194304] 0 2024-03-22T07:28:33.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/482: dwrite d1/d4/dd/df/f3e [0,4194304] 0 2024-03-22T07:28:33.270 INFO:tasks.workunit.client.0.smithi134.stdout:4/341: dwrite d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:33.270 INFO:tasks.workunit.client.0.smithi134.stdout:9/244: dwrite d3/f51 [0,4194304] 0 2024-03-22T07:28:33.270 INFO:tasks.workunit.client.0.smithi134.stdout:9/245: fsync d3/d9/df/f26 0 2024-03-22T07:28:33.270 INFO:tasks.workunit.client.0.smithi134.stdout:9/246: chown d3/d9/df/d12/d1b/l1e 23728017 1 2024-03-22T07:28:33.270 INFO:tasks.workunit.client.0.smithi134.stdout:9/247: write d3/d9/df/f49 [684,1405] 0 2024-03-22T07:28:33.271 INFO:tasks.workunit.client.1.smithi195.stdout:8/509: rename f9 to da/d82/f9c 0 2024-03-22T07:28:33.271 INFO:tasks.workunit.client.0.smithi134.stdout:3/241: dwrite d4/d22/d29/f30 [0,4194304] 0 2024-03-22T07:28:33.272 INFO:tasks.workunit.client.0.smithi134.stdout:7/462: creat d1/de/d11/d2b/d31/d85/f93 x:0 0 0 2024-03-22T07:28:33.272 INFO:tasks.workunit.client.0.smithi134.stdout:3/242: dread d4/d22/f25 [0,4194304] 0 2024-03-22T07:28:33.274 INFO:tasks.workunit.client.0.smithi134.stdout:8/353: write d1/d15/d42/d12/d20/d41/f48 [5859539,85572] 0 2024-03-22T07:28:33.274 INFO:tasks.workunit.client.0.smithi134.stdout:8/354: fsync d1/d4/f4a 0 2024-03-22T07:28:33.280 INFO:tasks.workunit.client.1.smithi195.stdout:1/368: link d0/d2/d9/c4d d0/d2/d6/d21/d41/d47/d4a/d66/c7b 0 2024-03-22T07:28:33.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/248: rename d3/d9/d37/c4a to d3/d9/c59 0 2024-03-22T07:28:33.282 INFO:tasks.workunit.client.1.smithi195.stdout:3/495: getdents d3/d18/d89/d8c/d9d 0 2024-03-22T07:28:33.284 INFO:tasks.workunit.client.1.smithi195.stdout:9/625: creat d2/d4/d1d/ddc/fe4 x:0 0 0 2024-03-22T07:28:33.288 INFO:tasks.workunit.client.0.smithi134.stdout:7/463: mknod d1/de/d11/d2b/c94 0 2024-03-22T07:28:33.289 INFO:tasks.workunit.client.0.smithi134.stdout:3/243: mkdir d4/d22/d29/d50 0 2024-03-22T07:28:33.289 INFO:tasks.workunit.client.0.smithi134.stdout:3/244: chown d4/d10/c37 19 1 2024-03-22T07:28:33.291 INFO:tasks.workunit.client.0.smithi134.stdout:8/355: rename d1/d15/d42/d12/d20/d5a to d1/d15/d57/d79 0 2024-03-22T07:28:33.294 INFO:tasks.workunit.client.0.smithi134.stdout:9/249: truncate d3/d9/df/d12/f2a 2736832 0 2024-03-22T07:28:33.294 INFO:tasks.workunit.client.0.smithi134.stdout:9/250: readlink d3/d9/df/d12/d2d/l33 0 2024-03-22T07:28:33.295 INFO:tasks.workunit.client.0.smithi134.stdout:7/464: write d1/de/d11/d2b/d31/f91 [1775027,42061] 0 2024-03-22T07:28:33.296 INFO:tasks.workunit.client.0.smithi134.stdout:3/245: link d4/d10/f35 d4/d8/d45/f51 0 2024-03-22T07:28:33.297 INFO:tasks.workunit.client.0.smithi134.stdout:3/246: write d4/d22/f20 [4593921,100893] 0 2024-03-22T07:28:33.297 INFO:tasks.workunit.client.0.smithi134.stdout:3/247: rename d4/d8 to d4/d8/d23/d52 22 2024-03-22T07:28:33.301 INFO:tasks.workunit.client.0.smithi134.stdout:8/356: creat d1/d15/d42/d12/f7a x:0 0 0 2024-03-22T07:28:33.305 INFO:tasks.workunit.client.1.smithi195.stdout:0/483: mkdir d1/d4/d12/d6c/d89 0 2024-03-22T07:28:33.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/248: mknod d4/d8/d23/c53 0 2024-03-22T07:28:33.307 INFO:tasks.workunit.client.0.smithi134.stdout:3/249: write d4/d8/f12 [2869010,18229] 0 2024-03-22T07:28:33.307 INFO:tasks.workunit.client.0.smithi134.stdout:3/250: chown d4/d10 0 1 2024-03-22T07:28:33.308 INFO:tasks.workunit.client.1.smithi195.stdout:7/427: rename d0/d13/d14/d20/l45 to d0/d13/d22/d57/l8e 0 2024-03-22T07:28:33.308 INFO:tasks.workunit.client.1.smithi195.stdout:7/428: chown d0/d13/d22/d52/f5e 18 1 2024-03-22T07:28:33.310 INFO:tasks.workunit.client.0.smithi134.stdout:8/357: mkdir d1/d15/d7b 0 2024-03-22T07:28:33.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/510: symlink da/d17/l9d 0 2024-03-22T07:28:33.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/511: read - da/d17/d32/d61/d47/d53/f89 zero size 2024-03-22T07:28:33.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/512: write da/d17/d32/d61/d47/f87 [372328,21083] 0 2024-03-22T07:28:33.313 INFO:tasks.workunit.client.1.smithi195.stdout:8/513: fsync da/d17/d32/d61/d47/f54 0 2024-03-22T07:28:33.314 INFO:tasks.workunit.client.1.smithi195.stdout:1/369: mknod d0/d2/c7c 0 2024-03-22T07:28:33.315 INFO:tasks.workunit.client.0.smithi134.stdout:3/251: symlink d4/l54 0 2024-03-22T07:28:33.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/486: dwrite d9/d12/d1d/d36/f44 [4194304,4194304] 0 2024-03-22T07:28:33.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/487: write d9/d12/d1d/f32 [280068,129666] 0 2024-03-22T07:28:33.316 INFO:tasks.workunit.client.1.smithi195.stdout:3/496: creat d3/fab x:0 0 0 2024-03-22T07:28:33.317 INFO:tasks.workunit.client.1.smithi195.stdout:3/497: write d3/f24 [2015703,119200] 0 2024-03-22T07:28:33.317 INFO:tasks.workunit.client.0.smithi134.stdout:8/358: symlink d1/l7c 0 2024-03-22T07:28:33.317 INFO:tasks.workunit.client.1.smithi195.stdout:5/488: write d9/d22/d46/f63 [953023,91400] 0 2024-03-22T07:28:33.318 INFO:tasks.workunit.client.1.smithi195.stdout:9/626: rmdir d2/dad/ddb 0 2024-03-22T07:28:33.319 INFO:tasks.workunit.client.1.smithi195.stdout:8/514: read da/d17/d32/d61/d47/d53/f5e [1186546,120005] 0 2024-03-22T07:28:33.321 INFO:tasks.workunit.client.1.smithi195.stdout:0/484: rename d1/d10/d1f/c75 to d1/d4/dd/df/d67/c8a 0 2024-03-22T07:28:33.322 INFO:tasks.workunit.client.0.smithi134.stdout:8/359: mknod d1/d15/d42/d12/d2a/c7d 0 2024-03-22T07:28:33.324 INFO:tasks.workunit.client.1.smithi195.stdout:1/370: link d0/d2/d6/d21/d39/d40/l60 d0/d2/d6/d21/d39/l7d 0 2024-03-22T07:28:33.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/371: write d0/d2/d6/d21/d39/d64/d7a/f57 [1045229,58710] 0 2024-03-22T07:28:33.326 INFO:tasks.workunit.client.0.smithi134.stdout:7/465: dwrite d1/de/d11/f55 [0,4194304] 0 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:9/251: dwrite d3/d9/f3a [0,4194304] 0 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/252: dread d4/d22/d29/f30 [0,4194304] 0 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/253: fsync d4/f1e 0 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/254: creat d4/d8/d23/f55 x:0 0 0 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/255: readlink d4/l54 0 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:3/256: dread - d4/d22/f3e zero size 2024-03-22T07:28:33.328 INFO:tasks.workunit.client.0.smithi134.stdout:4/342: dwrite d2/d15/f51 [4194304,4194304] 0 2024-03-22T07:28:33.330 INFO:tasks.workunit.client.1.smithi195.stdout:0/485: dread d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:33.332 INFO:tasks.workunit.client.1.smithi195.stdout:5/489: read f7 [2346017,30626] 0 2024-03-22T07:28:33.336 INFO:tasks.workunit.client.1.smithi195.stdout:8/515: dwrite da/de/f2d [0,4194304] 0 2024-03-22T07:28:33.337 INFO:tasks.workunit.client.1.smithi195.stdout:5/490: dread f8 [0,4194304] 0 2024-03-22T07:28:33.387 INFO:tasks.workunit.client.0.smithi134.stdout:8/360: rmdir d1/d15/d42/d25 39 2024-03-22T07:28:33.392 INFO:tasks.workunit.client.1.smithi195.stdout:3/498: unlink d3/d22/l4e 0 2024-03-22T07:28:33.395 INFO:tasks.workunit.client.0.smithi134.stdout:7/466: unlink d1/de/d11/d2b/d31/l7c 0 2024-03-22T07:28:33.396 INFO:tasks.workunit.client.1.smithi195.stdout:9/627: rmdir d2/d4/d6/db5/de2 0 2024-03-22T07:28:33.400 INFO:tasks.workunit.client.1.smithi195.stdout:7/429: mknod d0/d13/d14/c8f 0 2024-03-22T07:28:33.401 INFO:tasks.workunit.client.0.smithi134.stdout:9/252: getdents d3/d9/df 0 2024-03-22T07:28:33.402 INFO:tasks.workunit.client.1.smithi195.stdout:3/499: dread d3/df/d15/d1d/f31 [4194304,4194304] 0 2024-03-22T07:28:33.402 INFO:tasks.workunit.client.0.smithi134.stdout:8/361: dwrite d1/d15/d42/d12/f37 [0,4194304] 0 2024-03-22T07:28:33.402 INFO:tasks.workunit.client.1.smithi195.stdout:6/436: sync 2024-03-22T07:28:33.403 INFO:tasks.workunit.client.1.smithi195.stdout:1/372: rename d0/d2/d6/d21/d39/d64/d7a/c54 to d0/d2/d6/d21/d39/d64/d7a/c7e 0 2024-03-22T07:28:33.406 INFO:tasks.workunit.client.1.smithi195.stdout:0/486: rename d1/d4/dd/df/d2b/l7d to d1/d4/dd/l8b 0 2024-03-22T07:28:33.407 INFO:tasks.workunit.client.1.smithi195.stdout:0/487: write d1/d4/f7 [165859,79247] 0 2024-03-22T07:28:33.409 INFO:tasks.workunit.client.1.smithi195.stdout:8/516: mknod da/d17/d32/d61/d88/c9e 0 2024-03-22T07:28:33.411 INFO:tasks.workunit.client.1.smithi195.stdout:1/373: write d0/d2/d9/f61 [537010,122828] 0 2024-03-22T07:28:33.415 INFO:tasks.workunit.client.1.smithi195.stdout:5/491: mknod d9/d22/d7b/d98/ca9 0 2024-03-22T07:28:33.419 INFO:tasks.workunit.client.1.smithi195.stdout:7/430: creat d0/d13/d22/d57/d7b/d8c/f90 x:0 0 0 2024-03-22T07:28:33.420 INFO:tasks.workunit.client.0.smithi134.stdout:3/257: rmdir d4/d8/d45 39 2024-03-22T07:28:33.421 INFO:tasks.workunit.client.1.smithi195.stdout:5/492: dread d9/f1c [0,4194304] 0 2024-03-22T07:28:33.422 INFO:tasks.workunit.client.1.smithi195.stdout:6/437: unlink d5/d16/d45/f83 0 2024-03-22T07:28:33.429 INFO:tasks.workunit.client.1.smithi195.stdout:4/474: sync 2024-03-22T07:28:33.429 INFO:tasks.workunit.client.1.smithi195.stdout:2/446: sync 2024-03-22T07:28:33.429 INFO:tasks.workunit.client.1.smithi195.stdout:4/475: readlink d13/d15/d6b/l9a 0 2024-03-22T07:28:33.431 INFO:tasks.workunit.client.0.smithi134.stdout:7/467: mknod d1/de/d11/d48/c95 0 2024-03-22T07:28:33.433 INFO:tasks.workunit.client.0.smithi134.stdout:9/253: mkdir d3/d9/d37/d5a 0 2024-03-22T07:28:33.435 INFO:tasks.workunit.client.1.smithi195.stdout:0/488: rmdir d1/d4/dd/df/d2b/d63 39 2024-03-22T07:28:33.435 INFO:tasks.workunit.client.1.smithi195.stdout:0/489: chown d1/d4/dd/f59 0 1 2024-03-22T07:28:33.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/500: dwrite d3/f8b [0,4194304] 0 2024-03-22T07:28:33.435 INFO:tasks.workunit.client.1.smithi195.stdout:3/501: write d3/df/d15/d1d/d5c/d47/d67/f8d [935822,79956] 0 2024-03-22T07:28:33.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/362: dwrite d1/d15/f19 [0,4194304] 0 2024-03-22T07:28:33.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/517: dwrite da/de/f5b [0,4194304] 0 2024-03-22T07:28:33.439 INFO:tasks.workunit.client.0.smithi134.stdout:3/258: unlink d4/d22/c42 0 2024-03-22T07:28:33.439 INFO:tasks.workunit.client.0.smithi134.stdout:3/259: creat d4/f56 x:0 0 0 2024-03-22T07:28:33.440 INFO:tasks.workunit.client.1.smithi195.stdout:1/374: symlink d0/d2/d9/d2a/d6f/l7f 0 2024-03-22T07:28:33.440 INFO:tasks.workunit.client.1.smithi195.stdout:1/375: truncate d0/d2/d6/d21/d41/d47/d4a/f4c 475415 0 2024-03-22T07:28:33.441 INFO:tasks.workunit.client.1.smithi195.stdout:1/376: write d0/d2/fe [4822457,72197] 0 2024-03-22T07:28:33.441 INFO:tasks.workunit.client.0.smithi134.stdout:7/468: mknod d1/c96 0 2024-03-22T07:28:33.442 INFO:tasks.workunit.client.1.smithi195.stdout:4/476: dread d13/d63/d3e/d5c/f69 [0,4194304] 0 2024-03-22T07:28:33.444 INFO:tasks.workunit.client.0.smithi134.stdout:8/363: rename d1/d15/d42/c55 to d1/d15/d7b/c7e 0 2024-03-22T07:28:33.445 INFO:tasks.workunit.client.1.smithi195.stdout:5/493: mkdir d9/daa 0 2024-03-22T07:28:33.447 INFO:tasks.workunit.client.1.smithi195.stdout:6/438: truncate d5/f6 2575644 0 2024-03-22T07:28:33.447 INFO:tasks.workunit.client.1.smithi195.stdout:6/439: chown d5/d5e/d34/d55/f36 13014 1 2024-03-22T07:28:33.447 INFO:tasks.workunit.client.1.smithi195.stdout:6/440: dread - d5/d16/d45/d53/d59/d87/f9f zero size 2024-03-22T07:28:33.448 INFO:tasks.workunit.client.0.smithi134.stdout:3/260: link d4/d22/d3c/c3d d4/d22/d29/c57 0 2024-03-22T07:28:33.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/261: rename d4 to d4/d22/d58 22 2024-03-22T07:28:33.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/262: chown d4/d8/d23/l2f 3981660 1 2024-03-22T07:28:33.450 INFO:tasks.workunit.client.0.smithi134.stdout:9/254: dwrite d3/f27 [0,4194304] 0 2024-03-22T07:28:33.451 INFO:tasks.workunit.client.0.smithi134.stdout:7/469: unlink d1/de/l38 0 2024-03-22T07:28:33.454 INFO:tasks.workunit.client.0.smithi134.stdout:8/364: mkdir d1/d15/d42/d25/d7f 0 2024-03-22T07:28:33.455 INFO:tasks.workunit.client.1.smithi195.stdout:6/441: dread d5/d5e/d34/d55/d3b/d6e/fd [4194304,4194304] 0 2024-03-22T07:28:33.456 INFO:tasks.workunit.client.1.smithi195.stdout:6/442: creat d5/d16/d45/d53/fa3 x:0 0 0 2024-03-22T07:28:33.457 INFO:tasks.workunit.client.1.smithi195.stdout:5/494: dwrite d9/d7f/f81 [0,4194304] 0 2024-03-22T07:28:33.458 INFO:tasks.workunit.client.1.smithi195.stdout:3/502: mkdir d3/df/d15/dac 0 2024-03-22T07:28:33.459 INFO:tasks.workunit.client.0.smithi134.stdout:1/315: sync 2024-03-22T07:28:33.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/518: creat da/d17/d32/d61/d88/d91/f9f x:0 0 0 2024-03-22T07:28:33.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/255: unlink d3/f28 0 2024-03-22T07:28:33.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/443: write d5/d5e/d34/d55/d3b/d6e/d3c/f70 [3184459,120991] 0 2024-03-22T07:28:33.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/444: chown d5/la 112561444 1 2024-03-22T07:28:33.465 INFO:tasks.workunit.client.1.smithi195.stdout:1/377: unlink d0/d2/d9/d2a/d6f/f73 0 2024-03-22T07:28:33.466 INFO:tasks.workunit.client.0.smithi134.stdout:7/470: mkdir d1/de/d11/d97 0 2024-03-22T07:28:33.466 INFO:tasks.workunit.client.0.smithi134.stdout:7/471: chown d1/de/d11/d2b/d31/f83 357 1 2024-03-22T07:28:33.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/503: dread d3/f14 [0,4194304] 0 2024-03-22T07:28:33.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/504: chown d3/df/d15/d1d/d5c/d47/d67/d93/c6b 2016434 1 2024-03-22T07:28:33.467 INFO:tasks.workunit.client.1.smithi195.stdout:3/505: chown d3/d18/d89/d76/f85 12422071 1 2024-03-22T07:28:33.468 INFO:tasks.workunit.client.1.smithi195.stdout:3/506: chown d3/df/d15/la7 0 1 2024-03-22T07:28:33.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/477: rmdir d13/d15/d64 39 2024-03-22T07:28:33.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/478: write d13/f4f [227570,65469] 0 2024-03-22T07:28:33.470 INFO:tasks.workunit.client.0.smithi134.stdout:8/365: unlink d1/d15/d42/d12/d2a/c7d 0 2024-03-22T07:28:33.470 INFO:tasks.workunit.client.0.smithi134.stdout:8/366: getdents d1/d15/d57/d79 0 2024-03-22T07:28:33.470 INFO:tasks.workunit.client.0.smithi134.stdout:8/367: fdatasync d1/f24 0 2024-03-22T07:28:33.470 INFO:tasks.workunit.client.0.smithi134.stdout:8/368: readlink d1/d15/d42/d12/l4c 0 2024-03-22T07:28:33.471 INFO:tasks.workunit.client.1.smithi195.stdout:7/431: truncate d0/d13/f1e 1382400 0 2024-03-22T07:28:33.476 INFO:tasks.workunit.client.1.smithi195.stdout:0/490: rmdir d1/d10/d1f/d40/d43 39 2024-03-22T07:28:33.479 INFO:tasks.workunit.client.0.smithi134.stdout:7/472: dread d1/de/f26 [4194304,4194304] 0 2024-03-22T07:28:33.481 INFO:tasks.workunit.client.1.smithi195.stdout:5/495: dwrite d9/d12/d1d/f95 [0,4194304] 0 2024-03-22T07:28:33.485 INFO:tasks.workunit.client.0.smithi134.stdout:3/263: rmdir d4/d8/d23 39 2024-03-22T07:28:33.488 INFO:tasks.workunit.client.1.smithi195.stdout:8/519: creat da/d17/d32/d7d/d8e/fa0 x:0 0 0 2024-03-22T07:28:33.488 INFO:tasks.workunit.client.1.smithi195.stdout:8/520: creat da/d17/d32/d7d/d8e/fa1 x:0 0 0 2024-03-22T07:28:33.489 INFO:tasks.workunit.client.0.smithi134.stdout:1/316: symlink d5/da/d13/d1e/d62/l6d 0 2024-03-22T07:28:33.495 INFO:tasks.workunit.client.1.smithi195.stdout:3/507: unlink d3/df/d15/d1d/l38 0 2024-03-22T07:28:33.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/491: dread d1/d10/d19/d20/f61 [0,4194304] 0 2024-03-22T07:28:33.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/492: truncate d1/d4/d12/f2d 945687 0 2024-03-22T07:28:33.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/493: truncate d1/d10/d19/d20/f4f 109389 0 2024-03-22T07:28:33.495 INFO:tasks.workunit.client.1.smithi195.stdout:0/494: write d1/d4/dd/df/f11 [4416434,102287] 0 2024-03-22T07:28:33.495 INFO:tasks.workunit.client.0.smithi134.stdout:1/317: mknod d5/c6e 0 2024-03-22T07:28:33.497 INFO:tasks.workunit.client.1.smithi195.stdout:8/521: write da/de/f2d [1992988,102578] 0 2024-03-22T07:28:33.497 INFO:tasks.workunit.client.1.smithi195.stdout:8/522: truncate da/d17/d32/d61/d88/d91/f9f 699004 0 2024-03-22T07:28:33.497 INFO:tasks.workunit.client.1.smithi195.stdout:7/432: creat d0/f91 x:0 0 0 2024-03-22T07:28:33.498 INFO:tasks.workunit.client.1.smithi195.stdout:7/433: chown d0/f91 877943 1 2024-03-22T07:28:33.498 INFO:tasks.workunit.client.1.smithi195.stdout:7/434: creat d0/d13/d22/d57/d7b/d8c/f92 x:0 0 0 2024-03-22T07:28:33.498 INFO:tasks.workunit.client.0.smithi134.stdout:8/369: rmdir d1/d15/d5b 39 2024-03-22T07:28:33.500 INFO:tasks.workunit.client.0.smithi134.stdout:1/318: rename d5/da/d1b/d27/f6a to d5/d1d/d2d/f6f 0 2024-03-22T07:28:33.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/370: getdents d1/d46 0 2024-03-22T07:28:33.503 INFO:tasks.workunit.client.0.smithi134.stdout:8/371: rename d1/d4/d38/c51 to d1/d15/d42/c80 0 2024-03-22T07:28:33.504 INFO:tasks.workunit.client.1.smithi195.stdout:5/496: rmdir d9/d12/d1d/d69/d78 39 2024-03-22T07:28:33.505 INFO:tasks.workunit.client.0.smithi134.stdout:8/372: creat d1/d15/d5b/f81 x:0 0 0 2024-03-22T07:28:33.505 INFO:tasks.workunit.client.0.smithi134.stdout:8/373: readlink d1/d15/lb 0 2024-03-22T07:28:33.506 INFO:tasks.workunit.client.0.smithi134.stdout:8/374: dread - d1/f77 zero size 2024-03-22T07:28:33.506 INFO:tasks.workunit.client.0.smithi134.stdout:8/375: creat d1/f82 x:0 0 0 2024-03-22T07:28:33.507 INFO:tasks.workunit.client.1.smithi195.stdout:6/445: dwrite d5/d5e/d34/d55/f2e [0,4194304] 0 2024-03-22T07:28:33.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/378: dwrite d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:33.507 INFO:tasks.workunit.client.1.smithi195.stdout:1/379: fsync d0/d2/fe 0 2024-03-22T07:28:33.507 INFO:tasks.workunit.client.1.smithi195.stdout:6/446: dread - d5/d16/d45/d53/d59/d87/f94 zero size 2024-03-22T07:28:33.508 INFO:tasks.workunit.client.1.smithi195.stdout:1/380: creat d0/d2/d9/d2a/f80 x:0 0 0 2024-03-22T07:28:33.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/508: symlink d3/d18/d89/d8c/lad 0 2024-03-22T07:28:33.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/509: fsync d3/d22/f8a 0 2024-03-22T07:28:33.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/510: fdatasync d3/d18/d89/f90 0 2024-03-22T07:28:33.509 INFO:tasks.workunit.client.0.smithi134.stdout:7/473: dwrite d1/de/d11/f13 [0,4194304] 0 2024-03-22T07:28:33.516 INFO:tasks.workunit.client.0.smithi134.stdout:8/376: rename d1/d15/d42/d25/d7f to d1/d15/d7b/d83 0 2024-03-22T07:28:33.519 INFO:tasks.workunit.client.1.smithi195.stdout:0/495: symlink d1/d4/d83/l8c 0 2024-03-22T07:28:33.522 INFO:tasks.workunit.client.1.smithi195.stdout:8/523: mknod da/ca2 0 2024-03-22T07:28:33.522 INFO:tasks.workunit.client.1.smithi195.stdout:8/524: write da/d17/d32/d61/d47/d53/f5e [1595294,113840] 0 2024-03-22T07:28:33.523 INFO:tasks.workunit.client.1.smithi195.stdout:8/525: creat da/d17/d32/d7d/d8e/fa3 x:0 0 0 2024-03-22T07:28:33.523 INFO:tasks.workunit.client.0.smithi134.stdout:7/474: write d1/f4 [1425571,78092] 0 2024-03-22T07:28:33.527 INFO:tasks.workunit.client.1.smithi195.stdout:7/435: rename d0/d13/d14/d20/d40/f41 to d0/d13/d14/d29/d35/d6d/f93 0 2024-03-22T07:28:33.529 INFO:tasks.workunit.client.0.smithi134.stdout:7/475: rename d1/de/ff to d1/de/f98 0 2024-03-22T07:28:33.529 INFO:tasks.workunit.client.1.smithi195.stdout:8/526: dread da/dc/d71/f80 [0,4194304] 0 2024-03-22T07:28:33.530 INFO:tasks.workunit.client.1.smithi195.stdout:8/527: chown da/dc/d71/l8b 77077 1 2024-03-22T07:28:33.530 INFO:tasks.workunit.client.1.smithi195.stdout:8/528: read - da/d17/d32/d61/d47/d53/f89 zero size 2024-03-22T07:28:33.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/497: creat d9/d73/da1/fab x:0 0 0 2024-03-22T07:28:33.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/498: stat d9/d2d/d84/d92 0 2024-03-22T07:28:33.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/499: dread - d9/d73/da1/fab zero size 2024-03-22T07:28:33.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/500: fsync d9/fb 0 2024-03-22T07:28:33.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/501: stat d9/d12/d14/ca7 0 2024-03-22T07:28:33.531 INFO:tasks.workunit.client.1.smithi195.stdout:5/502: dread - d9/d2d/d84/f9d zero size 2024-03-22T07:28:33.532 INFO:tasks.workunit.client.0.smithi134.stdout:7/476: symlink d1/de/d41/d87/l99 0 2024-03-22T07:28:33.536 INFO:tasks.workunit.client.0.smithi134.stdout:2/234: sync 2024-03-22T07:28:33.536 INFO:tasks.workunit.client.0.smithi134.stdout:2/235: chown d2/f3a 916 1 2024-03-22T07:28:33.536 INFO:tasks.workunit.client.0.smithi134.stdout:0/310: sync 2024-03-22T07:28:33.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/447: getdents d5/d16/d45/d53/d59 0 2024-03-22T07:28:33.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/448: dread - d5/d16/d5a/f8d zero size 2024-03-22T07:28:33.542 INFO:tasks.workunit.client.0.smithi134.stdout:2/236: unlink d2/d5/d8/d31/l3f 0 2024-03-22T07:28:33.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/503: write d9/d2d/f67 [4448777,59486] 0 2024-03-22T07:28:33.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/319: dwrite d5/f4d [0,4194304] 0 2024-03-22T07:28:33.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/320: creat d5/d1d/d49/f70 x:0 0 0 2024-03-22T07:28:33.546 INFO:tasks.workunit.client.0.smithi134.stdout:0/311: unlink dc/d18/f45 0 2024-03-22T07:28:33.548 INFO:tasks.workunit.client.1.smithi195.stdout:0/496: mkdir d1/d4/dd/df/d44/d8d 0 2024-03-22T07:28:33.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/449: dwrite d5/d16/f48 [0,4194304] 0 2024-03-22T07:28:33.559 INFO:tasks.workunit.client.1.smithi195.stdout:1/381: dwrite d0/d2/d6/d21/d39/d64/d7a/f57 [0,4194304] 0 2024-03-22T07:28:33.559 INFO:tasks.workunit.client.0.smithi134.stdout:2/237: dread d2/d5/fc [0,4194304] 0 2024-03-22T07:28:33.560 INFO:tasks.workunit.client.1.smithi195.stdout:7/436: unlink d0/d13/d14/d29/d35/d3a/f61 0 2024-03-22T07:28:33.562 INFO:tasks.workunit.client.0.smithi134.stdout:0/312: dread dc/d18/f1a [0,4194304] 0 2024-03-22T07:28:33.562 INFO:tasks.workunit.client.0.smithi134.stdout:0/313: dread - dc/f3e zero size 2024-03-22T07:28:33.562 INFO:tasks.workunit.client.0.smithi134.stdout:8/377: dwrite d1/d15/f19 [0,4194304] 0 2024-03-22T07:28:33.564 INFO:tasks.workunit.client.0.smithi134.stdout:7/477: dwrite d1/de/d11/d48/f6b [0,4194304] 0 2024-03-22T07:28:33.565 INFO:tasks.workunit.client.1.smithi195.stdout:6/450: rename d5/d5e/d34/d55/d3b/d6e/fd to d5/d16/d45/fa4 0 2024-03-22T07:28:33.565 INFO:tasks.workunit.client.1.smithi195.stdout:7/437: rename d0 to d0/d13/d22/d57/d94 22 2024-03-22T07:28:33.565 INFO:tasks.workunit.client.1.smithi195.stdout:7/438: chown d0/d13/d22/c31 37956066 1 2024-03-22T07:28:33.565 INFO:tasks.workunit.client.1.smithi195.stdout:6/451: write d5/d5e/f33 [4856039,87868] 0 2024-03-22T07:28:33.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/238: mknod d2/c41 0 2024-03-22T07:28:33.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/239: dread - d2/d5/d8/f33 zero size 2024-03-22T07:28:33.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/240: fdatasync d2/f1a 0 2024-03-22T07:28:33.568 INFO:tasks.workunit.client.0.smithi134.stdout:0/314: link lb dc/d17/l5c 0 2024-03-22T07:28:33.568 INFO:tasks.workunit.client.0.smithi134.stdout:0/315: fdatasync dc/f32 0 2024-03-22T07:28:33.568 INFO:tasks.workunit.client.0.smithi134.stdout:0/316: chown dc/d18/l4d 0 1 2024-03-22T07:28:33.569 INFO:tasks.workunit.client.1.smithi195.stdout:7/439: creat d0/d13/d14/d29/d35/d3a/d7e/f95 x:0 0 0 2024-03-22T07:28:33.569 INFO:tasks.workunit.client.1.smithi195.stdout:7/440: stat d0/d13/d14/d20/d40 0 2024-03-22T07:28:33.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/441: mkdir d0/d13/d14/d96 0 2024-03-22T07:28:33.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/442: stat d0/d13/d14/d20/d40/c51 0 2024-03-22T07:28:33.572 INFO:tasks.workunit.client.0.smithi134.stdout:7/478: mknod d1/de/d11/d97/c9a 0 2024-03-22T07:28:33.573 INFO:tasks.workunit.client.0.smithi134.stdout:7/479: stat d1/f33 0 2024-03-22T07:28:33.573 INFO:tasks.workunit.client.0.smithi134.stdout:2/241: rmdir d2/d5/d8/d2c 39 2024-03-22T07:28:33.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/443: mkdir d0/d13/d14/d29/d35/d3a/d97 0 2024-03-22T07:28:33.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/444: truncate d0/d13/d22/d57/d7b/d8c/f92 255136 0 2024-03-22T07:28:33.575 INFO:tasks.workunit.client.0.smithi134.stdout:0/317: truncate dc/d17/f41 4100641 0 2024-03-22T07:28:33.575 INFO:tasks.workunit.client.0.smithi134.stdout:0/318: truncate dc/f1f 1671390 0 2024-03-22T07:28:33.575 INFO:tasks.workunit.client.0.smithi134.stdout:7/480: dread d1/de/d11/d48/fc [0,4194304] 0 2024-03-22T07:28:33.575 INFO:tasks.workunit.client.1.smithi195.stdout:7/445: mkdir d0/d98 0 2024-03-22T07:28:33.575 INFO:tasks.workunit.client.1.smithi195.stdout:7/446: chown d0/d13/d14/d2b/l66 560765319 1 2024-03-22T07:28:33.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/319: truncate dc/d18/f2f 810225 0 2024-03-22T07:28:33.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/320: stat dc/d18/f2e 0 2024-03-22T07:28:33.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/321: chown dc/d17/l5c 0 1 2024-03-22T07:28:33.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/242: dread d2/d5/d8/f1b [0,4194304] 0 2024-03-22T07:28:33.577 INFO:tasks.workunit.client.0.smithi134.stdout:7/481: mknod d1/d19/d32/c9b 0 2024-03-22T07:28:33.578 INFO:tasks.workunit.client.1.smithi195.stdout:7/447: creat d0/d13/d14/d29/d35/d6d/f99 x:0 0 0 2024-03-22T07:28:33.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/243: creat d2/d5/d8/f42 x:0 0 0 2024-03-22T07:28:33.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/244: chown d2/l16 5383396 1 2024-03-22T07:28:33.579 INFO:tasks.workunit.client.0.smithi134.stdout:2/245: chown d2/d5/d8/f33 42576 1 2024-03-22T07:28:33.579 INFO:tasks.workunit.client.0.smithi134.stdout:7/482: mkdir d1/d19/d9c 0 2024-03-22T07:28:33.580 INFO:tasks.workunit.client.1.smithi195.stdout:1/382: write d0/d2/d6/d21/d39/d64/d7a/f57 [1863708,106221] 0 2024-03-22T07:28:33.580 INFO:tasks.workunit.client.1.smithi195.stdout:1/383: chown d0/d70 27809 1 2024-03-22T07:28:33.582 INFO:tasks.workunit.client.0.smithi134.stdout:2/246: symlink d2/d5/d8/d31/l43 0 2024-03-22T07:28:33.582 INFO:tasks.workunit.client.0.smithi134.stdout:2/247: chown d2/d5/d8/d2c/d3c/c3d 248 1 2024-03-22T07:28:33.582 INFO:tasks.workunit.client.0.smithi134.stdout:2/248: dread - d2/f3a zero size 2024-03-22T07:28:33.582 INFO:tasks.workunit.client.1.smithi195.stdout:8/529: dwrite da/dc/f12 [0,4194304] 0 2024-03-22T07:28:33.582 INFO:tasks.workunit.client.1.smithi195.stdout:8/530: chown l0 179 1 2024-03-22T07:28:33.584 INFO:tasks.workunit.client.0.smithi134.stdout:2/249: symlink d2/l44 0 2024-03-22T07:28:33.588 INFO:tasks.workunit.client.0.smithi134.stdout:2/250: truncate d2/f1c 5051997 0 2024-03-22T07:28:33.591 INFO:tasks.workunit.client.0.smithi134.stdout:2/251: mknod d2/d5/d8/d2c/c45 0 2024-03-22T07:28:33.592 INFO:tasks.workunit.client.0.smithi134.stdout:1/321: dwrite d5/fc [0,4194304] 0 2024-03-22T07:28:33.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/452: dread d5/d5e/d34/d55/f2e [0,4194304] 0 2024-03-22T07:28:33.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/322: link d5/d1d/d49/c65 d5/da/d1b/d27/d39/c71 0 2024-03-22T07:28:33.595 INFO:tasks.workunit.client.0.smithi134.stdout:2/252: dread d2/f1a [0,4194304] 0 2024-03-22T07:28:33.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/323: mkdir d5/da/d1b/d27/d60/d72 0 2024-03-22T07:28:33.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/324: truncate d5/da/d1b/d27/d39/f58 812438 0 2024-03-22T07:28:33.595 INFO:tasks.workunit.client.0.smithi134.stdout:1/325: write d5/da/d13/d1e/d34/f5f [1011965,31556] 0 2024-03-22T07:28:33.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/326: symlink d5/da/d1b/d27/d39/l73 0 2024-03-22T07:28:33.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/327: write d5/da/f21 [4201159,130629] 0 2024-03-22T07:28:33.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/328: chown d5/f9 2523 1 2024-03-22T07:28:33.602 INFO:tasks.workunit.client.1.smithi195.stdout:1/384: dread d0/d2/fe [0,4194304] 0 2024-03-22T07:28:33.602 INFO:tasks.workunit.client.1.smithi195.stdout:1/385: dread - d0/d2/d6/d21/d39/d40/f43 zero size 2024-03-22T07:28:33.603 INFO:tasks.workunit.client.1.smithi195.stdout:1/386: getdents d0/d2/d6/d21/d41 0 2024-03-22T07:28:33.603 INFO:tasks.workunit.client.1.smithi195.stdout:1/387: creat d0/d2/d9/f81 x:0 0 0 2024-03-22T07:28:33.607 INFO:tasks.workunit.client.1.smithi195.stdout:5/504: dwrite d9/d12/d14/f17 [0,4194304] 0 2024-03-22T07:28:33.607 INFO:tasks.workunit.client.1.smithi195.stdout:5/505: write d9/f6f [685349,21200] 0 2024-03-22T07:28:33.608 INFO:tasks.workunit.client.1.smithi195.stdout:0/497: dwrite d1/d10/d19/d20/f3c [0,4194304] 0 2024-03-22T07:28:33.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/506: dread d9/d2d/f40 [0,4194304] 0 2024-03-22T07:28:33.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/507: fdatasync d9/d12/f52 0 2024-03-22T07:28:33.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/508: truncate d9/d73/da1/f3c 4602031 0 2024-03-22T07:28:33.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/509: write d9/d22/d46/f85 [548235,77611] 0 2024-03-22T07:28:33.613 INFO:tasks.workunit.client.1.smithi195.stdout:5/510: getdents d9/da8 0 2024-03-22T07:28:33.615 INFO:tasks.workunit.client.0.smithi134.stdout:0/322: dwrite dc/d17/f38 [0,4194304] 0 2024-03-22T07:28:33.617 INFO:tasks.workunit.client.1.smithi195.stdout:6/453: dread f4 [0,4194304] 0 2024-03-22T07:28:33.617 INFO:tasks.workunit.client.1.smithi195.stdout:7/448: dwrite d0/d13/d22/d57/d7b/d8c/f90 [0,4194304] 0 2024-03-22T07:28:33.619 INFO:tasks.workunit.client.0.smithi134.stdout:0/323: symlink dc/d17/l5d 0 2024-03-22T07:28:33.621 INFO:tasks.workunit.client.1.smithi195.stdout:7/449: dread d0/d13/f1c [0,4194304] 0 2024-03-22T07:28:33.623 INFO:tasks.workunit.client.1.smithi195.stdout:6/454: mknod d5/d16/d45/d53/d59/ca5 0 2024-03-22T07:28:33.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/450: creat d0/d13/d14/d29/d35/d3a/f9a x:0 0 0 2024-03-22T07:28:33.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/451: write d0/d13/d14/d2b/f42 [935793,61669] 0 2024-03-22T07:28:33.635 INFO:tasks.workunit.client.0.smithi134.stdout:1/329: dwrite d5/f20 [0,4194304] 0 2024-03-22T07:28:33.635 INFO:tasks.workunit.client.0.smithi134.stdout:2/253: dwrite d2/d5/d8/f2f [0,4194304] 0 2024-03-22T07:28:33.636 INFO:tasks.workunit.client.1.smithi195.stdout:1/388: dwrite d0/d2/d6/f4b [0,4194304] 0 2024-03-22T07:28:33.638 INFO:tasks.workunit.client.0.smithi134.stdout:7/483: dwrite f0 [0,4194304] 0 2024-03-22T07:28:33.639 INFO:tasks.workunit.client.1.smithi195.stdout:5/511: dwrite d9/d12/d1d/d69/d78/f97 [0,4194304] 0 2024-03-22T07:28:33.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/324: dwrite dc/d18/f5a [0,4194304] 0 2024-03-22T07:28:33.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/325: read - dc/de/f35 zero size 2024-03-22T07:28:33.640 INFO:tasks.workunit.client.0.smithi134.stdout:7/484: dread d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:33.640 INFO:tasks.workunit.client.0.smithi134.stdout:1/330: rename d5/da/d13/d1e/l48 to d5/d1d/l74 0 2024-03-22T07:28:33.640 INFO:tasks.workunit.client.0.smithi134.stdout:1/331: write d5/da/d1b/f5d [675362,88795] 0 2024-03-22T07:28:33.647 INFO:tasks.workunit.client.0.smithi134.stdout:2/254: creat d2/d5/d8/d31/f46 x:0 0 0 2024-03-22T07:28:33.648 INFO:tasks.workunit.client.0.smithi134.stdout:0/326: write dc/d18/f5a [1467046,93578] 0 2024-03-22T07:28:33.648 INFO:tasks.workunit.client.0.smithi134.stdout:0/327: creat dc/d18/f5e x:0 0 0 2024-03-22T07:28:33.648 INFO:tasks.workunit.client.1.smithi195.stdout:8/531: truncate da/de/f2d 854540 0 2024-03-22T07:28:33.653 INFO:tasks.workunit.client.0.smithi134.stdout:2/255: dread d2/f14 [0,4194304] 0 2024-03-22T07:28:33.653 INFO:tasks.workunit.client.0.smithi134.stdout:2/256: write d2/f3e [3150,16927] 0 2024-03-22T07:28:33.653 INFO:tasks.workunit.client.0.smithi134.stdout:2/257: chown d2/d5/d8/f42 2 1 2024-03-22T07:28:33.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/532: dread da/dc/f7b [0,4194304] 0 2024-03-22T07:28:33.653 INFO:tasks.workunit.client.1.smithi195.stdout:8/533: write da/d17/d32/d7d/d8e/fa3 [818144,21051] 0 2024-03-22T07:28:33.654 INFO:tasks.workunit.client.1.smithi195.stdout:6/455: creat d5/d5e/d34/fa6 x:0 0 0 2024-03-22T07:28:33.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/485: dwrite d1/de/d11/d2b/d31/d85/f93 [0,4194304] 0 2024-03-22T07:28:33.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/486: fdatasync d1/de/d11/d2b/d69/f8c 0 2024-03-22T07:28:33.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/487: write d1/de/d11/d2b/d69/f6c [66974,114685] 0 2024-03-22T07:28:33.657 INFO:tasks.workunit.client.1.smithi195.stdout:7/452: link d0/d13/d22/d52/d59/f7c d0/d13/d14/d2b/f9b 0 2024-03-22T07:28:33.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/332: creat d5/d1d/f75 x:0 0 0 2024-03-22T07:28:33.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/333: creat d5/d1d/f76 x:0 0 0 2024-03-22T07:28:33.660 INFO:tasks.workunit.client.0.smithi134.stdout:1/334: truncate d5/da/d13/f6c 358773 0 2024-03-22T07:28:33.665 INFO:tasks.workunit.client.1.smithi195.stdout:1/389: unlink d0/d2/d9/d2a/f5b 0 2024-03-22T07:28:33.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/335: dread d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:33.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/336: dread - d5/da/d13/d1e/d34/f59 zero size 2024-03-22T07:28:33.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/337: write d5/da/d13/d1e/f22 [211722,125498] 0 2024-03-22T07:28:33.672 INFO:tasks.workunit.client.0.smithi134.stdout:2/258: rename d2/d5/d22/f25 to d2/d5/d8/d2c/d3c/f47 0 2024-03-22T07:28:33.674 INFO:tasks.workunit.client.0.smithi134.stdout:6/250: sync 2024-03-22T07:28:33.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/286: sync 2024-03-22T07:28:33.677 INFO:tasks.workunit.client.1.smithi195.stdout:5/512: creat d9/d73/da1/d5f/fac x:0 0 0 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:5/513: dread d9/d12/f3d [0,4194304] 0 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:5/514: chown f0 949851 1 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:5/515: chown d9/d12/d1d/d36/c8b 0 1 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:5/516: write d9/d22/d46/f88 [4514694,5287] 0 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:5/517: chown d9/d2d/d84/f9d 97 1 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:8/534: mkdir da/dc/da4 0 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:8/535: read da/d82/f9c [984940,106956] 0 2024-03-22T07:28:33.679 INFO:tasks.workunit.client.1.smithi195.stdout:8/536: dread - da/dc/f6e zero size 2024-03-22T07:28:33.680 INFO:tasks.workunit.client.0.smithi134.stdout:2/259: dread d2/d5/fc [0,4194304] 0 2024-03-22T07:28:33.680 INFO:tasks.workunit.client.1.smithi195.stdout:6/456: symlink d5/d5e/d34/d55/d4b/da2/la7 0 2024-03-22T07:28:33.683 INFO:tasks.workunit.client.1.smithi195.stdout:7/453: mkdir d0/d13/d14/d80/d9c 0 2024-03-22T07:28:33.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/390: rename d0/d2/l29 to d0/d2/d6/d21/d41/d47/d4a/d66/l82 0 2024-03-22T07:28:33.689 INFO:tasks.workunit.client.1.smithi195.stdout:5/518: mknod d9/d22/cad 0 2024-03-22T07:28:33.692 INFO:tasks.workunit.client.1.smithi195.stdout:8/537: symlink da/d17/d32/d61/d47/d53/d8d/la5 0 2024-03-22T07:28:33.692 INFO:tasks.workunit.client.1.smithi195.stdout:8/538: write da/d82/f9c [663881,111107] 0 2024-03-22T07:28:33.692 INFO:tasks.workunit.client.1.smithi195.stdout:7/454: read d0/d13/d22/f23 [2623874,121808] 0 2024-03-22T07:28:33.692 INFO:tasks.workunit.client.1.smithi195.stdout:7/455: chown d0/d13/d14/d29/d35/d3a/l75 185184 1 2024-03-22T07:28:33.692 INFO:tasks.workunit.client.1.smithi195.stdout:7/456: creat d0/d13/d14/d2b/f9d x:0 0 0 2024-03-22T07:28:33.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/287: dwrite d1/d8/d3f/f41 [0,4194304] 0 2024-03-22T07:28:33.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/288: fdatasync d1/d13/f18 0 2024-03-22T07:28:33.694 INFO:tasks.workunit.client.1.smithi195.stdout:1/391: dread d0/d2/d9/f61 [0,4194304] 0 2024-03-22T07:28:33.694 INFO:tasks.workunit.client.1.smithi195.stdout:1/392: read d0/d2/d6/d21/d39/f65 [908156,116131] 0 2024-03-22T07:28:33.694 INFO:tasks.workunit.client.1.smithi195.stdout:1/393: creat d0/d2/d6/d21/d41/d47/d4a/f83 x:0 0 0 2024-03-22T07:28:33.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/457: creat d5/d5e/d34/d55/d3b/d6e/d56/d8f/fa8 x:0 0 0 2024-03-22T07:28:33.695 INFO:tasks.workunit.client.0.smithi134.stdout:6/251: symlink d2/d1b/d1d/l5f 0 2024-03-22T07:28:33.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/519: rename d9/d12/d1d/d36/d7d/la4 to d9/daa/lae 0 2024-03-22T07:28:33.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/260: mknod d2/d5/d8/d2c/d3c/c48 0 2024-03-22T07:28:33.702 INFO:tasks.workunit.client.1.smithi195.stdout:8/539: truncate da/d17/d32/d61/d47/d53/f96 293182 0 2024-03-22T07:28:33.708 INFO:tasks.workunit.client.1.smithi195.stdout:7/457: link d0/d13/d22/d52/f5e d0/d13/d22/d52/d59/f9e 0 2024-03-22T07:28:33.714 INFO:tasks.workunit.client.1.smithi195.stdout:1/394: rmdir d0/d2/d6/d21 39 2024-03-22T07:28:33.716 INFO:tasks.workunit.client.0.smithi134.stdout:6/252: getdents d2 0 2024-03-22T07:28:33.722 INFO:tasks.workunit.client.1.smithi195.stdout:8/540: creat da/dc/fa6 x:0 0 0 2024-03-22T07:28:33.726 INFO:tasks.workunit.client.0.smithi134.stdout:2/261: dwrite d2/f14 [0,4194304] 0 2024-03-22T07:28:33.726 INFO:tasks.workunit.client.0.smithi134.stdout:2/262: creat d2/f49 x:0 0 0 2024-03-22T07:28:33.726 INFO:tasks.workunit.client.1.smithi195.stdout:7/458: rename d0/d13/d14/f4a to d0/d13/d22/d52/f9f 0 2024-03-22T07:28:33.727 INFO:tasks.workunit.client.1.smithi195.stdout:6/458: dwrite d5/d16/d5a/f8d [0,4194304] 0 2024-03-22T07:28:33.727 INFO:tasks.workunit.client.1.smithi195.stdout:6/459: stat d5/d16/d45/d53/d59/ca5 0 2024-03-22T07:28:33.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/460: write d5/d16/d45/d53/f62 [384079,33711] 0 2024-03-22T07:28:33.731 INFO:tasks.workunit.client.0.smithi134.stdout:2/263: link d2/d5/lf d2/d5/l4a 0 2024-03-22T07:28:33.732 INFO:tasks.workunit.client.0.smithi134.stdout:6/253: dwrite d2/d1b/f2f [0,4194304] 0 2024-03-22T07:28:33.733 INFO:tasks.workunit.client.0.smithi134.stdout:6/254: chown d2/l3b 103307 1 2024-03-22T07:28:33.735 INFO:tasks.workunit.client.0.smithi134.stdout:2/264: creat d2/d5/d8/d2c/f4b x:0 0 0 2024-03-22T07:28:33.735 INFO:tasks.workunit.client.0.smithi134.stdout:2/265: write d2/d5/d22/f23 [2174487,95808] 0 2024-03-22T07:28:33.742 INFO:tasks.workunit.client.0.smithi134.stdout:6/255: mknod d2/d1b/d1d/c60 0 2024-03-22T07:28:33.745 INFO:tasks.workunit.client.1.smithi195.stdout:8/541: dwrite da/d17/d32/d61/f73 [0,4194304] 0 2024-03-22T07:28:33.746 INFO:tasks.workunit.client.0.smithi134.stdout:2/266: dread d2/d5/d8/f2f [0,4194304] 0 2024-03-22T07:28:33.750 INFO:tasks.workunit.client.1.smithi195.stdout:8/542: link da/d17/l9b da/d17/d32/d61/d47/d53/d8d/la7 0 2024-03-22T07:28:33.750 INFO:tasks.workunit.client.1.smithi195.stdout:8/543: stat da/de/f5b 0 2024-03-22T07:28:33.754 INFO:tasks.workunit.client.1.smithi195.stdout:7/459: dwrite d0/d13/d22/f23 [0,4194304] 0 2024-03-22T07:28:33.756 INFO:tasks.workunit.client.1.smithi195.stdout:8/544: stat da/d17/l9b 0 2024-03-22T07:28:33.758 INFO:tasks.workunit.client.1.smithi195.stdout:6/461: dwrite d5/d5e/d34/d55/d4b/da2/f91 [0,4194304] 0 2024-03-22T07:28:33.758 INFO:tasks.workunit.client.1.smithi195.stdout:6/462: stat d5/d5e/f33 0 2024-03-22T07:28:33.769 INFO:tasks.workunit.client.0.smithi134.stdout:9/256: sync 2024-03-22T07:28:33.769 INFO:tasks.workunit.client.0.smithi134.stdout:4/343: sync 2024-03-22T07:28:33.770 INFO:tasks.workunit.client.0.smithi134.stdout:4/344: chown d2/d15/d6f 17578196 1 2024-03-22T07:28:33.770 INFO:tasks.workunit.client.0.smithi134.stdout:4/345: chown d2/d25/c22 18456560 1 2024-03-22T07:28:33.772 INFO:tasks.workunit.client.0.smithi134.stdout:4/346: mkdir d2/d25/d74 0 2024-03-22T07:28:33.772 INFO:tasks.workunit.client.0.smithi134.stdout:4/347: chown d2/l4a 29 1 2024-03-22T07:28:33.773 INFO:tasks.workunit.client.0.smithi134.stdout:4/348: truncate d2/d25/f3e 694421 0 2024-03-22T07:28:33.775 INFO:tasks.workunit.client.0.smithi134.stdout:2/267: dwrite d2/f1c [0,4194304] 0 2024-03-22T07:28:33.775 INFO:tasks.workunit.client.0.smithi134.stdout:2/268: creat d2/f4c x:0 0 0 2024-03-22T07:28:33.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/349: read d2/d15/f30 [458122,52802] 0 2024-03-22T07:28:33.776 INFO:tasks.workunit.client.0.smithi134.stdout:4/350: chown d2/d15/l10 1356100 1 2024-03-22T07:28:33.778 INFO:tasks.workunit.client.0.smithi134.stdout:2/269: unlink d2/d5/c29 0 2024-03-22T07:28:33.780 INFO:tasks.workunit.client.0.smithi134.stdout:4/351: creat d2/d25/d74/f75 x:0 0 0 2024-03-22T07:28:33.784 INFO:tasks.workunit.client.0.smithi134.stdout:9/257: dread d3/d9/f36 [0,4194304] 0 2024-03-22T07:28:33.786 INFO:tasks.workunit.client.0.smithi134.stdout:9/258: write d3/d9/df/d12/f16 [812329,33643] 0 2024-03-22T07:28:33.787 INFO:tasks.workunit.client.1.smithi195.stdout:9/628: sync 2024-03-22T07:28:33.788 INFO:tasks.workunit.client.0.smithi134.stdout:2/270: dread d2/d5/d22/f24 [0,4194304] 0 2024-03-22T07:28:33.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/545: dwrite da/d17/d32/f58 [0,4194304] 0 2024-03-22T07:28:33.788 INFO:tasks.workunit.client.1.smithi195.stdout:8/546: creat da/d17/d32/d61/d88/d91/fa8 x:0 0 0 2024-03-22T07:28:33.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/547: fsync da/d17/d32/d61/d47/d53/f8f 0 2024-03-22T07:28:33.789 INFO:tasks.workunit.client.0.smithi134.stdout:4/352: dread f1 [0,4194304] 0 2024-03-22T07:28:33.790 INFO:tasks.workunit.client.1.smithi195.stdout:7/460: dwrite d0/f25 [0,4194304] 0 2024-03-22T07:28:33.791 INFO:tasks.workunit.client.0.smithi134.stdout:6/256: rmdir d2/d1b 39 2024-03-22T07:28:33.793 INFO:tasks.workunit.client.1.smithi195.stdout:6/463: dwrite d5/d5e/d34/d55/d4b/da2/f2a [0,4194304] 0 2024-03-22T07:28:33.800 INFO:tasks.workunit.client.0.smithi134.stdout:6/257: dread d2/f35 [0,4194304] 0 2024-03-22T07:28:33.800 INFO:tasks.workunit.client.0.smithi134.stdout:6/258: fsync d2/d1b/d4d/f54 0 2024-03-22T07:28:33.800 INFO:tasks.workunit.client.0.smithi134.stdout:6/259: write d2/f2e [846405,110396] 0 2024-03-22T07:28:33.802 INFO:tasks.workunit.client.1.smithi195.stdout:9/629: dwrite d2/d4/d32/d6d/d78/d79/f99 [0,4194304] 0 2024-03-22T07:28:33.890 INFO:tasks.workunit.client.0.smithi134.stdout:4/353: mkdir d2/d15/d35/d37/d76 0 2024-03-22T07:28:33.892 INFO:tasks.workunit.client.1.smithi195.stdout:8/548: rename da/d17/d32/d78/c79 to da/d17/d32/d7d/ca9 0 2024-03-22T07:28:33.894 INFO:tasks.workunit.client.0.smithi134.stdout:4/354: dread d2/fd [0,4194304] 0 2024-03-22T07:28:33.902 INFO:tasks.workunit.client.1.smithi195.stdout:8/549: dread da/d17/d32/d61/f73 [0,4194304] 0 2024-03-22T07:28:33.902 INFO:tasks.workunit.client.1.smithi195.stdout:8/550: truncate da/f4f 4222878 0 2024-03-22T07:28:33.904 INFO:tasks.workunit.client.0.smithi134.stdout:6/260: creat d2/d3f/f61 x:0 0 0 2024-03-22T07:28:33.904 INFO:tasks.workunit.client.0.smithi134.stdout:6/261: write d2/d1b/d4d/f54 [308980,67247] 0 2024-03-22T07:28:33.916 INFO:tasks.workunit.client.1.smithi195.stdout:8/551: dwrite da/d17/d32/f40 [0,4194304] 0 2024-03-22T07:28:33.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/552: dread da/de/f45 [0,4194304] 0 2024-03-22T07:28:33.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/553: stat da/f4f 0 2024-03-22T07:28:33.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/554: fsync da/d17/d32/f40 0 2024-03-22T07:28:33.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/555: chown l0 0 1 2024-03-22T07:28:33.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/556: chown da/d17/d32/d61/d47/l51 15 1 2024-03-22T07:28:33.933 INFO:tasks.workunit.client.1.smithi195.stdout:8/557: dwrite da/f6b [0,4194304] 0 2024-03-22T07:28:34.019 INFO:tasks.workunit.client.1.smithi195.stdout:9/630: mknod d2/d4/d6/d18/d50/ce5 0 2024-03-22T07:28:34.019 INFO:tasks.workunit.client.1.smithi195.stdout:9/631: creat d2/d4/d1d/ddc/fe6 x:0 0 0 2024-03-22T07:28:34.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/447: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:5/520: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:3/511: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:0/498: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:5/521: stat d9/d12/d14 0 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:2/448: fsync d2/d17/f7b 0 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:2/449: chown d2/d3/d7/d19/l59 977569 1 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:3/512: write d3/df/d15/d1d/f7e [422608,83554] 0 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:3/513: chown d3/df/d15/d1d/c45 230806 1 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:3/514: write d3/df/d15/d1d/f56 [423694,2315] 0 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:1/395: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:6/464: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/479: sync 2024-03-22T07:28:34.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/480: read - d13/d63/d79/f8f zero size 2024-03-22T07:28:34.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/450: creat d2/d3/d7/da/d4e/f8d x:0 0 0 2024-03-22T07:28:34.041 INFO:tasks.workunit.client.1.smithi195.stdout:3/515: symlink d3/df/d50/lae 0 2024-03-22T07:28:34.047 INFO:tasks.workunit.client.1.smithi195.stdout:4/481: truncate f12 1984155 0 2024-03-22T07:28:34.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/516: rmdir d3/d18/d89 39 2024-03-22T07:28:34.053 INFO:tasks.workunit.client.1.smithi195.stdout:4/482: mkdir d13/d63/d3e/d5c/da8 0 2024-03-22T07:28:34.053 INFO:tasks.workunit.client.1.smithi195.stdout:3/517: mknod d3/d18/d89/d8c/d9d/caf 0 2024-03-22T07:28:34.054 INFO:tasks.workunit.client.1.smithi195.stdout:2/451: dread d2/d3/f31 [0,4194304] 0 2024-03-22T07:28:34.054 INFO:tasks.workunit.client.1.smithi195.stdout:3/518: write d3/df/d15/d1d/d5c/d47/f4d [5071241,31804] 0 2024-03-22T07:28:34.055 INFO:tasks.workunit.client.1.smithi195.stdout:2/452: mkdir d2/d3/d7/d5c/d8e 0 2024-03-22T07:28:34.055 INFO:tasks.workunit.client.1.smithi195.stdout:2/453: read - d2/d3/d7/da/de/f65 zero size 2024-03-22T07:28:34.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/454: symlink d2/d3/d1a/l8f 0 2024-03-22T07:28:34.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/455: write d2/d3/d1a/f3a [890414,76286] 0 2024-03-22T07:28:34.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/456: dread - d2/d3/d1a/f50 zero size 2024-03-22T07:28:34.056 INFO:tasks.workunit.client.1.smithi195.stdout:2/457: write d2/d3/d7/da/de/f65 [62374,35668] 0 2024-03-22T07:28:34.057 INFO:tasks.workunit.client.1.smithi195.stdout:2/458: write d2/d3/d7/da/d1b/f29 [663168,23455] 0 2024-03-22T07:28:34.057 INFO:tasks.workunit.client.1.smithi195.stdout:0/499: dwrite d1/d10/d19/d20/f4f [0,4194304] 0 2024-03-22T07:28:34.058 INFO:tasks.workunit.client.1.smithi195.stdout:0/500: write d1/d4/dd/df/d2b/d63/d85/f86 [98240,107466] 0 2024-03-22T07:28:34.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/459: creat d2/d3/d21/d60/d7c/f90 x:0 0 0 2024-03-22T07:28:34.064 INFO:tasks.workunit.client.1.smithi195.stdout:2/460: mknod d2/d17/c91 0 2024-03-22T07:28:34.066 INFO:tasks.workunit.client.1.smithi195.stdout:2/461: symlink d2/d3/d21/d40/l92 0 2024-03-22T07:28:34.066 INFO:tasks.workunit.client.1.smithi195.stdout:2/462: dread - d2/d3/d7/da/f72 zero size 2024-03-22T07:28:34.069 INFO:tasks.workunit.client.1.smithi195.stdout:2/463: mkdir d2/d1e/d93 0 2024-03-22T07:28:34.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/519: dwrite f0 [0,4194304] 0 2024-03-22T07:28:34.078 INFO:tasks.workunit.client.1.smithi195.stdout:3/520: chown d3/d98 766952791 1 2024-03-22T07:28:34.081 INFO:tasks.workunit.client.1.smithi195.stdout:0/501: dwrite d1/d4/d12/f2d [0,4194304] 0 2024-03-22T07:28:34.087 INFO:tasks.workunit.client.1.smithi195.stdout:2/464: rmdir d2/d3/d7/da 39 2024-03-22T07:28:34.088 INFO:tasks.workunit.client.1.smithi195.stdout:2/465: link d2/d3/l11 d2/d3/d7/da/d4e/l94 0 2024-03-22T07:28:34.090 INFO:tasks.workunit.client.1.smithi195.stdout:0/502: dread d1/d10/d19/d20/f4f [0,4194304] 0 2024-03-22T07:28:34.099 INFO:tasks.workunit.client.1.smithi195.stdout:0/503: write d1/d10/d19/f65 [944606,74731] 0 2024-03-22T07:28:34.100 INFO:tasks.workunit.client.1.smithi195.stdout:7/461: rename d0/d13/d22/d52 to d0/d13/d14/d20/d40/d82/da0 0 2024-03-22T07:28:34.102 INFO:tasks.workunit.client.1.smithi195.stdout:0/504: mknod d1/d4/dd/d66/c8e 0 2024-03-22T07:28:34.103 INFO:tasks.workunit.client.1.smithi195.stdout:0/505: write d1/d4/dd/df/d44/d6f/f71 [2781252,20484] 0 2024-03-22T07:28:34.104 INFO:tasks.workunit.client.1.smithi195.stdout:2/466: dwrite d2/d17/f7b [0,4194304] 0 2024-03-22T07:28:34.110 INFO:tasks.workunit.client.1.smithi195.stdout:8/558: creat da/d17/d32/d61/d47/faa x:0 0 0 2024-03-22T07:28:34.114 INFO:tasks.workunit.client.1.smithi195.stdout:0/506: creat d1/d4/dd/d66/d80/f8f x:0 0 0 2024-03-22T07:28:34.115 INFO:tasks.workunit.client.1.smithi195.stdout:7/462: symlink d0/d13/d14/d20/la1 0 2024-03-22T07:28:34.118 INFO:tasks.workunit.client.1.smithi195.stdout:8/559: getdents da/de 0 2024-03-22T07:28:34.121 INFO:tasks.workunit.client.1.smithi195.stdout:0/507: unlink d1/d10/d1f/d40/d47/c6e 0 2024-03-22T07:28:34.121 INFO:tasks.workunit.client.1.smithi195.stdout:0/508: chown d1/d4/dd/df/d6b/f81 534126 1 2024-03-22T07:28:34.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/463: write d0/f11 [738743,59123] 0 2024-03-22T07:28:34.122 INFO:tasks.workunit.client.1.smithi195.stdout:7/464: read - d0/d13/d14/d2b/f9d zero size 2024-03-22T07:28:34.123 INFO:tasks.workunit.client.1.smithi195.stdout:0/509: mknod d1/d4/dd/df/d67/c90 0 2024-03-22T07:28:34.124 INFO:tasks.workunit.client.1.smithi195.stdout:8/560: getdents da/d17/d32/d7d 0 2024-03-22T07:28:34.127 INFO:tasks.workunit.client.1.smithi195.stdout:0/510: link d1/d10/d19/d20/f4f d1/d4/dd/df/d44/d6f/f91 0 2024-03-22T07:28:34.128 INFO:tasks.workunit.client.1.smithi195.stdout:8/561: symlink da/d17/d32/d7d/d8e/lab 0 2024-03-22T07:28:34.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/511: mknod d1/d10/d1f/d40/d47/c92 0 2024-03-22T07:28:34.131 INFO:tasks.workunit.client.1.smithi195.stdout:0/512: dread d1/d10/d1f/d40/d43/f4c [0,4194304] 0 2024-03-22T07:28:34.132 INFO:tasks.workunit.client.1.smithi195.stdout:8/562: rename da/d17/d32/d61/d47/d53/l63 to da/d17/d32/d78/lac 0 2024-03-22T07:28:34.133 INFO:tasks.workunit.client.1.smithi195.stdout:8/563: readlink da/d17/l37 0 2024-03-22T07:28:34.134 INFO:tasks.workunit.client.1.smithi195.stdout:0/513: symlink d1/d10/d1f/d40/d43/l93 0 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/514: chown d1/d4/d42/l7a 140 1 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/515: truncate d1/d4/dd/d66/d80/f8f 1029452 0 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/516: chown d1/d4/dd/df/d67/c8a 6 1 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/517: chown d1/d4/dd/df/d44/d6f 20049 1 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/518: creat d1/d4/dd/df/d6b/f94 x:0 0 0 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:0/519: chown d1/d4/dd/df/d2b/d63 337285 1 2024-03-22T07:28:34.135 INFO:tasks.workunit.client.1.smithi195.stdout:8/564: dread f7 [0,4194304] 0 2024-03-22T07:28:34.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/565: chown da/d17/d32/d61/d88/c9e 130 1 2024-03-22T07:28:34.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/566: getdents da/d17/d32/d61 0 2024-03-22T07:28:34.138 INFO:tasks.workunit.client.1.smithi195.stdout:7/465: unlink d0/c6a 0 2024-03-22T07:28:34.141 INFO:tasks.workunit.client.1.smithi195.stdout:7/466: fsync d0/f11 0 2024-03-22T07:28:34.146 INFO:tasks.workunit.client.1.smithi195.stdout:2/467: link d2/f4d d2/d3/f95 0 2024-03-22T07:28:34.146 INFO:tasks.workunit.client.1.smithi195.stdout:2/468: chown d2/d3/d21/d60/d81/f84 14 1 2024-03-22T07:28:34.147 INFO:tasks.workunit.client.1.smithi195.stdout:2/469: symlink d2/d3/d7/d19/d22/l96 0 2024-03-22T07:28:34.150 INFO:tasks.workunit.client.1.smithi195.stdout:2/470: rename d2/l63 to d2/d3/d7/da/d4e/l97 0 2024-03-22T07:28:34.150 INFO:tasks.workunit.client.1.smithi195.stdout:2/471: truncate d2/d3/d21/d40/f5d 5111838 0 2024-03-22T07:28:34.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/520: dwrite d1/d10/d1f/d40/d43/f62 [0,4194304] 0 2024-03-22T07:28:34.151 INFO:tasks.workunit.client.1.smithi195.stdout:2/472: mkdir d2/d3/d7/da/d1b/d98 0 2024-03-22T07:28:34.156 INFO:tasks.workunit.client.1.smithi195.stdout:2/473: dread d2/d3/f31 [0,4194304] 0 2024-03-22T07:28:34.157 INFO:tasks.workunit.client.0.smithi134.stdout:2/271: rename d2/d5/fc to d2/d5/d8/d2c/f4d 0 2024-03-22T07:28:34.158 INFO:tasks.workunit.client.1.smithi195.stdout:2/474: rmdir d2/d3/d7/da 39 2024-03-22T07:28:34.162 INFO:tasks.workunit.client.0.smithi134.stdout:4/355: rename d2/d25/d48/d6e/f69 to d2/d1d/f77 0 2024-03-22T07:28:34.162 INFO:tasks.workunit.client.0.smithi134.stdout:6/262: rename d2/d3f/d28 to d2/d3f/d28/d62 22 2024-03-22T07:28:34.163 INFO:tasks.workunit.client.1.smithi195.stdout:2/475: mkdir d2/d3/d7/d19/d22/d26/d99 0 2024-03-22T07:28:34.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/263: mkdir d2/d1b/d1d/d5e/d63 0 2024-03-22T07:28:34.168 INFO:tasks.workunit.client.0.smithi134.stdout:4/356: read d2/d25/d48/f4b [1883453,64285] 0 2024-03-22T07:28:34.168 INFO:tasks.workunit.client.0.smithi134.stdout:6/264: link d2/d1b/d1d/d2b/f53 d2/d1b/d1d/d5e/d63/f64 0 2024-03-22T07:28:34.168 INFO:tasks.workunit.client.0.smithi134.stdout:6/265: chown d2/d1b/f45 1562 1 2024-03-22T07:28:34.169 INFO:tasks.workunit.client.0.smithi134.stdout:6/266: readlink d2/d3f/l49 0 2024-03-22T07:28:34.169 INFO:tasks.workunit.client.0.smithi134.stdout:6/267: dread - d2/d1b/f24 zero size 2024-03-22T07:28:34.171 INFO:tasks.workunit.client.0.smithi134.stdout:2/272: dwrite d2/d5/d8/d2c/f4b [0,4194304] 0 2024-03-22T07:28:34.172 INFO:tasks.workunit.client.0.smithi134.stdout:4/357: creat d2/d15/d35/f78 x:0 0 0 2024-03-22T07:28:34.175 INFO:tasks.workunit.client.1.smithi195.stdout:2/476: rename d2/d17 to d2/d3/d21/d60/d81/d9a 0 2024-03-22T07:28:34.175 INFO:tasks.workunit.client.1.smithi195.stdout:2/477: creat d2/d3/d21/d40/f9b x:0 0 0 2024-03-22T07:28:34.175 INFO:tasks.workunit.client.1.smithi195.stdout:2/478: fdatasync d2/d3/d21/d60/d7c/f90 0 2024-03-22T07:28:34.176 INFO:tasks.workunit.client.0.smithi134.stdout:6/268: mkdir d2/d1b/d4d/d65 0 2024-03-22T07:28:34.182 INFO:tasks.workunit.client.0.smithi134.stdout:4/358: read d2/d15/f61 [55386,120283] 0 2024-03-22T07:28:34.182 INFO:tasks.workunit.client.0.smithi134.stdout:4/359: chown d2/f46 86 1 2024-03-22T07:28:34.182 INFO:tasks.workunit.client.0.smithi134.stdout:4/360: readlink d2/d25/d48/l70 0 2024-03-22T07:28:34.182 INFO:tasks.workunit.client.0.smithi134.stdout:4/361: chown d2/d25/c6d 2 1 2024-03-22T07:28:34.182 INFO:tasks.workunit.client.1.smithi195.stdout:2/479: creat d2/d3/d21/d60/d81/d9a/f9c x:0 0 0 2024-03-22T07:28:34.184 INFO:tasks.workunit.client.0.smithi134.stdout:4/362: unlink d2/d25/f6a 0 2024-03-22T07:28:34.184 INFO:tasks.workunit.client.0.smithi134.stdout:4/363: chown d2/d25/d48/d6e/c56 10 1 2024-03-22T07:28:34.186 INFO:tasks.workunit.client.0.smithi134.stdout:2/273: dwrite d2/f3b [0,4194304] 0 2024-03-22T07:28:34.186 INFO:tasks.workunit.client.0.smithi134.stdout:2/274: fdatasync d2/d5/d22/f23 0 2024-03-22T07:28:34.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/480: creat d2/d3/d7/d19/f9d x:0 0 0 2024-03-22T07:28:34.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/481: chown d2/d3/d21/d60/d81/f84 9 1 2024-03-22T07:28:34.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/482: write d2/d3/d24/f67 [1390816,129310] 0 2024-03-22T07:28:34.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/483: write d2/f34 [26218,33267] 0 2024-03-22T07:28:34.187 INFO:tasks.workunit.client.1.smithi195.stdout:2/484: truncate d2/d3/d1a/f50 819731 0 2024-03-22T07:28:34.190 INFO:tasks.workunit.client.1.smithi195.stdout:8/567: rmdir da/d17/d32 39 2024-03-22T07:28:34.190 INFO:tasks.workunit.client.1.smithi195.stdout:8/568: write da/d17/d32/d61/d47/f87 [1405374,90247] 0 2024-03-22T07:28:34.190 INFO:tasks.workunit.client.1.smithi195.stdout:8/569: dread - da/d17/d32/d61/d47/d53/f8f zero size 2024-03-22T07:28:34.193 INFO:tasks.workunit.client.1.smithi195.stdout:7/467: mkdir d0/d13/d14/d29/da2 0 2024-03-22T07:28:34.195 INFO:tasks.workunit.client.1.smithi195.stdout:7/468: symlink d0/d13/d14/d29/d35/d6d/la3 0 2024-03-22T07:28:34.198 INFO:tasks.workunit.client.1.smithi195.stdout:1/396: creat d0/d2/d6/f84 x:0 0 0 2024-03-22T07:28:34.198 INFO:tasks.workunit.client.1.smithi195.stdout:1/397: fsync d0/d2/f2e 0 2024-03-22T07:28:34.198 INFO:tasks.workunit.client.1.smithi195.stdout:1/398: chown d0/d2/fe 122174 1 2024-03-22T07:28:34.199 INFO:tasks.workunit.client.1.smithi195.stdout:9/632: mknod d2/d4/d32/ce7 0 2024-03-22T07:28:34.200 INFO:tasks.workunit.client.1.smithi195.stdout:3/521: unlink d3/df/d15/d1d/c45 0 2024-03-22T07:28:34.200 INFO:tasks.workunit.client.1.smithi195.stdout:3/522: truncate d3/f84 84903 0 2024-03-22T07:28:34.203 INFO:tasks.workunit.client.1.smithi195.stdout:9/633: unlink d2/d4/d1d/d9b/fd2 0 2024-03-22T07:28:34.204 INFO:tasks.workunit.client.1.smithi195.stdout:6/465: mknod d5/d5e/d34/d55/ca9 0 2024-03-22T07:28:34.205 INFO:tasks.workunit.client.1.smithi195.stdout:3/523: symlink d3/d98/lb0 0 2024-03-22T07:28:34.209 INFO:tasks.workunit.client.1.smithi195.stdout:7/469: dread d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:34.209 INFO:tasks.workunit.client.1.smithi195.stdout:9/634: rename d2/d4/d1d/c25 to d2/d4/d6/db/d20/d4a/da2/ce8 0 2024-03-22T07:28:34.209 INFO:tasks.workunit.client.1.smithi195.stdout:9/635: truncate d2/d4/d6/db/d20/d4a/da2/fc4 1092816 0 2024-03-22T07:28:34.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/524: write d3/df/d15/d1d/f7e [355723,83610] 0 2024-03-22T07:28:34.209 INFO:tasks.workunit.client.1.smithi195.stdout:3/525: chown d3/f84 294 1 2024-03-22T07:28:34.210 INFO:tasks.workunit.client.0.smithi134.stdout:4/364: write d2/d15/f1e [1475703,88312] 0 2024-03-22T07:28:34.210 INFO:tasks.workunit.client.0.smithi134.stdout:6/269: dwrite d2/d1b/d1d/d2b/f46 [0,4194304] 0 2024-03-22T07:28:34.210 INFO:tasks.workunit.client.0.smithi134.stdout:4/365: dread - d2/d25/d48/f57 zero size 2024-03-22T07:28:34.210 INFO:tasks.workunit.client.0.smithi134.stdout:4/366: stat d2/f46 0 2024-03-22T07:28:34.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/636: rmdir d2/d4/d32 39 2024-03-22T07:28:34.215 INFO:tasks.workunit.client.1.smithi195.stdout:2/485: dwrite d2/d3/d7/d19/f28 [4194304,4194304] 0 2024-03-22T07:28:34.219 INFO:tasks.workunit.client.0.smithi134.stdout:6/270: creat d2/d1b/d1d/d5e/f66 x:0 0 0 2024-03-22T07:28:34.219 INFO:tasks.workunit.client.1.smithi195.stdout:9/637: symlink d2/d4/d32/d6d/d78/le9 0 2024-03-22T07:28:34.219 INFO:tasks.workunit.client.1.smithi195.stdout:9/638: getdents d2/d4/d6/db5/de3 0 2024-03-22T07:28:34.220 INFO:tasks.workunit.client.1.smithi195.stdout:8/570: dwrite da/d17/d32/d61/d47/d53/d8d/f92 [0,4194304] 0 2024-03-22T07:28:34.222 INFO:tasks.workunit.client.0.smithi134.stdout:2/275: dwrite d2/f28 [4194304,4194304] 0 2024-03-22T07:28:34.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/486: creat d2/d3/d7/d19/d22/d26/d3c/f9e x:0 0 0 2024-03-22T07:28:34.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/487: readlink d2/d3/d7/d19/d22/l77 0 2024-03-22T07:28:34.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/488: chown d2/d3/d21/d60/d7c 346643 1 2024-03-22T07:28:34.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/489: write d2/d3/d21/d60/d7c/f90 [428817,117417] 0 2024-03-22T07:28:34.224 INFO:tasks.workunit.client.1.smithi195.stdout:9/639: rename d2/d4/d6/db/f1f to d2/d4/d6/db/d20/d47/fea 0 2024-03-22T07:28:34.225 INFO:tasks.workunit.client.0.smithi134.stdout:4/367: dread d2/d15/f13 [0,4194304] 0 2024-03-22T07:28:34.236 INFO:tasks.workunit.client.0.smithi134.stdout:6/271: truncate d2/d3f/d28/f20 1088493 0 2024-03-22T07:28:34.238 INFO:tasks.workunit.client.1.smithi195.stdout:1/399: dwrite d0/d2/fe [4194304,4194304] 0 2024-03-22T07:28:34.238 INFO:tasks.workunit.client.1.smithi195.stdout:1/400: write d0/d2/fe [9343041,36656] 0 2024-03-22T07:28:34.238 INFO:tasks.workunit.client.1.smithi195.stdout:8/571: symlink da/d82/lad 0 2024-03-22T07:28:34.238 INFO:tasks.workunit.client.1.smithi195.stdout:8/572: dread - da/d17/d32/f7e zero size 2024-03-22T07:28:34.238 INFO:tasks.workunit.client.1.smithi195.stdout:8/573: stat da/d17/d32/d61/f74 0 2024-03-22T07:28:34.240 INFO:tasks.workunit.client.1.smithi195.stdout:9/640: mkdir d2/d4/d32/d6d/deb 0 2024-03-22T07:28:34.240 INFO:tasks.workunit.client.1.smithi195.stdout:7/470: dwrite d0/d13/d14/d20/d40/d82/da0/d59/f9e [4194304,4194304] 0 2024-03-22T07:28:34.247 INFO:tasks.workunit.client.1.smithi195.stdout:9/641: mkdir d2/d4/d32/d6d/d78/d79/d97/dec 0 2024-03-22T07:28:34.250 INFO:tasks.workunit.client.1.smithi195.stdout:1/401: dread d0/d2/f2e [0,4194304] 0 2024-03-22T07:28:34.252 INFO:tasks.workunit.client.1.smithi195.stdout:9/642: link d2/f82 d2/d4/d32/d6d/d78/d79/d97/fed 0 2024-03-22T07:28:34.256 INFO:tasks.workunit.client.1.smithi195.stdout:3/526: dwrite d3/df/d15/f6a [0,4194304] 0 2024-03-22T07:28:34.267 INFO:tasks.workunit.client.0.smithi134.stdout:3/264: sync 2024-03-22T07:28:34.268 INFO:tasks.workunit.client.0.smithi134.stdout:8/378: sync 2024-03-22T07:28:34.268 INFO:tasks.workunit.client.0.smithi134.stdout:8/379: chown d1/d15/f19 5772326 1 2024-03-22T07:28:34.268 INFO:tasks.workunit.client.0.smithi134.stdout:8/380: truncate d1/d15/d42/d12/d20/f3c 1525813 0 2024-03-22T07:28:34.270 INFO:tasks.workunit.client.0.smithi134.stdout:3/265: mknod d4/d8/d23/c59 0 2024-03-22T07:28:34.273 INFO:tasks.workunit.client.0.smithi134.stdout:8/381: rename d1/d15/d42/d44/c3b to d1/d4/d61/c84 0 2024-03-22T07:28:34.273 INFO:tasks.workunit.client.0.smithi134.stdout:8/382: dread - d1/f82 zero size 2024-03-22T07:28:34.273 INFO:tasks.workunit.client.0.smithi134.stdout:3/266: mknod d4/d10/d4b/c5a 0 2024-03-22T07:28:34.273 INFO:tasks.workunit.client.0.smithi134.stdout:3/267: write f0 [1722239,112071] 0 2024-03-22T07:28:34.273 INFO:tasks.workunit.client.0.smithi134.stdout:3/268: write d4/d8/d23/f3b [161863,122850] 0 2024-03-22T07:28:34.274 INFO:tasks.workunit.client.1.smithi195.stdout:7/471: write d0/d13/d22/d57/d7b/d8c/f90 [10595,35429] 0 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:0/328: sync 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:1/338: sync 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:1/339: stat d5/da/d13/d1e/d34/f43 0 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:7/488: sync 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:9/259: sync 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:9/260: chown d3/d9/df/d12/d3b 15 1 2024-03-22T07:28:34.275 INFO:tasks.workunit.client.0.smithi134.stdout:9/261: chown d3/d9/d37 0 1 2024-03-22T07:28:34.276 INFO:tasks.workunit.client.0.smithi134.stdout:5/289: sync 2024-03-22T07:28:34.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/383: mkdir d1/d4/d61/d85 0 2024-03-22T07:28:34.276 INFO:tasks.workunit.client.0.smithi134.stdout:8/384: creat d1/d15/d42/d12/d20/f86 x:0 0 0 2024-03-22T07:28:34.277 INFO:tasks.workunit.client.0.smithi134.stdout:0/329: unlink dc/f32 0 2024-03-22T07:28:34.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/489: creat d1/de/d41/d87/d8f/f9d x:0 0 0 2024-03-22T07:28:34.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/490: fdatasync d1/de/d11/d2b/d31/f91 0 2024-03-22T07:28:34.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/491: dread - d1/de/d11/d48/f8b zero size 2024-03-22T07:28:34.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/492: chown d1/l68 16 1 2024-03-22T07:28:34.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/493: write d1/de/d11/d48/fc [830059,3742] 0 2024-03-22T07:28:34.280 INFO:tasks.workunit.client.0.smithi134.stdout:7/494: truncate d1/de/d11/d2b/d31/f8e 202075 0 2024-03-22T07:28:34.281 INFO:tasks.workunit.client.0.smithi134.stdout:9/262: dread d3/f1a [0,4194304] 0 2024-03-22T07:28:34.285 INFO:tasks.workunit.client.0.smithi134.stdout:5/290: mkdir d1/d8/d20/d62 0 2024-03-22T07:28:34.285 INFO:tasks.workunit.client.0.smithi134.stdout:5/291: write d1/d8/d16/f4d [787685,105780] 0 2024-03-22T07:28:34.285 INFO:tasks.workunit.client.0.smithi134.stdout:5/292: chown d1/lc 17 1 2024-03-22T07:28:34.285 INFO:tasks.workunit.client.0.smithi134.stdout:2/276: dwrite d2/f30 [0,4194304] 0 2024-03-22T07:28:34.285 INFO:tasks.workunit.client.0.smithi134.stdout:2/277: chown d2/d5/d22 1382644990 1 2024-03-22T07:28:34.285 INFO:tasks.workunit.client.0.smithi134.stdout:2/278: fdatasync d2/f3e 0 2024-03-22T07:28:34.288 INFO:tasks.workunit.client.0.smithi134.stdout:8/385: truncate d1/d15/d42/d44/f3e 373858 0 2024-03-22T07:28:34.290 INFO:tasks.workunit.client.0.smithi134.stdout:0/330: truncate dc/d18/f2f 352884 0 2024-03-22T07:28:34.293 INFO:tasks.workunit.client.0.smithi134.stdout:9/263: truncate d3/f22 3486156 0 2024-03-22T07:28:34.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/386: getdents d1/d15/d42/d12 0 2024-03-22T07:28:34.297 INFO:tasks.workunit.client.1.smithi195.stdout:2/490: dwrite d2/d3/d21/d40/f9b [0,4194304] 0 2024-03-22T07:28:34.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/491: creat d2/d3/d24/f9f x:0 0 0 2024-03-22T07:28:34.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/492: creat d2/d3/d21/d40/fa0 x:0 0 0 2024-03-22T07:28:34.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/493: chown d2/d3/d21/d4c 3698 1 2024-03-22T07:28:34.298 INFO:tasks.workunit.client.1.smithi195.stdout:2/494: chown d2/d3/d7 144787 1 2024-03-22T07:28:34.301 INFO:tasks.workunit.client.0.smithi134.stdout:4/368: dwrite d2/d15/d35/f78 [0,4194304] 0 2024-03-22T07:28:34.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/293: write d1/d8/d16/d4a/f4b [784639,52849] 0 2024-03-22T07:28:34.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/294: fsync d1/d8/d20/f39 0 2024-03-22T07:28:34.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/295: write d1/d8/f42 [373671,33057] 0 2024-03-22T07:28:34.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/296: creat d1/d8/f63 x:0 0 0 2024-03-22T07:28:34.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/297: creat d1/d13/f64 x:0 0 0 2024-03-22T07:28:34.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/466: dwrite d5/d16/d5a/f99 [0,4194304] 0 2024-03-22T07:28:34.307 INFO:tasks.workunit.client.0.smithi134.stdout:9/264: dread d3/d9/df/d12/d1b/f32 [0,4194304] 0 2024-03-22T07:28:34.308 INFO:tasks.workunit.client.0.smithi134.stdout:8/387: rename d1/d15/d42/d12/d20/d41/f48 to d1/d4/d61/f87 0 2024-03-22T07:28:34.310 INFO:tasks.workunit.client.1.smithi195.stdout:2/495: dread d2/d3/d7/da/d4e/f83 [4194304,4194304] 0 2024-03-22T07:28:34.310 INFO:tasks.workunit.client.1.smithi195.stdout:2/496: readlink d2/d3/d24/l4a 0 2024-03-22T07:28:34.316 INFO:tasks.workunit.client.1.smithi195.stdout:8/574: dwrite da/f4f [0,4194304] 0 2024-03-22T07:28:34.316 INFO:tasks.workunit.client.1.smithi195.stdout:9/643: dwrite d2/d4/d6/db/d20/d4a/f6a [4194304,4194304] 0 2024-03-22T07:28:34.316 INFO:tasks.workunit.client.1.smithi195.stdout:9/644: stat d2/d4/d32/fa4 0 2024-03-22T07:28:34.316 INFO:tasks.workunit.client.1.smithi195.stdout:8/575: read - da/dc/fa6 zero size 2024-03-22T07:28:34.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/645: dread - d2/d4/d1d/fce zero size 2024-03-22T07:28:34.317 INFO:tasks.workunit.client.0.smithi134.stdout:4/369: symlink d2/d2a/d50/l79 0 2024-03-22T07:28:34.322 INFO:tasks.workunit.client.1.smithi195.stdout:6/467: creat d5/d16/d5a/faa x:0 0 0 2024-03-22T07:28:34.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/497: symlink d2/d3/d7/d19/d22/d26/d99/la1 0 2024-03-22T07:28:34.325 INFO:tasks.workunit.client.0.smithi134.stdout:9/265: creat d3/d9/df/d12/d1b/f5b x:0 0 0 2024-03-22T07:28:34.328 INFO:tasks.workunit.client.1.smithi195.stdout:8/576: truncate da/dc/f7b 2153003 0 2024-03-22T07:28:34.330 INFO:tasks.workunit.client.0.smithi134.stdout:4/370: unlink d2/d25/d48/f64 0 2024-03-22T07:28:34.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/646: mkdir d2/d4/d6/db/d20/d47/dee 0 2024-03-22T07:28:34.332 INFO:tasks.workunit.client.0.smithi134.stdout:9/266: symlink d3/d9/d37/l5c 0 2024-03-22T07:28:34.332 INFO:tasks.workunit.client.0.smithi134.stdout:9/267: creat d3/d9/df/d12/d1b/f5d x:0 0 0 2024-03-22T07:28:34.337 INFO:tasks.workunit.client.0.smithi134.stdout:4/371: symlink d2/d25/d48/l7a 0 2024-03-22T07:28:34.339 INFO:tasks.workunit.client.0.smithi134.stdout:9/268: symlink d3/d9/d37/d5a/l5e 0 2024-03-22T07:28:34.339 INFO:tasks.workunit.client.0.smithi134.stdout:9/269: read - d3/d9/df/d12/d1b/f5b zero size 2024-03-22T07:28:34.340 INFO:tasks.workunit.client.1.smithi195.stdout:3/527: dwrite d3/df/d15/d1d/f30 [4194304,4194304] 0 2024-03-22T07:28:34.340 INFO:tasks.workunit.client.0.smithi134.stdout:7/495: dwrite d1/d40/f7f [0,4194304] 0 2024-03-22T07:28:34.340 INFO:tasks.workunit.client.0.smithi134.stdout:1/340: dwrite d5/da/d1b/f1f [0,4194304] 0 2024-03-22T07:28:34.340 INFO:tasks.workunit.client.0.smithi134.stdout:1/341: creat d5/d1d/f77 x:0 0 0 2024-03-22T07:28:34.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/269: dwrite d4/f1e [0,4194304] 0 2024-03-22T07:28:34.341 INFO:tasks.workunit.client.1.smithi195.stdout:1/402: dwrite d0/d2/d6/d21/d39/d64/d7a/f79 [0,4194304] 0 2024-03-22T07:28:34.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/403: dread d0/d2/d6/d21/d41/d47/d4a/d66/f6d [4194304,4194304] 0 2024-03-22T07:28:34.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/404: write d0/d2/d27/f30 [1144167,17179] 0 2024-03-22T07:28:34.344 INFO:tasks.workunit.client.0.smithi134.stdout:4/372: mkdir d2/d25/d48/d6e/d7b 0 2024-03-22T07:28:34.344 INFO:tasks.workunit.client.0.smithi134.stdout:4/373: write d2/d1d/f72 [598787,73735] 0 2024-03-22T07:28:34.346 INFO:tasks.workunit.client.1.smithi195.stdout:9/647: write d2/d4/d32/f54 [4051470,81985] 0 2024-03-22T07:28:34.347 INFO:tasks.workunit.client.0.smithi134.stdout:9/270: mkdir d3/d9/df/d12/d2d/d5f 0 2024-03-22T07:28:34.350 INFO:tasks.workunit.client.0.smithi134.stdout:0/331: dwrite dc/f20 [0,4194304] 0 2024-03-22T07:28:34.350 INFO:tasks.workunit.client.0.smithi134.stdout:8/388: dwrite d1/d15/d42/d49/f5f [0,4194304] 0 2024-03-22T07:28:34.350 INFO:tasks.workunit.client.0.smithi134.stdout:8/389: readlink d1/d4/l30 0 2024-03-22T07:28:34.350 INFO:tasks.workunit.client.0.smithi134.stdout:8/390: readlink d1/d15/l1d 0 2024-03-22T07:28:34.350 INFO:tasks.workunit.client.0.smithi134.stdout:8/391: write d1/d15/d5b/f6d [727760,62234] 0 2024-03-22T07:28:34.351 INFO:tasks.workunit.client.1.smithi195.stdout:7/472: dwrite d0/d13/d22/d28/f85 [0,4194304] 0 2024-03-22T07:28:34.351 INFO:tasks.workunit.client.1.smithi195.stdout:7/473: truncate d0/d13/f1c 4615197 0 2024-03-22T07:28:34.351 INFO:tasks.workunit.client.1.smithi195.stdout:7/474: creat d0/d13/d22/d57/d7b/d8c/fa4 x:0 0 0 2024-03-22T07:28:34.352 INFO:tasks.workunit.client.0.smithi134.stdout:2/279: dwrite d2/d5/d8/d2c/d3c/f47 [0,4194304] 0 2024-03-22T07:28:34.352 INFO:tasks.workunit.client.1.smithi195.stdout:2/498: dwrite d2/d3/d24/f67 [0,4194304] 0 2024-03-22T07:28:34.358 INFO:tasks.workunit.client.0.smithi134.stdout:9/271: write d3/f1a [3672706,54729] 0 2024-03-22T07:28:34.363 INFO:tasks.workunit.client.1.smithi195.stdout:8/577: link da/d17/d32/d61/c3e da/d17/cae 0 2024-03-22T07:28:34.363 INFO:tasks.workunit.client.1.smithi195.stdout:9/648: dwrite d2/d4/d23/d74/f76 [0,4194304] 0 2024-03-22T07:28:34.364 INFO:tasks.workunit.client.1.smithi195.stdout:9/649: readlink d2/d4/d6/l19 0 2024-03-22T07:28:34.364 INFO:tasks.workunit.client.0.smithi134.stdout:1/342: truncate d5/da/d1b/d27/d39/f58 183791 0 2024-03-22T07:28:34.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/528: unlink d3/df/d15/d1d/f56 0 2024-03-22T07:28:34.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/529: readlink d3/df/l6e 0 2024-03-22T07:28:34.369 INFO:tasks.workunit.client.0.smithi134.stdout:3/270: mknod d4/d22/c5b 0 2024-03-22T07:28:34.371 INFO:tasks.workunit.client.0.smithi134.stdout:4/374: creat d2/d15/d35/d37/d76/f7c x:0 0 0 2024-03-22T07:28:34.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/578: dread da/d17/d32/d61/d47/d53/d8d/f92 [0,4194304] 0 2024-03-22T07:28:34.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/579: write da/d17/d32/d61/d47/d53/f8f [285683,70540] 0 2024-03-22T07:28:34.374 INFO:tasks.workunit.client.1.smithi195.stdout:8/580: dread - da/d17/d32/d7d/f85 zero size 2024-03-22T07:28:34.377 INFO:tasks.workunit.client.1.smithi195.stdout:1/405: symlink d0/d2/d6/d21/d39/d64/l85 0 2024-03-22T07:28:34.385 INFO:tasks.workunit.client.0.smithi134.stdout:9/272: dwrite f0 [0,4194304] 0 2024-03-22T07:28:34.386 INFO:tasks.workunit.client.1.smithi195.stdout:9/650: dwrite d2/d4/f12 [4194304,4194304] 0 2024-03-22T07:28:34.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/406: dread d0/d70/f3e [0,4194304] 0 2024-03-22T07:28:34.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/407: creat d0/d2/d9/d2a/f86 x:0 0 0 2024-03-22T07:28:34.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/408: dread - d0/d2/d9/d2a/f86 zero size 2024-03-22T07:28:34.388 INFO:tasks.workunit.client.1.smithi195.stdout:1/409: write d0/d70/f3e [4575673,90287] 0 2024-03-22T07:28:34.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/475: symlink d0/d13/d22/d57/d7b/la5 0 2024-03-22T07:28:34.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/476: chown d0/d13/d14/d29/d6e 7505 1 2024-03-22T07:28:34.391 INFO:tasks.workunit.client.1.smithi195.stdout:7/477: chown d0/d13/d14/d20/d40/d82/da0/d59/d79 195371 1 2024-03-22T07:28:34.395 INFO:tasks.workunit.client.1.smithi195.stdout:2/499: link d2/d3/d7/d19/c46 d2/d3/d7/d19/d22/d26/d99/ca2 0 2024-03-22T07:28:34.396 INFO:tasks.workunit.client.0.smithi134.stdout:9/273: write d3/d9/df/d12/d1b/f29 [5538839,19173] 0 2024-03-22T07:28:34.396 INFO:tasks.workunit.client.0.smithi134.stdout:9/274: creat d3/d9/df/d12/f60 x:0 0 0 2024-03-22T07:28:34.401 INFO:tasks.workunit.client.1.smithi195.stdout:8/581: mknod da/d17/d32/d7d/d8e/caf 0 2024-03-22T07:28:34.402 INFO:tasks.workunit.client.1.smithi195.stdout:9/651: dwrite d2/d4/d6/f49 [4194304,4194304] 0 2024-03-22T07:28:34.406 INFO:tasks.workunit.client.0.smithi134.stdout:7/496: link d1/de/d41/d87/d8f/f9d d1/de/d11/d2b/d69/f9e 0 2024-03-22T07:28:34.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/410: symlink d0/d2/d6/d21/d39/d64/d7a/l87 0 2024-03-22T07:28:34.408 INFO:tasks.workunit.client.0.smithi134.stdout:1/343: truncate d5/da/f21 3465183 0 2024-03-22T07:28:34.410 INFO:tasks.workunit.client.1.smithi195.stdout:7/478: mkdir d0/d13/d14/d20/d40/d82/da6 0 2024-03-22T07:28:34.416 INFO:tasks.workunit.client.0.smithi134.stdout:3/271: mkdir d4/d8/d5c 0 2024-03-22T07:28:34.416 INFO:tasks.workunit.client.0.smithi134.stdout:3/272: write d4/d22/f25 [417807,101880] 0 2024-03-22T07:28:34.416 INFO:tasks.workunit.client.0.smithi134.stdout:3/273: creat d4/d10/f5d x:0 0 0 2024-03-22T07:28:34.418 INFO:tasks.workunit.client.1.smithi195.stdout:8/582: dwrite da/d17/d32/d61/d47/faa [0,4194304] 0 2024-03-22T07:28:34.418 INFO:tasks.workunit.client.1.smithi195.stdout:8/583: read da/d17/d32/d61/d47/d53/f8f [180040,121349] 0 2024-03-22T07:28:34.419 INFO:tasks.workunit.client.1.smithi195.stdout:3/530: truncate d3/f29 1263955 0 2024-03-22T07:28:34.420 INFO:tasks.workunit.client.1.smithi195.stdout:7/479: dread d0/d13/f1c [0,4194304] 0 2024-03-22T07:28:34.420 INFO:tasks.workunit.client.1.smithi195.stdout:7/480: chown d0/d98 461 1 2024-03-22T07:28:34.420 INFO:tasks.workunit.client.0.smithi134.stdout:4/375: link d2/d15/d35/f5d d2/d1d/f7d 0 2024-03-22T07:28:34.421 INFO:tasks.workunit.client.1.smithi195.stdout:9/652: unlink d2/d4/c64 0 2024-03-22T07:28:34.423 INFO:tasks.workunit.client.0.smithi134.stdout:5/298: rename d1/d13 to d1/d8/d20/d62/d65 0 2024-03-22T07:28:34.425 INFO:tasks.workunit.client.1.smithi195.stdout:2/500: rmdir d2/d3/d7/d19/d22/d26/d3c 39 2024-03-22T07:28:34.425 INFO:tasks.workunit.client.1.smithi195.stdout:2/501: write d2/d3/d21/d60/d81/d9a/f9c [380598,117383] 0 2024-03-22T07:28:34.428 INFO:tasks.workunit.client.0.smithi134.stdout:4/376: dread d2/d15/d35/f78 [0,4194304] 0 2024-03-22T07:28:34.429 INFO:tasks.workunit.client.0.smithi134.stdout:9/275: creat d3/d9/df/f61 x:0 0 0 2024-03-22T07:28:34.431 INFO:tasks.workunit.client.0.smithi134.stdout:2/280: mknod d2/d5/d8/c4e 0 2024-03-22T07:28:34.432 INFO:tasks.workunit.client.1.smithi195.stdout:4/483: sync 2024-03-22T07:28:34.432 INFO:tasks.workunit.client.1.smithi195.stdout:5/522: sync 2024-03-22T07:28:34.433 INFO:tasks.workunit.client.0.smithi134.stdout:7/497: truncate d1/de/d41/f49 2856351 0 2024-03-22T07:28:34.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/411: dwrite d0/d2/f1f [4194304,4194304] 0 2024-03-22T07:28:34.434 INFO:tasks.workunit.client.1.smithi195.stdout:1/412: stat d0/d2/d9 0 2024-03-22T07:28:34.436 INFO:tasks.workunit.client.0.smithi134.stdout:4/377: dread d2/d15/f1b [0,4194304] 0 2024-03-22T07:28:34.441 INFO:tasks.workunit.client.0.smithi134.stdout:3/274: stat d4/d22/d3c/c3d 0 2024-03-22T07:28:34.441 INFO:tasks.workunit.client.0.smithi134.stdout:3/275: dread - d4/d10/d4b/f4c zero size 2024-03-22T07:28:34.441 INFO:tasks.workunit.client.0.smithi134.stdout:3/276: creat d4/d22/d29/f5e x:0 0 0 2024-03-22T07:28:34.442 INFO:tasks.workunit.client.0.smithi134.stdout:3/277: fdatasync d4/d8/d45/f51 0 2024-03-22T07:28:34.442 INFO:tasks.workunit.client.0.smithi134.stdout:3/278: dread - d4/d10/f4f zero size 2024-03-22T07:28:34.442 INFO:tasks.workunit.client.0.smithi134.stdout:3/279: fsync d4/d8/f19 0 2024-03-22T07:28:34.445 INFO:tasks.workunit.client.0.smithi134.stdout:0/332: rename dc/d17/c59 to dc/de/d55/c5f 0 2024-03-22T07:28:34.445 INFO:tasks.workunit.client.0.smithi134.stdout:0/333: fdatasync dc/de/f35 0 2024-03-22T07:28:34.448 INFO:tasks.workunit.client.1.smithi195.stdout:8/584: symlink da/d82/lb0 0 2024-03-22T07:28:34.448 INFO:tasks.workunit.client.1.smithi195.stdout:8/585: stat da/dc/l3c 0 2024-03-22T07:28:34.450 INFO:tasks.workunit.client.0.smithi134.stdout:9/276: creat d3/d9/f62 x:0 0 0 2024-03-22T07:28:34.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/531: rmdir d3/df/d15/dac 0 2024-03-22T07:28:34.452 INFO:tasks.workunit.client.1.smithi195.stdout:3/532: chown d3/d18/d89/d8c/d9d 4747179 1 2024-03-22T07:28:34.453 INFO:tasks.workunit.client.0.smithi134.stdout:4/378: mknod d2/d15/d66/c7e 0 2024-03-22T07:28:34.453 INFO:tasks.workunit.client.0.smithi134.stdout:4/379: truncate d2/d15/d35/d37/d76/f7c 360662 0 2024-03-22T07:28:34.455 INFO:tasks.workunit.client.0.smithi134.stdout:1/344: getdents d5/da/d1b/d27/d60 0 2024-03-22T07:28:34.456 INFO:tasks.workunit.client.0.smithi134.stdout:4/380: dread d2/d15/f13 [0,4194304] 0 2024-03-22T07:28:34.459 INFO:tasks.workunit.client.1.smithi195.stdout:2/502: link d2/d3/d7/d19/c46 d2/d3/d7/ca3 0 2024-03-22T07:28:34.460 INFO:tasks.workunit.client.0.smithi134.stdout:7/498: dwrite d1/d19/f53 [0,4194304] 0 2024-03-22T07:28:34.461 INFO:tasks.workunit.client.0.smithi134.stdout:2/281: dwrite d2/f3b [4194304,4194304] 0 2024-03-22T07:28:34.461 INFO:tasks.workunit.client.1.smithi195.stdout:5/523: dwrite d9/d12/d1d/d36/fa3 [0,4194304] 0 2024-03-22T07:28:34.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/334: mkdir dc/de/d55/d60 0 2024-03-22T07:28:34.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/335: truncate dc/f4e 46258 0 2024-03-22T07:28:34.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/336: write f0 [2479446,104038] 0 2024-03-22T07:28:34.463 INFO:tasks.workunit.client.1.smithi195.stdout:4/484: link d13/d63/d36/l67 d13/d2a/d7d/la9 0 2024-03-22T07:28:34.465 INFO:tasks.workunit.client.0.smithi134.stdout:3/280: rename d4/ce to d4/d22/d29/c5f 0 2024-03-22T07:28:34.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/299: truncate d1/d8/d16/f4d 2874031 0 2024-03-22T07:28:34.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/300: creat d1/d8/f66 x:0 0 0 2024-03-22T07:28:34.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/524: dread d9/f45 [0,4194304] 0 2024-03-22T07:28:34.473 INFO:tasks.workunit.client.1.smithi195.stdout:5/525: fsync d9/d12/f1f 0 2024-03-22T07:28:34.473 INFO:tasks.workunit.client.1.smithi195.stdout:5/526: truncate d9/d12/d14/f4b 745884 0 2024-03-22T07:28:34.475 INFO:tasks.workunit.client.1.smithi195.stdout:4/485: dread d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:34.475 INFO:tasks.workunit.client.1.smithi195.stdout:4/486: readlink d13/d15/l4a 0 2024-03-22T07:28:34.475 INFO:tasks.workunit.client.1.smithi195.stdout:4/487: write d13/d63/d79/f4b [1098487,117196] 0 2024-03-22T07:28:34.475 INFO:tasks.workunit.client.1.smithi195.stdout:4/488: getdents d13/d63/d79/d68 0 2024-03-22T07:28:34.476 INFO:tasks.workunit.client.0.smithi134.stdout:9/277: symlink d3/d9/df/d12/d2d/d5f/l63 0 2024-03-22T07:28:34.476 INFO:tasks.workunit.client.0.smithi134.stdout:4/381: dwrite d2/d15/d35/d37/d76/f7c [0,4194304] 0 2024-03-22T07:28:34.485 INFO:tasks.workunit.client.0.smithi134.stdout:1/345: mknod d5/da/d61/c78 0 2024-03-22T07:28:34.487 INFO:tasks.workunit.client.1.smithi195.stdout:8/586: rmdir da/d17/d32/d7d/d8e/d97 0 2024-03-22T07:28:34.488 INFO:tasks.workunit.client.0.smithi134.stdout:5/301: dwrite d1/d8/f46 [0,4194304] 0 2024-03-22T07:28:34.491 INFO:tasks.workunit.client.1.smithi195.stdout:7/481: rename d0/d13/d14/d20/d40/l8d to d0/d13/d14/la7 0 2024-03-22T07:28:34.494 INFO:tasks.workunit.client.1.smithi195.stdout:9/653: link d2/d4/d1d/l8a d2/d4/d6/d18/d50/lef 0 2024-03-22T07:28:34.494 INFO:tasks.workunit.client.1.smithi195.stdout:9/654: fsync d2/d4/d6/db/f6c 0 2024-03-22T07:28:34.497 INFO:tasks.workunit.client.1.smithi195.stdout:2/503: mkdir d2/d3/d7/d5c/da4 0 2024-03-22T07:28:34.497 INFO:tasks.workunit.client.1.smithi195.stdout:2/504: stat d2/d3/d7/d5c/da4 0 2024-03-22T07:28:34.497 INFO:tasks.workunit.client.1.smithi195.stdout:2/505: getdents d2/d3/d7/d5c/d8e 0 2024-03-22T07:28:34.500 INFO:tasks.workunit.client.0.smithi134.stdout:7/499: unlink d1/f3b 0 2024-03-22T07:28:34.506 INFO:tasks.workunit.client.0.smithi134.stdout:2/282: mkdir d2/d5/d8/d2c/d3c/d4f 0 2024-03-22T07:28:34.507 INFO:tasks.workunit.client.1.smithi195.stdout:5/527: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:34.507 INFO:tasks.workunit.client.1.smithi195.stdout:7/482: dread d0/d13/d14/f30 [0,4194304] 0 2024-03-22T07:28:34.507 INFO:tasks.workunit.client.1.smithi195.stdout:5/528: chown d9/d22/cad 1619414 1 2024-03-22T07:28:34.507 INFO:tasks.workunit.client.1.smithi195.stdout:7/483: write d0/d13/d14/d29/d35/d3a/f9a [598239,89081] 0 2024-03-22T07:28:34.509 INFO:tasks.workunit.client.0.smithi134.stdout:3/281: rename d4/fc to d4/d8/d23/f60 0 2024-03-22T07:28:34.509 INFO:tasks.workunit.client.0.smithi134.stdout:3/282: creat d4/d10/f61 x:0 0 0 2024-03-22T07:28:34.509 INFO:tasks.workunit.client.0.smithi134.stdout:3/283: chown d4/d8/d23/f55 23 1 2024-03-22T07:28:34.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/382: dwrite d2/d2a/f4d [0,4194304] 0 2024-03-22T07:28:34.512 INFO:tasks.workunit.client.0.smithi134.stdout:4/383: write d2/f71 [1550971,108720] 0 2024-03-22T07:28:34.512 INFO:tasks.workunit.client.0.smithi134.stdout:4/384: readlink d2/l28 0 2024-03-22T07:28:34.514 INFO:tasks.workunit.client.0.smithi134.stdout:9/278: mknod d3/d9/df/d12/c64 0 2024-03-22T07:28:34.514 INFO:tasks.workunit.client.1.smithi195.stdout:9/655: dread d2/d4/f1a [0,4194304] 0 2024-03-22T07:28:34.516 INFO:tasks.workunit.client.1.smithi195.stdout:4/489: creat d13/d63/d36/d9e/faa x:0 0 0 2024-03-22T07:28:34.516 INFO:tasks.workunit.client.1.smithi195.stdout:7/484: read d0/d13/d14/d20/f4b [69523,19358] 0 2024-03-22T07:28:34.516 INFO:tasks.workunit.client.1.smithi195.stdout:7/485: dread - d0/d13/d22/d57/f84 zero size 2024-03-22T07:28:34.518 INFO:tasks.workunit.client.1.smithi195.stdout:2/506: dwrite d2/d3/d7/da/f72 [0,4194304] 0 2024-03-22T07:28:34.520 INFO:tasks.workunit.client.1.smithi195.stdout:1/413: rename d0/d70/f3e to d0/d70/d6a/f88 0 2024-03-22T07:28:34.521 INFO:tasks.workunit.client.1.smithi195.stdout:5/529: symlink d9/d12/d1d/laf 0 2024-03-22T07:28:34.522 INFO:tasks.workunit.client.0.smithi134.stdout:1/346: rmdir d5 39 2024-03-22T07:28:34.522 INFO:tasks.workunit.client.0.smithi134.stdout:1/347: readlink d5/da/d13/d1e/l2e 0 2024-03-22T07:28:34.522 INFO:tasks.workunit.client.1.smithi195.stdout:1/414: write d0/d2/d6/d21/d39/f65 [303601,1667] 0 2024-03-22T07:28:34.523 INFO:tasks.workunit.client.1.smithi195.stdout:9/656: symlink d2/d4/d6/db/lf0 0 2024-03-22T07:28:34.527 INFO:tasks.workunit.client.1.smithi195.stdout:4/490: creat d13/d63/d36/d5f/d83/fab x:0 0 0 2024-03-22T07:28:34.530 INFO:tasks.workunit.client.0.smithi134.stdout:5/302: creat d1/d8/d20/d62/d65/f67 x:0 0 0 2024-03-22T07:28:34.533 INFO:tasks.workunit.client.0.smithi134.stdout:7/500: link d1/de/f5a d1/d40/f9f 0 2024-03-22T07:28:34.533 INFO:tasks.workunit.client.0.smithi134.stdout:7/501: creat d1/de/d11/d2b/d69/fa0 x:0 0 0 2024-03-22T07:28:34.536 INFO:tasks.workunit.client.0.smithi134.stdout:2/283: link d2/l44 d2/d5/d8/d2c/l50 0 2024-03-22T07:28:34.536 INFO:tasks.workunit.client.1.smithi195.stdout:2/507: dwrite d2/d3/db/f88 [0,4194304] 0 2024-03-22T07:28:34.538 INFO:tasks.workunit.client.1.smithi195.stdout:3/533: rename d3/df/d15/d1d/d5c/c82 to d3/df/cb1 0 2024-03-22T07:28:34.542 INFO:tasks.workunit.client.0.smithi134.stdout:3/284: creat d4/d22/d29/d50/f62 x:0 0 0 2024-03-22T07:28:34.543 INFO:tasks.workunit.client.1.smithi195.stdout:0/521: sync 2024-03-22T07:28:34.543 INFO:tasks.workunit.client.1.smithi195.stdout:0/522: chown d1/d10/d1f/d40/d43/f53 0 1 2024-03-22T07:28:34.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/530: creat d9/d2d/d58/fb0 x:0 0 0 2024-03-22T07:28:34.544 INFO:tasks.workunit.client.1.smithi195.stdout:0/523: dread d1/d4/dd/df/d2b/d63/d85/f86 [0,4194304] 0 2024-03-22T07:28:34.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/337: rename dc/d17/c31 to dc/c61 0 2024-03-22T07:28:34.546 INFO:tasks.workunit.client.0.smithi134.stdout:3/285: dread d4/d10/f14 [0,4194304] 0 2024-03-22T07:28:34.546 INFO:tasks.workunit.client.0.smithi134.stdout:3/286: creat d4/d22/d29/d50/f63 x:0 0 0 2024-03-22T07:28:34.546 INFO:tasks.workunit.client.1.smithi195.stdout:1/415: mknod d0/d2/d6/c89 0 2024-03-22T07:28:34.548 INFO:tasks.workunit.client.0.smithi134.stdout:0/338: dread dc/f1f [0,4194304] 0 2024-03-22T07:28:34.548 INFO:tasks.workunit.client.0.smithi134.stdout:0/339: readlink dc/de/l28 0 2024-03-22T07:28:34.549 INFO:tasks.workunit.client.0.smithi134.stdout:0/340: fdatasync dc/de/f50 0 2024-03-22T07:28:34.550 INFO:tasks.workunit.client.1.smithi195.stdout:9/657: rmdir d2/d4/d32/d6d/d78/d79/d97/dec 0 2024-03-22T07:28:34.550 INFO:tasks.workunit.client.1.smithi195.stdout:9/658: dread - d2/d4/d6/db/f9d zero size 2024-03-22T07:28:34.553 INFO:tasks.workunit.client.1.smithi195.stdout:4/491: creat d13/d63/fac x:0 0 0 2024-03-22T07:28:34.554 INFO:tasks.workunit.client.0.smithi134.stdout:4/385: mknod d2/d25/d48/c7f 0 2024-03-22T07:28:34.556 INFO:tasks.workunit.client.0.smithi134.stdout:9/279: rmdir d3/d9/d37/d3c 39 2024-03-22T07:28:34.558 INFO:tasks.workunit.client.1.smithi195.stdout:0/524: dwrite d1/d4/dd/df/d44/f50 [0,4194304] 0 2024-03-22T07:28:34.558 INFO:tasks.workunit.client.1.smithi195.stdout:0/525: chown d1/d4/dd 1693832 1 2024-03-22T07:28:34.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/526: chown d1/d4/d12/l4e 191 1 2024-03-22T07:28:34.559 INFO:tasks.workunit.client.1.smithi195.stdout:0/527: chown d1/d10/d1f/d40/d47/c76 1139153 1 2024-03-22T07:28:34.559 INFO:tasks.workunit.client.0.smithi134.stdout:1/348: unlink d5/l35 0 2024-03-22T07:28:34.561 INFO:tasks.workunit.client.1.smithi195.stdout:6/468: sync 2024-03-22T07:28:34.561 INFO:tasks.workunit.client.1.smithi195.stdout:6/469: dread - d5/d16/d45/d53/fa3 zero size 2024-03-22T07:28:34.564 INFO:tasks.workunit.client.1.smithi195.stdout:2/508: creat d2/d3/fa5 x:0 0 0 2024-03-22T07:28:34.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/502: creat d1/de/fa1 x:0 0 0 2024-03-22T07:28:34.567 INFO:tasks.workunit.client.0.smithi134.stdout:7/503: chown d1/ld 37130740 1 2024-03-22T07:28:34.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/504: dread d1/de/d41/f5d [0,4194304] 0 2024-03-22T07:28:34.568 INFO:tasks.workunit.client.0.smithi134.stdout:7/505: fdatasync d1/de/d41/f5d 0 2024-03-22T07:28:34.569 INFO:tasks.workunit.client.1.smithi195.stdout:8/587: rename da/d17/d32/d61/c49 to da/d17/d32/cb1 0 2024-03-22T07:28:34.570 INFO:tasks.workunit.client.0.smithi134.stdout:7/506: dread d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:34.571 INFO:tasks.workunit.client.1.smithi195.stdout:5/531: creat d9/d12/d1d/d69/d78/fb1 x:0 0 0 2024-03-22T07:28:34.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/416: unlink d0/d2/d6/d21/d39/d64/d7a/f79 0 2024-03-22T07:28:34.574 INFO:tasks.workunit.client.1.smithi195.stdout:1/417: write d0/d2/d6/d21/d41/d47/f49 [441710,123323] 0 2024-03-22T07:28:34.574 INFO:tasks.workunit.client.0.smithi134.stdout:3/287: symlink d4/d10/d4b/l64 0 2024-03-22T07:28:34.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/341: link dc/f1f dc/d18/f62 0 2024-03-22T07:28:34.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/342: creat dc/de/d55/f63 x:0 0 0 2024-03-22T07:28:34.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/343: chown dc/de/d55/d60 3540818 1 2024-03-22T07:28:34.577 INFO:tasks.workunit.client.0.smithi134.stdout:0/344: creat dc/de/d55/f64 x:0 0 0 2024-03-22T07:28:34.578 INFO:tasks.workunit.client.1.smithi195.stdout:4/492: rmdir d13/d15/d6b 39 2024-03-22T07:28:34.578 INFO:tasks.workunit.client.1.smithi195.stdout:4/493: fsync d13/d63/f6a 0 2024-03-22T07:28:34.578 INFO:tasks.workunit.client.1.smithi195.stdout:4/494: chown f9 4638 1 2024-03-22T07:28:34.581 INFO:tasks.workunit.client.0.smithi134.stdout:9/280: rmdir d3/d9/d37/d3c 39 2024-03-22T07:28:34.583 INFO:tasks.workunit.client.0.smithi134.stdout:1/349: mknod d5/da/d61/c79 0 2024-03-22T07:28:34.583 INFO:tasks.workunit.client.0.smithi134.stdout:1/350: chown d5/d1d/d49/c65 134 1 2024-03-22T07:28:34.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/470: mkdir d5/d5e/d34/d55/dab 0 2024-03-22T07:28:34.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/471: chown d5/d5e/d34/d55/d3b/d6e/d56/d8f/fa8 54 1 2024-03-22T07:28:34.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/303: truncate d1/d4/f2b 2262907 0 2024-03-22T07:28:34.586 INFO:tasks.workunit.client.1.smithi195.stdout:0/528: dwrite d1/d4/d12/f27 [0,4194304] 0 2024-03-22T07:28:34.586 INFO:tasks.workunit.client.1.smithi195.stdout:5/532: dread d9/d2d/f67 [4194304,4194304] 0 2024-03-22T07:28:34.586 INFO:tasks.workunit.client.1.smithi195.stdout:0/529: chown d1/d10/d1f/d40/d43/f4c 0 1 2024-03-22T07:28:34.587 INFO:tasks.workunit.client.1.smithi195.stdout:3/534: rename d3/df/d15/l17 to d3/df/d15/d1d/d5c/d86/lb2 0 2024-03-22T07:28:34.590 INFO:tasks.workunit.client.0.smithi134.stdout:2/284: rename l1 to d2/d5/l51 0 2024-03-22T07:28:34.593 INFO:tasks.workunit.client.0.smithi134.stdout:7/507: creat d1/d40/fa2 x:0 0 0 2024-03-22T07:28:34.593 INFO:tasks.workunit.client.0.smithi134.stdout:7/508: chown d1/d19/c72 3198 1 2024-03-22T07:28:34.594 INFO:tasks.workunit.client.1.smithi195.stdout:9/659: getdents d2/d4/d6/db/d20/d4a 0 2024-03-22T07:28:34.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/660: chown d2/d4/d32/d6d/d78/d79/d97/ca7 675 1 2024-03-22T07:28:34.595 INFO:tasks.workunit.client.1.smithi195.stdout:9/661: write d2/d4/d23/d74/fd3 [600545,119913] 0 2024-03-22T07:28:34.598 INFO:tasks.workunit.client.1.smithi195.stdout:0/530: dread d1/d4/dd/df/d44/d6f/f71 [0,4194304] 0 2024-03-22T07:28:34.598 INFO:tasks.workunit.client.1.smithi195.stdout:0/531: creat d1/d4/dd/d66/d80/f95 x:0 0 0 2024-03-22T07:28:34.598 INFO:tasks.workunit.client.1.smithi195.stdout:4/495: creat d13/d63/d3e/d5c/da8/fad x:0 0 0 2024-03-22T07:28:34.599 INFO:tasks.workunit.client.1.smithi195.stdout:4/496: fsync d13/f1f 0 2024-03-22T07:28:34.601 INFO:tasks.workunit.client.1.smithi195.stdout:6/472: getdents d5/d5e/d34/d55/d4b/da2/d1a 0 2024-03-22T07:28:34.603 INFO:tasks.workunit.client.1.smithi195.stdout:2/509: rename d2/d3/d7/f78 to d2/d3/d7/da/de/fa6 0 2024-03-22T07:28:34.604 INFO:tasks.workunit.client.0.smithi134.stdout:0/345: mkdir dc/de/d55/d65 0 2024-03-22T07:28:34.604 INFO:tasks.workunit.client.0.smithi134.stdout:0/346: chown dc/d18/f2e 71293386 1 2024-03-22T07:28:34.604 INFO:tasks.workunit.client.0.smithi134.stdout:0/347: truncate dc/d17/f2b 994401 0 2024-03-22T07:28:34.605 INFO:tasks.workunit.client.0.smithi134.stdout:0/348: creat dc/d18/f66 x:0 0 0 2024-03-22T07:28:34.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/535: dwrite d3/d18/f26 [4194304,4194304] 0 2024-03-22T07:28:34.611 INFO:tasks.workunit.client.1.smithi195.stdout:0/532: creat d1/d4/d22/f96 x:0 0 0 2024-03-22T07:28:34.612 INFO:tasks.workunit.client.0.smithi134.stdout:4/386: rmdir d2/d25 39 2024-03-22T07:28:34.614 INFO:tasks.workunit.client.1.smithi195.stdout:4/497: mkdir d13/d63/d3e/d5c/d65/dae 0 2024-03-22T07:28:34.616 INFO:tasks.workunit.client.0.smithi134.stdout:9/281: link d3/l5 d3/d9/df/d12/d2d/d5f/l65 0 2024-03-22T07:28:34.618 INFO:tasks.workunit.client.1.smithi195.stdout:6/473: mknod d5/d16/d5a/cac 0 2024-03-22T07:28:34.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/474: dread - d5/d5e/d34/d55/d3b/f8e zero size 2024-03-22T07:28:34.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/475: write d5/d5e/d34/d55/f36 [579097,93161] 0 2024-03-22T07:28:34.619 INFO:tasks.workunit.client.0.smithi134.stdout:9/282: dread d3/d9/df/d12/f2f [0,4194304] 0 2024-03-22T07:28:34.619 INFO:tasks.workunit.client.1.smithi195.stdout:2/510: dwrite d2/d3/d7/d19/d22/d26/f2c [0,4194304] 0 2024-03-22T07:28:34.619 INFO:tasks.workunit.client.1.smithi195.stdout:2/511: dread - d2/d3/fa5 zero size 2024-03-22T07:28:34.620 INFO:tasks.workunit.client.0.smithi134.stdout:1/351: truncate d5/d1d/d49/f52 4415779 0 2024-03-22T07:28:34.622 INFO:tasks.workunit.client.0.smithi134.stdout:9/283: write d3/d9/f36 [102301,129864] 0 2024-03-22T07:28:34.622 INFO:tasks.workunit.client.0.smithi134.stdout:9/284: read d3/d9/f36 [785792,106503] 0 2024-03-22T07:28:34.622 INFO:tasks.workunit.client.0.smithi134.stdout:9/285: readlink d3/d9/df/d12/d2d/d5f/l63 0 2024-03-22T07:28:34.623 INFO:tasks.workunit.client.0.smithi134.stdout:9/286: truncate d3/d9/df/d12/d3b/f42 380752 0 2024-03-22T07:28:34.623 INFO:tasks.workunit.client.1.smithi195.stdout:5/533: rename d9/daa to d9/d22/d46/db2 0 2024-03-22T07:28:34.624 INFO:tasks.workunit.client.0.smithi134.stdout:5/304: mkdir d1/d8/d20/d62/d68 0 2024-03-22T07:28:34.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/533: creat d1/d4/d42/f97 x:0 0 0 2024-03-22T07:28:34.626 INFO:tasks.workunit.client.1.smithi195.stdout:0/534: readlink d1/d4/d12/l4e 0 2024-03-22T07:28:34.628 INFO:tasks.workunit.client.1.smithi195.stdout:4/498: link d13/d2a/f56 d13/d15/faf 0 2024-03-22T07:28:34.633 INFO:tasks.workunit.client.1.smithi195.stdout:6/476: mkdir d5/d5e/d34/d55/d4b/da2/dad 0 2024-03-22T07:28:34.636 INFO:tasks.workunit.client.0.smithi134.stdout:9/287: dwrite d3/d9/df/d12/f2f [0,4194304] 0 2024-03-22T07:28:34.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/288: write d3/d9/f62 [836523,108962] 0 2024-03-22T07:28:34.640 INFO:tasks.workunit.client.1.smithi195.stdout:2/512: link d2/d3/d24/l4a d2/d3/d21/d60/d7c/la7 0 2024-03-22T07:28:34.641 INFO:tasks.workunit.client.1.smithi195.stdout:2/513: write d2/d3/d7/da/de/f35 [4884842,35025] 0 2024-03-22T07:28:34.644 INFO:tasks.workunit.client.1.smithi195.stdout:9/662: rename d2/d4/d6/db/f30 to d2/d4/d32/d6d/deb/ff1 0 2024-03-22T07:28:34.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/534: symlink d9/d73/da1/lb3 0 2024-03-22T07:28:34.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/535: mkdir d1/d4/dd/df/d98 0 2024-03-22T07:28:34.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/536: truncate d1/d10/d1f/d40/d47/f84 440980 0 2024-03-22T07:28:34.650 INFO:tasks.workunit.client.1.smithi195.stdout:6/477: dwrite d5/d5e/d34/d55/d4b/da2/f4e [0,4194304] 0 2024-03-22T07:28:34.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/418: truncate d0/d2/d6/d21/d41/d47/f49 563620 0 2024-03-22T07:28:34.654 INFO:tasks.workunit.client.0.smithi134.stdout:7/509: symlink d1/de/d11/d48/d52/d46/la3 0 2024-03-22T07:28:34.655 INFO:tasks.workunit.client.1.smithi195.stdout:4/499: creat d13/d63/d36/d5f/fb0 x:0 0 0 2024-03-22T07:28:34.657 INFO:tasks.workunit.client.1.smithi195.stdout:2/514: mkdir d2/d3/d21/d60/d81/da8 0 2024-03-22T07:28:34.663 INFO:tasks.workunit.client.1.smithi195.stdout:9/663: unlink d2/f9 0 2024-03-22T07:28:34.663 INFO:tasks.workunit.client.1.smithi195.stdout:9/664: read d2/d4/d6/f49 [3607137,125192] 0 2024-03-22T07:28:34.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/510: write d1/f3a [1756173,130573] 0 2024-03-22T07:28:34.664 INFO:tasks.workunit.client.1.smithi195.stdout:4/500: read f12 [1792216,107152] 0 2024-03-22T07:28:34.668 INFO:tasks.workunit.client.0.smithi134.stdout:3/288: rmdir d4/d22 39 2024-03-22T07:28:34.668 INFO:tasks.workunit.client.0.smithi134.stdout:3/289: creat d4/d10/d4b/f65 x:0 0 0 2024-03-22T07:28:34.668 INFO:tasks.workunit.client.1.smithi195.stdout:5/535: dwrite d9/ff [0,4194304] 0 2024-03-22T07:28:34.669 INFO:tasks.workunit.client.1.smithi195.stdout:4/501: dread d13/d2a/f70 [0,4194304] 0 2024-03-22T07:28:34.671 INFO:tasks.workunit.client.1.smithi195.stdout:6/478: creat d5/d5e/d34/d55/d4b/da2/fae x:0 0 0 2024-03-22T07:28:34.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/349: link dc/d17/f38 dc/de/d55/d65/f67 0 2024-03-22T07:28:34.674 INFO:tasks.workunit.client.1.smithi195.stdout:1/419: symlink d0/d2/l8a 0 2024-03-22T07:28:34.674 INFO:tasks.workunit.client.1.smithi195.stdout:1/420: creat d0/d2/d6/f8b x:0 0 0 2024-03-22T07:28:34.674 INFO:tasks.workunit.client.1.smithi195.stdout:1/421: dread - d0/d2/d6/d21/d41/d47/d4a/f83 zero size 2024-03-22T07:28:34.674 INFO:tasks.workunit.client.1.smithi195.stdout:1/422: fdatasync d0/d2/d6/f8b 0 2024-03-22T07:28:34.675 INFO:tasks.workunit.client.1.smithi195.stdout:4/502: dread d13/d2a/f28 [0,4194304] 0 2024-03-22T07:28:34.676 INFO:tasks.workunit.client.1.smithi195.stdout:4/503: rename d13 to d13/d63/d36/db1 22 2024-03-22T07:28:34.676 INFO:tasks.workunit.client.1.smithi195.stdout:2/515: creat d2/d3/d7/d19/d22/fa9 x:0 0 0 2024-03-22T07:28:34.676 INFO:tasks.workunit.client.1.smithi195.stdout:2/516: readlink d2/l1c 0 2024-03-22T07:28:34.678 INFO:tasks.workunit.client.0.smithi134.stdout:4/387: mkdir d2/d2a/d80 0 2024-03-22T07:28:34.680 INFO:tasks.workunit.client.1.smithi195.stdout:9/665: truncate d2/d4/d6/db/d20/d4a/f5e 3314858 0 2024-03-22T07:28:34.681 INFO:tasks.workunit.client.0.smithi134.stdout:5/305: creat d1/d8/d20/d62/f69 x:0 0 0 2024-03-22T07:28:34.681 INFO:tasks.workunit.client.0.smithi134.stdout:5/306: truncate d1/d8/f66 92850 0 2024-03-22T07:28:34.685 INFO:tasks.workunit.client.1.smithi195.stdout:4/504: dread d13/d63/d79/d68/f82 [4194304,4194304] 0 2024-03-22T07:28:34.687 INFO:tasks.workunit.client.1.smithi195.stdout:6/479: rmdir d5/d5e/d34/d55/d4b 39 2024-03-22T07:28:34.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/536: dwrite d9/d22/d50/f6c [0,4194304] 0 2024-03-22T07:28:34.687 INFO:tasks.workunit.client.1.smithi195.stdout:5/537: write d9/f25 [841967,130570] 0 2024-03-22T07:28:34.688 INFO:tasks.workunit.client.1.smithi195.stdout:5/538: dread d9/d2d/f51 [0,4194304] 0 2024-03-22T07:28:34.690 INFO:tasks.workunit.client.0.smithi134.stdout:9/289: mknod d3/d9/df/d12/d3b/c66 0 2024-03-22T07:28:34.690 INFO:tasks.workunit.client.0.smithi134.stdout:9/290: chown d3/d9/df/f61 0 1 2024-03-22T07:28:34.691 INFO:tasks.workunit.client.1.smithi195.stdout:1/423: mknod d0/d70/d6b/c8c 0 2024-03-22T07:28:34.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/307: dread d1/f57 [0,4194304] 0 2024-03-22T07:28:34.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/308: dread - d1/d8/f63 zero size 2024-03-22T07:28:34.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/517: mknod d2/d3/d21/d60/d81/d9a/caa 0 2024-03-22T07:28:34.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/511: link d1/de/d11/d48/f29 d1/de/d11/d48/d52/fa4 0 2024-03-22T07:28:34.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/512: stat d1/de/d11/d2b/d31/c5c 0 2024-03-22T07:28:34.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/666: mkdir d2/d4/d6/db5/df2 0 2024-03-22T07:28:34.698 INFO:tasks.workunit.client.1.smithi195.stdout:9/667: chown d2/d4/d6/db/d20/d47/f73 249 1 2024-03-22T07:28:34.702 INFO:tasks.workunit.client.0.smithi134.stdout:3/290: creat d4/f66 x:0 0 0 2024-03-22T07:28:34.703 INFO:tasks.workunit.client.0.smithi134.stdout:7/513: dread d1/de/d11/d48/f29 [0,4194304] 0 2024-03-22T07:28:34.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/350: mknod dc/d18/c68 0 2024-03-22T07:28:34.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/424: dwrite d0/d2/d9/d2a/f80 [0,4194304] 0 2024-03-22T07:28:34.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/425: chown d0/d2/d6/d21/d39/l7d 67 1 2024-03-22T07:28:34.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/426: stat d0/d2/d6/d21/d41/d47/d4a/f83 0 2024-03-22T07:28:34.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/505: creat d13/d63/d7a/fb2 x:0 0 0 2024-03-22T07:28:34.710 INFO:tasks.workunit.client.0.smithi134.stdout:4/388: mknod d2/d15/d6f/c81 0 2024-03-22T07:28:34.711 INFO:tasks.workunit.client.1.smithi195.stdout:6/480: truncate d5/d5e/d34/d55/d4b/f68 908048 0 2024-03-22T07:28:34.711 INFO:tasks.workunit.client.1.smithi195.stdout:6/481: creat d5/d5e/d34/d55/d3b/d6e/d56/d8f/faf x:0 0 0 2024-03-22T07:28:34.711 INFO:tasks.workunit.client.1.smithi195.stdout:6/482: dread - d5/d5e/d34/d55/d3b/d6e/d3c/fa0 zero size 2024-03-22T07:28:34.712 INFO:tasks.workunit.client.0.smithi134.stdout:2/285: rename d2/d5/d8/d2c to d2/d5/d22/d52 0 2024-03-22T07:28:34.712 INFO:tasks.workunit.client.0.smithi134.stdout:2/286: write d2/d5/d8/f33 [465980,125673] 0 2024-03-22T07:28:34.713 INFO:tasks.workunit.client.0.smithi134.stdout:9/291: getdents d3 0 2024-03-22T07:28:34.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/309: mknod d1/d8/d20/d62/d65/c6a 0 2024-03-22T07:28:34.716 INFO:tasks.workunit.client.1.smithi195.stdout:5/539: creat d9/d22/fb4 x:0 0 0 2024-03-22T07:28:34.717 INFO:tasks.workunit.client.1.smithi195.stdout:5/540: write d9/d12/d1d/d69/d78/d41/f8d [265560,43300] 0 2024-03-22T07:28:34.717 INFO:tasks.workunit.client.1.smithi195.stdout:5/541: fsync d9/d22/d50/f75 0 2024-03-22T07:28:34.717 INFO:tasks.workunit.client.0.smithi134.stdout:3/291: truncate d4/d8/f4e 1695270 0 2024-03-22T07:28:34.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/518: symlink d2/d3/d7/da/d4e/lab 0 2024-03-22T07:28:34.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/519: readlink d2/l4 0 2024-03-22T07:28:34.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/520: chown d2/d3/f74 0 1 2024-03-22T07:28:34.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/521: chown d2/f34 1626 1 2024-03-22T07:28:34.719 INFO:tasks.workunit.client.0.smithi134.stdout:0/351: mknod dc/c69 0 2024-03-22T07:28:34.723 INFO:tasks.workunit.client.0.smithi134.stdout:4/389: creat d2/d25/d48/d6e/f82 x:0 0 0 2024-03-22T07:28:34.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/514: dwrite d1/d40/fa2 [0,4194304] 0 2024-03-22T07:28:34.728 INFO:tasks.workunit.client.0.smithi134.stdout:1/352: rename d5/fc to d5/da/d13/d1e/d45/f7a 0 2024-03-22T07:28:34.731 INFO:tasks.workunit.client.1.smithi195.stdout:1/427: truncate d0/d2/f1f 3727876 0 2024-03-22T07:28:34.732 INFO:tasks.workunit.client.0.smithi134.stdout:1/353: dread d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:34.733 INFO:tasks.workunit.client.1.smithi195.stdout:4/506: mkdir d13/d15/d6b/da6/db3 0 2024-03-22T07:28:34.734 INFO:tasks.workunit.client.0.smithi134.stdout:3/292: creat d4/d22/d29/f67 x:0 0 0 2024-03-22T07:28:34.735 INFO:tasks.workunit.client.0.smithi134.stdout:3/293: chown d4/d8/c9 4006195 1 2024-03-22T07:28:34.735 INFO:tasks.workunit.client.1.smithi195.stdout:4/507: write d13/d63/d79/f48 [1221760,110789] 0 2024-03-22T07:28:34.738 INFO:tasks.workunit.client.0.smithi134.stdout:4/390: symlink d2/l83 0 2024-03-22T07:28:34.741 INFO:tasks.workunit.client.0.smithi134.stdout:0/352: dwrite dc/d17/f38 [0,4194304] 0 2024-03-22T07:28:34.743 INFO:tasks.workunit.client.1.smithi195.stdout:5/542: mknod d9/d12/d1d/d69/d78/d41/cb5 0 2024-03-22T07:28:34.745 INFO:tasks.workunit.client.0.smithi134.stdout:6/272: sync 2024-03-22T07:28:34.745 INFO:tasks.workunit.client.0.smithi134.stdout:8/392: sync 2024-03-22T07:28:34.745 INFO:tasks.workunit.client.0.smithi134.stdout:6/273: chown d2/d3f/c4e 6 1 2024-03-22T07:28:34.745 INFO:tasks.workunit.client.0.smithi134.stdout:8/393: dread - d1/d4/d61/f65 zero size 2024-03-22T07:28:34.745 INFO:tasks.workunit.client.0.smithi134.stdout:6/274: chown d2/d1b/d1d 10 1 2024-03-22T07:28:34.745 INFO:tasks.workunit.client.0.smithi134.stdout:6/275: read - d2/d3f/f61 zero size 2024-03-22T07:28:34.747 INFO:tasks.workunit.client.1.smithi195.stdout:2/522: mkdir d2/d3/dac 0 2024-03-22T07:28:34.750 INFO:tasks.workunit.client.0.smithi134.stdout:7/515: symlink d1/de/d11/d2b/d31/d85/la5 0 2024-03-22T07:28:34.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/294: dread d4/d10/f11 [0,4194304] 0 2024-03-22T07:28:34.750 INFO:tasks.workunit.client.1.smithi195.stdout:1/428: dwrite d0/d2/d9/f61 [0,4194304] 0 2024-03-22T07:28:34.751 INFO:tasks.workunit.client.1.smithi195.stdout:1/429: dread - d0/d2/d6/f71 zero size 2024-03-22T07:28:34.751 INFO:tasks.workunit.client.1.smithi195.stdout:1/430: chown d0/d2/d6/d21/d41/d47/d4a 419743 1 2024-03-22T07:28:34.751 INFO:tasks.workunit.client.1.smithi195.stdout:9/668: getdents d2/d4/d1d 0 2024-03-22T07:28:34.751 INFO:tasks.workunit.client.1.smithi195.stdout:9/669: truncate d2/d4/d6/d18/f29 4583520 0 2024-03-22T07:28:34.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/543: dread d9/d22/d46/f63 [0,4194304] 0 2024-03-22T07:28:34.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/544: stat d9/d12/d1d/d69 0 2024-03-22T07:28:34.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/545: write d9/d12/d1d/d69/d78/fb1 [978967,104820] 0 2024-03-22T07:28:34.752 INFO:tasks.workunit.client.1.smithi195.stdout:5/546: write d9/f96 [130580,9093] 0 2024-03-22T07:28:34.753 INFO:tasks.workunit.client.0.smithi134.stdout:9/292: rename d3/d9/df/d12/d2d to d3/d9/df/d57/d67 0 2024-03-22T07:28:34.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/293: dread d3/d9/d37/f47 [0,4194304] 0 2024-03-22T07:28:34.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/294: write d3/d9/df/d12/f4c [2514951,14664] 0 2024-03-22T07:28:34.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/295: chown f0 40 1 2024-03-22T07:28:34.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/508: symlink d13/d63/d3e/d5c/d65/lb4 0 2024-03-22T07:28:34.755 INFO:tasks.workunit.client.1.smithi195.stdout:4/509: dread - d13/d15/faf zero size 2024-03-22T07:28:34.755 INFO:tasks.workunit.client.0.smithi134.stdout:2/287: mknod d2/d5/d8/c53 0 2024-03-22T07:28:34.757 INFO:tasks.workunit.client.1.smithi195.stdout:6/483: link d5/d5e/d34/d55/d4b/f68 d5/d5e/d34/d55/d3b/d6e/d3c/fb0 0 2024-03-22T07:28:34.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/310: rmdir d1/d8/d3f 39 2024-03-22T07:28:34.758 INFO:tasks.workunit.client.0.smithi134.stdout:5/311: write d1/d8/d16/f40 [746217,44998] 0 2024-03-22T07:28:34.762 INFO:tasks.workunit.client.1.smithi195.stdout:2/523: mkdir d2/d3/dac/dad 0 2024-03-22T07:28:34.764 INFO:tasks.workunit.client.0.smithi134.stdout:1/354: mknod d5/da/d1b/d27/d60/d72/c7b 0 2024-03-22T07:28:34.764 INFO:tasks.workunit.client.0.smithi134.stdout:1/355: fsync d5/da/d13/d1e/f44 0 2024-03-22T07:28:34.767 INFO:tasks.workunit.client.0.smithi134.stdout:6/276: dwrite d2/d1b/d1d/f55 [0,4194304] 0 2024-03-22T07:28:34.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/394: symlink d1/d46/l88 0 2024-03-22T07:28:34.769 INFO:tasks.workunit.client.0.smithi134.stdout:8/395: chown d1/f77 17095 1 2024-03-22T07:28:34.770 INFO:tasks.workunit.client.1.smithi195.stdout:4/510: dread d13/f34 [0,4194304] 0 2024-03-22T07:28:34.772 INFO:tasks.workunit.client.0.smithi134.stdout:7/516: mknod d1/d40/ca6 0 2024-03-22T07:28:34.772 INFO:tasks.workunit.client.0.smithi134.stdout:7/517: truncate d1/d40/f7f 5014621 0 2024-03-22T07:28:34.773 INFO:tasks.workunit.client.0.smithi134.stdout:7/518: creat d1/de/d11/d2b/d31/fa7 x:0 0 0 2024-03-22T07:28:34.773 INFO:tasks.workunit.client.0.smithi134.stdout:5/312: dread d1/d8/d20/d62/d65/f15 [0,4194304] 0 2024-03-22T07:28:34.773 INFO:tasks.workunit.client.0.smithi134.stdout:5/313: fsync d1/d8/d20/d62/d65/f15 0 2024-03-22T07:28:34.774 INFO:tasks.workunit.client.0.smithi134.stdout:7/519: dread f0 [4194304,4194304] 0 2024-03-22T07:28:34.775 INFO:tasks.workunit.client.1.smithi195.stdout:2/524: dread d2/d3/d21/f14 [0,4194304] 0 2024-03-22T07:28:34.776 INFO:tasks.workunit.client.0.smithi134.stdout:3/295: getdents d4/d22/d29/d50 0 2024-03-22T07:28:34.777 INFO:tasks.workunit.client.1.smithi195.stdout:1/431: truncate d0/d70/d6a/f88 3773985 0 2024-03-22T07:28:34.779 INFO:tasks.workunit.client.0.smithi134.stdout:6/277: rename d2/f8 to d2/d1b/d1d/d2b/d4f/f67 0 2024-03-22T07:28:34.779 INFO:tasks.workunit.client.0.smithi134.stdout:6/278: write d2/d1b/f29 [1874686,25034] 0 2024-03-22T07:28:34.780 INFO:tasks.workunit.client.0.smithi134.stdout:8/396: getdents d1/d15/d42 0 2024-03-22T07:28:34.783 INFO:tasks.workunit.client.1.smithi195.stdout:5/547: creat d9/d2d/d8f/fb6 x:0 0 0 2024-03-22T07:28:34.786 INFO:tasks.workunit.client.0.smithi134.stdout:1/356: getdents d5/da/d1b 0 2024-03-22T07:28:34.786 INFO:tasks.workunit.client.0.smithi134.stdout:1/357: readlink d5/l4e 0 2024-03-22T07:28:34.787 INFO:tasks.workunit.client.0.smithi134.stdout:3/296: rename d4/d8/d23/c59 to d4/d22/c68 0 2024-03-22T07:28:34.787 INFO:tasks.workunit.client.0.smithi134.stdout:0/353: dwrite dc/d18/f1b [4194304,4194304] 0 2024-03-22T07:28:34.788 INFO:tasks.workunit.client.0.smithi134.stdout:2/288: dwrite d2/d5/d22/d52/f4b [0,4194304] 0 2024-03-22T07:28:34.788 INFO:tasks.workunit.client.0.smithi134.stdout:2/289: readlink d2/d5/lf 0 2024-03-22T07:28:34.789 INFO:tasks.workunit.client.0.smithi134.stdout:4/391: dwrite d2/f46 [0,4194304] 0 2024-03-22T07:28:34.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/548: dread d9/d2d/f40 [0,4194304] 0 2024-03-22T07:28:34.791 INFO:tasks.workunit.client.0.smithi134.stdout:7/520: dread d1/de/d11/d48/d52/f3e [0,4194304] 0 2024-03-22T07:28:34.794 INFO:tasks.workunit.client.1.smithi195.stdout:6/484: symlink d5/d5e/d34/d55/d4b/lb1 0 2024-03-22T07:28:34.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/485: chown d5/d5e/d34/d55/d4b/da2/f2a 3248062 1 2024-03-22T07:28:34.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/486: chown d5/d16/d45/d53/d59/d87 2140309640 1 2024-03-22T07:28:34.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:34.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:34.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:28:34.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:28:34.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:34.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr fail", "who": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: osdmap e48: 6 total, 6 up, 6 in 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "mgr fail", "who": "smithi134.wtwqre"}]': finished 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: mgrmap e21: smithi195.jxfsnc(active, starting, since 0.0104888s) 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:28:34.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: Manager daemon smithi195.jxfsnc is now available 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/trash_purge_schedule"}]: dispatch 2024-03-22T07:28:34.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/trash_purge_schedule"}]: dispatch 2024-03-22T07:28:34.799 INFO:tasks.workunit.client.0.smithi134.stdout:1/358: mkdir d5/da/d1b/d27/d60/d72/d7c 0 2024-03-22T07:28:34.799 INFO:tasks.workunit.client.0.smithi134.stdout:8/397: creat d1/d15/d57/f89 x:0 0 0 2024-03-22T07:28:34.799 INFO:tasks.workunit.client.0.smithi134.stdout:8/398: write d1/d15/d42/d76/f78 [66477,89995] 0 2024-03-22T07:28:34.800 INFO:tasks.workunit.client.1.smithi195.stdout:4/511: rmdir d13 39 2024-03-22T07:28:34.800 INFO:tasks.workunit.client.1.smithi195.stdout:9/670: getdents d2/d4/d1d/ddc 0 2024-03-22T07:28:34.800 INFO:tasks.workunit.client.1.smithi195.stdout:9/671: dread - d2/d4/d23/f8d zero size 2024-03-22T07:28:34.801 INFO:tasks.workunit.client.1.smithi195.stdout:5/549: creat d9/d12/d1d/d36/fb7 x:0 0 0 2024-03-22T07:28:34.803 INFO:tasks.workunit.client.0.smithi134.stdout:9/296: dread d3/d9/f36 [0,4194304] 0 2024-03-22T07:28:34.805 INFO:tasks.workunit.client.1.smithi195.stdout:6/487: rename d5/d5e/d34/d55/d4b/f68 to d5/d5e/d34/d55/d4b/da2/d1a/fb2 0 2024-03-22T07:28:34.808 INFO:tasks.workunit.client.0.smithi134.stdout:3/297: mkdir d4/d8/d69 0 2024-03-22T07:28:34.810 INFO:tasks.workunit.client.1.smithi195.stdout:4/512: mkdir d13/d63/d3e/db5 0 2024-03-22T07:28:34.813 INFO:tasks.workunit.client.0.smithi134.stdout:9/297: dread d3/d9/df/d12/d1b/f29 [0,4194304] 0 2024-03-22T07:28:34.814 INFO:tasks.workunit.client.1.smithi195.stdout:9/672: link d2/d4/d1d/l75 d2/d4/d32/d6d/d78/lf3 0 2024-03-22T07:28:34.814 INFO:tasks.workunit.client.0.smithi134.stdout:9/298: read d3/d9/d37/f47 [39771,122414] 0 2024-03-22T07:28:34.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/550: symlink d9/d22/d7b/d98/da0/lb8 0 2024-03-22T07:28:34.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/551: chown d9/d22/c9c 5 1 2024-03-22T07:28:34.816 INFO:tasks.workunit.client.1.smithi195.stdout:5/552: write d9/f28 [5032280,7366] 0 2024-03-22T07:28:34.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/399: dwrite d1/d4/d61/f65 [0,4194304] 0 2024-03-22T07:28:34.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/513: rename d13/d63/d79/f8f to d13/d2a/d7e/fb6 0 2024-03-22T07:28:34.818 INFO:tasks.workunit.client.1.smithi195.stdout:4/514: readlink d13/d63/d3e/l8b 0 2024-03-22T07:28:34.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/553: mknod d9/d2d/d84/cb9 0 2024-03-22T07:28:34.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/554: fsync d9/d2d/d58/f93 0 2024-03-22T07:28:34.827 INFO:tasks.workunit.client.0.smithi134.stdout:0/354: dwrite dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:34.828 INFO:tasks.workunit.client.1.smithi195.stdout:5/555: fsync d9/d12/d1d/d69/d78/d41/f8d 0 2024-03-22T07:28:34.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/588: sync 2024-03-22T07:28:34.828 INFO:tasks.workunit.client.1.smithi195.stdout:3/536: sync 2024-03-22T07:28:34.828 INFO:tasks.workunit.client.1.smithi195.stdout:7/486: sync 2024-03-22T07:28:34.828 INFO:tasks.workunit.client.1.smithi195.stdout:8/589: write da/d17/d32/d7d/d8e/fa1 [320546,64851] 0 2024-03-22T07:28:34.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/392: rename d2/d25/l36 to d2/d15/d35/d37/d76/l84 0 2024-03-22T07:28:34.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/393: fsync d2/d15/f11 0 2024-03-22T07:28:34.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/394: readlink d2/d15/d35/d37/l68 0 2024-03-22T07:28:34.829 INFO:tasks.workunit.client.1.smithi195.stdout:2/525: dwrite d2/d3/f79 [0,4194304] 0 2024-03-22T07:28:34.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/432: dwrite d0/d2/d6/f8b [0,4194304] 0 2024-03-22T07:28:34.829 INFO:tasks.workunit.client.1.smithi195.stdout:1/433: chown d0/d2/d6/d21/d41/d47/d4a/d66/c6e 4 1 2024-03-22T07:28:34.830 INFO:tasks.workunit.client.0.smithi134.stdout:6/279: dwrite d2/d1b/f24 [0,4194304] 0 2024-03-22T07:28:34.830 INFO:tasks.workunit.client.1.smithi195.stdout:8/590: dread da/dc/f6f [0,4194304] 0 2024-03-22T07:28:34.831 INFO:tasks.workunit.client.0.smithi134.stdout:7/521: mkdir d1/da8 0 2024-03-22T07:28:34.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/280: dread d2/f17 [4194304,4194304] 0 2024-03-22T07:28:34.835 INFO:tasks.workunit.client.1.smithi195.stdout:4/515: dread d13/d63/d79/f45 [0,4194304] 0 2024-03-22T07:28:34.835 INFO:tasks.workunit.client.1.smithi195.stdout:0/537: sync 2024-03-22T07:28:34.835 INFO:tasks.workunit.client.1.smithi195.stdout:0/538: getdents d1/d4/d12/d6c/d7b 0 2024-03-22T07:28:34.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/298: mkdir d4/d8/d69/d6a 0 2024-03-22T07:28:34.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/299: fdatasync d4/d8/f49 0 2024-03-22T07:28:34.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/300: dread - d4/d22/d29/f46 zero size 2024-03-22T07:28:34.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/537: creat d3/d22/fb3 x:0 0 0 2024-03-22T07:28:34.841 INFO:tasks.workunit.client.1.smithi195.stdout:3/538: stat d3/d18/d89/d70 0 2024-03-22T07:28:34.841 INFO:tasks.workunit.client.1.smithi195.stdout:2/526: write d2/d3/d21/d40/f5d [295816,31857] 0 2024-03-22T07:28:34.842 INFO:tasks.workunit.client.0.smithi134.stdout:9/299: creat d3/d9/df/d12/d1b/d54/f68 x:0 0 0 2024-03-22T07:28:34.848 INFO:tasks.workunit.client.1.smithi195.stdout:7/487: rename d0/d13/d14/d29/d35/d3a/d7e/f95 to d0/d13/d14/d29/d35/fa8 0 2024-03-22T07:28:34.850 INFO:tasks.workunit.client.0.smithi134.stdout:2/290: mkdir d2/d5/d54 0 2024-03-22T07:28:34.854 INFO:tasks.workunit.client.1.smithi195.stdout:9/673: dwrite d2/d4/d6/db/d20/f26 [0,4194304] 0 2024-03-22T07:28:34.854 INFO:tasks.workunit.client.1.smithi195.stdout:9/674: truncate d2/d4/d6/d18/f43 1603272 0 2024-03-22T07:28:34.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/359: getdents d5/da/d1b/d27/d60/d72 0 2024-03-22T07:28:34.857 INFO:tasks.workunit.client.1.smithi195.stdout:4/516: dread fa [4194304,4194304] 0 2024-03-22T07:28:34.857 INFO:tasks.workunit.client.1.smithi195.stdout:4/517: dread - d13/d63/f18 zero size 2024-03-22T07:28:34.857 INFO:tasks.workunit.client.1.smithi195.stdout:1/434: dwrite d0/d2/d6/d21/d39/d64/d7a/f57 [0,4194304] 0 2024-03-22T07:28:34.858 INFO:tasks.workunit.client.1.smithi195.stdout:1/435: chown d0/d2/d27/c45 133380 1 2024-03-22T07:28:34.858 INFO:tasks.workunit.client.1.smithi195.stdout:1/436: dread - d0/d70/f77 zero size 2024-03-22T07:28:34.859 INFO:tasks.workunit.client.1.smithi195.stdout:5/556: dwrite d9/d12/f52 [0,4194304] 0 2024-03-22T07:28:34.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/557: truncate d9/d22/fb4 852776 0 2024-03-22T07:28:34.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/558: chown d9/d22/d46/db2/lae 1237056 1 2024-03-22T07:28:34.860 INFO:tasks.workunit.client.0.smithi134.stdout:8/400: dwrite d1/d15/d42/d12/d20/f70 [0,4194304] 0 2024-03-22T07:28:34.864 INFO:tasks.workunit.client.0.smithi134.stdout:4/395: mkdir d2/d2a/d80/d85 0 2024-03-22T07:28:34.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/539: symlink d1/d4/dd/df/d67/l99 0 2024-03-22T07:28:34.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/540: creat d1/d4/dd/d66/f9a x:0 0 0 2024-03-22T07:28:34.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/541: chown d1/d10/d19/d20/f3c 55956 1 2024-03-22T07:28:34.869 INFO:tasks.workunit.client.1.smithi195.stdout:3/539: creat d3/df/d15/d1d/d5c/d47/fb4 x:0 0 0 2024-03-22T07:28:34.871 INFO:tasks.workunit.client.0.smithi134.stdout:7/522: symlink d1/de/d11/d2b/d69/la9 0 2024-03-22T07:28:34.873 INFO:tasks.workunit.client.1.smithi195.stdout:2/527: unlink d2/d3/c3e 0 2024-03-22T07:28:34.873 INFO:tasks.workunit.client.1.smithi195.stdout:1/437: dread d0/d2/d6/d21/d39/d64/d7a/f57 [0,4194304] 0 2024-03-22T07:28:34.874 INFO:tasks.workunit.client.0.smithi134.stdout:6/281: getdents d2/d3f/d28 0 2024-03-22T07:28:34.874 INFO:tasks.workunit.client.0.smithi134.stdout:6/282: fdatasync d2/f35 0 2024-03-22T07:28:34.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/675: creat d2/d4/d6/ff4 x:0 0 0 2024-03-22T07:28:34.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/676: chown d2/d4/d6/d18/fbf 115 1 2024-03-22T07:28:34.877 INFO:tasks.workunit.client.0.smithi134.stdout:4/396: write d2/d2a/d50/f59 [1035827,125772] 0 2024-03-22T07:28:34.877 INFO:tasks.workunit.client.0.smithi134.stdout:9/300: dwrite d3/f22 [0,4194304] 0 2024-03-22T07:28:34.878 INFO:tasks.workunit.client.0.smithi134.stdout:3/301: mknod d4/d8/d69/d6a/c6b 0 2024-03-22T07:28:34.878 INFO:tasks.workunit.client.1.smithi195.stdout:1/438: write d0/d2/d6/d21/d39/d64/d7a/f57 [1591963,29385] 0 2024-03-22T07:28:34.878 INFO:tasks.workunit.client.1.smithi195.stdout:7/488: dwrite d0/d13/d14/f8 [4194304,4194304] 0 2024-03-22T07:28:34.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/518: rmdir d13/d63/d3e/db5 0 2024-03-22T07:28:34.881 INFO:tasks.workunit.client.1.smithi195.stdout:4/519: dread - d13/d2a/d7e/d85/fa7 zero size 2024-03-22T07:28:34.882 INFO:tasks.workunit.client.0.smithi134.stdout:2/291: symlink d2/d5/d8/d31/l55 0 2024-03-22T07:28:34.884 INFO:tasks.workunit.client.0.smithi134.stdout:1/360: creat d5/da/d1b/d27/d60/d72/f7d x:0 0 0 2024-03-22T07:28:34.885 INFO:tasks.workunit.client.0.smithi134.stdout:1/361: fdatasync d5/fe 0 2024-03-22T07:28:34.885 INFO:tasks.workunit.client.1.smithi195.stdout:1/439: dread d0/f26 [0,4194304] 0 2024-03-22T07:28:34.887 INFO:tasks.workunit.client.0.smithi134.stdout:8/401: mknod d1/d4/d61/c8a 0 2024-03-22T07:28:34.887 INFO:tasks.workunit.client.0.smithi134.stdout:1/362: dread d5/da/d13/d1e/f22 [0,4194304] 0 2024-03-22T07:28:34.888 INFO:tasks.workunit.client.1.smithi195.stdout:5/559: creat d9/d2d/d84/d92/fba x:0 0 0 2024-03-22T07:28:34.890 INFO:tasks.workunit.client.1.smithi195.stdout:8/591: getdents da/d17/d32/d61/d47 0 2024-03-22T07:28:34.895 INFO:tasks.workunit.client.0.smithi134.stdout:0/355: rmdir dc/d18 39 2024-03-22T07:28:34.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/402: dread d1/d15/d42/d25/f59 [0,4194304] 0 2024-03-22T07:28:34.897 INFO:tasks.workunit.client.0.smithi134.stdout:8/403: fsync d1/d15/d5b/f6d 0 2024-03-22T07:28:34.898 INFO:tasks.workunit.client.0.smithi134.stdout:8/404: chown d1/d15/d42/d12/l5c 45886393 1 2024-03-22T07:28:34.898 INFO:tasks.workunit.client.0.smithi134.stdout:7/523: truncate d1/d40/f9f 2170993 0 2024-03-22T07:28:34.901 INFO:tasks.workunit.client.1.smithi195.stdout:0/542: rmdir d1/d4/dd/df/d98 0 2024-03-22T07:28:34.902 INFO:tasks.workunit.client.1.smithi195.stdout:1/440: dread d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:34.903 INFO:tasks.workunit.client.0.smithi134.stdout:4/397: symlink d2/d2a/l86 0 2024-03-22T07:28:34.904 INFO:tasks.workunit.client.1.smithi195.stdout:3/540: mkdir d3/d18/d89/d70/db5 0 2024-03-22T07:28:34.905 INFO:tasks.workunit.client.1.smithi195.stdout:2/528: symlink d2/d3/d21/d4c/lae 0 2024-03-22T07:28:34.905 INFO:tasks.workunit.client.1.smithi195.stdout:2/529: readlink d2/d3/l69 0 2024-03-22T07:28:34.907 INFO:tasks.workunit.client.0.smithi134.stdout:9/301: mknod d3/d9/c69 0 2024-03-22T07:28:34.907 INFO:tasks.workunit.client.0.smithi134.stdout:4/398: dread d2/d1d/f72 [0,4194304] 0 2024-03-22T07:28:34.907 INFO:tasks.workunit.client.0.smithi134.stdout:4/399: chown d2/d25/d48/d6e/f82 2 1 2024-03-22T07:28:34.909 INFO:tasks.workunit.client.1.smithi195.stdout:9/677: dwrite d2/d4/d1d/f22 [0,4194304] 0 2024-03-22T07:28:34.910 INFO:tasks.workunit.client.1.smithi195.stdout:7/489: creat d0/d13/d14/d96/fa9 x:0 0 0 2024-03-22T07:28:34.912 INFO:tasks.workunit.client.1.smithi195.stdout:4/520: mkdir d13/d2a/d7e/d8c/db7 0 2024-03-22T07:28:34.914 INFO:tasks.workunit.client.0.smithi134.stdout:1/363: dwrite d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/560: mkdir d9/d73/dbb 0 2024-03-22T07:28:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/561: chown d9/f6f 22031 1 2024-03-22T07:28:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/562: write d9/d12/f47 [5193976,24090] 0 2024-03-22T07:28:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/563: write d9/d2d/d8f/fb6 [285756,120206] 0 2024-03-22T07:28:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/564: fdatasync d9/d2d/f67 0 2024-03-22T07:28:34.915 INFO:tasks.workunit.client.1.smithi195.stdout:5/565: fsync d9/d12/d1d/d36/f5a 0 2024-03-22T07:28:34.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/592: rename da/d17/d32/d61/d47/d53/d8d/l95 to da/d17/d32/d61/d88/lb2 0 2024-03-22T07:28:34.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/593: fdatasync da/d82/f9a 0 2024-03-22T07:28:34.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/302: mknod d3/d9/df/d57/d67/d5f/c6a 0 2024-03-22T07:28:34.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/303: chown d3/d9/d37/d3c/l3e 125364 1 2024-03-22T07:28:34.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/304: fsync f0 0 2024-03-22T07:28:34.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/305: truncate d3/d9/df/d12/d1b/f2e 946237 0 2024-03-22T07:28:34.919 INFO:tasks.workunit.client.0.smithi134.stdout:9/306: truncate d3/d9/df/d12/d1b/f5d 879587 0 2024-03-22T07:28:34.920 INFO:tasks.workunit.client.1.smithi195.stdout:1/441: mknod d0/d2/d9/d2a/c8d 0 2024-03-22T07:28:34.921 INFO:tasks.workunit.client.0.smithi134.stdout:4/400: rmdir d2 39 2024-03-22T07:28:34.922 INFO:tasks.workunit.client.0.smithi134.stdout:4/401: dread - d2/f62 zero size 2024-03-22T07:28:34.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/490: dread d0/d13/d14/d20/d40/d82/da0/d59/f9e [0,4194304] 0 2024-03-22T07:28:34.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/491: getdents d0/d13/d14/d80/d9c 0 2024-03-22T07:28:34.922 INFO:tasks.workunit.client.1.smithi195.stdout:7/492: chown d0/d13/d14/d5b 32433629 1 2024-03-22T07:28:34.926 INFO:tasks.workunit.client.1.smithi195.stdout:2/530: symlink d2/d3/d7/d19/d22/d26/laf 0 2024-03-22T07:28:34.928 INFO:tasks.workunit.client.0.smithi134.stdout:1/364: dread d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:34.929 INFO:tasks.workunit.client.0.smithi134.stdout:8/405: dwrite d1/f5d [0,4194304] 0 2024-03-22T07:28:34.931 INFO:tasks.workunit.client.1.smithi195.stdout:0/543: dwrite d1/d4/d22/f6d [0,4194304] 0 2024-03-22T07:28:34.931 INFO:tasks.workunit.client.1.smithi195.stdout:0/544: write d1/d4/f7 [4854186,65146] 0 2024-03-22T07:28:34.932 INFO:tasks.workunit.client.0.smithi134.stdout:2/292: rmdir d2/d5/d8/d31 39 2024-03-22T07:28:34.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/493: read d0/d13/d22/f23 [1459242,66028] 0 2024-03-22T07:28:34.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/494: write d0/d13/d22/d57/f84 [1032694,91948] 0 2024-03-22T07:28:34.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/495: fsync d0/d13/d14/f8 0 2024-03-22T07:28:34.934 INFO:tasks.workunit.client.1.smithi195.stdout:7/496: chown d0/d13/c38 1 1 2024-03-22T07:28:34.935 INFO:tasks.workunit.client.0.smithi134.stdout:1/365: rename d5/d1d/d49/c55 to d5/da/d13/d1e/d63/c7e 0 2024-03-22T07:28:34.940 INFO:tasks.workunit.client.1.smithi195.stdout:9/678: creat d2/d4/d6/db5/df2/ff5 x:0 0 0 2024-03-22T07:28:34.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/307: dwrite d3/d9/df/d12/d1b/d54/f68 [0,4194304] 0 2024-03-22T07:28:34.944 INFO:tasks.workunit.client.0.smithi134.stdout:8/406: mkdir d1/d46/d75/d8b 0 2024-03-22T07:28:34.946 INFO:tasks.workunit.client.0.smithi134.stdout:8/407: write d1/d15/d42/d12/d20/f3c [1148297,55035] 0 2024-03-22T07:28:34.946 INFO:tasks.workunit.client.1.smithi195.stdout:5/566: link d9/d12/l86 d9/d12/d1d/d69/d78/d41/lbc 0 2024-03-22T07:28:34.950 INFO:tasks.workunit.client.1.smithi195.stdout:4/521: rename d13/d63/d21/c94 to d13/d63/d3e/cb8 0 2024-03-22T07:28:34.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:34.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:28:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:28:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' 2024-03-22T07:28:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr fail", "who": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: osdmap e48: 6 total, 6 up, 6 in 2024-03-22T07:28:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.14210 172.21.15.134:0/2557604055' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "mgr fail", "who": "smithi134.wtwqre"}]': finished 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: mgrmap e21: smithi195.jxfsnc(active, starting, since 0.0104888s) 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: Manager daemon smithi195.jxfsnc is now available 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:28:34.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:34.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:28:34.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:28:34.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/trash_purge_schedule"}]: dispatch 2024-03-22T07:28:34.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi195.jxfsnc/trash_purge_schedule"}]: dispatch 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.0.smithi134.stdout:4/402: dwrite d2/d1d/f54 [4194304,4194304] 0 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.0.smithi134.stdout:2/293: dwrite d2/f14 [0,4194304] 0 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.0.smithi134.stdout:2/294: chown d2/d5/d54 29 1 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.0.smithi134.stdout:9/308: dwrite d3/d9/df/d12/d3b/f42 [0,4194304] 0 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/531: dwrite d2/d3/d24/f6e [0,4194304] 0 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/532: chown d2/d3/d24/f9f 402664 1 2024-03-22T07:28:34.960 INFO:tasks.workunit.client.1.smithi195.stdout:2/533: fdatasync d2/d3/d7/da/de/fa6 0 2024-03-22T07:28:34.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/594: dwrite da/dc/f2b [0,4194304] 0 2024-03-22T07:28:34.962 INFO:tasks.workunit.client.1.smithi195.stdout:0/545: mknod d1/d4/c9b 0 2024-03-22T07:28:34.966 INFO:tasks.workunit.client.1.smithi195.stdout:7/497: mkdir d0/d13/d14/d20/d40/d82/daa 0 2024-03-22T07:28:34.968 INFO:tasks.workunit.client.1.smithi195.stdout:9/679: truncate d2/d4/d6/d18/f36 2330770 0 2024-03-22T07:28:34.970 INFO:tasks.workunit.client.1.smithi195.stdout:5/567: creat d9/d12/d1d/d69/d78/d41/fbd x:0 0 0 2024-03-22T07:28:34.970 INFO:tasks.workunit.client.1.smithi195.stdout:5/568: fdatasync d9/d22/fb4 0 2024-03-22T07:28:34.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/680: dread d2/f82 [0,4194304] 0 2024-03-22T07:28:34.970 INFO:tasks.workunit.client.1.smithi195.stdout:9/681: readlink d2/d4/d32/d6d/d78/le9 0 2024-03-22T07:28:34.972 INFO:tasks.workunit.client.1.smithi195.stdout:1/442: rename d0/d2/d6/c89 to d0/d70/c8e 0 2024-03-22T07:28:34.972 INFO:tasks.workunit.client.1.smithi195.stdout:2/534: dwrite d2/d1e/f64 [0,4194304] 0 2024-03-22T07:28:34.974 INFO:tasks.workunit.client.1.smithi195.stdout:4/522: rmdir d13/d63/d3e/d5c/d65/dae 0 2024-03-22T07:28:34.975 INFO:tasks.workunit.client.0.smithi134.stdout:1/366: creat d5/da/d13/d1e/d45/f7f x:0 0 0 2024-03-22T07:28:34.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/595: mkdir da/de/db3 0 2024-03-22T07:28:34.980 INFO:tasks.workunit.client.1.smithi195.stdout:5/569: write d9/d22/d46/f88 [1085078,66174] 0 2024-03-22T07:28:34.981 INFO:tasks.workunit.client.1.smithi195.stdout:9/682: read d2/d4/d32/f37 [3633451,28933] 0 2024-03-22T07:28:34.983 INFO:tasks.workunit.client.0.smithi134.stdout:4/403: mkdir d2/d25/d48/d87 0 2024-03-22T07:28:34.986 INFO:tasks.workunit.client.0.smithi134.stdout:2/295: creat d2/d5/d8/d31/f56 x:0 0 0 2024-03-22T07:28:34.990 INFO:tasks.workunit.client.0.smithi134.stdout:9/309: mkdir d3/d9/d37/d5a/d6b 0 2024-03-22T07:28:34.992 INFO:tasks.workunit.client.0.smithi134.stdout:1/367: creat d5/da/d1b/d27/f80 x:0 0 0 2024-03-22T07:28:34.993 INFO:tasks.workunit.client.0.smithi134.stdout:1/368: chown d5/da/d1b/f36 7307 1 2024-03-22T07:28:34.994 INFO:tasks.workunit.client.1.smithi195.stdout:0/546: symlink d1/d4/dd/df/d67/l9c 0 2024-03-22T07:28:34.994 INFO:tasks.workunit.client.1.smithi195.stdout:0/547: readlink d1/d4/d22/l5f 0 2024-03-22T07:28:34.994 INFO:tasks.workunit.client.0.smithi134.stdout:8/408: rmdir d1/d15/d57 39 2024-03-22T07:28:34.995 INFO:tasks.workunit.client.0.smithi134.stdout:8/409: chown d1/d46/l72 7 1 2024-03-22T07:28:34.996 INFO:tasks.workunit.client.1.smithi195.stdout:7/498: mkdir d0/d98/dab 0 2024-03-22T07:28:34.998 INFO:tasks.workunit.client.0.smithi134.stdout:4/404: creat d2/d2a/d80/d85/f88 x:0 0 0 2024-03-22T07:28:34.998 INFO:tasks.workunit.client.0.smithi134.stdout:4/405: fsync d2/d15/f61 0 2024-03-22T07:28:34.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/523: dwrite d13/d15/f6f [0,4194304] 0 2024-03-22T07:28:35.000 INFO:tasks.workunit.client.0.smithi134.stdout:4/406: read d2/f71 [860964,101291] 0 2024-03-22T07:28:35.000 INFO:tasks.workunit.client.0.smithi134.stdout:4/407: chown d2/d25/d48/d6e 11444887 1 2024-03-22T07:28:35.001 INFO:tasks.workunit.client.0.smithi134.stdout:2/296: symlink d2/d5/d22/d52/d3c/l57 0 2024-03-22T07:28:35.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/310: creat d3/d9/df/d57/d67/f6c x:0 0 0 2024-03-22T07:28:35.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/311: chown d3/d9/df/d12/l48 70354 1 2024-03-22T07:28:35.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/312: chown d3/d9/df/d12/d3b/f4d 8856738 1 2024-03-22T07:28:35.007 INFO:tasks.workunit.client.0.smithi134.stdout:1/369: symlink d5/da/d68/l81 0 2024-03-22T07:28:35.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/535: unlink d2/d3/c2d 0 2024-03-22T07:28:35.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/536: dread - d2/d3/d7/da/d4e/f8d zero size 2024-03-22T07:28:35.011 INFO:tasks.workunit.client.0.smithi134.stdout:4/408: link d2/d15/f39 d2/d15/d66/f89 0 2024-03-22T07:28:35.011 INFO:tasks.workunit.client.0.smithi134.stdout:4/409: dread - d2/d25/d74/f75 zero size 2024-03-22T07:28:35.013 INFO:tasks.workunit.client.1.smithi195.stdout:8/596: mkdir da/d17/d32/d61/d47/db4 0 2024-03-22T07:28:35.013 INFO:tasks.workunit.client.0.smithi134.stdout:9/313: creat d3/d9/d37/d3c/f6d x:0 0 0 2024-03-22T07:28:35.013 INFO:tasks.workunit.client.0.smithi134.stdout:9/314: truncate d3/d9/df/d57/d67/f6c 233613 0 2024-03-22T07:28:35.013 INFO:tasks.workunit.client.0.smithi134.stdout:9/315: creat d3/d9/df/d12/d3b/f6e x:0 0 0 2024-03-22T07:28:35.015 INFO:tasks.workunit.client.0.smithi134.stdout:1/370: unlink d5/da/d13/d1e/d45/f7a 0 2024-03-22T07:28:35.015 INFO:tasks.workunit.client.0.smithi134.stdout:1/371: readlink d5/d1d/l5b 0 2024-03-22T07:28:35.015 INFO:tasks.workunit.client.0.smithi134.stdout:1/372: creat d5/da/d1b/d27/d39/f82 x:0 0 0 2024-03-22T07:28:35.016 INFO:tasks.workunit.client.0.smithi134.stdout:8/410: dwrite d1/d4/f22 [0,4194304] 0 2024-03-22T07:28:35.016 INFO:tasks.workunit.client.0.smithi134.stdout:8/411: chown d1/d15/d42/d44/c53 20569 1 2024-03-22T07:28:35.017 INFO:tasks.workunit.client.1.smithi195.stdout:5/570: mkdir d9/d22/d7b/d98/dbe 0 2024-03-22T07:28:35.023 INFO:tasks.workunit.client.1.smithi195.stdout:9/683: rename d2/d4/f55 to d2/d4/d32/d6d/deb/ff6 0 2024-03-22T07:28:35.023 INFO:tasks.workunit.client.1.smithi195.stdout:9/684: dread - d2/d4/d6/d18/d50/fe0 zero size 2024-03-22T07:28:35.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/297: dwrite d2/f1c [0,4194304] 0 2024-03-22T07:28:35.024 INFO:tasks.workunit.client.0.smithi134.stdout:2/298: readlink d2/l16 0 2024-03-22T07:28:35.025 INFO:tasks.workunit.client.0.smithi134.stdout:2/299: read - d2/f3a zero size 2024-03-22T07:28:35.025 INFO:tasks.workunit.client.0.smithi134.stdout:2/300: fdatasync d2/d5/d22/d52/f4b 0 2024-03-22T07:28:35.027 INFO:tasks.workunit.client.0.smithi134.stdout:9/316: dread d3/d9/df/d12/d1b/d54/f68 [0,4194304] 0 2024-03-22T07:28:35.027 INFO:tasks.workunit.client.1.smithi195.stdout:2/537: write d2/d3/d7/d19/d22/d26/f6f [3567798,75036] 0 2024-03-22T07:28:35.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/548: creat d1/d10/d1f/f9d x:0 0 0 2024-03-22T07:28:35.030 INFO:tasks.workunit.client.0.smithi134.stdout:8/412: dread d1/d15/d42/d12/d20/d41/f45 [0,4194304] 0 2024-03-22T07:28:35.030 INFO:tasks.workunit.client.0.smithi134.stdout:8/413: readlink d1/d46/l88 0 2024-03-22T07:28:35.030 INFO:tasks.workunit.client.0.smithi134.stdout:1/373: chown d5/da/d1b/d27/d60/d72/c7b 633989 1 2024-03-22T07:28:35.030 INFO:tasks.workunit.client.0.smithi134.stdout:1/374: write d5/da/d13/d1e/d45/f7f [969114,106230] 0 2024-03-22T07:28:35.032 INFO:tasks.workunit.client.0.smithi134.stdout:2/301: truncate d2/d5/d22/f24 3343787 0 2024-03-22T07:28:35.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/302: truncate d2/d5/d8/f1b 343112 0 2024-03-22T07:28:35.035 INFO:tasks.workunit.client.0.smithi134.stdout:4/410: getdents d2/d15/d66 0 2024-03-22T07:28:35.035 INFO:tasks.workunit.client.0.smithi134.stdout:4/411: write d2/d1d/f72 [852312,44814] 0 2024-03-22T07:28:35.035 INFO:tasks.workunit.client.0.smithi134.stdout:4/412: write d2/d15/f61 [3103195,33417] 0 2024-03-22T07:28:35.036 INFO:tasks.workunit.client.1.smithi195.stdout:8/597: dwrite da/d17/d32/d61/d47/d53/f96 [0,4194304] 0 2024-03-22T07:28:35.036 INFO:tasks.workunit.client.1.smithi195.stdout:2/538: read d2/d3/d21/d60/d81/d9a/f7b [1042888,15916] 0 2024-03-22T07:28:35.036 INFO:tasks.workunit.client.0.smithi134.stdout:2/303: creat d2/f58 x:0 0 0 2024-03-22T07:28:35.036 INFO:tasks.workunit.client.0.smithi134.stdout:2/304: chown d2/d5/d8/d31/f46 61083271 1 2024-03-22T07:28:35.038 INFO:tasks.workunit.client.1.smithi195.stdout:5/571: dwrite d9/d73/da1/d5f/fac [0,4194304] 0 2024-03-22T07:28:35.039 INFO:tasks.workunit.client.1.smithi195.stdout:4/524: unlink d13/d63/d79/f48 0 2024-03-22T07:28:35.041 INFO:tasks.workunit.client.1.smithi195.stdout:1/443: getdents d0/d2/d6 0 2024-03-22T07:28:35.041 INFO:tasks.workunit.client.1.smithi195.stdout:1/444: dread - d0/d2/d6/d21/d41/d47/d4a/f83 zero size 2024-03-22T07:28:35.042 INFO:tasks.workunit.client.0.smithi134.stdout:8/414: read d1/d4/f22 [1428994,18208] 0 2024-03-22T07:28:35.043 INFO:tasks.workunit.client.1.smithi195.stdout:9/685: rename d2/d4/d6/db/da8/lc5 to d2/d4/d6/db5/de3/lf7 0 2024-03-22T07:28:35.045 INFO:tasks.workunit.client.1.smithi195.stdout:8/598: write da/dc/f12 [1605971,130860] 0 2024-03-22T07:28:35.045 INFO:tasks.workunit.client.1.smithi195.stdout:8/599: fdatasync da/d17/d32/d61/d47/f87 0 2024-03-22T07:28:35.045 INFO:tasks.workunit.client.1.smithi195.stdout:8/600: creat da/d82/fb5 x:0 0 0 2024-03-22T07:28:35.045 INFO:tasks.workunit.client.1.smithi195.stdout:8/601: chown da/d82/f9c 0 1 2024-03-22T07:28:35.047 INFO:tasks.workunit.client.0.smithi134.stdout:8/415: mkdir d1/d15/d57/d8c 0 2024-03-22T07:28:35.047 INFO:tasks.workunit.client.0.smithi134.stdout:8/416: fdatasync d1/d15/d42/d49/f5f 0 2024-03-22T07:28:35.048 INFO:tasks.workunit.client.1.smithi195.stdout:0/549: symlink d1/d4/d12/d6c/d89/l9e 0 2024-03-22T07:28:35.049 INFO:tasks.workunit.client.0.smithi134.stdout:9/317: rename d3/d9/df/d12/d1b to d3/d9/d37/d6f 0 2024-03-22T07:28:35.050 INFO:tasks.workunit.client.1.smithi195.stdout:6/488: sync 2024-03-22T07:28:35.050 INFO:tasks.workunit.client.1.smithi195.stdout:6/489: read - d5/d5e/d34/d55/d4b/da2/d4a/f8c zero size 2024-03-22T07:28:35.051 INFO:tasks.workunit.client.1.smithi195.stdout:6/490: creat d5/d5e/d34/d55/d4b/da2/fb3 x:0 0 0 2024-03-22T07:28:35.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/499: getdents d0/d13/d14/d5b 0 2024-03-22T07:28:35.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/500: fsync d0/d13/d14/d2f/f86 0 2024-03-22T07:28:35.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/501: truncate d0/d13/d14/d29/f89 509143 0 2024-03-22T07:28:35.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/502: write d0/d13/d14/d2f/f86 [154299,41873] 0 2024-03-22T07:28:35.051 INFO:tasks.workunit.client.1.smithi195.stdout:7/503: truncate d0/d13/d14/d29/d35/d3a/f3e 760899 0 2024-03-22T07:28:35.052 INFO:tasks.workunit.client.1.smithi195.stdout:6/491: read d5/d5e/d34/d55/d3b/d6e/d3c/fb0 [164425,29216] 0 2024-03-22T07:28:35.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/504: write d0/d13/f1c [4563688,9437] 0 2024-03-22T07:28:35.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/505: chown d0/d13/d22/d28/f64 122620692 1 2024-03-22T07:28:35.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/506: chown d0/d13/d14/c8f 216214141 1 2024-03-22T07:28:35.052 INFO:tasks.workunit.client.0.smithi134.stdout:8/417: creat d1/d4/d61/d85/f8d x:0 0 0 2024-03-22T07:28:35.053 INFO:tasks.workunit.client.0.smithi134.stdout:1/375: dwrite d5/da/d13/f51 [0,4194304] 0 2024-03-22T07:28:35.054 INFO:tasks.workunit.client.1.smithi195.stdout:5/572: dwrite d9/d7f/f81 [0,4194304] 0 2024-03-22T07:28:35.055 INFO:tasks.workunit.client.1.smithi195.stdout:5/573: creat d9/d22/fbf x:0 0 0 2024-03-22T07:28:35.055 INFO:tasks.workunit.client.0.smithi134.stdout:4/413: rename d2/d15/c47 to d2/d2a/c8a 0 2024-03-22T07:28:35.056 INFO:tasks.workunit.client.0.smithi134.stdout:9/318: mkdir d3/d9/d37/d70 0 2024-03-22T07:28:35.060 INFO:tasks.workunit.client.1.smithi195.stdout:2/539: dread - d2/d3/d21/d40/f8c zero size 2024-03-22T07:28:35.060 INFO:tasks.workunit.client.0.smithi134.stdout:8/418: dread d1/d15/d42/d25/f59 [0,4194304] 0 2024-03-22T07:28:35.060 INFO:tasks.workunit.client.0.smithi134.stdout:8/419: creat d1/d15/d42/d76/f8e x:0 0 0 2024-03-22T07:28:35.060 INFO:tasks.workunit.client.0.smithi134.stdout:8/420: write d1/d4/d61/f65 [4321657,7223] 0 2024-03-22T07:28:35.062 INFO:tasks.workunit.client.0.smithi134.stdout:1/376: unlink d5/da/d1b/d27/d60/d72/c7b 0 2024-03-22T07:28:35.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/414: symlink d2/d25/d74/l8b 0 2024-03-22T07:28:35.067 INFO:tasks.workunit.client.1.smithi195.stdout:4/525: mknod d13/d63/d36/d5f/cb9 0 2024-03-22T07:28:35.069 INFO:tasks.workunit.client.0.smithi134.stdout:2/305: rename d2/l35 to d2/d5/d22/d52/d3c/d4f/l59 0 2024-03-22T07:28:35.070 INFO:tasks.workunit.client.1.smithi195.stdout:3/541: sync 2024-03-22T07:28:35.072 INFO:tasks.workunit.client.1.smithi195.stdout:1/445: creat d0/d2/d6/d21/d41/d47/f8f x:0 0 0 2024-03-22T07:28:35.073 INFO:tasks.workunit.client.0.smithi134.stdout:8/421: dread d1/d15/f19 [0,4194304] 0 2024-03-22T07:28:35.076 INFO:tasks.workunit.client.1.smithi195.stdout:9/686: rmdir d2/d4/d6/db5 39 2024-03-22T07:28:35.076 INFO:tasks.workunit.client.1.smithi195.stdout:9/687: chown d2/d4/d6/db5/df2/ff5 4 1 2024-03-22T07:28:35.077 INFO:tasks.workunit.client.1.smithi195.stdout:9/688: dread d2/d4/d6/d18/f4e [0,4194304] 0 2024-03-22T07:28:35.078 INFO:tasks.workunit.client.1.smithi195.stdout:5/574: dwrite d9/d12/f1f [0,4194304] 0 2024-03-22T07:28:35.078 INFO:tasks.workunit.client.1.smithi195.stdout:5/575: chown d9/d12/d1d/d69/ca2 10491480 1 2024-03-22T07:28:35.078 INFO:tasks.workunit.client.1.smithi195.stdout:5/576: write d9/d12/d1d/d36/fb7 [297429,100217] 0 2024-03-22T07:28:35.078 INFO:tasks.workunit.client.1.smithi195.stdout:5/577: write d9/d22/f2b [751163,112031] 0 2024-03-22T07:28:35.078 INFO:tasks.workunit.client.1.smithi195.stdout:5/578: fdatasync d9/f1c 0 2024-03-22T07:28:35.081 INFO:tasks.workunit.client.0.smithi134.stdout:4/415: dwrite d2/d15/d35/f63 [0,4194304] 0 2024-03-22T07:28:35.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/602: rename f7 to da/dc/d71/fb6 0 2024-03-22T07:28:35.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/603: write da/d17/d32/d61/d47/f83 [547399,19108] 0 2024-03-22T07:28:35.086 INFO:tasks.workunit.client.0.smithi134.stdout:1/377: creat d5/da/d61/f83 x:0 0 0 2024-03-22T07:28:35.086 INFO:tasks.workunit.client.0.smithi134.stdout:1/378: fsync d5/da/d13/d1e/f44 0 2024-03-22T07:28:35.088 INFO:tasks.workunit.client.1.smithi195.stdout:7/507: stat d0/d13/d14/d29/d35/d3a/c6f 0 2024-03-22T07:28:35.089 INFO:tasks.workunit.client.1.smithi195.stdout:7/508: dread d0/d13/d14/d20/d40/d82/da0/d59/f7c [0,4194304] 0 2024-03-22T07:28:35.089 INFO:tasks.workunit.client.1.smithi195.stdout:7/509: write d0/d13/d14/d29/d35/d6d/f93 [631458,7248] 0 2024-03-22T07:28:35.089 INFO:tasks.workunit.client.1.smithi195.stdout:7/510: write d0/d13/d22/d57/d7b/d8c/f92 [700435,125871] 0 2024-03-22T07:28:35.091 INFO:tasks.workunit.client.0.smithi134.stdout:2/306: creat d2/d5/d8/f5a x:0 0 0 2024-03-22T07:28:35.091 INFO:tasks.workunit.client.0.smithi134.stdout:2/307: creat d2/d5/d8/d31/f5b x:0 0 0 2024-03-22T07:28:35.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/422: unlink d1/d15/c26 0 2024-03-22T07:28:35.100 INFO:tasks.workunit.client.0.smithi134.stdout:4/416: dwrite d2/d15/f39 [0,4194304] 0 2024-03-22T07:28:35.100 INFO:tasks.workunit.client.1.smithi195.stdout:2/540: mknod d2/d3/dac/dad/cb0 0 2024-03-22T07:28:35.100 INFO:tasks.workunit.client.1.smithi195.stdout:2/541: creat d2/d3/d7/da/d4e/fb1 x:0 0 0 2024-03-22T07:28:35.102 INFO:tasks.workunit.client.0.smithi134.stdout:1/379: rename d5/da/d13/l46 to d5/da/d13/d1e/d63/l84 0 2024-03-22T07:28:35.107 INFO:tasks.workunit.client.0.smithi134.stdout:2/308: dwrite d2/f14 [4194304,4194304] 0 2024-03-22T07:28:35.109 INFO:tasks.workunit.client.1.smithi195.stdout:4/526: link d13/d2a/f70 d13/d63/d36/d5f/d83/fba 0 2024-03-22T07:28:35.109 INFO:tasks.workunit.client.1.smithi195.stdout:4/527: chown d13/d63/d36/d5f 1 1 2024-03-22T07:28:35.109 INFO:tasks.workunit.client.1.smithi195.stdout:4/528: read d13/f34 [1040294,14304] 0 2024-03-22T07:28:35.109 INFO:tasks.workunit.client.1.smithi195.stdout:4/529: fsync d13/d15/f22 0 2024-03-22T07:28:35.110 INFO:tasks.workunit.client.0.smithi134.stdout:1/380: write d5/f4d [2297457,96704] 0 2024-03-22T07:28:35.110 INFO:tasks.workunit.client.0.smithi134.stdout:1/381: write d5/da/d1b/d27/d60/f66 [603769,75739] 0 2024-03-22T07:28:35.112 INFO:tasks.workunit.client.1.smithi195.stdout:1/446: unlink d0/d2/d6/d21/d39/l7d 0 2024-03-22T07:28:35.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/447: fsync d0/d70/d6a/f88 0 2024-03-22T07:28:35.115 INFO:tasks.workunit.client.1.smithi195.stdout:9/689: creat d2/d4/d32/d6d/deb/ff8 x:0 0 0 2024-03-22T07:28:35.115 INFO:tasks.workunit.client.1.smithi195.stdout:9/690: write d2/d4/d32/fa4 [333847,37792] 0 2024-03-22T07:28:35.117 INFO:tasks.workunit.client.0.smithi134.stdout:8/423: unlink d1/d15/l1b 0 2024-03-22T07:28:35.117 INFO:tasks.workunit.client.0.smithi134.stdout:8/424: chown d1/f2e 215 1 2024-03-22T07:28:35.122 INFO:tasks.workunit.client.0.smithi134.stdout:4/417: creat d2/d15/d35/d37/f8c x:0 0 0 2024-03-22T07:28:35.122 INFO:tasks.workunit.client.0.smithi134.stdout:4/418: fdatasync d2/d2a/d50/f5c 0 2024-03-22T07:28:35.123 INFO:tasks.workunit.client.1.smithi195.stdout:8/604: symlink da/d17/d32/d61/d88/lb7 0 2024-03-22T07:28:35.127 INFO:tasks.workunit.client.0.smithi134.stdout:1/382: rename d5/da/d13/d1e/d63/c7e to d5/da/d1b/d27/c85 0 2024-03-22T07:28:35.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/425: dwrite d1/d4/f47 [0,4194304] 0 2024-03-22T07:28:35.131 INFO:tasks.workunit.client.0.smithi134.stdout:8/426: chown d1/d4/d61/d85/f8d 31183 1 2024-03-22T07:28:35.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/550: rmdir d1/d10/d1f 39 2024-03-22T07:28:35.132 INFO:tasks.workunit.client.1.smithi195.stdout:0/551: fsync d1/d10/d1f/d40/d47/f68 0 2024-03-22T07:28:35.133 INFO:tasks.workunit.client.0.smithi134.stdout:4/419: truncate d2/d1d/f24 2151521 0 2024-03-22T07:28:35.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/511: mknod d0/d13/d14/d80/cac 0 2024-03-22T07:28:35.136 INFO:tasks.workunit.client.1.smithi195.stdout:7/512: creat d0/d13/d22/d57/fad x:0 0 0 2024-03-22T07:28:35.137 INFO:tasks.workunit.client.0.smithi134.stdout:1/383: link d5/da/d1b/d27/f80 d5/da/f86 0 2024-03-22T07:28:35.137 INFO:tasks.workunit.client.0.smithi134.stdout:1/384: readlink d5/da/d68/l81 0 2024-03-22T07:28:35.138 INFO:tasks.workunit.client.1.smithi195.stdout:2/542: rename d2/d3/d7/da/f58 to d2/d3/d21/d4c/fb2 0 2024-03-22T07:28:35.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/552: dread d1/d4/d12/f54 [0,4194304] 0 2024-03-22T07:28:35.141 INFO:tasks.workunit.client.1.smithi195.stdout:4/530: creat d13/d63/d3e/d5c/fbb x:0 0 0 2024-03-22T07:28:35.143 INFO:tasks.workunit.client.1.smithi195.stdout:3/542: link d3/d22/fa9 d3/d18/fb6 0 2024-03-22T07:28:35.144 INFO:tasks.workunit.client.1.smithi195.stdout:1/448: link d0/d2/d6/d21/d39/d64/l85 d0/d2/d6/d21/d39/d64/d7a/l90 0 2024-03-22T07:28:35.144 INFO:tasks.workunit.client.1.smithi195.stdout:8/605: dwrite da/d17/d32/d7d/d8e/fa3 [0,4194304] 0 2024-03-22T07:28:35.145 INFO:tasks.workunit.client.1.smithi195.stdout:8/606: write da/dc/fa6 [938320,100410] 0 2024-03-22T07:28:35.148 INFO:tasks.workunit.client.1.smithi195.stdout:9/691: creat d2/d4/d32/d6d/ff9 x:0 0 0 2024-03-22T07:28:35.152 INFO:tasks.workunit.client.0.smithi134.stdout:4/420: link d2/d25/l1a d2/d2a/d50/l8d 0 2024-03-22T07:28:35.152 INFO:tasks.workunit.client.1.smithi195.stdout:4/531: dread d13/d15/f98 [0,4194304] 0 2024-03-22T07:28:35.154 INFO:tasks.workunit.client.0.smithi134.stdout:1/385: symlink d5/da/d13/d1e/d45/l87 0 2024-03-22T07:28:35.156 INFO:tasks.workunit.client.0.smithi134.stdout:8/427: mkdir d1/d15/d42/d76/d8f 0 2024-03-22T07:28:35.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/386: stat d5/d1d/l74 0 2024-03-22T07:28:35.159 INFO:tasks.workunit.client.0.smithi134.stdout:1/387: creat d5/d1d/d49/f88 x:0 0 0 2024-03-22T07:28:35.160 INFO:tasks.workunit.client.1.smithi195.stdout:4/532: dread d13/d2a/d7e/d85/f9b [0,4194304] 0 2024-03-22T07:28:35.161 INFO:tasks.workunit.client.1.smithi195.stdout:0/553: symlink d1/d4/dd/df/l9f 0 2024-03-22T07:28:35.162 INFO:tasks.workunit.client.1.smithi195.stdout:0/554: fsync d1/d10/d1f/d40/d47/f68 0 2024-03-22T07:28:35.162 INFO:tasks.workunit.client.1.smithi195.stdout:0/555: fsync d1/d4/dd/df/d44/f50 0 2024-03-22T07:28:35.162 INFO:tasks.workunit.client.1.smithi195.stdout:0/556: chown d1/d4/dd/df/c52 47771231 1 2024-03-22T07:28:35.162 INFO:tasks.workunit.client.0.smithi134.stdout:8/428: mknod d1/d15/d57/d8c/c90 0 2024-03-22T07:28:35.162 INFO:tasks.workunit.client.0.smithi134.stdout:8/429: dread - d1/d15/f2c zero size 2024-03-22T07:28:35.163 INFO:tasks.workunit.client.1.smithi195.stdout:3/543: getdents d3/df 0 2024-03-22T07:28:35.164 INFO:tasks.workunit.client.1.smithi195.stdout:2/543: write d2/d3/d21/d40/f9b [3799266,129019] 0 2024-03-22T07:28:35.164 INFO:tasks.workunit.client.1.smithi195.stdout:1/449: dwrite d0/d2/d6/d21/d41/d47/f8f [0,4194304] 0 2024-03-22T07:28:35.165 INFO:tasks.workunit.client.1.smithi195.stdout:1/450: dread - d0/d2/d6/d21/d39/d40/f43 zero size 2024-03-22T07:28:35.165 INFO:tasks.workunit.client.1.smithi195.stdout:1/451: write d0/d2/d9/d2a/f86 [862075,126484] 0 2024-03-22T07:28:35.168 INFO:tasks.workunit.client.1.smithi195.stdout:8/607: rename da/d17/c3f to da/de/cb8 0 2024-03-22T07:28:35.169 INFO:tasks.workunit.client.1.smithi195.stdout:8/608: fsync da/d17/d32/d61/f72 0 2024-03-22T07:28:35.169 INFO:tasks.workunit.client.1.smithi195.stdout:3/544: rename d3/df/d15/d1d/d5c to d3/df/d15/d1d/d5c/d86/da0/db7 22 2024-03-22T07:28:35.169 INFO:tasks.workunit.client.1.smithi195.stdout:3/545: chown d3/df/d15/d1d/d5c/d47/f66 1787264686 1 2024-03-22T07:28:35.170 INFO:tasks.workunit.client.1.smithi195.stdout:9/692: link d2/d4/d6/d18/d50/d88/f9a d2/d4/d32/d6d/d78/ffa 0 2024-03-22T07:28:35.174 INFO:tasks.workunit.client.0.smithi134.stdout:8/430: write d1/d15/d42/d25/f59 [3809649,68612] 0 2024-03-22T07:28:35.174 INFO:tasks.workunit.client.0.smithi134.stdout:8/431: read - d1/d15/d57/f89 zero size 2024-03-22T07:28:35.174 INFO:tasks.workunit.client.0.smithi134.stdout:8/432: creat d1/d4/d61/d85/f91 x:0 0 0 2024-03-22T07:28:35.174 INFO:tasks.workunit.client.1.smithi195.stdout:1/452: dread d0/d2/d6/f42 [0,4194304] 0 2024-03-22T07:28:35.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/513: rmdir d0/d13/d22/d57/d7b/d8c 39 2024-03-22T07:28:35.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/514: dread - d0/d13/d22/d57/d7b/d8c/fa4 zero size 2024-03-22T07:28:35.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/515: dread - d0/d13/d14/d2b/f9d zero size 2024-03-22T07:28:35.175 INFO:tasks.workunit.client.1.smithi195.stdout:7/516: dread - d0/d13/d22/d57/d7b/d8c/fa4 zero size 2024-03-22T07:28:35.176 INFO:tasks.workunit.client.0.smithi134.stdout:8/433: dread d1/d15/d42/d76/f78 [0,4194304] 0 2024-03-22T07:28:35.177 INFO:tasks.workunit.client.0.smithi134.stdout:1/388: dwrite d5/da/d13/f51 [4194304,4194304] 0 2024-03-22T07:28:35.178 INFO:tasks.workunit.client.0.smithi134.stdout:1/389: rename d5/da/d13 to d5/da/d13/d1e/d67/d89 22 2024-03-22T07:28:35.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/533: symlink d13/d15/d44/lbc 0 2024-03-22T07:28:35.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/534: chown d13/d2a/d7e/d85/fa7 15158087 1 2024-03-22T07:28:35.181 INFO:tasks.workunit.client.1.smithi195.stdout:0/557: mknod d1/d4/dd/df/d2b/ca0 0 2024-03-22T07:28:35.184 INFO:tasks.workunit.client.0.smithi134.stdout:8/434: mknod d1/d15/d42/d12/c92 0 2024-03-22T07:28:35.184 INFO:tasks.workunit.client.0.smithi134.stdout:8/435: write d1/d4/f4a [1040423,75058] 0 2024-03-22T07:28:35.186 INFO:tasks.workunit.client.0.smithi134.stdout:8/436: symlink d1/d4/l93 0 2024-03-22T07:28:35.186 INFO:tasks.workunit.client.0.smithi134.stdout:8/437: dread - d1/d4/d61/d85/f91 zero size 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.0.smithi134.stdout:8/438: chown d1/f4b 15923915 1 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.0.smithi134.stdout:8/439: fdatasync d1/d15/d42/d76/f8e 0 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.0.smithi134.stdout:8/440: write d1/d15/d42/d12/d20/f86 [324182,40601] 0 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.0.smithi134.stdout:8/441: dread - d1/f82 zero size 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.0.smithi134.stdout:8/442: write d1/d15/d42/d12/d2a/f23 [1072797,26697] 0 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.0.smithi134.stdout:8/443: getdents d1/d46/d75/d8b 0 2024-03-22T07:28:35.187 INFO:tasks.workunit.client.1.smithi195.stdout:3/546: truncate d3/df/d15/d1d/d5c/d47/f66 4524631 0 2024-03-22T07:28:35.189 INFO:tasks.workunit.client.1.smithi195.stdout:9/693: creat d2/ffb x:0 0 0 2024-03-22T07:28:35.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/453: mkdir d0/d2/d27/d91 0 2024-03-22T07:28:35.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/454: fdatasync d0/d2/d9/f15 0 2024-03-22T07:28:35.190 INFO:tasks.workunit.client.1.smithi195.stdout:1/455: stat d0/d2/d6/f8b 0 2024-03-22T07:28:35.191 INFO:tasks.workunit.client.0.smithi134.stdout:8/444: dread d1/d4/f22 [0,4194304] 0 2024-03-22T07:28:35.191 INFO:tasks.workunit.client.0.smithi134.stdout:5/314: sync 2024-03-22T07:28:35.191 INFO:tasks.workunit.client.0.smithi134.stdout:5/315: chown d1/d8/d16/l55 459083626 1 2024-03-22T07:28:35.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/517: unlink d0/d13/d14/la7 0 2024-03-22T07:28:35.193 INFO:tasks.workunit.client.0.smithi134.stdout:8/445: symlink d1/d15/d5b/l94 0 2024-03-22T07:28:35.195 INFO:tasks.workunit.client.0.smithi134.stdout:8/446: dread d1/d15/d5b/f6d [0,4194304] 0 2024-03-22T07:28:35.195 INFO:tasks.workunit.client.0.smithi134.stdout:8/447: dread - d1/f2e zero size 2024-03-22T07:28:35.196 INFO:tasks.workunit.client.1.smithi195.stdout:2/544: mkdir d2/d3/db/db3 0 2024-03-22T07:28:35.198 INFO:tasks.workunit.client.1.smithi195.stdout:3/547: mkdir d3/df/d15/d1d/d5c/d47/d67/d80/db8 0 2024-03-22T07:28:35.199 INFO:tasks.workunit.client.0.smithi134.stdout:8/448: symlink d1/d15/d57/d79/l95 0 2024-03-22T07:28:35.199 INFO:tasks.workunit.client.0.smithi134.stdout:8/449: write d1/d15/d42/d12/d20/f86 [1047023,40361] 0 2024-03-22T07:28:35.200 INFO:tasks.workunit.client.0.smithi134.stdout:5/316: write d1/d8/d20/f54 [2496956,8790] 0 2024-03-22T07:28:35.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/694: link d2/d4/d32/f4b d2/d4/d1d/d9b/ffc 0 2024-03-22T07:28:35.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/695: truncate d2/d4/d32/d6d/ff9 924572 0 2024-03-22T07:28:35.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/696: stat d2/d4/d1d/c21 0 2024-03-22T07:28:35.202 INFO:tasks.workunit.client.0.smithi134.stdout:8/450: mkdir d1/d15/d7b/d96 0 2024-03-22T07:28:35.203 INFO:tasks.workunit.client.1.smithi195.stdout:7/518: getdents d0/d13/d14/d20/d40/d82/da0/d59/d79 0 2024-03-22T07:28:35.203 INFO:tasks.workunit.client.1.smithi195.stdout:7/519: stat d0/d13/d14/d29/d35/l44 0 2024-03-22T07:28:35.204 INFO:tasks.workunit.client.0.smithi134.stdout:5/317: rename d1/d8/ce to d1/d8/d20/c6b 0 2024-03-22T07:28:35.204 INFO:tasks.workunit.client.0.smithi134.stdout:5/318: truncate d1/d8/d20/d62/d65/f64 453515 0 2024-03-22T07:28:35.205 INFO:tasks.workunit.client.1.smithi195.stdout:4/535: link d13/d63/d36/f50 d13/d2a/fbd 0 2024-03-22T07:28:35.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/558: rmdir d1/d4/dd/df/d44/d6f 39 2024-03-22T07:28:35.206 INFO:tasks.workunit.client.1.smithi195.stdout:0/559: write d1/d4/dd/df/d6b/f81 [152650,18622] 0 2024-03-22T07:28:35.208 INFO:tasks.workunit.client.0.smithi134.stdout:5/319: rename d1/d4/c37 to d1/c6c 0 2024-03-22T07:28:35.208 INFO:tasks.workunit.client.0.smithi134.stdout:5/320: fdatasync d1/d8/d20/d62/d65/f53 0 2024-03-22T07:28:35.208 INFO:tasks.workunit.client.0.smithi134.stdout:5/321: chown d1/d8/d20/c31 6649072 1 2024-03-22T07:28:35.213 INFO:tasks.workunit.client.0.smithi134.stdout:8/451: write d1/d4/d61/f87 [3232692,123883] 0 2024-03-22T07:28:35.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/322: creat d1/d4/d5f/f6d x:0 0 0 2024-03-22T07:28:35.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/323: creat d1/d8/d20/f6e x:0 0 0 2024-03-22T07:28:35.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/324: read d1/d8/d20/f3e [13124,102785] 0 2024-03-22T07:28:35.218 INFO:tasks.workunit.client.1.smithi195.stdout:1/456: link d0/d2/d6/d21/d39/c46 d0/d2/d6/d21/c92 0 2024-03-22T07:28:35.219 INFO:tasks.workunit.client.1.smithi195.stdout:7/520: getdents d0/d13/d22 0 2024-03-22T07:28:35.220 INFO:tasks.workunit.client.1.smithi195.stdout:0/560: symlink d1/d4/d22/la1 0 2024-03-22T07:28:35.222 INFO:tasks.workunit.client.0.smithi134.stdout:5/325: unlink d1/d8/d20/f6e 0 2024-03-22T07:28:35.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/545: truncate d2/d3/d21/d40/f5d 1381800 0 2024-03-22T07:28:35.223 INFO:tasks.workunit.client.1.smithi195.stdout:2/546: truncate d2/d3/d7/d19/d22/fa9 452478 0 2024-03-22T07:28:35.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/547: fsync d2/d3/d21/d4c/fb2 0 2024-03-22T07:28:35.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/548: fsync d2/d3/d7/da/d4e/fb1 0 2024-03-22T07:28:35.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/549: fsync d2/d3/d7/d19/f33 0 2024-03-22T07:28:35.224 INFO:tasks.workunit.client.1.smithi195.stdout:3/548: mknod d3/cb9 0 2024-03-22T07:28:35.225 INFO:tasks.workunit.client.0.smithi134.stdout:5/326: symlink d1/d8/d16/l6f 0 2024-03-22T07:28:35.226 INFO:tasks.workunit.client.0.smithi134.stdout:5/327: chown d1/d8/d20/f50 992994001 1 2024-03-22T07:28:35.226 INFO:tasks.workunit.client.0.smithi134.stdout:5/328: truncate d1/d8/d20/d62/d65/f43 4324402 0 2024-03-22T07:28:35.226 INFO:tasks.workunit.client.1.smithi195.stdout:4/536: dwrite d13/d2a/d7e/fb6 [0,4194304] 0 2024-03-22T07:28:35.226 INFO:tasks.workunit.client.0.smithi134.stdout:8/452: dread d1/d15/d42/d44/f3a [0,4194304] 0 2024-03-22T07:28:35.228 INFO:tasks.workunit.client.1.smithi195.stdout:9/697: link d2/d4/d6/d18/f4e d2/d4/d6/ffd 0 2024-03-22T07:28:35.231 INFO:tasks.workunit.client.1.smithi195.stdout:7/521: mkdir d0/d13/d14/d2f/dae 0 2024-03-22T07:28:35.232 INFO:tasks.workunit.client.0.smithi134.stdout:8/453: symlink d1/d15/d42/d12/l97 0 2024-03-22T07:28:35.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/549: dread f0 [0,4194304] 0 2024-03-22T07:28:35.234 INFO:tasks.workunit.client.1.smithi195.stdout:1/457: read d0/d2/d9/d2a/f80 [1357120,36361] 0 2024-03-22T07:28:35.234 INFO:tasks.workunit.client.1.smithi195.stdout:0/561: mkdir d1/da2 0 2024-03-22T07:28:35.235 INFO:tasks.workunit.client.0.smithi134.stdout:8/454: dread d1/d15/d42/d12/d20/f3c [0,4194304] 0 2024-03-22T07:28:35.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/537: unlink d13/d2a/d7e/d85/f9b 0 2024-03-22T07:28:35.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/538: fdatasync d13/d63/d36/d5f/d83/fa2 0 2024-03-22T07:28:35.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/539: readlink d13/l61 0 2024-03-22T07:28:35.239 INFO:tasks.workunit.client.1.smithi195.stdout:0/562: write d1/d4/d12/f54 [4042333,72562] 0 2024-03-22T07:28:35.239 INFO:tasks.workunit.client.1.smithi195.stdout:0/563: chown d1/d4/dd/f13 7973 1 2024-03-22T07:28:35.241 INFO:tasks.workunit.client.1.smithi195.stdout:9/698: rename d2/d4/d6/d18/l68 to d2/d4/d1d/lfe 0 2024-03-22T07:28:35.243 INFO:tasks.workunit.client.1.smithi195.stdout:4/540: write d13/d63/d36/f5d [64879,25263] 0 2024-03-22T07:28:35.243 INFO:tasks.workunit.client.1.smithi195.stdout:4/541: chown d13/d63/d7a/fb2 2029647 1 2024-03-22T07:28:35.243 INFO:tasks.workunit.client.1.smithi195.stdout:4/542: write d13/d2a/f28 [3888052,66774] 0 2024-03-22T07:28:35.243 INFO:tasks.workunit.client.1.smithi195.stdout:7/522: mknod d0/d13/d14/d80/caf 0 2024-03-22T07:28:35.246 INFO:tasks.workunit.client.1.smithi195.stdout:3/550: mknod d3/df/d15/d1d/d5c/cba 0 2024-03-22T07:28:35.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/458: dread d0/d2/d6/d21/d41/f5a [0,4194304] 0 2024-03-22T07:28:35.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/523: rename d0/d13/d14/d2b/f42 to d0/d13/d14/d20/d40/d82/da0/d59/d79/fb0 0 2024-03-22T07:28:35.248 INFO:tasks.workunit.client.1.smithi195.stdout:7/524: creat d0/d13/d22/d57/fb1 x:0 0 0 2024-03-22T07:28:35.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/699: write d2/d4/d6/db/f2c [7270,48617] 0 2024-03-22T07:28:35.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/700: write d2/d4/d6/db/fb9 [337465,49586] 0 2024-03-22T07:28:35.253 INFO:tasks.workunit.client.1.smithi195.stdout:9/701: chown d2/d4/d6/d18/lda 30 1 2024-03-22T07:28:35.253 INFO:tasks.workunit.client.1.smithi195.stdout:0/564: dread d1/d4/d12/f27 [0,4194304] 0 2024-03-22T07:28:35.256 INFO:tasks.workunit.client.1.smithi195.stdout:9/702: mkdir d2/dad/dff 0 2024-03-22T07:28:35.256 INFO:tasks.workunit.client.1.smithi195.stdout:2/550: dwrite d2/d3/f79 [4194304,4194304] 0 2024-03-22T07:28:35.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/565: symlink d1/d10/la3 0 2024-03-22T07:28:35.259 INFO:tasks.workunit.client.0.smithi134.stdout:5/329: dwrite d1/d8/d16/f4d [0,4194304] 0 2024-03-22T07:28:35.264 INFO:tasks.workunit.client.1.smithi195.stdout:7/525: dread d0/d13/f46 [0,4194304] 0 2024-03-22T07:28:35.266 INFO:tasks.workunit.client.0.smithi134.stdout:5/330: link d1/d8/d20/d62/d65/f1e d1/d8/d20/f70 0 2024-03-22T07:28:35.266 INFO:tasks.workunit.client.0.smithi134.stdout:5/331: dread - d1/f60 zero size 2024-03-22T07:28:35.268 INFO:tasks.workunit.client.1.smithi195.stdout:9/703: creat d2/d4/d6/d18/d50/f100 x:0 0 0 2024-03-22T07:28:35.268 INFO:tasks.workunit.client.1.smithi195.stdout:9/704: chown d2/d4/d6/db/d20/d4a/da2/cc7 881 1 2024-03-22T07:28:35.272 INFO:tasks.workunit.client.0.smithi134.stdout:8/455: dwrite d1/f67 [0,4194304] 0 2024-03-22T07:28:35.275 INFO:tasks.workunit.client.1.smithi195.stdout:9/705: dread d2/d4/d6/db/d20/d4a/f6a [0,4194304] 0 2024-03-22T07:28:35.278 INFO:tasks.workunit.client.1.smithi195.stdout:2/551: rmdir d2/d1e 39 2024-03-22T07:28:35.279 INFO:tasks.workunit.client.1.smithi195.stdout:7/526: creat d0/d13/d14/d20/d40/d82/da0/d59/fb2 x:0 0 0 2024-03-22T07:28:35.280 INFO:tasks.workunit.client.1.smithi195.stdout:4/543: dwrite d13/f14 [0,4194304] 0 2024-03-22T07:28:35.280 INFO:tasks.workunit.client.1.smithi195.stdout:0/566: dwrite d1/d4/dd/f3a [0,4194304] 0 2024-03-22T07:28:35.281 INFO:tasks.workunit.client.0.smithi134.stdout:5/332: read d1/d8/d20/d62/d65/f15 [535061,62503] 0 2024-03-22T07:28:35.281 INFO:tasks.workunit.client.0.smithi134.stdout:5/333: dread - d1/d8/d20/f5c zero size 2024-03-22T07:28:35.281 INFO:tasks.workunit.client.0.smithi134.stdout:5/334: creat d1/d8/d20/f71 x:0 0 0 2024-03-22T07:28:35.281 INFO:tasks.workunit.client.0.smithi134.stdout:5/335: creat d1/d8/f72 x:0 0 0 2024-03-22T07:28:35.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/706: unlink d2/d4/d6/db/d20/d4a/fa9 0 2024-03-22T07:28:35.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/707: dread - d2/d4/d6/d18/d50/f100 zero size 2024-03-22T07:28:35.282 INFO:tasks.workunit.client.1.smithi195.stdout:9/708: chown d2/d4/d23/c86 2851 1 2024-03-22T07:28:35.282 INFO:tasks.workunit.client.1.smithi195.stdout:2/552: unlink d2/d3/d7/da/de/fa6 0 2024-03-22T07:28:35.283 INFO:tasks.workunit.client.1.smithi195.stdout:7/527: symlink d0/d13/d14/d2b/lb3 0 2024-03-22T07:28:35.285 INFO:tasks.workunit.client.0.smithi134.stdout:5/336: link d1/d8/d16/f5a d1/f73 0 2024-03-22T07:28:35.288 INFO:tasks.workunit.client.0.smithi134.stdout:5/337: link d1/d8/d20/d62/d65/f53 d1/d8/d16/f74 0 2024-03-22T07:28:35.290 INFO:tasks.workunit.client.1.smithi195.stdout:4/544: getdents d13/d15/d6b 0 2024-03-22T07:28:35.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/709: dread d2/d4/d23/f69 [0,4194304] 0 2024-03-22T07:28:35.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/710: chown f0 1476 1 2024-03-22T07:28:35.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/711: readlink d2/d4/d6/d18/d50/lef 0 2024-03-22T07:28:35.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/712: truncate d2/d4/fd5 319776 0 2024-03-22T07:28:35.291 INFO:tasks.workunit.client.1.smithi195.stdout:9/713: fdatasync d2/d4/d6/d18/f29 0 2024-03-22T07:28:35.292 INFO:tasks.workunit.client.1.smithi195.stdout:0/567: mknod d1/d4/d42/ca4 0 2024-03-22T07:28:35.292 INFO:tasks.workunit.client.0.smithi134.stdout:8/456: dwrite d1/d4/d61/f65 [0,4194304] 0 2024-03-22T07:28:35.294 INFO:tasks.workunit.client.1.smithi195.stdout:2/553: creat d2/d3/d1a/fb4 x:0 0 0 2024-03-22T07:28:35.295 INFO:tasks.workunit.client.1.smithi195.stdout:7/528: symlink d0/d13/d22/d28/lb4 0 2024-03-22T07:28:35.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/457: dread d1/d15/d5b/f6d [0,4194304] 0 2024-03-22T07:28:35.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/458: fdatasync d1/d4/d61/f65 0 2024-03-22T07:28:35.296 INFO:tasks.workunit.client.1.smithi195.stdout:2/554: dread d2/d3/d21/d4c/fb2 [0,4194304] 0 2024-03-22T07:28:35.296 INFO:tasks.workunit.client.1.smithi195.stdout:5/579: sync 2024-03-22T07:28:35.296 INFO:tasks.workunit.client.1.smithi195.stdout:6/492: sync 2024-03-22T07:28:35.296 INFO:tasks.workunit.client.1.smithi195.stdout:6/493: chown d5/d5e/d34/d55/c47 6841 1 2024-03-22T07:28:35.297 INFO:tasks.workunit.client.1.smithi195.stdout:6/494: chown d5/d16/d5a/f99 473632405 1 2024-03-22T07:28:35.299 INFO:tasks.workunit.client.0.smithi134.stdout:8/459: rename d1/d4/l93 to d1/d4/d61/l98 0 2024-03-22T07:28:35.306 INFO:tasks.workunit.client.1.smithi195.stdout:9/714: mknod d2/d4/d32/c101 0 2024-03-22T07:28:35.309 INFO:tasks.workunit.client.0.smithi134.stdout:8/460: symlink d1/d4/d61/d85/l99 0 2024-03-22T07:28:35.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/529: link d0/d13/d14/d2f/l54 d0/d13/d22/d57/d7b/lb5 0 2024-03-22T07:28:35.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/530: readlink d0/d13/d14/d29/d35/d6d/l76 0 2024-03-22T07:28:35.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/531: readlink d0/d13/d14/le 0 2024-03-22T07:28:35.312 INFO:tasks.workunit.client.1.smithi195.stdout:2/555: mknod d2/d3/d7/d19/d22/d26/cb5 0 2024-03-22T07:28:35.313 INFO:tasks.workunit.client.1.smithi195.stdout:2/556: chown d2/d3/c3d 25 1 2024-03-22T07:28:35.313 INFO:tasks.workunit.client.1.smithi195.stdout:2/557: dread - d2/d3/d21/d40/f8c zero size 2024-03-22T07:28:35.314 INFO:tasks.workunit.client.0.smithi134.stdout:8/461: mkdir d1/d15/d57/d8c/d9a 0 2024-03-22T07:28:35.314 INFO:tasks.workunit.client.0.smithi134.stdout:8/462: readlink d1/d15/l1d 0 2024-03-22T07:28:35.316 INFO:tasks.workunit.client.1.smithi195.stdout:7/532: dread d0/d13/d14/d20/d40/d82/da0/f9f [0,4194304] 0 2024-03-22T07:28:35.316 INFO:tasks.workunit.client.1.smithi195.stdout:7/533: chown d0/d13/d14/d29 48 1 2024-03-22T07:28:35.316 INFO:tasks.workunit.client.1.smithi195.stdout:5/580: unlink f7 0 2024-03-22T07:28:35.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/534: read d0/d13/d14/d29/d35/d3a/f9a [434800,66235] 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.1.smithi195.stdout:0/568: dwrite d1/d10/d1f/d40/d47/f84 [0,4194304] 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/495: mkdir d5/d5e/d34/d55/d3b/d7f/db4 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/496: readlink d5/d5e/d34/d55/d4b/l90 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.1.smithi195.stdout:6/497: write d5/f3a [896056,36967] 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/338: dwrite d1/d8/d20/f39 [0,4194304] 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/339: fsync d1/d8/d20/d62/f69 0 2024-03-22T07:28:35.319 INFO:tasks.workunit.client.0.smithi134.stdout:5/340: write d1/d8/d20/d62/d65/f67 [375228,57919] 0 2024-03-22T07:28:35.320 INFO:tasks.workunit.client.0.smithi134.stdout:5/341: write d1/d8/d16/f40 [1484070,32718] 0 2024-03-22T07:28:35.320 INFO:tasks.workunit.client.1.smithi195.stdout:8/609: sync 2024-03-22T07:28:35.320 INFO:tasks.workunit.client.1.smithi195.stdout:4/545: rmdir d13/d63/d36/d9e 39 2024-03-22T07:28:35.321 INFO:tasks.workunit.client.1.smithi195.stdout:4/546: truncate d13/d63/d36/d9e/faa 854991 0 2024-03-22T07:28:35.321 INFO:tasks.workunit.client.1.smithi195.stdout:7/535: dread d0/d13/d14/d20/f78 [0,4194304] 0 2024-03-22T07:28:35.321 INFO:tasks.workunit.client.0.smithi134.stdout:8/463: creat d1/d15/d42/d44/f9b x:0 0 0 2024-03-22T07:28:35.321 INFO:tasks.workunit.client.0.smithi134.stdout:8/464: chown d1 1 1 2024-03-22T07:28:35.325 INFO:tasks.workunit.client.1.smithi195.stdout:9/715: mkdir d2/d4/d32/d102 0 2024-03-22T07:28:35.328 INFO:tasks.workunit.client.1.smithi195.stdout:5/581: link d9/f11 d9/d22/d50/fc0 0 2024-03-22T07:28:35.328 INFO:tasks.workunit.client.1.smithi195.stdout:5/582: chown d9/d12/d1d/d36/d7d/l83 52 1 2024-03-22T07:28:35.337 INFO:tasks.workunit.client.1.smithi195.stdout:7/536: dwrite d0/d13/d22/d57/d7b/d8c/f92 [0,4194304] 0 2024-03-22T07:28:35.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/569: unlink d1/d4/d42/l7a 0 2024-03-22T07:28:35.339 INFO:tasks.workunit.client.0.smithi134.stdout:5/342: dwrite d1/f57 [0,4194304] 0 2024-03-22T07:28:35.339 INFO:tasks.workunit.client.1.smithi195.stdout:2/558: dwrite d2/d3/d21/d60/d81/d9a/f44 [0,4194304] 0 2024-03-22T07:28:35.340 INFO:tasks.workunit.client.1.smithi195.stdout:2/559: chown d2/d3/d7/d19/f9d 106561527 1 2024-03-22T07:28:35.341 INFO:tasks.workunit.client.1.smithi195.stdout:8/610: mknod da/d17/d32/cb9 0 2024-03-22T07:28:35.347 INFO:tasks.workunit.client.1.smithi195.stdout:9/716: dwrite d2/d4/d32/fa4 [0,4194304] 0 2024-03-22T07:28:35.348 INFO:tasks.workunit.client.1.smithi195.stdout:5/583: dwrite d9/d12/f3d [0,4194304] 0 2024-03-22T07:28:35.349 INFO:tasks.workunit.client.1.smithi195.stdout:7/537: creat d0/d13/d14/d80/fb6 x:0 0 0 2024-03-22T07:28:35.349 INFO:tasks.workunit.client.1.smithi195.stdout:7/538: write d0/d13/d14/d29/d35/d3a/f5d [4972077,28211] 0 2024-03-22T07:28:35.355 INFO:tasks.workunit.client.1.smithi195.stdout:0/570: dwrite d1/d4/dd/df/f11 [0,4194304] 0 2024-03-22T07:28:35.355 INFO:tasks.workunit.client.1.smithi195.stdout:5/584: dread d9/d12/d1d/d36/fa6 [0,4194304] 0 2024-03-22T07:28:35.355 INFO:tasks.workunit.client.1.smithi195.stdout:5/585: fdatasync d9/fb 0 2024-03-22T07:28:35.355 INFO:tasks.workunit.client.1.smithi195.stdout:5/586: chown d9/d22/d7b/l8e 74065013 1 2024-03-22T07:28:35.360 INFO:tasks.workunit.client.1.smithi195.stdout:6/498: rmdir d5/d5e/d34 39 2024-03-22T07:28:35.362 INFO:tasks.workunit.client.0.smithi134.stdout:8/465: creat d1/d46/f9c x:0 0 0 2024-03-22T07:28:35.363 INFO:tasks.workunit.client.0.smithi134.stdout:7/524: sync 2024-03-22T07:28:35.363 INFO:tasks.workunit.client.0.smithi134.stdout:0/356: sync 2024-03-22T07:28:35.363 INFO:tasks.workunit.client.0.smithi134.stdout:3/302: sync 2024-03-22T07:28:35.363 INFO:tasks.workunit.client.0.smithi134.stdout:7/525: readlink d1/de/l37 0 2024-03-22T07:28:35.363 INFO:tasks.workunit.client.0.smithi134.stdout:6/283: sync 2024-03-22T07:28:35.366 INFO:tasks.workunit.client.0.smithi134.stdout:5/343: mkdir d1/d8/d3f/d75 0 2024-03-22T07:28:35.366 INFO:tasks.workunit.client.0.smithi134.stdout:9/319: sync 2024-03-22T07:28:35.368 INFO:tasks.workunit.client.0.smithi134.stdout:8/466: symlink d1/d4/l9d 0 2024-03-22T07:28:35.369 INFO:tasks.workunit.client.1.smithi195.stdout:8/611: mknod da/d17/d32/d61/cba 0 2024-03-22T07:28:35.370 INFO:tasks.workunit.client.0.smithi134.stdout:3/303: getdents d4/d8/d69 0 2024-03-22T07:28:35.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/304: getdents d4/d22/d29/d50 0 2024-03-22T07:28:35.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/305: fdatasync d4/d8/d45/f51 0 2024-03-22T07:28:35.371 INFO:tasks.workunit.client.0.smithi134.stdout:3/306: truncate d4/d10/d4b/f65 427361 0 2024-03-22T07:28:35.372 INFO:tasks.workunit.client.0.smithi134.stdout:0/357: write dc/de/d55/d65/f67 [64615,101760] 0 2024-03-22T07:28:35.373 INFO:tasks.workunit.client.0.smithi134.stdout:7/526: creat d1/de/d11/d2b/faa x:0 0 0 2024-03-22T07:28:35.374 INFO:tasks.workunit.client.0.smithi134.stdout:7/527: creat d1/de/d11/d2b/fab x:0 0 0 2024-03-22T07:28:35.374 INFO:tasks.workunit.client.0.smithi134.stdout:7/528: chown d1/de/d41/l82 234593901 1 2024-03-22T07:28:35.374 INFO:tasks.workunit.client.0.smithi134.stdout:7/529: fsync d1/de/d41/f5d 0 2024-03-22T07:28:35.375 INFO:tasks.workunit.client.0.smithi134.stdout:6/284: mknod d2/d1b/d1d/c68 0 2024-03-22T07:28:35.381 INFO:tasks.workunit.client.0.smithi134.stdout:5/344: rename d1/d8/d20/d62/d65/f61 to d1/d8/d3f/d75/f76 0 2024-03-22T07:28:35.382 INFO:tasks.workunit.client.0.smithi134.stdout:8/467: getdents d1/d15/d42/d12 0 2024-03-22T07:28:35.382 INFO:tasks.workunit.client.0.smithi134.stdout:8/468: chown d1/d15/d7b/d83 61 1 2024-03-22T07:28:35.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/539: mknod d0/d13/d14/d20/d40/d82/da0/cb7 0 2024-03-22T07:28:35.391 INFO:tasks.workunit.client.0.smithi134.stdout:3/307: dwrite d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:35.392 INFO:tasks.workunit.client.0.smithi134.stdout:3/308: fsync d4/d22/d29/d50/f63 0 2024-03-22T07:28:35.392 INFO:tasks.workunit.client.0.smithi134.stdout:0/358: getdents dc/d17 0 2024-03-22T07:28:35.392 INFO:tasks.workunit.client.0.smithi134.stdout:0/359: creat dc/de/f6a x:0 0 0 2024-03-22T07:28:35.393 INFO:tasks.workunit.client.1.smithi195.stdout:0/571: creat d1/d4/d12/d6c/d7b/fa5 x:0 0 0 2024-03-22T07:28:35.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/587: link d9/d12/d1d/d36/d7d/l83 d9/d7f/lc1 0 2024-03-22T07:28:35.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/588: write d9/d2d/d58/f93 [355725,10578] 0 2024-03-22T07:28:35.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/589: fsync d9/d12/d1d/d36/f44 0 2024-03-22T07:28:35.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/590: write d9/f29 [2173370,122692] 0 2024-03-22T07:28:35.395 INFO:tasks.workunit.client.0.smithi134.stdout:7/530: mkdir d1/d19/d9c/dac 0 2024-03-22T07:28:35.396 INFO:tasks.workunit.client.1.smithi195.stdout:6/499: getdents d5/d5e/d34/d55/d3b/d6e/d56 0 2024-03-22T07:28:35.396 INFO:tasks.workunit.client.1.smithi195.stdout:6/500: dread - d5/d5e/d34/d55/d3b/d6e/d3c/f6c zero size 2024-03-22T07:28:35.399 INFO:tasks.workunit.client.0.smithi134.stdout:0/360: creat dc/f6b x:0 0 0 2024-03-22T07:28:35.401 INFO:tasks.workunit.client.0.smithi134.stdout:5/345: dwrite d1/f57 [0,4194304] 0 2024-03-22T07:28:35.404 INFO:tasks.workunit.client.1.smithi195.stdout:9/717: mknod d2/d4/c103 0 2024-03-22T07:28:35.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/718: readlink d2/d4/d6/db/d20/d4a/da2/lcd 0 2024-03-22T07:28:35.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/719: write d2/d4/d32/d6d/ff9 [1440297,110019] 0 2024-03-22T07:28:35.405 INFO:tasks.workunit.client.1.smithi195.stdout:9/720: chown d2/d4/d6/db/d20/d4a/da2/fc4 39929 1 2024-03-22T07:28:35.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/572: write d1/d10/d1f/f64 [4137569,82896] 0 2024-03-22T07:28:35.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/531: truncate d1/de/f26 4306165 0 2024-03-22T07:28:35.405 INFO:tasks.workunit.client.0.smithi134.stdout:3/309: write d4/d8/fa [3684217,43953] 0 2024-03-22T07:28:35.406 INFO:tasks.workunit.client.1.smithi195.stdout:7/540: mkdir d0/d13/d14/d20/d40/d82/db8 0 2024-03-22T07:28:35.409 INFO:tasks.workunit.client.0.smithi134.stdout:8/469: dwrite d1/f2d [0,4194304] 0 2024-03-22T07:28:35.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/346: link d1/d8/d20/f50 d1/d8/d20/d62/d65/f77 0 2024-03-22T07:28:35.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/347: readlink d1/d8/d16/d4a/l4c 0 2024-03-22T07:28:35.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/348: write d1/d8/f66 [805398,107123] 0 2024-03-22T07:28:35.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/349: fdatasync d1/d8/d16/f5a 0 2024-03-22T07:28:35.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/350: write d1/d8/d20/f70 [2183279,80402] 0 2024-03-22T07:28:35.410 INFO:tasks.workunit.client.0.smithi134.stdout:5/351: chown d1/d8/d3f/d75/f76 29 1 2024-03-22T07:28:35.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/612: rmdir da/d82 39 2024-03-22T07:28:35.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/613: truncate da/de/f2d 1710602 0 2024-03-22T07:28:35.413 INFO:tasks.workunit.client.1.smithi195.stdout:8/614: write da/d82/f9a [138244,28750] 0 2024-03-22T07:28:35.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/310: mkdir d4/d10/d6c 0 2024-03-22T07:28:35.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/311: chown d4/d8/d69/d6a 1471949 1 2024-03-22T07:28:35.415 INFO:tasks.workunit.client.1.smithi195.stdout:0/573: mkdir d1/d10/d4d/da6 0 2024-03-22T07:28:35.418 INFO:tasks.workunit.client.1.smithi195.stdout:8/615: creat da/de/fbb x:0 0 0 2024-03-22T07:28:35.419 INFO:tasks.workunit.client.0.smithi134.stdout:3/312: creat d4/d22/f6d x:0 0 0 2024-03-22T07:28:35.420 INFO:tasks.workunit.client.1.smithi195.stdout:7/541: dread d0/d13/d14/d20/d40/d82/da0/f5e [4194304,4194304] 0 2024-03-22T07:28:35.421 INFO:tasks.workunit.client.1.smithi195.stdout:7/542: write d0/f71 [3569827,38629] 0 2024-03-22T07:28:35.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/574: rmdir d1/d4/dd/df/d44/d6f 39 2024-03-22T07:28:35.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 -- 172.21.15.134:0/2762945738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fcc40 msgr2=0x7f995c0fd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:35.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 --2- 172.21.15.134:0/2762945738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fcc40 0x7f995c0fd0b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f994c004940 tx=0x7f994c009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:35.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 -- 172.21.15.134:0/2762945738 shutdown_connections 2024-03-22T07:28:35.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 --2- 172.21.15.134:0/2762945738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fcc40 0x7f995c0fd0b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:35.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 --2- 172.21.15.134:0/2762945738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fc2f0 0x7f995c0fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:35.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 -- 172.21.15.134:0/2762945738 >> 172.21.15.134:0/2762945738 conn(0x7f995c0f6ba0 msgr2=0x7f995c0f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:35.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 -- 172.21.15.134:0/2762945738 shutdown_connections 2024-03-22T07:28:35.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.420+0000 7f9963dee700 1 -- 172.21.15.134:0/2762945738 wait complete. 2024-03-22T07:28:35.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.421+0000 7f9963dee700 1 Processor -- start 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.421+0000 7f9963dee700 1 -- start start 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9963dee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 0x7f995c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9963dee700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fcc40 0x7f995c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9963dee700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c10e5d0 con 0x7f995c0fc2f0 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9963dee700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c10edc0 con 0x7f995c0fcc40 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9961b8a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 0x7f995c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9961b8a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 0x7f995c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45816/0 (socket says 172.21.15.134:45816) 2024-03-22T07:28:35.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.422+0000 7f9961b8a700 1 -- 172.21.15.134:0/2748020167 learned_addr learned my addr 172.21.15.134:0/2748020167 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:35.423 INFO:tasks.workunit.client.1.smithi195.stdout:9/721: dread d2/d4/d32/f54 [0,4194304] 0 2024-03-22T07:28:35.424 INFO:tasks.workunit.client.1.smithi195.stdout:9/722: chown d2/d4/fd6 500588 1 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f9961389700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fcc40 0x7f995c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f9961b8a700 1 -- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fcc40 msgr2=0x7f995c10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f9961b8a700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fcc40 0x7f995c10df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f9961b8a700 1 -- 172.21.15.134:0/2748020167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c005040 con 0x7f995c0fc2f0 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f9961389700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fcc40 0x7f995c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f9961b8a700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 0x7f995c10da00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f995800b790 tx=0x7f9958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:35.424 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995800f770 con 0x7f995c0fc2f0 2024-03-22T07:28:35.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f995800fda0 con 0x7f995c0fc2f0 2024-03-22T07:28:35.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.423+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995800d310 con 0x7f995c0fc2f0 2024-03-22T07:28:35.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.424+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c10f0a0 con 0x7f995c0fc2f0 2024-03-22T07:28:35.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.424+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c10f5b0 con 0x7f995c0fc2f0 2024-03-22T07:28:35.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.425+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 22) v1 ==== 45419+0+0 (secure 0 0 0) 0x7f9958010420 con 0x7f995c0fc2f0 2024-03-22T07:28:35.425 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.425+0000 7f99527fc700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9948038470 0x7f994803a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:35.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.425+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f995804bb90 con 0x7f995c0fc2f0 2024-03-22T07:28:35.426 INFO:tasks.workunit.client.0.smithi134.stdout:3/313: rename d4/d22/d3c/f43 to d4/d8/f6e 0 2024-03-22T07:28:35.426 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.426+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c05f5f0 con 0x7f995c0fc2f0 2024-03-22T07:28:35.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/543: mknod d0/cb9 0 2024-03-22T07:28:35.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/544: chown d0/d13/d22/d28/f64 0 1 2024-03-22T07:28:35.429 INFO:tasks.workunit.client.1.smithi195.stdout:9/723: rmdir d2/d4/d23/d74 39 2024-03-22T07:28:35.429 INFO:tasks.workunit.client.1.smithi195.stdout:9/724: write d2/d4/d6/ff4 [34508,34186] 0 2024-03-22T07:28:35.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.431+0000 7f9961389700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9948038470 0x7f994803a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:35.431 INFO:tasks.workunit.client.0.smithi134.stdout:3/314: creat d4/d22/d29/d50/f6f x:0 0 0 2024-03-22T07:28:35.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.435+0000 7f9961389700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9948038470 0x7f994803a920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f994c00b7a0 tx=0x7f994c009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:35.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/470: write d1/f5d [424504,74017] 0 2024-03-22T07:28:35.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/471: dread - d1/d15/d42/d12/f7a zero size 2024-03-22T07:28:35.437 INFO:tasks.workunit.client.1.smithi195.stdout:7/545: dread d0/d13/d14/d20/f4b [0,4194304] 0 2024-03-22T07:28:35.437 INFO:tasks.workunit.client.1.smithi195.stdout:7/546: dread - d0/d13/d14/d2b/f9d zero size 2024-03-22T07:28:35.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.437+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f995800d580 con 0x7f995c0fc2f0 2024-03-22T07:28:35.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/315: creat d4/d8/d23/f70 x:0 0 0 2024-03-22T07:28:35.443 INFO:tasks.workunit.client.1.smithi195.stdout:7/547: symlink d0/d13/d22/d28/lba 0 2024-03-22T07:28:35.443 INFO:tasks.workunit.client.1.smithi195.stdout:5/591: dwrite d9/d12/f1f [0,4194304] 0 2024-03-22T07:28:35.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/501: dwrite d5/d16/f48 [0,4194304] 0 2024-03-22T07:28:35.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/502: chown d5/d5e/d34/d55/d4b/da2/f2a 16529 1 2024-03-22T07:28:35.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/548: creat d0/d13/d14/d80/d9c/fbb x:0 0 0 2024-03-22T07:28:35.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/361: dwrite dc/d18/f1d [8388608,4194304] 0 2024-03-22T07:28:35.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/362: fsync dc/d18/f2f 0 2024-03-22T07:28:35.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/363: read dc/f3c [3148032,117428] 0 2024-03-22T07:28:35.446 INFO:tasks.workunit.client.0.smithi134.stdout:0/364: chown dc/d17/l5c 99711 1 2024-03-22T07:28:35.449 INFO:tasks.workunit.client.1.smithi195.stdout:5/592: rename d9/f5b to d9/d12/d1d/d69/d78/d41/fc2 0 2024-03-22T07:28:35.449 INFO:tasks.workunit.client.0.smithi134.stdout:0/365: getdents dc 0 2024-03-22T07:28:35.449 INFO:tasks.workunit.client.0.smithi134.stdout:0/366: chown dc/d17/l2c 7216857 1 2024-03-22T07:28:35.453 INFO:tasks.workunit.client.0.smithi134.stdout:0/367: rename dc/d17/l43 to dc/de/d55/d65/l6c 0 2024-03-22T07:28:35.454 INFO:tasks.workunit.client.0.smithi134.stdout:0/368: truncate dc/d18/f2e 913135 0 2024-03-22T07:28:35.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/593: link d9/d22/d7b/d98/da0/lb8 d9/d73/da1/d5f/lc3 0 2024-03-22T07:28:35.455 INFO:tasks.workunit.client.1.smithi195.stdout:8/616: dwrite da/d17/d32/f40 [0,4194304] 0 2024-03-22T07:28:35.456 INFO:tasks.workunit.client.0.smithi134.stdout:0/369: rename dc/de/f35 to dc/d17/f6d 0 2024-03-22T07:28:35.458 INFO:tasks.workunit.client.0.smithi134.stdout:7/532: dwrite d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:35.458 INFO:tasks.workunit.client.0.smithi134.stdout:7/533: read d1/de/d11/f16 [883000,106784] 0 2024-03-22T07:28:35.458 INFO:tasks.workunit.client.1.smithi195.stdout:0/575: dwrite d1/d10/d19/d20/f28 [0,4194304] 0 2024-03-22T07:28:35.458 INFO:tasks.workunit.client.1.smithi195.stdout:7/549: getdents d0/d13/d14/d29/d35/d6d 0 2024-03-22T07:28:35.459 INFO:tasks.workunit.client.0.smithi134.stdout:8/472: dread d1/f67 [0,4194304] 0 2024-03-22T07:28:35.459 INFO:tasks.workunit.client.0.smithi134.stdout:8/473: fdatasync d1/d15/d42/d44/f3a 0 2024-03-22T07:28:35.459 INFO:tasks.workunit.client.0.smithi134.stdout:5/352: dwrite d1/d4/f2b [0,4194304] 0 2024-03-22T07:28:35.460 INFO:tasks.workunit.client.0.smithi134.stdout:3/316: dwrite d4/d8/f6e [0,4194304] 0 2024-03-22T07:28:35.460 INFO:tasks.workunit.client.1.smithi195.stdout:5/594: truncate f8 234530 0 2024-03-22T07:28:35.466 INFO:tasks.workunit.client.1.smithi195.stdout:6/503: dwrite d5/d5e/d34/d55/d4b/da2/f2a [0,4194304] 0 2024-03-22T07:28:35.467 INFO:tasks.workunit.client.1.smithi195.stdout:0/576: link d1/d4/dd/df/d2b/l3d d1/d4/d12/d6c/d87/la7 0 2024-03-22T07:28:35.467 INFO:tasks.workunit.client.0.smithi134.stdout:5/353: rmdir d1 39 2024-03-22T07:28:35.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/550: symlink d0/d13/d14/d29/da2/lbc 0 2024-03-22T07:28:35.469 INFO:tasks.workunit.client.1.smithi195.stdout:7/551: creat d0/d13/d14/d29/d35/d3a/fbd x:0 0 0 2024-03-22T07:28:35.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/595: symlink d9/d73/lc4 0 2024-03-22T07:28:35.475 INFO:tasks.workunit.client.1.smithi195.stdout:8/617: getdents da/d17/d32/d7d/d8e 0 2024-03-22T07:28:35.476 INFO:tasks.workunit.client.0.smithi134.stdout:7/534: dwrite d1/de/d11/d2b/d31/f91 [4194304,4194304] 0 2024-03-22T07:28:35.476 INFO:tasks.workunit.client.0.smithi134.stdout:2/309: sync 2024-03-22T07:28:35.476 INFO:tasks.workunit.client.0.smithi134.stdout:2/310: chown d2/d5/d22/c36 2054880 1 2024-03-22T07:28:35.479 INFO:tasks.workunit.client.0.smithi134.stdout:8/474: dwrite d1/d15/f2c [0,4194304] 0 2024-03-22T07:28:35.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/577: mknod d1/d4/dd/df/d6b/ca8 0 2024-03-22T07:28:35.483 INFO:tasks.workunit.client.1.smithi195.stdout:0/578: chown d1/d4/d83/l8c 205 1 2024-03-22T07:28:35.489 INFO:tasks.workunit.client.1.smithi195.stdout:7/552: mknod d0/d13/d22/d57/d7b/cbe 0 2024-03-22T07:28:35.494 INFO:tasks.workunit.client.0.smithi134.stdout:3/317: mknod d4/d10/c71 0 2024-03-22T07:28:35.494 INFO:tasks.workunit.client.0.smithi134.stdout:3/318: getdents d4/d8/d69 0 2024-03-22T07:28:35.494 INFO:tasks.workunit.client.1.smithi195.stdout:6/504: dwrite d5/d5e/d34/d55/d4b/da2/d1a/fb2 [0,4194304] 0 2024-03-22T07:28:35.496 INFO:tasks.workunit.client.0.smithi134.stdout:3/319: dread d4/d22/f25 [0,4194304] 0 2024-03-22T07:28:35.496 INFO:tasks.workunit.client.1.smithi195.stdout:0/579: dread d1/d4/dd/df/d44/d6f/f91 [0,4194304] 0 2024-03-22T07:28:35.497 INFO:tasks.workunit.client.1.smithi195.stdout:7/553: rename d0/d13/d14/d2f/f43 to d0/d13/d14/d20/d40/d82/da6/fbf 0 2024-03-22T07:28:35.497 INFO:tasks.workunit.client.1.smithi195.stdout:1/459: sync 2024-03-22T07:28:35.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/551: sync 2024-03-22T07:28:35.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/552: stat d3/df/d15/d1d/d5c/d86/da0/da5 0 2024-03-22T07:28:35.497 INFO:tasks.workunit.client.1.smithi195.stdout:3/553: chown d3/f91 80587 1 2024-03-22T07:28:35.498 INFO:tasks.workunit.client.0.smithi134.stdout:5/354: creat d1/d8/d3f/f78 x:0 0 0 2024-03-22T07:28:35.500 INFO:tasks.workunit.client.0.smithi134.stdout:7/535: truncate d1/de/d11/d2b/d31/f54 704355 0 2024-03-22T07:28:35.504 INFO:tasks.workunit.client.0.smithi134.stdout:2/311: dwrite d2/f3b [0,4194304] 0 2024-03-22T07:28:35.507 INFO:tasks.workunit.client.0.smithi134.stdout:2/312: dread d2/f3e [0,4194304] 0 2024-03-22T07:28:35.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/320: dread d4/d8/fa [4194304,4194304] 0 2024-03-22T07:28:35.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/321: write d4/d8/fa [8307305,5467] 0 2024-03-22T07:28:35.507 INFO:tasks.workunit.client.0.smithi134.stdout:3/322: truncate d4/d22/d29/f46 82823 0 2024-03-22T07:28:35.508 INFO:tasks.workunit.client.0.smithi134.stdout:2/313: write d2/f1c [5926850,61576] 0 2024-03-22T07:28:35.508 INFO:tasks.workunit.client.1.smithi195.stdout:8/618: dwrite da/d17/d32/d61/d47/d53/f89 [0,4194304] 0 2024-03-22T07:28:35.512 INFO:tasks.workunit.client.1.smithi195.stdout:6/505: write d5/d16/d5a/f99 [3607000,6459] 0 2024-03-22T07:28:35.512 INFO:tasks.workunit.client.1.smithi195.stdout:4/547: sync 2024-03-22T07:28:35.512 INFO:tasks.workunit.client.1.smithi195.stdout:4/548: write f12 [2341632,21308] 0 2024-03-22T07:28:35.513 INFO:tasks.workunit.client.1.smithi195.stdout:0/580: mknod d1/d4/dd/df/d44/ca9 0 2024-03-22T07:28:35.513 INFO:tasks.workunit.client.0.smithi134.stdout:5/355: symlink d1/d8/d3f/l79 0 2024-03-22T07:28:35.516 INFO:tasks.workunit.client.1.smithi195.stdout:3/554: dread d3/f3f [0,4194304] 0 2024-03-22T07:28:35.516 INFO:tasks.workunit.client.1.smithi195.stdout:1/460: dread d0/d2/fe [4194304,4194304] 0 2024-03-22T07:28:35.517 INFO:tasks.workunit.client.1.smithi195.stdout:7/554: rename d0/d13/d14/c55 to d0/d13/d14/d20/cc0 0 2024-03-22T07:28:35.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/323: symlink d4/d8/l72 0 2024-03-22T07:28:35.523 INFO:tasks.workunit.client.1.smithi195.stdout:5/596: rmdir d9/d53 0 2024-03-22T07:28:35.527 INFO:tasks.workunit.client.0.smithi134.stdout:8/475: mkdir d1/d15/d42/d9e 0 2024-03-22T07:28:35.533 INFO:tasks.workunit.client.0.smithi134.stdout:5/356: unlink d1/d8/l26 0 2024-03-22T07:28:35.533 INFO:tasks.workunit.client.0.smithi134.stdout:3/324: creat d4/d22/d3c/f73 x:0 0 0 2024-03-22T07:28:35.533 INFO:tasks.workunit.client.0.smithi134.stdout:3/325: chown d4/d8/d5c 73 1 2024-03-22T07:28:35.533 INFO:tasks.workunit.client.0.smithi134.stdout:3/326: creat d4/d10/d4b/f74 x:0 0 0 2024-03-22T07:28:35.533 INFO:tasks.workunit.client.0.smithi134.stdout:3/327: chown d4/d22/d3c/f73 123 1 2024-03-22T07:28:35.534 INFO:tasks.workunit.client.1.smithi195.stdout:1/461: dread d0/d2/f1b [0,4194304] 0 2024-03-22T07:28:35.534 INFO:tasks.workunit.client.1.smithi195.stdout:1/462: chown d0/d2/fe 102326 1 2024-03-22T07:28:35.534 INFO:tasks.workunit.client.1.smithi195.stdout:1/463: chown d0/d2/d6/d21/d41/d47/f49 288471 1 2024-03-22T07:28:35.536 INFO:tasks.workunit.client.0.smithi134.stdout:2/314: mknod d2/d5/d8/c5c 0 2024-03-22T07:28:35.536 INFO:tasks.workunit.client.0.smithi134.stdout:7/536: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:35.536 INFO:tasks.workunit.client.1.smithi195.stdout:4/549: dwrite d13/d63/d79/f4b [0,4194304] 0 2024-03-22T07:28:35.536 INFO:tasks.workunit.client.1.smithi195.stdout:4/550: stat d13/d15/f22 0 2024-03-22T07:28:35.543 INFO:tasks.workunit.client.1.smithi195.stdout:1/464: read d0/d2/d6/f8b [839268,509] 0 2024-03-22T07:28:35.546 INFO:tasks.workunit.client.0.smithi134.stdout:8/476: truncate d1/f5d 2907262 0 2024-03-22T07:28:35.549 INFO:tasks.workunit.client.1.smithi195.stdout:4/551: write d13/d63/d36/f50 [3362435,32114] 0 2024-03-22T07:28:35.550 INFO:tasks.workunit.client.1.smithi195.stdout:0/581: dwrite d1/d4/dd/df/d44/d6f/f71 [4194304,4194304] 0 2024-03-22T07:28:35.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/506: rename d5/d5e/d34/d55/d4b/da2/fae to d5/d5e/d34/d55/d3b/d6e/d97/fb5 0 2024-03-22T07:28:35.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/507: creat d5/d16/d45/d53/d59/d87/fb6 x:0 0 0 2024-03-22T07:28:35.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/508: chown d5/d16/d45/d53 0 1 2024-03-22T07:28:35.557 INFO:tasks.workunit.client.0.smithi134.stdout:3/328: truncate d4/f2b 1670777 0 2024-03-22T07:28:35.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/555: rmdir d0/d13/d22 39 2024-03-22T07:28:35.559 INFO:tasks.workunit.client.1.smithi195.stdout:8/619: dwrite da/dc/fa6 [0,4194304] 0 2024-03-22T07:28:35.560 INFO:tasks.workunit.client.1.smithi195.stdout:8/620: stat da/d17 0 2024-03-22T07:28:35.560 INFO:tasks.workunit.client.1.smithi195.stdout:8/621: fsync da/d17/d32/d61/d47/d53/f96 0 2024-03-22T07:28:35.560 INFO:tasks.workunit.client.1.smithi195.stdout:8/622: write da/d17/d32/d61/d47/f83 [587765,14295] 0 2024-03-22T07:28:35.560 INFO:tasks.workunit.client.1.smithi195.stdout:3/555: dwrite d3/d18/d89/f90 [0,4194304] 0 2024-03-22T07:28:35.563 INFO:tasks.workunit.client.0.smithi134.stdout:8/477: link d1/d15/d42/d44/f52 d1/d15/d57/d79/f9f 0 2024-03-22T07:28:35.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/357: dwrite d1/d8/d16/f40 [0,4194304] 0 2024-03-22T07:28:35.564 INFO:tasks.workunit.client.0.smithi134.stdout:5/358: truncate d1/d8/d20/d62/d65/f1e 5182463 0 2024-03-22T07:28:35.567 INFO:tasks.workunit.client.0.smithi134.stdout:3/329: getdents d4/d8/d69/d6a 0 2024-03-22T07:28:35.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/597: dwrite d9/d22/d46/f63 [0,4194304] 0 2024-03-22T07:28:35.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/598: read - d9/d2d/d58/fb0 zero size 2024-03-22T07:28:35.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/599: chown d9/d22/c2e 168 1 2024-03-22T07:28:35.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/600: write d9/d12/f8c [940359,49982] 0 2024-03-22T07:28:35.568 INFO:tasks.workunit.client.1.smithi195.stdout:1/465: truncate d0/d2/d9/f15 371185 0 2024-03-22T07:28:35.570 INFO:tasks.workunit.client.0.smithi134.stdout:8/478: mkdir d1/d15/d57/d79/da0 0 2024-03-22T07:28:35.573 INFO:tasks.workunit.client.1.smithi195.stdout:2/560: sync 2024-03-22T07:28:35.575 INFO:tasks.workunit.client.1.smithi195.stdout:8/623: dread da/d17/d32/d7d/d8e/fa3 [0,4194304] 0 2024-03-22T07:28:35.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/359: symlink d1/d8/d3f/d75/l7a 0 2024-03-22T07:28:35.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/360: write d1/d8/d20/f3b [451792,28803] 0 2024-03-22T07:28:35.586 INFO:tasks.workunit.client.0.smithi134.stdout:7/537: dwrite d1/de/f5a [0,4194304] 0 2024-03-22T07:28:35.589 INFO:tasks.workunit.client.1.smithi195.stdout:4/552: dwrite d13/f73 [0,4194304] 0 2024-03-22T07:28:35.590 INFO:tasks.workunit.client.0.smithi134.stdout:2/315: dwrite d2/f3e [0,4194304] 0 2024-03-22T07:28:35.590 INFO:tasks.workunit.client.0.smithi134.stdout:2/316: dread - d2/d5/d8/f42 zero size 2024-03-22T07:28:35.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/330: rename d4/d22/c26 to d4/d10/d6c/c75 0 2024-03-22T07:28:35.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/331: truncate d4/d8/d23/f3b 1265565 0 2024-03-22T07:28:35.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/332: truncate d4/d22/d29/f46 177689 0 2024-03-22T07:28:35.590 INFO:tasks.workunit.client.0.smithi134.stdout:3/333: truncate d4/d10/f35 793171 0 2024-03-22T07:28:35.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/553: dread d13/d2a/fbd [0,4194304] 0 2024-03-22T07:28:35.596 INFO:tasks.workunit.client.0.smithi134.stdout:8/479: rmdir d1/d15/d57/d79/da0 0 2024-03-22T07:28:35.597 INFO:tasks.workunit.client.0.smithi134.stdout:8/480: stat d1/d46 0 2024-03-22T07:28:35.604 INFO:tasks.workunit.client.0.smithi134.stdout:7/538: dwrite d1/de/d11/d2b/d31/f43 [0,4194304] 0 2024-03-22T07:28:35.605 INFO:tasks.workunit.client.1.smithi195.stdout:4/554: dread d13/d63/d3e/d5c/d65/f72 [0,4194304] 0 2024-03-22T07:28:35.605 INFO:tasks.workunit.client.1.smithi195.stdout:4/555: fdatasync d13/d2a/d7e/d85/fa7 0 2024-03-22T07:28:35.605 INFO:tasks.workunit.client.1.smithi195.stdout:4/556: truncate d13/d63/f18 95954 0 2024-03-22T07:28:35.605 INFO:tasks.workunit.client.1.smithi195.stdout:4/557: chown d13/d63/d3e/d5c 0 1 2024-03-22T07:28:35.605 INFO:tasks.workunit.client.1.smithi195.stdout:4/558: stat f9 0 2024-03-22T07:28:35.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/556: mkdir d3/df/d15/d1d/d5c/d47/dbb 0 2024-03-22T07:28:35.608 INFO:tasks.workunit.client.1.smithi195.stdout:3/557: truncate d3/d22/f8a 835036 0 2024-03-22T07:28:35.609 INFO:tasks.workunit.client.1.smithi195.stdout:3/558: write d3/df/f4a [881660,54942] 0 2024-03-22T07:28:35.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/539: dread d1/de/d11/d48/d52/d46/f61 [0,4194304] 0 2024-03-22T07:28:35.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/540: truncate d1/de/d11/d48/d52/d46/f61 2577669 0 2024-03-22T07:28:35.613 INFO:tasks.workunit.client.0.smithi134.stdout:7/541: creat d1/de/d11/d2b/fad x:0 0 0 2024-03-22T07:28:35.622 INFO:tasks.workunit.client.0.smithi134.stdout:5/361: chown d1/d8/d20/d62/d65/f18 337932403 1 2024-03-22T07:28:35.622 INFO:tasks.workunit.client.0.smithi134.stdout:5/362: chown d1/d8/d16/l6f 14078398 1 2024-03-22T07:28:35.626 INFO:tasks.workunit.client.1.smithi195.stdout:5/601: link d9/d12/d1d/d69/d78/c43 d9/d22/d46/cc5 0 2024-03-22T07:28:35.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/602: write d9/f25 [120475,15160] 0 2024-03-22T07:28:35.628 INFO:tasks.workunit.client.1.smithi195.stdout:1/466: mknod d0/d2/d9/d2a/d6f/c93 0 2024-03-22T07:28:35.632 INFO:tasks.workunit.client.1.smithi195.stdout:2/561: mknod d2/d3/d21/d4c/cb6 0 2024-03-22T07:28:35.634 INFO:tasks.workunit.client.1.smithi195.stdout:6/509: truncate d5/d5e/d34/d55/d4b/da2/d1a/fb2 3282572 0 2024-03-22T07:28:35.639 INFO:tasks.workunit.client.0.smithi134.stdout:2/317: unlink d2/f14 0 2024-03-22T07:28:35.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/556: rmdir d0/d13/d14/d20/d40/d82/da0/d59 39 2024-03-22T07:28:35.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/557: fdatasync d0/d13/f1e 0 2024-03-22T07:28:35.641 INFO:tasks.workunit.client.1.smithi195.stdout:7/558: read - d0/d13/d14/d80/fb6 zero size 2024-03-22T07:28:35.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/334: unlink d4/d8/f4e 0 2024-03-22T07:28:35.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/335: write d4/d10/d4b/f4c [276151,75188] 0 2024-03-22T07:28:35.644 INFO:tasks.workunit.client.0.smithi134.stdout:3/336: dread - d4/f56 zero size 2024-03-22T07:28:35.644 INFO:tasks.workunit.client.1.smithi195.stdout:4/559: getdents d13/d2a 0 2024-03-22T07:28:35.644 INFO:tasks.workunit.client.1.smithi195.stdout:4/560: creat d13/d63/d36/d5f/d83/fbe x:0 0 0 2024-03-22T07:28:35.647 INFO:tasks.workunit.client.1.smithi195.stdout:3/559: rename d3/l5 to d3/df/d15/d1d/d5c/d47/d67/lbc 0 2024-03-22T07:28:35.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/560: dread - d3/d18/d89/d76/f85 zero size 2024-03-22T07:28:35.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/561: chown d3/f29 0 1 2024-03-22T07:28:35.654 INFO:tasks.workunit.client.1.smithi195.stdout:5/603: getdents d9/d12/d1d/d36/d7d 0 2024-03-22T07:28:35.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/542: mkdir d1/dae 0 2024-03-22T07:28:35.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/543: chown d1/d19 663111 1 2024-03-22T07:28:35.655 INFO:tasks.workunit.client.0.smithi134.stdout:7/544: fsync d1/d19/d32/f4d 0 2024-03-22T07:28:35.658 INFO:tasks.workunit.client.1.smithi195.stdout:1/467: mknod d0/d2/d9/d2a/d6f/c94 0 2024-03-22T07:28:35.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/559: dwrite d0/d13/d22/d57/d7b/d8c/f90 [0,4194304] 0 2024-03-22T07:28:35.671 INFO:tasks.workunit.client.1.smithi195.stdout:2/562: creat d2/d3/d21/d60/d81/da8/fb7 x:0 0 0 2024-03-22T07:28:35.673 INFO:tasks.workunit.client.1.smithi195.stdout:6/510: symlink d5/d5e/d34/d55/d4b/da2/dad/lb7 0 2024-03-22T07:28:35.674 INFO:tasks.workunit.client.0.smithi134.stdout:5/363: link d1/d8/d3f/l79 d1/d8/d20/l7b 0 2024-03-22T07:28:35.677 INFO:tasks.workunit.client.1.smithi195.stdout:3/562: dwrite d3/d18/f26 [4194304,4194304] 0 2024-03-22T07:28:35.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/561: creat d13/d63/d36/fbf x:0 0 0 2024-03-22T07:28:35.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/562: dread - d13/f90 zero size 2024-03-22T07:28:35.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/563: write d13/d2a/f88 [528872,6655] 0 2024-03-22T07:28:35.679 INFO:tasks.workunit.client.1.smithi195.stdout:1/468: rmdir d0/d2/d6/d21/d41 39 2024-03-22T07:28:35.682 INFO:tasks.workunit.client.0.smithi134.stdout:8/481: symlink d1/d15/d42/d49/la1 0 2024-03-22T07:28:35.682 INFO:tasks.workunit.client.0.smithi134.stdout:8/482: chown d1/d4/d61 2884 1 2024-03-22T07:28:35.683 INFO:tasks.workunit.client.0.smithi134.stdout:8/483: chown d1/f82 1935 1 2024-03-22T07:28:35.685 INFO:tasks.workunit.client.1.smithi195.stdout:7/560: getdents d0/d13/d22/d57/d7b/d8c 0 2024-03-22T07:28:35.686 INFO:tasks.workunit.client.0.smithi134.stdout:8/484: write d1/d15/d57/f68 [1903738,47015] 0 2024-03-22T07:28:35.687 INFO:tasks.workunit.client.0.smithi134.stdout:3/337: dwrite d4/f1e [0,4194304] 0 2024-03-22T07:28:35.689 INFO:tasks.workunit.client.0.smithi134.stdout:7/545: dwrite d1/d40/f7f [0,4194304] 0 2024-03-22T07:28:35.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/318: mkdir d2/d5/d8/d5d 0 2024-03-22T07:28:35.690 INFO:tasks.workunit.client.1.smithi195.stdout:5/604: dwrite d9/f31 [0,4194304] 0 2024-03-22T07:28:35.690 INFO:tasks.workunit.client.1.smithi195.stdout:5/605: write f8 [404613,44464] 0 2024-03-22T07:28:35.691 INFO:tasks.workunit.client.1.smithi195.stdout:2/563: symlink d2/d3/d1a/lb8 0 2024-03-22T07:28:35.691 INFO:tasks.workunit.client.1.smithi195.stdout:2/564: chown d2/d3/d7/da/de/f65 3476 1 2024-03-22T07:28:35.692 INFO:tasks.workunit.client.1.smithi195.stdout:2/565: dread - d2/d3/d24/f9f zero size 2024-03-22T07:28:35.693 INFO:tasks.workunit.client.0.smithi134.stdout:1/390: sync 2024-03-22T07:28:35.693 INFO:tasks.workunit.client.0.smithi134.stdout:1/391: creat d5/d1d/d49/f8a x:0 0 0 2024-03-22T07:28:35.693 INFO:tasks.workunit.client.0.smithi134.stdout:4/421: sync 2024-03-22T07:28:35.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/364: read d1/f57 [3780257,21946] 0 2024-03-22T07:28:35.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/511: symlink d5/d5e/d34/d55/lb8 0 2024-03-22T07:28:35.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/512: truncate d5/d5e/d34/fa6 864439 0 2024-03-22T07:28:35.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/513: chown d5/d5e/d34/d55/d4b/l90 100 1 2024-03-22T07:28:35.696 INFO:tasks.workunit.client.0.smithi134.stdout:8/485: write d1/d15/f5 [1854888,51000] 0 2024-03-22T07:28:35.696 INFO:tasks.workunit.client.0.smithi134.stdout:8/486: stat d1/d15/d42/d25/l33 0 2024-03-22T07:28:35.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/514: dread d5/d5e/d34/d55/d3b/f50 [0,4194304] 0 2024-03-22T07:28:35.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.696+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 23) v1 ==== 45715+0+0 (secure 0 0 0) 0x7f995800ed60 con 0x7f995c0fc2f0 2024-03-22T07:28:35.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:35 smithi134 ceph-mon[29057]: Deploying cephadm binary to smithi195 2024-03-22T07:28:35.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:35 smithi134 ceph-mon[29057]: Deploying cephadm binary to smithi134 2024-03-22T07:28:35.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:35 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:35.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:35 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:35.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:35 smithi134 ceph-mon[29057]: mgrmap e22: smithi195.jxfsnc(active, since 1.01113s) 2024-03-22T07:28:35.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:35 smithi134 ceph-mon[29057]: pgmap v3: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-03-22T07:28:35.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/546: truncate d1/de/d11/d48/f29 3769555 0 2024-03-22T07:28:35.701 INFO:tasks.workunit.client.1.smithi195.stdout:9/725: sync 2024-03-22T07:28:35.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/319: write d2/d5/d22/d52/d3c/f47 [2908714,23054] 0 2024-03-22T07:28:35.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/320: chown d2/d5/d8 11620510 1 2024-03-22T07:28:35.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/321: chown d2/d5/d22/d52/d3c/d4f 22805314 1 2024-03-22T07:28:35.704 INFO:tasks.workunit.client.1.smithi195.stdout:1/469: dwrite d0/d2/d6/d21/d41/d47/d4a/f83 [0,4194304] 0 2024-03-22T07:28:35.705 INFO:tasks.workunit.client.1.smithi195.stdout:3/563: symlink d3/df/d15/d1d/d5c/d47/d67/lbd 0 2024-03-22T07:28:35.707 INFO:tasks.workunit.client.0.smithi134.stdout:1/392: symlink d5/l8b 0 2024-03-22T07:28:35.709 INFO:tasks.workunit.client.1.smithi195.stdout:1/470: dread d0/f26 [0,4194304] 0 2024-03-22T07:28:35.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/564: unlink d13/d63/d79/f76 0 2024-03-22T07:28:35.711 INFO:tasks.workunit.client.0.smithi134.stdout:4/422: creat d2/d25/d48/d6e/d7b/f8e x:0 0 0 2024-03-22T07:28:35.712 INFO:tasks.workunit.client.1.smithi195.stdout:4/565: dread d13/f4f [0,4194304] 0 2024-03-22T07:28:35.712 INFO:tasks.workunit.client.1.smithi195.stdout:4/566: stat d13/d63/c5b 0 2024-03-22T07:28:35.712 INFO:tasks.workunit.client.1.smithi195.stdout:7/561: mknod d0/d98/cc1 0 2024-03-22T07:28:35.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/365: link d1/d8/d20/d62/d65/f18 d1/d8/d20/d62/d68/f7c 0 2024-03-22T07:28:35.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/366: chown d1/d8 7196591 1 2024-03-22T07:28:35.721 INFO:tasks.workunit.client.1.smithi195.stdout:1/471: write d0/d2/d6/d21/d39/f68 [506619,58602] 0 2024-03-22T07:28:35.721 INFO:tasks.workunit.client.1.smithi195.stdout:1/472: fdatasync d0/d2/d6/f71 0 2024-03-22T07:28:35.721 INFO:tasks.workunit.client.1.smithi195.stdout:1/473: write d0/d2/d6/f8b [1717153,75053] 0 2024-03-22T07:28:35.723 INFO:tasks.workunit.client.0.smithi134.stdout:3/338: dwrite d4/d22/d29/f67 [0,4194304] 0 2024-03-22T07:28:35.723 INFO:tasks.workunit.client.0.smithi134.stdout:3/339: creat d4/f76 x:0 0 0 2024-03-22T07:28:35.723 INFO:tasks.workunit.client.0.smithi134.stdout:3/340: fsync d4/d8/d23/f60 0 2024-03-22T07:28:35.724 INFO:tasks.workunit.client.0.smithi134.stdout:2/322: creat d2/d5/d22/f5e x:0 0 0 2024-03-22T07:28:35.725 INFO:tasks.workunit.client.1.smithi195.stdout:3/564: dread d3/d18/f51 [0,4194304] 0 2024-03-22T07:28:35.740 INFO:tasks.workunit.client.0.smithi134.stdout:8/487: dwrite d1/d15/d42/d12/f7a [0,4194304] 0 2024-03-22T07:28:35.740 INFO:tasks.workunit.client.0.smithi134.stdout:1/393: dwrite d5/da/d13/d1e/d45/f7f [0,4194304] 0 2024-03-22T07:28:35.742 INFO:tasks.workunit.client.1.smithi195.stdout:5/606: creat d9/da8/fc6 x:0 0 0 2024-03-22T07:28:35.742 INFO:tasks.workunit.client.1.smithi195.stdout:5/607: write d9/d2d/d84/d92/fba [955649,107411] 0 2024-03-22T07:28:35.745 INFO:tasks.workunit.client.1.smithi195.stdout:2/566: symlink d2/d3/d7/da/d1b/d98/lb9 0 2024-03-22T07:28:35.745 INFO:tasks.workunit.client.1.smithi195.stdout:2/567: creat d2/d3/d24/fba x:0 0 0 2024-03-22T07:28:35.751 INFO:tasks.workunit.client.1.smithi195.stdout:4/567: mknod d13/d63/d36/cc0 0 2024-03-22T07:28:35.751 INFO:tasks.workunit.client.1.smithi195.stdout:2/568: dread d2/d3/d7/d19/f28 [4194304,4194304] 0 2024-03-22T07:28:35.752 INFO:tasks.workunit.client.1.smithi195.stdout:2/569: fdatasync d2/d3/d24/f6b 0 2024-03-22T07:28:35.752 INFO:tasks.workunit.client.1.smithi195.stdout:2/570: write d2/d3/d7/da/d4e/fb1 [282595,64373] 0 2024-03-22T07:28:35.755 INFO:tasks.workunit.client.1.smithi195.stdout:7/562: creat d0/d13/d14/d20/d40/d82/daa/fc2 x:0 0 0 2024-03-22T07:28:35.755 INFO:tasks.workunit.client.1.smithi195.stdout:9/726: dwrite d2/d4/d32/d6d/deb/ff6 [0,4194304] 0 2024-03-22T07:28:35.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/394: write d5/da/d1b/f1f [316660,89837] 0 2024-03-22T07:28:35.757 INFO:tasks.workunit.client.0.smithi134.stdout:9/320: sync 2024-03-22T07:28:35.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/563: dread d0/d13/d14/d29/d35/f60 [0,4194304] 0 2024-03-22T07:28:35.757 INFO:tasks.workunit.client.1.smithi195.stdout:7/564: chown d0/d13/d22/d28/lb4 219354 1 2024-03-22T07:28:35.758 INFO:tasks.workunit.client.1.smithi195.stdout:5/608: dread d9/d12/d1d/f95 [0,4194304] 0 2024-03-22T07:28:35.758 INFO:tasks.workunit.client.1.smithi195.stdout:5/609: write d9/d12/f9e [1035,67063] 0 2024-03-22T07:28:35.758 INFO:tasks.workunit.client.0.smithi134.stdout:4/423: dwrite d2/d25/d48/f4b [0,4194304] 0 2024-03-22T07:28:35.759 INFO:tasks.workunit.client.1.smithi195.stdout:1/474: dwrite d0/f26 [0,4194304] 0 2024-03-22T07:28:35.759 INFO:tasks.workunit.client.1.smithi195.stdout:1/475: stat d0/d2/d27/c31 0 2024-03-22T07:28:35.759 INFO:tasks.workunit.client.1.smithi195.stdout:1/476: chown d0/d2/d9/d2a/d6f/l7f 6106863 1 2024-03-22T07:28:35.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/610: dread d9/d12/d1d/f32 [0,4194304] 0 2024-03-22T07:28:35.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/611: stat d9/d22/d50/f75 0 2024-03-22T07:28:35.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/612: chown d9/d12/l18 194107 1 2024-03-22T07:28:35.760 INFO:tasks.workunit.client.0.smithi134.stdout:2/323: mkdir d2/d5/d8/d5d/d5f 0 2024-03-22T07:28:35.760 INFO:tasks.workunit.client.0.smithi134.stdout:2/324: stat d2/d5/d22/f24 0 2024-03-22T07:28:35.760 INFO:tasks.workunit.client.0.smithi134.stdout:2/325: chown d2/d5/d22/c36 28 1 2024-03-22T07:28:35.764 INFO:tasks.workunit.client.0.smithi134.stdout:0/370: sync 2024-03-22T07:28:35.764 INFO:tasks.workunit.client.0.smithi134.stdout:0/371: write dc/de/f6a [118988,103947] 0 2024-03-22T07:28:35.764 INFO:tasks.workunit.client.0.smithi134.stdout:0/372: getdents dc 0 2024-03-22T07:28:35.764 INFO:tasks.workunit.client.0.smithi134.stdout:6/285: sync 2024-03-22T07:28:35.764 INFO:tasks.workunit.client.0.smithi134.stdout:6/286: write d2/d1b/d1d/d5e/f66 [1022513,114252] 0 2024-03-22T07:28:35.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/613: write d9/f11 [2335312,40928] 0 2024-03-22T07:28:35.771 INFO:tasks.workunit.client.1.smithi195.stdout:3/565: symlink d3/d18/d89/d70/db5/lbe 0 2024-03-22T07:28:35.774 INFO:tasks.workunit.client.0.smithi134.stdout:8/488: rmdir d1/d46/d75 39 2024-03-22T07:28:35.774 INFO:tasks.workunit.client.0.smithi134.stdout:8/489: chown d1/d4/d38/c3f 0 1 2024-03-22T07:28:35.774 INFO:tasks.workunit.client.0.smithi134.stdout:8/490: dread - d1/d4/d61/d85/f91 zero size 2024-03-22T07:28:35.779 INFO:tasks.workunit.client.1.smithi195.stdout:4/568: creat d13/d15/d64/fc1 x:0 0 0 2024-03-22T07:28:35.779 INFO:tasks.workunit.client.1.smithi195.stdout:4/569: write d13/d63/d36/d5f/d83/fbe [1032365,24254] 0 2024-03-22T07:28:35.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/571: rename d2/d3/d7/da/d4e/c7a to d2/d3/d24/cbb 0 2024-03-22T07:28:35.782 INFO:tasks.workunit.client.1.smithi195.stdout:0/582: sync 2024-03-22T07:28:35.783 INFO:tasks.workunit.client.0.smithi134.stdout:5/367: truncate d1/d8/d20/d62/d65/f53 1275557 0 2024-03-22T07:28:35.787 INFO:tasks.workunit.client.1.smithi195.stdout:9/727: creat d2/d4/d32/d6d/d78/d79/f104 x:0 0 0 2024-03-22T07:28:35.787 INFO:tasks.workunit.client.1.smithi195.stdout:9/728: creat d2/f105 x:0 0 0 2024-03-22T07:28:35.789 INFO:tasks.workunit.client.1.smithi195.stdout:4/570: dread d13/f1f [0,4194304] 0 2024-03-22T07:28:35.789 INFO:tasks.workunit.client.1.smithi195.stdout:7/565: mkdir d0/d13/d14/d2f/dae/dc3 0 2024-03-22T07:28:35.789 INFO:tasks.workunit.client.1.smithi195.stdout:7/566: chown d0/d13/d14/le 0 1 2024-03-22T07:28:35.789 INFO:tasks.workunit.client.0.smithi134.stdout:9/321: truncate d3/d9/f18 1204058 0 2024-03-22T07:28:35.792 INFO:tasks.workunit.client.0.smithi134.stdout:8/491: dread d1/d15/d42/d25/f59 [0,4194304] 0 2024-03-22T07:28:35.792 INFO:tasks.workunit.client.0.smithi134.stdout:8/492: write d1/d15/d42/d12/d20/f74 [417203,102017] 0 2024-03-22T07:28:35.794 INFO:tasks.workunit.client.0.smithi134.stdout:4/424: truncate d2/d15/f1b 3483568 0 2024-03-22T07:28:35.794 INFO:tasks.workunit.client.0.smithi134.stdout:4/425: getdents d2/d15/d66 0 2024-03-22T07:28:35.795 INFO:tasks.workunit.client.1.smithi195.stdout:8/624: sync 2024-03-22T07:28:35.795 INFO:tasks.workunit.client.1.smithi195.stdout:8/625: chown da/d17/d32/d61/d88/c9e 23 1 2024-03-22T07:28:35.797 INFO:tasks.workunit.client.0.smithi134.stdout:2/326: mkdir d2/d5/d22/d52/d3c/d60 0 2024-03-22T07:28:35.798 INFO:tasks.workunit.client.1.smithi195.stdout:5/614: creat d9/d22/d7b/d98/fc7 x:0 0 0 2024-03-22T07:28:35.798 INFO:tasks.workunit.client.0.smithi134.stdout:9/322: dread d3/d9/d37/d3c/f46 [0,4194304] 0 2024-03-22T07:28:35.799 INFO:tasks.workunit.client.0.smithi134.stdout:0/373: dread dc/d18/f2e [0,4194304] 0 2024-03-22T07:28:35.800 INFO:tasks.workunit.client.1.smithi195.stdout:1/477: rename d0/d2/d9/c4d to d0/d2/d6/d21/d39/d64/c95 0 2024-03-22T07:28:35.801 INFO:tasks.workunit.client.0.smithi134.stdout:6/287: creat d2/f69 x:0 0 0 2024-03-22T07:28:35.804 INFO:tasks.workunit.client.0.smithi134.stdout:6/288: dread d2/f2e [0,4194304] 0 2024-03-22T07:28:35.804 INFO:tasks.workunit.client.1.smithi195.stdout:2/572: truncate d2/d3/f31 2355940 0 2024-03-22T07:28:35.806 INFO:tasks.workunit.client.1.smithi195.stdout:0/583: symlink d1/d10/d1f/d40/laa 0 2024-03-22T07:28:35.810 INFO:tasks.workunit.client.1.smithi195.stdout:9/729: symlink d2/d4/d23/d74/l106 0 2024-03-22T07:28:35.812 INFO:tasks.workunit.client.0.smithi134.stdout:8/493: unlink d1/f2d 0 2024-03-22T07:28:35.813 INFO:tasks.workunit.client.1.smithi195.stdout:4/571: creat d13/d63/d79/d68/fc2 x:0 0 0 2024-03-22T07:28:35.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/615: dwrite d9/d12/d1d/d69/d78/d41/fc2 [0,4194304] 0 2024-03-22T07:28:35.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/616: fdatasync d9/f45 0 2024-03-22T07:28:35.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/617: readlink d9/l10 0 2024-03-22T07:28:35.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/618: creat d9/d2d/d84/fc8 x:0 0 0 2024-03-22T07:28:35.814 INFO:tasks.workunit.client.1.smithi195.stdout:5/619: readlink d9/d22/d46/db2/lae 0 2024-03-22T07:28:35.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/620: readlink d9/d12/d1d/d36/d7d/l83 0 2024-03-22T07:28:35.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/426: rename d2/d25/l1a to d2/d2a/d80/d85/l8f 0 2024-03-22T07:28:35.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/427: creat d2/d1d/f90 x:0 0 0 2024-03-22T07:28:35.818 INFO:tasks.workunit.client.0.smithi134.stdout:9/323: mkdir d3/d9/d37/d3c/d71 0 2024-03-22T07:28:35.819 INFO:tasks.workunit.client.1.smithi195.stdout:5/621: dread d9/d12/d1d/d36/fb7 [0,4194304] 0 2024-03-22T07:28:35.820 INFO:tasks.workunit.client.1.smithi195.stdout:8/626: creat da/de/db3/fbc x:0 0 0 2024-03-22T07:28:35.823 INFO:tasks.workunit.client.0.smithi134.stdout:6/289: symlink d2/d1b/d1d/d5e/l6a 0 2024-03-22T07:28:35.825 INFO:tasks.workunit.client.1.smithi195.stdout:1/478: mknod d0/d70/c96 0 2024-03-22T07:28:35.825 INFO:tasks.workunit.client.1.smithi195.stdout:1/479: write d0/d2/d9/f6c [4881635,32180] 0 2024-03-22T07:28:35.825 INFO:tasks.workunit.client.1.smithi195.stdout:1/480: stat d0/d2/d9/d2a/f80 0 2024-03-22T07:28:35.825 INFO:tasks.workunit.client.1.smithi195.stdout:1/481: fdatasync d0/d2/d6/d21/d39/f65 0 2024-03-22T07:28:35.825 INFO:tasks.workunit.client.0.smithi134.stdout:5/368: rmdir d1/d8/d16 39 2024-03-22T07:28:35.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/573: creat d2/d3/d7/da/d18/fbc x:0 0 0 2024-03-22T07:28:35.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/574: creat d2/d3/d1a/fbd x:0 0 0 2024-03-22T07:28:35.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/575: read d2/d3/d21/d60/d81/d9a/f7b [3211107,5612] 0 2024-03-22T07:28:35.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/576: chown d2/d3/db/d82/f8a 337753 1 2024-03-22T07:28:35.829 INFO:tasks.workunit.client.0.smithi134.stdout:5/369: dread d1/d8/d20/f70 [0,4194304] 0 2024-03-22T07:28:35.829 INFO:tasks.workunit.client.0.smithi134.stdout:8/494: mkdir d1/d15/d57/d8c/d9a/da2 0 2024-03-22T07:28:35.831 INFO:tasks.workunit.client.1.smithi195.stdout:0/584: symlink d1/d4/d42/lab 0 2024-03-22T07:28:35.831 INFO:tasks.workunit.client.1.smithi195.stdout:0/585: chown d1/d4/dd/df/d44/d6f/f79 51 1 2024-03-22T07:28:35.831 INFO:tasks.workunit.client.1.smithi195.stdout:0/586: creat d1/d4/dd/d66/d80/fac x:0 0 0 2024-03-22T07:28:35.836 INFO:tasks.workunit.client.1.smithi195.stdout:9/730: mkdir d2/d4/d32/d6d/d78/d107 0 2024-03-22T07:28:35.838 INFO:tasks.workunit.client.0.smithi134.stdout:4/428: rename d2/d1d/f77 to d2/d1d/f91 0 2024-03-22T07:28:35.838 INFO:tasks.workunit.client.0.smithi134.stdout:4/429: write d2/d2a/d50/f59 [109097,38412] 0 2024-03-22T07:28:35.838 INFO:tasks.workunit.client.0.smithi134.stdout:8/495: dread d1/d15/d42/d12/f35 [0,4194304] 0 2024-03-22T07:28:35.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.839+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f995c10f9c0 con 0x7f9948038470 2024-03-22T07:28:35.841 INFO:tasks.workunit.client.0.smithi134.stdout:2/327: rename d2/d5/l51 to d2/d5/d22/d52/d3c/d4f/l61 0 2024-03-22T07:28:35.841 INFO:tasks.workunit.client.0.smithi134.stdout:2/328: fsync d2/f49 0 2024-03-22T07:28:35.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/482: dwrite d0/d2/d9/f15 [0,4194304] 0 2024-03-22T07:28:35.845 INFO:tasks.workunit.client.0.smithi134.stdout:9/324: link d3/f27 d3/f72 0 2024-03-22T07:28:35.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.847+0000 7f99527fc700 1 -- 172.21.15.134:0/2748020167 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f995c10f9c0 con 0x7f9948038470 2024-03-22T07:28:35.850 INFO:tasks.workunit.client.0.smithi134.stdout:0/374: rmdir dc/de 39 2024-03-22T07:28:35.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9948038470 msgr2=0x7f994803a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9948038470 0x7f994803a920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f994c00b7a0 tx=0x7f994c009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 msgr2=0x7f995c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 0x7f995c10da00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f995800b790 tx=0x7f9958009250 comp rx=0 tx=0).stop 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 shutdown_connections 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9948038470 0x7f994803a920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f995c0fc2f0 0x7f995c10da00 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f995800b790 tx=0x7f9958009250 comp rx=0 tx=0).stop 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.849+0000 7f9963dee700 1 --2- 172.21.15.134:0/2748020167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f995c0fcc40 0x7f995c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.850+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 >> 172.21.15.134:0/2748020167 conn(0x7f995c0f6ba0 msgr2=0x7f995c0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.850+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 shutdown_connections 2024-03-22T07:28:35.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:35.850+0000 7f9963dee700 1 -- 172.21.15.134:0/2748020167 wait complete. 2024-03-22T07:28:35.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/370: symlink d1/d8/d3f/d75/l7d 0 2024-03-22T07:28:35.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/371: chown d1/d8/d20/l27 8259718 1 2024-03-22T07:28:35.857 INFO:tasks.workunit.client.0.smithi134.stdout:8/496: dwrite d1/f77 [0,4194304] 0 2024-03-22T07:28:35.857 INFO:tasks.workunit.client.0.smithi134.stdout:4/430: symlink d2/l92 0 2024-03-22T07:28:35.862 INFO:tasks.workunit.client.0.smithi134.stdout:0/375: write dc/d18/f1d [12140752,82633] 0 2024-03-22T07:28:35.862 INFO:tasks.workunit.client.0.smithi134.stdout:6/290: rename d2/d1b/d1d/d2b/d4f to d2/d3f/d28/d6b 0 2024-03-22T07:28:35.864 INFO:tasks.workunit.client.1.smithi195.stdout:7/567: symlink d0/d13/d14/lc4 0 2024-03-22T07:28:35.866 INFO:tasks.workunit.client.0.smithi134.stdout:4/431: dread d2/d15/f39 [0,4194304] 0 2024-03-22T07:28:35.866 INFO:tasks.workunit.client.0.smithi134.stdout:6/291: dread d2/d1b/d4d/f54 [0,4194304] 0 2024-03-22T07:28:35.866 INFO:tasks.workunit.client.0.smithi134.stdout:6/292: dread - d2/d1b/f45 zero size 2024-03-22T07:28:35.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/329: mkdir d2/d5/d22/d52/d3c/d4f/d62 0 2024-03-22T07:28:35.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/330: write d2/d5/d22/f5e [612695,103685] 0 2024-03-22T07:28:35.869 INFO:tasks.workunit.client.0.smithi134.stdout:9/325: creat d3/f73 x:0 0 0 2024-03-22T07:28:35.871 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:28:35.871 INFO:tasks.workunit.client.1.smithi195.stdout:8/627: symlink da/d17/d32/d61/d47/lbd 0 2024-03-22T07:28:35.871 INFO:tasks.workunit.client.1.smithi195.stdout:8/628: chown da/dc/d71 32379325 1 2024-03-22T07:28:35.876 INFO:tasks.workunit.client.0.smithi134.stdout:5/372: symlink d1/l7e 0 2024-03-22T07:28:35.876 INFO:tasks.workunit.client.0.smithi134.stdout:5/373: chown d1/d8/d3f/l79 283114 1 2024-03-22T07:28:35.884 INFO:tasks.workunit.client.0.smithi134.stdout:8/497: link d1/d15/d42/d44/f52 d1/d15/d42/d12/d20/d41/fa3 0 2024-03-22T07:28:35.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/568: dwrite d0/d13/d14/d20/d40/d82/daa/fc2 [0,4194304] 0 2024-03-22T07:28:35.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/569: truncate d0/d13/d14/d29/d35/fa8 114520 0 2024-03-22T07:28:35.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/570: write d0/d13/d14/d20/f78 [1145220,20550] 0 2024-03-22T07:28:35.885 INFO:tasks.workunit.client.1.smithi195.stdout:7/571: truncate d0/d13/d14/d29/d35/f60 936418 0 2024-03-22T07:28:35.886 INFO:tasks.workunit.client.1.smithi195.stdout:2/577: mknod d2/d3/d21/d60/cbe 0 2024-03-22T07:28:35.888 INFO:tasks.workunit.client.0.smithi134.stdout:0/376: mknod dc/d18/c6e 0 2024-03-22T07:28:35.888 INFO:tasks.workunit.client.0.smithi134.stdout:0/377: dread - dc/f6b zero size 2024-03-22T07:28:35.888 INFO:tasks.workunit.client.0.smithi134.stdout:2/331: dwrite d2/f3e [4194304,4194304] 0 2024-03-22T07:28:35.892 INFO:tasks.workunit.client.1.smithi195.stdout:0/587: creat d1/d4/dd/df/d2b/d63/fad x:0 0 0 2024-03-22T07:28:35.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/731: creat d2/d4/d23/f108 x:0 0 0 2024-03-22T07:28:35.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/572: dread d0/d13/d14/d29/f33 [0,4194304] 0 2024-03-22T07:28:35.896 INFO:tasks.workunit.client.1.smithi195.stdout:9/732: getdents d2/dad/dff 0 2024-03-22T07:28:35.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/573: creat d0/d13/d14/d2b/fc5 x:0 0 0 2024-03-22T07:28:35.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/574: readlink d0/d13/d14/d29/d35/l44 0 2024-03-22T07:28:35.896 INFO:tasks.workunit.client.1.smithi195.stdout:7/575: read d0/d13/d14/d29/d35/d6d/f7a [2842449,8350] 0 2024-03-22T07:28:35.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/576: readlink d0/d13/d14/d20/d40/d82/da0/d59/l62 0 2024-03-22T07:28:35.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/483: stat d0/d2/d6/d21/l3c 0 2024-03-22T07:28:35.897 INFO:tasks.workunit.client.1.smithi195.stdout:1/484: chown d0/d2/d9/l22 43 1 2024-03-22T07:28:35.900 INFO:tasks.workunit.client.0.smithi134.stdout:6/293: creat d2/d1b/f6c x:0 0 0 2024-03-22T07:28:35.900 INFO:tasks.workunit.client.0.smithi134.stdout:6/294: write d2/d1b/d1d/d2b/f50 [245474,60814] 0 2024-03-22T07:28:35.901 INFO:tasks.workunit.client.1.smithi195.stdout:5/622: getdents d9/d22 0 2024-03-22T07:28:35.901 INFO:tasks.workunit.client.1.smithi195.stdout:8/629: dwrite da/d17/d32/d7d/d8e/fa1 [0,4194304] 0 2024-03-22T07:28:35.903 INFO:tasks.workunit.client.0.smithi134.stdout:4/432: dwrite d2/d15/f40 [0,4194304] 0 2024-03-22T07:28:35.903 INFO:tasks.workunit.client.0.smithi134.stdout:4/433: chown d2/d2a/d50 590608959 1 2024-03-22T07:28:35.903 INFO:tasks.workunit.client.1.smithi195.stdout:2/578: dwrite d2/d3/d7/da/de/f65 [0,4194304] 0 2024-03-22T07:28:35.907 INFO:tasks.workunit.client.0.smithi134.stdout:9/326: rename d3/d9/d37/l5c to d3/d9/df/d12/d3b/l74 0 2024-03-22T07:28:35.910 INFO:tasks.workunit.client.0.smithi134.stdout:5/374: creat d1/f7f x:0 0 0 2024-03-22T07:28:35.911 INFO:tasks.workunit.client.1.smithi195.stdout:5/623: dread d9/f1c [0,4194304] 0 2024-03-22T07:28:35.911 INFO:tasks.workunit.client.1.smithi195.stdout:6/515: sync 2024-03-22T07:28:35.912 INFO:tasks.workunit.client.0.smithi134.stdout:8/498: mkdir d1/d15/d57/d8c/da4 0 2024-03-22T07:28:35.912 INFO:tasks.workunit.client.0.smithi134.stdout:8/499: chown d1/f77 1984 1 2024-03-22T07:28:35.912 INFO:tasks.workunit.client.0.smithi134.stdout:8/500: chown d1/f77 52 1 2024-03-22T07:28:35.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/588: dwrite d1/d10/d19/d20/f56 [0,4194304] 0 2024-03-22T07:28:35.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/589: read - d1/d4/dd/d66/d80/fac zero size 2024-03-22T07:28:35.914 INFO:tasks.workunit.client.0.smithi134.stdout:0/378: mknod dc/de/c6f 0 2024-03-22T07:28:35.914 INFO:tasks.workunit.client.0.smithi134.stdout:0/379: readlink dc/de/d55/d65/l6c 0 2024-03-22T07:28:35.921 INFO:tasks.workunit.client.0.smithi134.stdout:2/332: creat d2/d5/d54/f63 x:0 0 0 2024-03-22T07:28:35.921 INFO:tasks.workunit.client.0.smithi134.stdout:2/333: chown d2/d5/d8/d31/l43 7891061 1 2024-03-22T07:28:35.922 INFO:tasks.workunit.client.1.smithi195.stdout:9/733: creat d2/d4/f109 x:0 0 0 2024-03-22T07:28:35.924 INFO:tasks.workunit.client.0.smithi134.stdout:6/295: rmdir d2/d3f/d28/d6b 39 2024-03-22T07:28:35.924 INFO:tasks.workunit.client.0.smithi134.stdout:6/296: write d2/f2e [1890843,29437] 0 2024-03-22T07:28:35.926 INFO:tasks.workunit.client.1.smithi195.stdout:1/485: dwrite d0/d2/d6/f42 [4194304,4194304] 0 2024-03-22T07:28:35.927 INFO:tasks.workunit.client.1.smithi195.stdout:7/577: creat d0/d13/d14/d2f/dae/fc6 x:0 0 0 2024-03-22T07:28:35.931 INFO:tasks.workunit.client.1.smithi195.stdout:7/578: dread d0/d13/f73 [0,4194304] 0 2024-03-22T07:28:35.932 INFO:tasks.workunit.client.1.smithi195.stdout:7/579: read d0/d13/d14/d20/d40/d82/da0/d59/f7c [94992,47664] 0 2024-03-22T07:28:35.934 INFO:tasks.workunit.client.0.smithi134.stdout:2/334: dread d2/f3b [0,4194304] 0 2024-03-22T07:28:35.938 INFO:tasks.workunit.client.1.smithi195.stdout:9/734: dread d2/d4/d6/d18/f3e [0,4194304] 0 2024-03-22T07:28:35.938 INFO:tasks.workunit.client.1.smithi195.stdout:9/735: write d2/d4/d6/db5/df2/ff5 [110275,26608] 0 2024-03-22T07:28:35.938 INFO:tasks.workunit.client.1.smithi195.stdout:9/736: chown d2/d4/d6/d18/f43 12251953 1 2024-03-22T07:28:35.939 INFO:tasks.workunit.client.0.smithi134.stdout:2/335: write d2/d5/d22/d52/f4d [3882972,24622] 0 2024-03-22T07:28:35.939 INFO:tasks.workunit.client.0.smithi134.stdout:2/336: read - d2/f58 zero size 2024-03-22T07:28:35.939 INFO:tasks.workunit.client.0.smithi134.stdout:2/337: truncate d2/d5/d8/f5a 771151 0 2024-03-22T07:28:35.940 INFO:tasks.workunit.client.1.smithi195.stdout:0/590: dwrite d1/d4/d22/f96 [0,4194304] 0 2024-03-22T07:28:35.940 INFO:tasks.workunit.client.0.smithi134.stdout:0/380: dwrite dc/d18/f5a [0,4194304] 0 2024-03-22T07:28:35.941 INFO:tasks.workunit.client.1.smithi195.stdout:8/630: mknod da/d17/d32/d61/d47/d53/cbe 0 2024-03-22T07:28:35.941 INFO:tasks.workunit.client.1.smithi195.stdout:8/631: creat da/de/fbf x:0 0 0 2024-03-22T07:28:35.941 INFO:tasks.workunit.client.1.smithi195.stdout:6/516: dwrite d5/d16/d45/d53/d59/d87/fb6 [0,4194304] 0 2024-03-22T07:28:35.942 INFO:tasks.workunit.client.1.smithi195.stdout:2/579: getdents d2/d3/d7 0 2024-03-22T07:28:35.942 INFO:tasks.workunit.client.1.smithi195.stdout:8/632: write da/d17/d32/f59 [300068,22114] 0 2024-03-22T07:28:35.943 INFO:tasks.workunit.client.0.smithi134.stdout:4/434: mkdir d2/d2a/d93 0 2024-03-22T07:28:35.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/566: rename d3/df/d15/d1d/d5c/d86 to d3/dbf 0 2024-03-22T07:28:35.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/567: chown d3/df/d15/d1d/d5c/d47/f59 473 1 2024-03-22T07:28:35.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/568: chown d3/d22/c52 38 1 2024-03-22T07:28:35.948 INFO:tasks.workunit.client.1.smithi195.stdout:8/633: dread da/dc/d71/f80 [4194304,4194304] 0 2024-03-22T07:28:35.948 INFO:tasks.workunit.client.1.smithi195.stdout:5/624: mknod d9/d2d/d8f/cc9 0 2024-03-22T07:28:35.948 INFO:tasks.workunit.client.1.smithi195.stdout:8/634: write da/d17/d32/d61/d47/d53/f8f [485740,68820] 0 2024-03-22T07:28:35.949 INFO:tasks.workunit.client.0.smithi134.stdout:5/375: mknod d1/d8/d3f/d75/c80 0 2024-03-22T07:28:35.949 INFO:tasks.workunit.client.0.smithi134.stdout:5/376: readlink d1/d8/d16/l6f 0 2024-03-22T07:28:35.952 INFO:tasks.workunit.client.0.smithi134.stdout:8/501: mknod d1/ca5 0 2024-03-22T07:28:35.954 INFO:tasks.workunit.client.1.smithi195.stdout:1/486: dwrite d0/d70/d6a/f88 [0,4194304] 0 2024-03-22T07:28:35.954 INFO:tasks.workunit.client.0.smithi134.stdout:7/547: sync 2024-03-22T07:28:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:35 smithi195 ceph-mon[36144]: Deploying cephadm binary to smithi195 2024-03-22T07:28:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:35 smithi195 ceph-mon[36144]: Deploying cephadm binary to smithi134 2024-03-22T07:28:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:35 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:35 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:35 smithi195 ceph-mon[36144]: mgrmap e22: smithi195.jxfsnc(active, since 1.01113s) 2024-03-22T07:28:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:35 smithi195 ceph-mon[36144]: pgmap v3: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-03-22T07:28:35.956 INFO:tasks.workunit.client.0.smithi134.stdout:4/435: write d2/d15/d35/f63 [2153815,23661] 0 2024-03-22T07:28:35.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/297: mknod d2/d1b/d1d/c6d 0 2024-03-22T07:28:35.958 INFO:tasks.workunit.client.0.smithi134.stdout:6/298: chown d2/d1b/d1d/d2b/f46 267900833 1 2024-03-22T07:28:35.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/591: dread d1/d4/dd/f3a [0,4194304] 0 2024-03-22T07:28:35.959 INFO:tasks.workunit.client.1.smithi195.stdout:0/592: getdents d1/d10/d4d/da6 0 2024-03-22T07:28:35.960 INFO:tasks.workunit.client.1.smithi195.stdout:0/593: chown d1/d4/d12/f2d 52326 1 2024-03-22T07:28:35.960 INFO:tasks.workunit.client.1.smithi195.stdout:9/737: link d2/d4/d6/db/d20/d47/cc1 d2/d4/d6/db/d20/d4a/c10a 0 2024-03-22T07:28:35.962 INFO:tasks.workunit.client.0.smithi134.stdout:2/338: link d2/l44 d2/d5/d22/d52/d3c/d60/l64 0 2024-03-22T07:28:35.963 INFO:tasks.workunit.client.0.smithi134.stdout:0/381: creat dc/d18/f70 x:0 0 0 2024-03-22T07:28:35.964 INFO:tasks.workunit.client.0.smithi134.stdout:0/382: chown dc/d18/l4d 10491 1 2024-03-22T07:28:35.964 INFO:tasks.workunit.client.0.smithi134.stdout:0/383: write dc/f3c [258794,111426] 0 2024-03-22T07:28:35.965 INFO:tasks.workunit.client.0.smithi134.stdout:6/299: dread d2/d1b/d1d/d2b/f50 [0,4194304] 0 2024-03-22T07:28:35.969 INFO:tasks.workunit.client.1.smithi195.stdout:6/517: creat d5/d5e/d34/d55/fb9 x:0 0 0 2024-03-22T07:28:35.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/395: sync 2024-03-22T07:28:35.970 INFO:tasks.workunit.client.0.smithi134.stdout:3/341: sync 2024-03-22T07:28:35.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/396: write d5/da/d68/f6b [129184,82235] 0 2024-03-22T07:28:35.970 INFO:tasks.workunit.client.0.smithi134.stdout:1/397: write d5/da/d13/d1e/d34/f59 [97082,131003] 0 2024-03-22T07:28:35.971 INFO:tasks.workunit.client.1.smithi195.stdout:1/487: dwrite d0/d2/d6/d21/d41/d47/f49 [0,4194304] 0 2024-03-22T07:28:35.972 INFO:tasks.workunit.client.1.smithi195.stdout:7/580: rename d0/d13/d14/d96/fa9 to d0/d13/d14/d2f/dae/dc3/fc7 0 2024-03-22T07:28:35.972 INFO:tasks.workunit.client.1.smithi195.stdout:3/569: dwrite d3/df/d15/d1d/d5c/f3b [0,4194304] 0 2024-03-22T07:28:35.976 INFO:tasks.workunit.client.0.smithi134.stdout:9/327: rmdir d3/d9 39 2024-03-22T07:28:35.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/738: mknod d2/dad/dff/c10b 0 2024-03-22T07:28:35.980 INFO:tasks.workunit.client.1.smithi195.stdout:9/739: readlink d2/d4/d6/db/d20/d4a/da2/lc8 0 2024-03-22T07:28:35.981 INFO:tasks.workunit.client.0.smithi134.stdout:3/342: read d4/f1e [333520,9825] 0 2024-03-22T07:28:35.982 INFO:tasks.workunit.client.0.smithi134.stdout:5/377: symlink d1/d8/d3f/d75/l81 0 2024-03-22T07:28:35.982 INFO:tasks.workunit.client.0.smithi134.stdout:3/343: dread d4/d22/d29/f46 [0,4194304] 0 2024-03-22T07:28:35.984 INFO:tasks.workunit.client.1.smithi195.stdout:6/518: dwrite d5/d16/d5a/faa [0,4194304] 0 2024-03-22T07:28:35.985 INFO:tasks.workunit.client.0.smithi134.stdout:8/502: truncate d1/d15/f5 614551 0 2024-03-22T07:28:35.987 INFO:tasks.workunit.client.0.smithi134.stdout:7/548: mkdir d1/de/d11/d48/daf 0 2024-03-22T07:28:35.994 INFO:tasks.workunit.client.0.smithi134.stdout:4/436: link d2/d15/d35/d37/f8c d2/d2a/d80/f94 0 2024-03-22T07:28:35.994 INFO:tasks.workunit.client.1.smithi195.stdout:8/635: fsync da/de/fbf 0 2024-03-22T07:28:35.996 INFO:tasks.workunit.client.0.smithi134.stdout:8/503: read d1/d4/d6e/f73 [2827918,61117] 0 2024-03-22T07:28:36.001 INFO:tasks.workunit.client.1.smithi195.stdout:5/625: rename d9/d12/d1d/f95 to d9/da8/fca 0 2024-03-22T07:28:36.001 INFO:tasks.workunit.client.0.smithi134.stdout:2/339: mknod d2/d5/d22/d52/d3c/c65 0 2024-03-22T07:28:36.001 INFO:tasks.workunit.client.0.smithi134.stdout:2/340: chown d2/d5/d22/d52/d3c/l57 0 1 2024-03-22T07:28:36.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/581: truncate d0/d13/f46 2608413 0 2024-03-22T07:28:36.003 INFO:tasks.workunit.client.1.smithi195.stdout:7/582: write d0/d13/d14/d29/d35/d3a/f5d [5187675,59232] 0 2024-03-22T07:28:36.008 INFO:tasks.workunit.client.0.smithi134.stdout:0/384: rename f9 to dc/de/d55/f71 0 2024-03-22T07:28:36.012 INFO:tasks.workunit.client.1.smithi195.stdout:9/740: dwrite d2/d4/d6/db/d20/f31 [0,4194304] 0 2024-03-22T07:28:36.012 INFO:tasks.workunit.client.1.smithi195.stdout:9/741: readlink d2/d4/d6/db/da8/lb1 0 2024-03-22T07:28:36.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/300: mkdir d2/d6e 0 2024-03-22T07:28:36.012 INFO:tasks.workunit.client.0.smithi134.stdout:9/328: dwrite d3/fe [0,4194304] 0 2024-03-22T07:28:36.015 INFO:tasks.workunit.client.1.smithi195.stdout:6/519: dwrite d5/d5e/d34/d55/d3b/d6e/d3c/f3d [0,4194304] 0 2024-03-22T07:28:36.015 INFO:tasks.workunit.client.1.smithi195.stdout:6/520: readlink d5/d5e/d34/d55/d4b/da2/dad/lb7 0 2024-03-22T07:28:36.018 INFO:tasks.workunit.client.0.smithi134.stdout:3/344: mkdir d4/d8/d45/d77 0 2024-03-22T07:28:36.018 INFO:tasks.workunit.client.0.smithi134.stdout:3/345: write d4/d8/f13 [120325,116283] 0 2024-03-22T07:28:36.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/636: mkdir da/d82/dc0 0 2024-03-22T07:28:36.019 INFO:tasks.workunit.client.0.smithi134.stdout:3/346: dread d4/d8/d45/f51 [0,4194304] 0 2024-03-22T07:28:36.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/549: mkdir d1/d19/d9c/db0 0 2024-03-22T07:28:36.022 INFO:tasks.workunit.client.0.smithi134.stdout:7/550: creat d1/de/d11/d48/d52/d46/fb1 x:0 0 0 2024-03-22T07:28:36.028 INFO:tasks.workunit.client.0.smithi134.stdout:4/437: mknod d2/d2a/d80/d85/c95 0 2024-03-22T07:28:36.031 INFO:tasks.workunit.client.0.smithi134.stdout:8/504: write d1/d15/d42/f28 [70328,26763] 0 2024-03-22T07:28:36.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/341: link d2/f1c d2/d5/d8/d5d/f66 0 2024-03-22T07:28:36.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/342: write d2/f1a [503794,65528] 0 2024-03-22T07:28:36.036 INFO:tasks.workunit.client.0.smithi134.stdout:2/343: stat d2/d5/d8/c4e 0 2024-03-22T07:28:36.038 INFO:tasks.workunit.client.0.smithi134.stdout:1/398: rename d5/lf to d5/da/d68/l8c 0 2024-03-22T07:28:36.039 INFO:tasks.workunit.client.1.smithi195.stdout:5/626: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:36.040 INFO:tasks.workunit.client.1.smithi195.stdout:7/583: dwrite d0/d13/d14/d20/f78 [0,4194304] 0 2024-03-22T07:28:36.042 INFO:tasks.workunit.client.1.smithi195.stdout:6/521: mkdir d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba 0 2024-03-22T07:28:36.042 INFO:tasks.workunit.client.1.smithi195.stdout:6/522: fdatasync d5/d5e/d34/d55/d3b/d6e/d3c/f44 0 2024-03-22T07:28:36.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/301: mkdir d2/d1b/d1d/d5e/d6f 0 2024-03-22T07:28:36.043 INFO:tasks.workunit.client.0.smithi134.stdout:6/302: creat d2/d1b/d1d/d5e/f70 x:0 0 0 2024-03-22T07:28:36.045 INFO:tasks.workunit.client.1.smithi195.stdout:8/637: creat da/dc/d71/fc1 x:0 0 0 2024-03-22T07:28:36.046 INFO:tasks.workunit.client.1.smithi195.stdout:8/638: write da/dc/f6e [747241,126002] 0 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.045+0000 7f607a3cc700 1 -- 172.21.15.134:0/1424549945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fe0d0 msgr2=0x7f60740fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.045+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1424549945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fe0d0 0x7f60740fe540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6068004940 tx=0x7f6068009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.046+0000 7f607a3cc700 1 -- 172.21.15.134:0/1424549945 shutdown_connections 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.046+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1424549945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fe0d0 0x7f60740fe540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.046+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1424549945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fcee0 0x7f60740fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.046+0000 7f607a3cc700 1 -- 172.21.15.134:0/1424549945 >> 172.21.15.134:0/1424549945 conn(0x7f60740f8560 msgr2=0x7f60740fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.046+0000 7f607a3cc700 1 -- 172.21.15.134:0/1424549945 shutdown_connections 2024-03-22T07:28:36.047 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.046+0000 7f607a3cc700 1 -- 172.21.15.134:0/1424549945 wait complete. 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.047+0000 7f607a3cc700 1 Processor -- start 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.047+0000 7f607a3cc700 1 -- start start 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f607a3cc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fcee0 0x7f6074067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f607a3cc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 0x7f60740682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f607a3cc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074068940 con 0x7f60740fcee0 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f607a3cc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074069140 con 0x7f60740fe0d0 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f60737fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 0x7f60740682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f60737fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 0x7f60740682f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:50068/0 (socket says 172.21.15.134:50068) 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f60737fe700 1 -- 172.21.15.134:0/1901391922 learned_addr learned my addr 172.21.15.134:0/1901391922 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:36.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.048+0000 7f6073fff700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fcee0 0x7f6074067db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:36.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/329: link d3/c15 d3/d9/df/d57/d67/c75 0 2024-03-22T07:28:36.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.049+0000 7f60737fe700 1 -- 172.21.15.134:0/1901391922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fcee0 msgr2=0x7f6074067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:36.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.049+0000 7f60737fe700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fcee0 0x7f6074067db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.051 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.049+0000 7f60737fe700 1 -- 172.21.15.134:0/1901391922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068005040 con 0x7f60740fe0d0 2024-03-22T07:28:36.052 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.049+0000 7f60737fe700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 0x7f60740682f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6068013870 tx=0x7f6068009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:36.052 INFO:tasks.workunit.client.0.smithi134.stdout:0/385: dwrite dc/d18/f2f [4194304,4194304] 0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.050+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606800e070 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.050+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6068009430 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.050+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606801ce70 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.050+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60740693c0 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.050+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60740697e0 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.051+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 23) v1 ==== 45715+0+0 (secure 0 0 0) 0x7f6068026460 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.052+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607405f5f0 con 0x7f60740fe0d0 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.052+0000 7f6070ff9700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f605c0387f0 0x7f605c03aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:36.053 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.052+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f606804d860 con 0x7f60740fe0d0 2024-03-22T07:28:36.054 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.052+0000 7f6073fff700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f605c0387f0 0x7f605c03aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:36.055 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.053+0000 7f6073fff700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f605c0387f0 0x7f605c03aca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6074067b40 tx=0x7f606400b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:36.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/378: mkdir d1/d8/d20/d62/d65/d82 0 2024-03-22T07:28:36.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/379: readlink d1/l7e 0 2024-03-22T07:28:36.058 INFO:tasks.workunit.client.1.smithi195.stdout:9/742: dwrite d2/d4/d32/d6d/deb/ff8 [0,4194304] 0 2024-03-22T07:28:36.059 INFO:tasks.workunit.client.0.smithi134.stdout:3/347: creat d4/d10/d6c/f78 x:0 0 0 2024-03-22T07:28:36.059 INFO:tasks.workunit.client.0.smithi134.stdout:3/348: fdatasync d4/d10/f4f 0 2024-03-22T07:28:36.059 INFO:tasks.workunit.client.0.smithi134.stdout:3/349: truncate d4/d22/f3e 312472 0 2024-03-22T07:28:36.059 INFO:tasks.workunit.client.0.smithi134.stdout:3/350: dread - d4/d22/d29/d50/f63 zero size 2024-03-22T07:28:36.059 INFO:tasks.workunit.client.0.smithi134.stdout:3/351: chown d4/d10/d6c/c75 10799456 1 2024-03-22T07:28:36.060 INFO:tasks.workunit.client.0.smithi134.stdout:6/303: write d2/d1b/f24 [2403680,108972] 0 2024-03-22T07:28:36.061 INFO:tasks.workunit.client.1.smithi195.stdout:5/627: dread d9/d2d/f65 [0,4194304] 0 2024-03-22T07:28:36.062 INFO:tasks.workunit.client.0.smithi134.stdout:9/330: dread d3/d9/df/f26 [4194304,4194304] 0 2024-03-22T07:28:36.062 INFO:tasks.workunit.client.0.smithi134.stdout:7/551: dwrite d1/de/d11/d2b/d31/f43 [0,4194304] 0 2024-03-22T07:28:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/584: mkdir d0/d13/d14/d20/d40/d82/da6/dc8 0 2024-03-22T07:28:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/585: readlink d0/d13/d22/d28/lba 0 2024-03-22T07:28:36.063 INFO:tasks.workunit.client.1.smithi195.stdout:7/586: write d0/d13/f1e [2153993,102140] 0 2024-03-22T07:28:36.064 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.062+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6068026800 con 0x7f60740fe0d0 2024-03-22T07:28:36.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/438: mkdir d2/d96 0 2024-03-22T07:28:36.068 INFO:tasks.workunit.client.1.smithi195.stdout:5/628: dread d9/d12/d1d/d36/fa6 [0,4194304] 0 2024-03-22T07:28:36.068 INFO:tasks.workunit.client.1.smithi195.stdout:5/629: chown d9/d2d/f51 2111 1 2024-03-22T07:28:36.069 INFO:tasks.workunit.client.0.smithi134.stdout:8/505: creat d1/d15/fa6 x:0 0 0 2024-03-22T07:28:36.071 INFO:tasks.workunit.client.1.smithi195.stdout:6/523: dwrite d5/d16/d45/d53/d59/d87/fb6 [0,4194304] 0 2024-03-22T07:28:36.071 INFO:tasks.workunit.client.1.smithi195.stdout:0/594: rename d1/d4/dd/df/d2b/d63/d85 to d1/d4/dd/df/d44/d6f/dae 0 2024-03-22T07:28:36.074 INFO:tasks.workunit.client.0.smithi134.stdout:2/344: link d2/d5/d22/d52/d3c/d60/l64 d2/l67 0 2024-03-22T07:28:36.079 INFO:tasks.workunit.client.0.smithi134.stdout:1/399: link d5/da/d13/d1e/d34/c56 d5/da/d13/d1e/d34/c8d 0 2024-03-22T07:28:36.079 INFO:tasks.workunit.client.0.smithi134.stdout:1/400: dread - d5/da/d61/f83 zero size 2024-03-22T07:28:36.080 INFO:tasks.workunit.client.0.smithi134.stdout:1/401: write d5/da/d13/d1e/d34/f5f [752798,35349] 0 2024-03-22T07:28:36.080 INFO:tasks.workunit.client.0.smithi134.stdout:1/402: dread - d5/da/d61/f83 zero size 2024-03-22T07:28:36.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/386: mkdir dc/d18/d72 0 2024-03-22T07:28:36.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/387: readlink lb 0 2024-03-22T07:28:36.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/743: dwrite d2/d4/d32/f54 [4194304,4194304] 0 2024-03-22T07:28:36.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/744: fdatasync d2/d4/d32/d6d/deb/ff1 0 2024-03-22T07:28:36.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/745: write d2/d4/d6/d18/fbf [955867,83493] 0 2024-03-22T07:28:36.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/746: write d2/d4/d32/fab [545078,127860] 0 2024-03-22T07:28:36.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/747: readlink d2/d4/d6/db/d20/d4a/da2/lc8 0 2024-03-22T07:28:36.084 INFO:tasks.workunit.client.0.smithi134.stdout:4/439: read d2/d15/d35/f78 [451331,19097] 0 2024-03-22T07:28:36.084 INFO:tasks.workunit.client.0.smithi134.stdout:5/380: unlink d1/d8/d16/d4a/f4b 0 2024-03-22T07:28:36.085 INFO:tasks.workunit.client.1.smithi195.stdout:6/524: dread d5/d16/d45/f39 [0,4194304] 0 2024-03-22T07:28:36.086 INFO:tasks.workunit.client.1.smithi195.stdout:5/630: dwrite d9/d12/d1d/f5e [0,4194304] 0 2024-03-22T07:28:36.087 INFO:tasks.workunit.client.0.smithi134.stdout:3/352: symlink d4/d8/d23/l79 0 2024-03-22T07:28:36.087 INFO:tasks.workunit.client.0.smithi134.stdout:3/353: readlink d4/d10/d4b/l64 0 2024-03-22T07:28:36.087 INFO:tasks.workunit.client.0.smithi134.stdout:3/354: fdatasync d4/d22/f20 0 2024-03-22T07:28:36.087 INFO:tasks.workunit.client.0.smithi134.stdout:3/355: truncate d4/f2b 1927177 0 2024-03-22T07:28:36.093 INFO:tasks.workunit.client.0.smithi134.stdout:3/356: dread d4/d10/d4b/f65 [0,4194304] 0 2024-03-22T07:28:36.093 INFO:tasks.workunit.client.1.smithi195.stdout:9/748: write d2/d4/d32/d6d/d78/d79/f99 [3610190,21835] 0 2024-03-22T07:28:36.094 INFO:tasks.workunit.client.0.smithi134.stdout:6/304: mknod d2/d1b/d1d/d5e/c71 0 2024-03-22T07:28:36.096 INFO:tasks.workunit.client.0.smithi134.stdout:9/331: rmdir d3/d9 39 2024-03-22T07:28:36.096 INFO:tasks.workunit.client.0.smithi134.stdout:9/332: chown d3/l7 21398155 1 2024-03-22T07:28:36.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/639: getdents da/dc/d71 0 2024-03-22T07:28:36.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/640: chown da/d17/d32/d61/cba 1416513 1 2024-03-22T07:28:36.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/641: chown da/de/c68 144923866 1 2024-03-22T07:28:36.098 INFO:tasks.workunit.client.1.smithi195.stdout:8/642: fdatasync da/d17/d32/d61/d47/f83 0 2024-03-22T07:28:36.098 INFO:tasks.workunit.client.0.smithi134.stdout:8/506: creat d1/d15/d42/fa7 x:0 0 0 2024-03-22T07:28:36.101 INFO:tasks.workunit.client.0.smithi134.stdout:2/345: link d2/c1f d2/d5/d8/d5d/d5f/c68 0 2024-03-22T07:28:36.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/643: read da/d17/d32/f40 [1534145,21254] 0 2024-03-22T07:28:36.105 INFO:tasks.workunit.client.1.smithi195.stdout:6/525: mknod d5/d5e/d34/d55/d3b/d6e/cbb 0 2024-03-22T07:28:36.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/526: write d5/d5e/d34/d55/d3b/d6e/d3c/f7e [962795,54013] 0 2024-03-22T07:28:36.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/527: write f4 [2535737,58223] 0 2024-03-22T07:28:36.106 INFO:tasks.workunit.client.1.smithi195.stdout:6/528: dread - d5/d5e/d34/d55/d3b/d6e/d3c/f6c zero size 2024-03-22T07:28:36.107 INFO:tasks.workunit.client.0.smithi134.stdout:0/388: mknod dc/de/d55/d65/c73 0 2024-03-22T07:28:36.110 INFO:tasks.workunit.client.1.smithi195.stdout:0/595: dwrite d1/d4/d42/f97 [0,4194304] 0 2024-03-22T07:28:36.110 INFO:tasks.workunit.client.0.smithi134.stdout:5/381: mkdir d1/d8/d83 0 2024-03-22T07:28:36.110 INFO:tasks.workunit.client.0.smithi134.stdout:8/507: write d1/d4/f47 [2287442,79747] 0 2024-03-22T07:28:36.111 INFO:tasks.workunit.client.0.smithi134.stdout:8/508: chown d1/d15/d5b 897204 1 2024-03-22T07:28:36.111 INFO:tasks.workunit.client.0.smithi134.stdout:8/509: chown d1/d15/d42/d76/d8f 2438 1 2024-03-22T07:28:36.111 INFO:tasks.workunit.client.0.smithi134.stdout:5/382: creat d1/d4/d5f/f84 x:0 0 0 2024-03-22T07:28:36.111 INFO:tasks.workunit.client.0.smithi134.stdout:8/510: write d1/f4b [289439,78078] 0 2024-03-22T07:28:36.111 INFO:tasks.workunit.client.0.smithi134.stdout:0/389: write dc/d18/f62 [165217,37226] 0 2024-03-22T07:28:36.111 INFO:tasks.workunit.client.0.smithi134.stdout:0/390: readlink dc/l22 0 2024-03-22T07:28:36.112 INFO:tasks.workunit.client.0.smithi134.stdout:3/357: getdents d4/d8/d45 0 2024-03-22T07:28:36.113 INFO:tasks.workunit.client.1.smithi195.stdout:5/631: mknod d9/d2d/d84/ccb 0 2024-03-22T07:28:36.116 INFO:tasks.workunit.client.1.smithi195.stdout:0/596: write d1/d10/d1f/f57 [3392613,83765] 0 2024-03-22T07:28:36.117 INFO:tasks.workunit.client.1.smithi195.stdout:4/572: sync 2024-03-22T07:28:36.118 INFO:tasks.workunit.client.0.smithi134.stdout:6/305: rename d2/d1b/d1d/d2b/c31 to d2/d1b/d4d/d65/c72 0 2024-03-22T07:28:36.120 INFO:tasks.workunit.client.1.smithi195.stdout:9/749: truncate d2/d4/d6/d18/d50/f59 3507536 0 2024-03-22T07:28:36.122 INFO:tasks.workunit.client.0.smithi134.stdout:7/552: getdents d1/de/d11/d48/d52/d46 0 2024-03-22T07:28:36.123 INFO:tasks.workunit.client.0.smithi134.stdout:0/391: dread dc/d18/f1b [0,4194304] 0 2024-03-22T07:28:36.124 INFO:tasks.workunit.client.1.smithi195.stdout:4/573: dread d13/d15/f25 [0,4194304] 0 2024-03-22T07:28:36.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/392: dread dc/d18/f2e [0,4194304] 0 2024-03-22T07:28:36.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/393: creat dc/d18/f74 x:0 0 0 2024-03-22T07:28:36.125 INFO:tasks.workunit.client.0.smithi134.stdout:0/394: chown dc/de/c13 16766 1 2024-03-22T07:28:36.131 INFO:tasks.workunit.client.0.smithi134.stdout:2/346: creat d2/d5/d22/d52/d3c/f69 x:0 0 0 2024-03-22T07:28:36.132 INFO:tasks.workunit.client.0.smithi134.stdout:1/403: symlink d5/da/d1b/d27/d60/d72/l8e 0 2024-03-22T07:28:36.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/488: rename d0/d2/d6/d21 to d0/d70/d97 0 2024-03-22T07:28:36.136 INFO:tasks.workunit.client.0.smithi134.stdout:1/404: dread d5/da/d13/f3f [0,4194304] 0 2024-03-22T07:28:36.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/644: mkdir da/d17/d32/d61/dc2 0 2024-03-22T07:28:36.136 INFO:tasks.workunit.client.1.smithi195.stdout:8/645: write da/d17/d32/d61/d47/f83 [1226032,31026] 0 2024-03-22T07:28:36.137 INFO:tasks.workunit.client.1.smithi195.stdout:6/529: truncate d5/d5e/d34/d55/d3b/d6e/d3c/f70 1037634 0 2024-03-22T07:28:36.140 INFO:tasks.workunit.client.0.smithi134.stdout:1/405: dread d5/d1d/d2d/f57 [0,4194304] 0 2024-03-22T07:28:36.140 INFO:tasks.workunit.client.0.smithi134.stdout:8/511: chown d1/d15/d42/c6c 546700 1 2024-03-22T07:28:36.144 INFO:tasks.workunit.client.0.smithi134.stdout:0/395: dread dc/f3c [0,4194304] 0 2024-03-22T07:28:36.144 INFO:tasks.workunit.client.0.smithi134.stdout:0/396: readlink dc/l53 0 2024-03-22T07:28:36.144 INFO:tasks.workunit.client.1.smithi195.stdout:0/597: dwrite d1/d4/d12/f2d [4194304,4194304] 0 2024-03-22T07:28:36.146 INFO:tasks.workunit.client.1.smithi195.stdout:6/530: dread d5/d16/f48 [0,4194304] 0 2024-03-22T07:28:36.147 INFO:tasks.workunit.client.0.smithi134.stdout:3/358: creat d4/d8/d5c/f7a x:0 0 0 2024-03-22T07:28:36.147 INFO:tasks.workunit.client.0.smithi134.stdout:3/359: read d4/d8/f13 [231828,53354] 0 2024-03-22T07:28:36.150 INFO:tasks.workunit.client.1.smithi195.stdout:8/646: dwrite da/d17/d32/d61/f74 [0,4194304] 0 2024-03-22T07:28:36.150 INFO:tasks.workunit.client.1.smithi195.stdout:8/647: write da/d17/d32/d61/d47/d53/f8f [632766,5998] 0 2024-03-22T07:28:36.151 INFO:tasks.workunit.client.0.smithi134.stdout:9/333: rename d3/d9/c59 to d3/d9/df/d57/d67/d5f/c76 0 2024-03-22T07:28:36.151 INFO:tasks.workunit.client.1.smithi195.stdout:8/648: dread da/de/f2d [0,4194304] 0 2024-03-22T07:28:36.153 INFO:tasks.workunit.client.0.smithi134.stdout:6/306: mkdir d2/d1b/d4d/d65/d73 0 2024-03-22T07:28:36.155 INFO:tasks.workunit.client.1.smithi195.stdout:5/632: symlink d9/d73/dbb/lcc 0 2024-03-22T07:28:36.156 INFO:tasks.workunit.client.0.smithi134.stdout:2/347: symlink d2/d5/d54/l6a 0 2024-03-22T07:28:36.158 INFO:tasks.workunit.client.0.smithi134.stdout:5/383: getdents d1/d8/d20 0 2024-03-22T07:28:36.162 INFO:tasks.workunit.client.0.smithi134.stdout:1/406: link d5/da/d1b/d27/c85 d5/da/d1b/d27/c8f 0 2024-03-22T07:28:36.167 INFO:tasks.workunit.client.1.smithi195.stdout:9/750: creat d2/d4/d1d/ddc/f10c x:0 0 0 2024-03-22T07:28:36.167 INFO:tasks.workunit.client.1.smithi195.stdout:9/751: write d2/d4/d6/db/d20/d47/fea [4507418,70375] 0 2024-03-22T07:28:36.167 INFO:tasks.workunit.client.0.smithi134.stdout:8/512: mknod d1/d15/d42/d44/ca8 0 2024-03-22T07:28:36.170 INFO:tasks.workunit.client.0.smithi134.stdout:3/360: dwrite d4/d8/d23/f55 [0,4194304] 0 2024-03-22T07:28:36.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/361: write d4/f76 [729653,48276] 0 2024-03-22T07:28:36.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/362: creat d4/d22/d29/d50/f7b x:0 0 0 2024-03-22T07:28:36.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/363: creat d4/d22/f7c x:0 0 0 2024-03-22T07:28:36.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/364: read - d4/d22/d29/d50/f7b zero size 2024-03-22T07:28:36.171 INFO:tasks.workunit.client.0.smithi134.stdout:0/397: creat dc/d17/f75 x:0 0 0 2024-03-22T07:28:36.171 INFO:tasks.workunit.client.1.smithi195.stdout:4/574: rename d13/d63/d36/d5f/d83/fab to d13/d63/fc3 0 2024-03-22T07:28:36.172 INFO:tasks.workunit.client.0.smithi134.stdout:9/334: symlink d3/d9/df/d57/l77 0 2024-03-22T07:28:36.173 INFO:tasks.workunit.client.1.smithi195.stdout:1/489: symlink d0/d2/l98 0 2024-03-22T07:28:36.175 INFO:tasks.workunit.client.0.smithi134.stdout:7/553: rename d1/de/d11/d2b/d31/f43 to d1/de/d11/fb2 0 2024-03-22T07:28:36.177 INFO:tasks.workunit.client.0.smithi134.stdout:6/307: unlink d2/c47 0 2024-03-22T07:28:36.180 INFO:tasks.workunit.client.1.smithi195.stdout:0/598: symlink d1/d4/dd/d3f/laf 0 2024-03-22T07:28:36.180 INFO:tasks.workunit.client.1.smithi195.stdout:0/599: creat d1/d4/dd/df/d44/fb0 x:0 0 0 2024-03-22T07:28:36.182 INFO:tasks.workunit.client.1.smithi195.stdout:5/633: dwrite d9/f25 [0,4194304] 0 2024-03-22T07:28:36.182 INFO:tasks.workunit.client.1.smithi195.stdout:8/649: dwrite da/dc/d71/f80 [0,4194304] 0 2024-03-22T07:28:36.182 INFO:tasks.workunit.client.0.smithi134.stdout:5/384: dwrite d1/d8/d20/f3e [0,4194304] 0 2024-03-22T07:28:36.182 INFO:tasks.workunit.client.0.smithi134.stdout:5/385: write d1/f60 [104361,38152] 0 2024-03-22T07:28:36.183 INFO:tasks.workunit.client.0.smithi134.stdout:1/407: truncate d5/fb 192334 0 2024-03-22T07:28:36.184 INFO:tasks.workunit.client.1.smithi195.stdout:6/531: mknod d5/d5e/d34/d55/d3b/d6e/d56/d8f/cbc 0 2024-03-22T07:28:36.186 INFO:tasks.workunit.client.0.smithi134.stdout:8/513: mknod d1/d15/d42/d12/d2a/ca9 0 2024-03-22T07:28:36.187 INFO:tasks.workunit.client.1.smithi195.stdout:4/575: dwrite f9 [0,4194304] 0 2024-03-22T07:28:36.190 INFO:tasks.workunit.client.1.smithi195.stdout:8/650: dread da/d17/f25 [0,4194304] 0 2024-03-22T07:28:36.193 INFO:tasks.workunit.client.1.smithi195.stdout:7/587: rmdir d0/d13/d14/d96 0 2024-03-22T07:28:36.198 INFO:tasks.workunit.client.1.smithi195.stdout:9/752: rename f1 to d2/d4/d6/db/d20/d47/f10d 0 2024-03-22T07:28:36.199 INFO:tasks.workunit.client.1.smithi195.stdout:1/490: truncate d0/d2/d9/d2a/f80 369266 0 2024-03-22T07:28:36.202 INFO:tasks.workunit.client.0.smithi134.stdout:0/398: mknod dc/de/d55/d65/c76 0 2024-03-22T07:28:36.202 INFO:tasks.workunit.client.0.smithi134.stdout:0/399: stat la 0 2024-03-22T07:28:36.202 INFO:tasks.workunit.client.0.smithi134.stdout:0/400: write dc/de/f6a [593220,71812] 0 2024-03-22T07:28:36.202 INFO:tasks.workunit.client.0.smithi134.stdout:0/401: chown dc/d17/f48 11 1 2024-03-22T07:28:36.205 INFO:tasks.workunit.client.0.smithi134.stdout:9/335: getdents d3/d9/df/d57 0 2024-03-22T07:28:36.205 INFO:tasks.workunit.client.1.smithi195.stdout:0/600: mknod d1/d10/d19/cb1 0 2024-03-22T07:28:36.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/554: mkdir d1/d19/d9c/db3 0 2024-03-22T07:28:36.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/555: stat d1/de/f59 0 2024-03-22T07:28:36.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/556: readlink d1/d19/d32/l4c 0 2024-03-22T07:28:36.211 INFO:tasks.workunit.client.0.smithi134.stdout:5/386: dwrite d1/f73 [0,4194304] 0 2024-03-22T07:28:36.211 INFO:tasks.workunit.client.0.smithi134.stdout:5/387: fdatasync d1/d4/f1a 0 2024-03-22T07:28:36.213 INFO:tasks.workunit.client.0.smithi134.stdout:8/514: dwrite d1/d15/d42/d44/f3e [0,4194304] 0 2024-03-22T07:28:36.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/308: creat d2/d1b/d4d/f74 x:0 0 0 2024-03-22T07:28:36.215 INFO:tasks.workunit.client.1.smithi195.stdout:5/634: symlink d9/lcd 0 2024-03-22T07:28:36.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/348: mknod d2/d5/d8/c6b 0 2024-03-22T07:28:36.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/349: creat d2/d5/d22/d52/d3c/f6c x:0 0 0 2024-03-22T07:28:36.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/350: readlink d2/d5/d22/d52/l50 0 2024-03-22T07:28:36.218 INFO:tasks.workunit.client.0.smithi134.stdout:1/408: dwrite d5/da/d1b/d27/d60/d72/f7d [0,4194304] 0 2024-03-22T07:28:36.218 INFO:tasks.workunit.client.1.smithi195.stdout:6/532: creat d5/d5e/d34/d55/d3b/d6e/d97/fbd x:0 0 0 2024-03-22T07:28:36.218 INFO:tasks.workunit.client.1.smithi195.stdout:6/533: truncate d5/d5e/d34/d55/d4b/f4f 1186220 0 2024-03-22T07:28:36.219 INFO:tasks.workunit.client.1.smithi195.stdout:4/576: symlink d13/d63/lc4 0 2024-03-22T07:28:36.219 INFO:tasks.workunit.client.1.smithi195.stdout:4/577: chown lc 7447505 1 2024-03-22T07:28:36.221 INFO:tasks.workunit.client.1.smithi195.stdout:3/570: sync 2024-03-22T07:28:36.221 INFO:tasks.workunit.client.1.smithi195.stdout:2/580: sync 2024-03-22T07:28:36.221 INFO:tasks.workunit.client.1.smithi195.stdout:2/581: write d2/d3/d21/d4c/f52 [826539,37250] 0 2024-03-22T07:28:36.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/753: dwrite d2/d4/d6/db/f9d [0,4194304] 0 2024-03-22T07:28:36.222 INFO:tasks.workunit.client.1.smithi195.stdout:9/754: creat d2/d4/d6/d18/d50/d88/f10e x:0 0 0 2024-03-22T07:28:36.222 INFO:tasks.workunit.client.1.smithi195.stdout:8/651: mkdir da/d17/d32/d61/dc2/dc3 0 2024-03-22T07:28:36.222 INFO:tasks.workunit.client.1.smithi195.stdout:8/652: chown da/d17/cae 216586 1 2024-03-22T07:28:36.226 INFO:tasks.workunit.client.1.smithi195.stdout:7/588: stat d0/d13/d14/d2b/l66 0 2024-03-22T07:28:36.227 INFO:tasks.workunit.client.1.smithi195.stdout:5/635: dread d9/d12/d1d/d36/f44 [4194304,4194304] 0 2024-03-22T07:28:36.233 INFO:tasks.workunit.client.0.smithi134.stdout:0/402: dwrite dc/f57 [0,4194304] 0 2024-03-22T07:28:36.234 INFO:tasks.workunit.client.0.smithi134.stdout:0/403: creat dc/d17/f77 x:0 0 0 2024-03-22T07:28:36.234 INFO:tasks.workunit.client.0.smithi134.stdout:0/404: creat dc/d17/f78 x:0 0 0 2024-03-22T07:28:36.234 INFO:tasks.workunit.client.1.smithi195.stdout:4/578: dread d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:36.234 INFO:tasks.workunit.client.1.smithi195.stdout:4/579: creat d13/d63/d36/fc5 x:0 0 0 2024-03-22T07:28:36.234 INFO:tasks.workunit.client.1.smithi195.stdout:3/571: unlink d3/df/d15/d1d/c73 0 2024-03-22T07:28:36.234 INFO:tasks.workunit.client.0.smithi134.stdout:6/309: write d2/d1b/d1d/f55 [122724,17196] 0 2024-03-22T07:28:36.235 INFO:tasks.workunit.client.1.smithi195.stdout:1/491: mknod d0/d2/d9/c99 0 2024-03-22T07:28:36.237 INFO:tasks.workunit.client.1.smithi195.stdout:2/582: mkdir d2/d3/d7/d19/d22/d26/d99/dbf 0 2024-03-22T07:28:36.238 INFO:tasks.workunit.client.0.smithi134.stdout:2/351: read d2/f28 [4582355,56425] 0 2024-03-22T07:28:36.244 INFO:tasks.workunit.client.1.smithi195.stdout:0/601: dwrite d1/d4/dd/df/d44/d6f/f79 [0,4194304] 0 2024-03-22T07:28:36.245 INFO:tasks.workunit.client.1.smithi195.stdout:6/534: dwrite d5/d5e/d34/d55/d3b/d6e/d97/f9a [0,4194304] 0 2024-03-22T07:28:36.245 INFO:tasks.workunit.client.1.smithi195.stdout:8/653: creat da/d17/d32/d7d/d8e/fc4 x:0 0 0 2024-03-22T07:28:36.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/583: dread d2/d3/d21/d40/f5d [0,4194304] 0 2024-03-22T07:28:36.247 INFO:tasks.workunit.client.1.smithi195.stdout:5/636: mknod d9/da8/cce 0 2024-03-22T07:28:36.249 INFO:tasks.workunit.client.0.smithi134.stdout:0/405: read dc/de/d55/f71 [3271595,21797] 0 2024-03-22T07:28:36.249 INFO:tasks.workunit.client.0.smithi134.stdout:0/406: creat dc/d18/f79 x:0 0 0 2024-03-22T07:28:36.250 INFO:tasks.workunit.client.0.smithi134.stdout:3/365: getdents d4/d8/d23 0 2024-03-22T07:28:36.253 INFO:tasks.workunit.client.1.smithi195.stdout:8/654: dread da/d17/d32/d7d/d8e/fa3 [0,4194304] 0 2024-03-22T07:28:36.255 INFO:tasks.workunit.client.0.smithi134.stdout:9/336: creat d3/d9/d37/d3c/f78 x:0 0 0 2024-03-22T07:28:36.256 INFO:tasks.workunit.client.1.smithi195.stdout:0/602: read d1/d10/d19/d20/f56 [1335541,55475] 0 2024-03-22T07:28:36.256 INFO:tasks.workunit.client.1.smithi195.stdout:0/603: write d1/d4/dd/f59 [4612872,62188] 0 2024-03-22T07:28:36.256 INFO:tasks.workunit.client.1.smithi195.stdout:3/572: dwrite d3/dbf/f97 [0,4194304] 0 2024-03-22T07:28:36.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/573: truncate d3/df/d15/d1d/d5c/d47/d67/d93/f68 1032825 0 2024-03-22T07:28:36.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/574: write d3/df/d15/f1c [42761,116306] 0 2024-03-22T07:28:36.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/575: chown d3/d18/d89/d8c/lad 42 1 2024-03-22T07:28:36.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/589: dwrite d0/d13/d22/d57/d7b/d8c/f92 [4194304,4194304] 0 2024-03-22T07:28:36.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/590: fsync d0/ff 0 2024-03-22T07:28:36.259 INFO:tasks.workunit.client.1.smithi195.stdout:7/591: stat d0/d98/cc1 0 2024-03-22T07:28:36.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/580: symlink d13/d2a/d7e/d8c/lc6 0 2024-03-22T07:28:36.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/581: readlink d13/l61 0 2024-03-22T07:28:36.261 INFO:tasks.workunit.client.0.smithi134.stdout:7/557: mknod d1/de/d11/d48/cb4 0 2024-03-22T07:28:36.271 INFO:tasks.workunit.client.1.smithi195.stdout:0/604: write d1/d4/dd/d66/d80/f6a [3295316,60767] 0 2024-03-22T07:28:36.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/584: dwrite d2/f34 [0,4194304] 0 2024-03-22T07:28:36.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/585: fdatasync d2/d3/d7/da/d4e/fb1 0 2024-03-22T07:28:36.273 INFO:tasks.workunit.client.0.smithi134.stdout:5/388: link d1/d8/d20/c6b d1/d8/d16/c85 0 2024-03-22T07:28:36.275 INFO:tasks.workunit.client.0.smithi134.stdout:2/352: dwrite d2/d5/d8/f33 [0,4194304] 0 2024-03-22T07:28:36.280 INFO:tasks.workunit.client.1.smithi195.stdout:6/535: rename d5/d5e/d34/d55/d4b/da2/f2a to d5/d5e/d34/d55/d4b/da2/d4a/fbe 0 2024-03-22T07:28:36.282 INFO:tasks.workunit.client.0.smithi134.stdout:8/515: link d1/d15/d42/d12/f35 d1/d15/d57/d8c/faa 0 2024-03-22T07:28:36.282 INFO:tasks.workunit.client.0.smithi134.stdout:8/516: fdatasync d1/d15/f5 0 2024-03-22T07:28:36.282 INFO:tasks.workunit.client.0.smithi134.stdout:7/558: dwrite d1/de/d11/d2b/d31/f8e [0,4194304] 0 2024-03-22T07:28:36.285 INFO:tasks.workunit.client.0.smithi134.stdout:7/559: dread d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:36.285 INFO:tasks.workunit.client.0.smithi134.stdout:7/560: readlink d1/de/d11/l24 0 2024-03-22T07:28:36.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/582: dwrite d13/d63/d36/fc5 [0,4194304] 0 2024-03-22T07:28:36.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/583: readlink d13/la5 0 2024-03-22T07:28:36.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/584: chown d13/f9c 2 1 2024-03-22T07:28:36.290 INFO:tasks.workunit.client.0.smithi134.stdout:7/561: write d1/de/f98 [805458,68009] 0 2024-03-22T07:28:36.291 INFO:tasks.workunit.client.0.smithi134.stdout:7/562: write d1/de/d11/d48/fc [605128,94388] 0 2024-03-22T07:28:36.291 INFO:tasks.workunit.client.0.smithi134.stdout:7/563: fsync d1/de/d11/d2b/faa 0 2024-03-22T07:28:36.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/655: creat da/d17/fc5 x:0 0 0 2024-03-22T07:28:36.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/656: readlink da/d17/d32/d61/d47/l51 0 2024-03-22T07:28:36.296 INFO:tasks.workunit.client.1.smithi195.stdout:8/657: truncate da/d17/d32/d61/d47/f87 1849257 0 2024-03-22T07:28:36.297 INFO:tasks.workunit.client.0.smithi134.stdout:6/310: symlink d2/d1b/d4d/d65/d73/l75 0 2024-03-22T07:28:36.300 INFO:tasks.workunit.client.0.smithi134.stdout:8/517: dwrite d1/d4/f47 [0,4194304] 0 2024-03-22T07:28:36.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/407: creat dc/de/d55/d60/f7a x:0 0 0 2024-03-22T07:28:36.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/408: chown dc/de/d55/d65/l6c 2810471 1 2024-03-22T07:28:36.305 INFO:tasks.workunit.client.0.smithi134.stdout:3/366: rename d4/d8/l72 to d4/d22/d3c/l7d 0 2024-03-22T07:28:36.305 INFO:tasks.workunit.client.0.smithi134.stdout:3/367: truncate d4/d10/f36 1023905 0 2024-03-22T07:28:36.305 INFO:tasks.workunit.client.0.smithi134.stdout:3/368: chown d4/d22/c27 2930 1 2024-03-22T07:28:36.307 INFO:tasks.workunit.client.1.smithi195.stdout:3/576: mkdir d3/df/d15/d1d/d5c/d47/d67/d80/db8/dc0 0 2024-03-22T07:28:36.310 INFO:tasks.workunit.client.0.smithi134.stdout:9/337: symlink d3/d9/d37/d6f/d54/l79 0 2024-03-22T07:28:36.312 INFO:tasks.workunit.client.0.smithi134.stdout:5/389: readlink d1/d8/d20/d62/d65/l23 0 2024-03-22T07:28:36.314 INFO:tasks.workunit.client.0.smithi134.stdout:6/311: write d2/d3f/d28/d6b/f5b [8370,5864] 0 2024-03-22T07:28:36.317 INFO:tasks.workunit.client.1.smithi195.stdout:7/592: mknod d0/d13/d22/d57/d7b/d8c/cc9 0 2024-03-22T07:28:36.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/658: dwrite da/d17/f25 [0,4194304] 0 2024-03-22T07:28:36.322 INFO:tasks.workunit.client.1.smithi195.stdout:8/659: chown da/d17/d32/d61/c6a 1120262 1 2024-03-22T07:28:36.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/409: dwrite dc/de/d55/d65/f67 [4194304,4194304] 0 2024-03-22T07:28:36.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/410: chown lb 11041760 1 2024-03-22T07:28:36.323 INFO:tasks.workunit.client.0.smithi134.stdout:0/411: stat dc/d17/f38 0 2024-03-22T07:28:36.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/605: truncate d1/d4/dd/df/f11 3094593 0 2024-03-22T07:28:36.326 INFO:tasks.workunit.client.0.smithi134.stdout:2/353: creat d2/d5/d22/d52/d3c/d4f/f6d x:0 0 0 2024-03-22T07:28:36.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/586: creat d2/d3/d7/fc0 x:0 0 0 2024-03-22T07:28:36.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/587: getdents d2/d3/d7/d19/d22/d26/d99/dbf 0 2024-03-22T07:28:36.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/588: dread - d2/d3/d7/fc0 zero size 2024-03-22T07:28:36.339 INFO:tasks.workunit.client.1.smithi195.stdout:5/637: rename d9/d22/d50 to d9/d2d/d84/dcf 0 2024-03-22T07:28:36.341 INFO:tasks.workunit.client.1.smithi195.stdout:6/536: mkdir d5/d5e/d34/d55/dab/dbf 0 2024-03-22T07:28:36.342 INFO:tasks.workunit.client.0.smithi134.stdout:3/369: dwrite d4/d22/d29/d50/f6f [0,4194304] 0 2024-03-22T07:28:36.345 INFO:tasks.workunit.client.0.smithi134.stdout:8/518: symlink d1/d15/d7b/d96/lab 0 2024-03-22T07:28:36.347 INFO:tasks.workunit.client.0.smithi134.stdout:0/412: dwrite dc/de/d55/f56 [0,4194304] 0 2024-03-22T07:28:36.350 INFO:tasks.workunit.client.0.smithi134.stdout:7/564: rename d1/de/d11/f13 to d1/de/d8d/fb5 0 2024-03-22T07:28:36.350 INFO:tasks.workunit.client.0.smithi134.stdout:7/565: chown d1/de/d11/d2b/d31/f91 257707270 1 2024-03-22T07:28:36.351 INFO:tasks.workunit.client.1.smithi195.stdout:4/585: symlink d13/d15/d6b/lc7 0 2024-03-22T07:28:36.351 INFO:tasks.workunit.client.1.smithi195.stdout:4/586: dread - d13/d15/faf zero size 2024-03-22T07:28:36.352 INFO:tasks.workunit.client.0.smithi134.stdout:9/338: truncate d3/f1a 863154 0 2024-03-22T07:28:36.353 INFO:tasks.workunit.client.0.smithi134.stdout:9/339: fsync d3/d9/d37/d3c/f78 0 2024-03-22T07:28:36.355 INFO:tasks.workunit.client.1.smithi195.stdout:7/593: mknod d0/d13/d14/d29/d35/d3a/d7e/cca 0 2024-03-22T07:28:36.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/413: read dc/d18/f2f [1307569,96453] 0 2024-03-22T07:28:36.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/414: chown dc/c46 3039 1 2024-03-22T07:28:36.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/415: write dc/d17/f6d [51207,32916] 0 2024-03-22T07:28:36.356 INFO:tasks.workunit.client.0.smithi134.stdout:0/416: chown dc/de/c16 214 1 2024-03-22T07:28:36.360 INFO:tasks.workunit.client.1.smithi195.stdout:6/537: dwrite d5/d5e/d34/d55/f2e [0,4194304] 0 2024-03-22T07:28:36.361 INFO:tasks.workunit.client.0.smithi134.stdout:7/566: write d1/d19/d32/f92 [5704055,64536] 0 2024-03-22T07:28:36.361 INFO:tasks.workunit.client.0.smithi134.stdout:7/567: creat d1/de/d11/d2b/fb6 x:0 0 0 2024-03-22T07:28:36.365 INFO:tasks.workunit.client.0.smithi134.stdout:2/354: stat d2/d5/d22/d52/c2e 0 2024-03-22T07:28:36.366 INFO:tasks.workunit.client.0.smithi134.stdout:2/355: dread - d2/f40 zero size 2024-03-22T07:28:36.366 INFO:tasks.workunit.client.1.smithi195.stdout:4/587: dwrite d13/d63/f18 [0,4194304] 0 2024-03-22T07:28:36.366 INFO:tasks.workunit.client.1.smithi195.stdout:4/588: stat d13/d63/d36/d5f/l89 0 2024-03-22T07:28:36.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/606: mknod d1/d4/dd/d3f/cb2 0 2024-03-22T07:28:36.369 INFO:tasks.workunit.client.1.smithi195.stdout:0/607: truncate d1/d4/dd/df/d44/d6f/f91 4420128 0 2024-03-22T07:28:36.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/577: rename d3/f8b to d3/d22/fc1 0 2024-03-22T07:28:36.377 INFO:tasks.workunit.client.1.smithi195.stdout:5/638: mkdir d9/d2d/dd0 0 2024-03-22T07:28:36.379 INFO:tasks.workunit.client.0.smithi134.stdout:8/519: rename d1/d15/d42/d76/f8e to d1/d15/d42/d44/fac 0 2024-03-22T07:28:36.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/538: mkdir d5/d5e/dc0 0 2024-03-22T07:28:36.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/539: truncate d5/d6d/f7b 392166 0 2024-03-22T07:28:36.384 INFO:tasks.workunit.client.1.smithi195.stdout:6/540: chown d5/d6d/d95 10 1 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/589: creat d13/d63/d3e/fc8 x:0 0 0 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:1/492: sync 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:9/755: sync 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/590: write d13/d63/d3e/d5c/fbb [338679,111816] 0 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/591: dread - d13/d63/d36/fbf zero size 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/592: chown d13/d2a/d7e/d8c 36741 1 2024-03-22T07:28:36.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/593: chown d13/d15/l4a 63 1 2024-03-22T07:28:36.392 INFO:tasks.workunit.client.0.smithi134.stdout:9/340: mkdir d3/d9/d37/d3c/d71/d7a 0 2024-03-22T07:28:36.392 INFO:tasks.workunit.client.1.smithi195.stdout:9/756: dread d2/d4/d6/db/d20/d4a/da2/fc4 [0,4194304] 0 2024-03-22T07:28:36.394 INFO:tasks.workunit.client.1.smithi195.stdout:0/608: unlink d1/d4/dd/df/d6b/f94 0 2024-03-22T07:28:36.396 INFO:tasks.workunit.client.0.smithi134.stdout:0/417: symlink dc/d18/l7b 0 2024-03-22T07:28:36.396 INFO:tasks.workunit.client.0.smithi134.stdout:0/418: write dc/d17/f6d [834890,12794] 0 2024-03-22T07:28:36.397 INFO:tasks.workunit.client.1.smithi195.stdout:4/594: read f11 [1249901,107993] 0 2024-03-22T07:28:36.398 INFO:tasks.workunit.client.0.smithi134.stdout:6/312: mknod d2/d1b/d1d/d2b/c76 0 2024-03-22T07:28:36.399 INFO:tasks.workunit.client.0.smithi134.stdout:6/313: write d2/d1b/d4d/f74 [20241,123380] 0 2024-03-22T07:28:36.403 INFO:tasks.workunit.client.1.smithi195.stdout:3/578: unlink d3/d18/fb6 0 2024-03-22T07:28:36.404 INFO:tasks.workunit.client.0.smithi134.stdout:9/341: dwrite d3/d9/df/d12/f16 [0,4194304] 0 2024-03-22T07:28:36.404 INFO:tasks.workunit.client.0.smithi134.stdout:9/342: write d3/d9/d37/d6f/f32 [928937,79563] 0 2024-03-22T07:28:36.404 INFO:tasks.workunit.client.0.smithi134.stdout:7/568: creat d1/da8/fb7 x:0 0 0 2024-03-22T07:28:36.406 INFO:tasks.workunit.client.1.smithi195.stdout:5/639: mkdir d9/d22/dd1 0 2024-03-22T07:28:36.406 INFO:tasks.workunit.client.1.smithi195.stdout:5/640: readlink d9/l34 0 2024-03-22T07:28:36.410 INFO:tasks.workunit.client.1.smithi195.stdout:6/541: symlink d5/d5e/d34/d55/d4b/da2/dad/lc1 0 2024-03-22T07:28:36.410 INFO:tasks.workunit.client.0.smithi134.stdout:2/356: mkdir d2/d5/d22/d52/d3c/d4f/d6e 0 2024-03-22T07:28:36.410 INFO:tasks.workunit.client.0.smithi134.stdout:9/343: dread d3/f1a [0,4194304] 0 2024-03-22T07:28:36.410 INFO:tasks.workunit.client.0.smithi134.stdout:9/344: getdents d3/d9/df/d57 0 2024-03-22T07:28:36.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/493: link d0/d70/c8e d0/d2/d9/c9a 0 2024-03-22T07:28:36.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/494: chown d0/l2b 80287 1 2024-03-22T07:28:36.414 INFO:tasks.workunit.client.1.smithi195.stdout:9/757: truncate d2/d4/d32/f54 4737226 0 2024-03-22T07:28:36.414 INFO:tasks.workunit.client.1.smithi195.stdout:9/758: chown d2/d4/d32/d6d/d78/d79/d97/laf 26 1 2024-03-22T07:28:36.415 INFO:tasks.workunit.client.1.smithi195.stdout:9/759: stat d2/d4/d23/d74/fcc 0 2024-03-22T07:28:36.417 INFO:tasks.workunit.client.1.smithi195.stdout:2/589: link d2/d3/d21/d40/c66 d2/d3/d21/d40/cc1 0 2024-03-22T07:28:36.418 INFO:tasks.workunit.client.1.smithi195.stdout:4/595: mkdir d13/d2a/d7e/d85/dc9 0 2024-03-22T07:28:36.419 INFO:tasks.workunit.client.1.smithi195.stdout:5/641: dread d9/ff [0,4194304] 0 2024-03-22T07:28:36.419 INFO:tasks.workunit.client.0.smithi134.stdout:2/357: write d2/d5/d8/f33 [846908,107507] 0 2024-03-22T07:28:36.421 INFO:tasks.workunit.client.1.smithi195.stdout:8/660: rename da/d17/d32/d61/d47 to da/d82/dc6 0 2024-03-22T07:28:36.421 INFO:tasks.workunit.client.1.smithi195.stdout:8/661: fdatasync da/d82/dc6/d53/f96 0 2024-03-22T07:28:36.424 INFO:tasks.workunit.client.1.smithi195.stdout:3/579: chown d3/d18/l19 122082958 1 2024-03-22T07:28:36.429 INFO:tasks.workunit.client.1.smithi195.stdout:6/542: mkdir d5/d5e/d34/d55/d3b/dc2 0 2024-03-22T07:28:36.430 INFO:tasks.workunit.client.0.smithi134.stdout:3/370: rmdir d4 39 2024-03-22T07:28:36.430 INFO:tasks.workunit.client.0.smithi134.stdout:3/371: write d4/d8/d23/f3b [1397744,124532] 0 2024-03-22T07:28:36.431 INFO:tasks.workunit.client.1.smithi195.stdout:4/596: dread d13/d63/d79/d68/f82 [0,4194304] 0 2024-03-22T07:28:36.431 INFO:tasks.workunit.client.1.smithi195.stdout:4/597: dread - d13/d15/d64/fc1 zero size 2024-03-22T07:28:36.433 INFO:tasks.workunit.client.1.smithi195.stdout:1/495: creat d0/d70/d97/d39/d64/d7a/f9b x:0 0 0 2024-03-22T07:28:36.435 INFO:tasks.workunit.client.0.smithi134.stdout:9/345: dwrite d3/f8 [0,4194304] 0 2024-03-22T07:28:36.435 INFO:tasks.workunit.client.0.smithi134.stdout:9/346: chown d3/d9/d37/f47 5 1 2024-03-22T07:28:36.436 INFO:tasks.workunit.client.0.smithi134.stdout:8/520: rename d1/d15/d7b/d96 to d1/d15/d42/d76/d8f/dad 0 2024-03-22T07:28:36.437 INFO:tasks.workunit.client.0.smithi134.stdout:9/347: dread d3/d9/d37/d6f/f32 [0,4194304] 0 2024-03-22T07:28:36.439 INFO:tasks.workunit.client.0.smithi134.stdout:0/419: creat dc/d18/d72/f7c x:0 0 0 2024-03-22T07:28:36.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/372: dread d4/d22/d29/f67 [0,4194304] 0 2024-03-22T07:28:36.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/373: truncate d4/d10/d4b/f65 774226 0 2024-03-22T07:28:36.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/374: chown d4/d10/d4b/c5a 61533 1 2024-03-22T07:28:36.440 INFO:tasks.workunit.client.0.smithi134.stdout:3/375: chown d4/d8/f12 116321092 1 2024-03-22T07:28:36.442 INFO:tasks.workunit.client.0.smithi134.stdout:6/314: mknod d2/d6e/c77 0 2024-03-22T07:28:36.442 INFO:tasks.workunit.client.0.smithi134.stdout:6/315: stat d2/d1b/d1d/d2b/f50 0 2024-03-22T07:28:36.443 INFO:tasks.workunit.client.1.smithi195.stdout:8/662: dwrite da/d17/d32/d61/f72 [0,4194304] 0 2024-03-22T07:28:36.444 INFO:tasks.workunit.client.1.smithi195.stdout:5/642: dwrite d9/d12/d1d/d36/f49 [0,4194304] 0 2024-03-22T07:28:36.444 INFO:tasks.workunit.client.1.smithi195.stdout:5/643: chown d9/d22/d46/db2 168 1 2024-03-22T07:28:36.445 INFO:tasks.workunit.client.1.smithi195.stdout:7/594: rename d0/d13/d14/d20/d40/d82/da0/f5e to d0/d13/d14/d2f/dae/fcb 0 2024-03-22T07:28:36.446 INFO:tasks.workunit.client.0.smithi134.stdout:8/521: dread d1/d4/d61/f65 [0,4194304] 0 2024-03-22T07:28:36.447 INFO:tasks.workunit.client.1.smithi195.stdout:6/543: write d5/d5e/d34/d55/d4b/da2/f91 [896487,17516] 0 2024-03-22T07:28:36.448 INFO:tasks.workunit.client.1.smithi195.stdout:3/580: symlink d3/d18/d89/d70/db5/lc2 0 2024-03-22T07:28:36.460 INFO:tasks.workunit.client.0.smithi134.stdout:3/376: dwrite d4/d10/f61 [0,4194304] 0 2024-03-22T07:28:36.461 INFO:tasks.workunit.client.1.smithi195.stdout:4/598: mknod d13/d2a/d7e/d8c/db7/cca 0 2024-03-22T07:28:36.461 INFO:tasks.workunit.client.1.smithi195.stdout:4/599: chown d13/d63/d3e/f93 3480320 1 2024-03-22T07:28:36.461 INFO:tasks.workunit.client.1.smithi195.stdout:4/600: truncate d13/d63/d36/f8d 802442 0 2024-03-22T07:28:36.463 INFO:tasks.workunit.client.1.smithi195.stdout:1/496: truncate d0/d2/d6/f62 359664 0 2024-03-22T07:28:36.464 INFO:tasks.workunit.client.0.smithi134.stdout:2/358: creat d2/d5/d8/d5d/d5f/f6f x:0 0 0 2024-03-22T07:28:36.465 INFO:tasks.workunit.client.1.smithi195.stdout:8/663: mkdir da/de/db3/dc7 0 2024-03-22T07:28:36.465 INFO:tasks.workunit.client.1.smithi195.stdout:8/664: chown da/d17/d32/d7d/d8e/fa0 106660 1 2024-03-22T07:28:36.466 INFO:tasks.workunit.client.1.smithi195.stdout:5/644: mkdir d9/d12/d1d/d36/d7d/dd2 0 2024-03-22T07:28:36.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.467+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6074069bc0 con 0x7f605c0387f0 2024-03-22T07:28:36.469 INFO:tasks.workunit.client.0.smithi134.stdout:2/359: dread d2/d5/d8/f1b [0,4194304] 0 2024-03-22T07:28:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:1/497: dread d0/d70/d97/d41/d47/d4a/f83 [0,4194304] 0 2024-03-22T07:28:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:3/581: dwrite d3/fd [0,4194304] 0 2024-03-22T07:28:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:0/609: rename d1/d4/d12/l46 to d1/d4/dd/lb3 0 2024-03-22T07:28:36.471 INFO:tasks.workunit.client.1.smithi195.stdout:0/610: write d1/d4/dd/f59 [5573222,126960] 0 2024-03-22T07:28:36.473 INFO:tasks.workunit.client.1.smithi195.stdout:4/601: truncate d13/d63/d3e/d5c/f69 4558134 0 2024-03-22T07:28:36.474 INFO:tasks.workunit.client.0.smithi134.stdout:3/377: write d4/d8/d23/f60 [1738720,127369] 0 2024-03-22T07:28:36.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/348: symlink d3/d9/d37/d3c/d71/l7b 0 2024-03-22T07:28:36.475 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.474+0000 7f6070ff9700 1 -- 172.21.15.134:0/1901391922 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6074069bc0 con 0x7f605c0387f0 2024-03-22T07:28:36.476 INFO:tasks.workunit.client.1.smithi195.stdout:9/760: dwrite d2/d4/d6/d18/d50/f59 [0,4194304] 0 2024-03-22T07:28:36.477 INFO:tasks.workunit.client.1.smithi195.stdout:9/761: chown d2/d4/d6/db/d20/l34 5031 1 2024-03-22T07:28:36.477 INFO:tasks.workunit.client.1.smithi195.stdout:9/762: stat d2/d4/d32/d6d/deb/ff6 0 2024-03-22T07:28:36.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/645: dread d9/f29 [0,4194304] 0 2024-03-22T07:28:36.478 INFO:tasks.workunit.client.0.smithi134.stdout:0/420: link dc/f3e dc/d18/d72/f7d 0 2024-03-22T07:28:36.478 INFO:tasks.workunit.client.0.smithi134.stdout:0/421: chown dc/f29 3103 1 2024-03-22T07:28:36.480 INFO:tasks.workunit.client.1.smithi195.stdout:8/665: link da/dc/f6f da/d17/d32/d61/d88/d91/fc8 0 2024-03-22T07:28:36.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f605c0387f0 msgr2=0x7f605c03aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:36.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f605c0387f0 0x7f605c03aca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6074067b40 tx=0x7f606400b040 comp rx=0 tx=0).stop 2024-03-22T07:28:36.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 msgr2=0x7f60740682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:36.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 0x7f60740682f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6068013870 tx=0x7f6068009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:36.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/316: rmdir d2/d1b/d4d/d65 39 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 shutdown_connections 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f605c0387f0 0x7f605c03aca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60740fcee0 0x7f6074067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 --2- 172.21.15.134:0/1901391922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60740fe0d0 0x7f60740682f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.480+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 >> 172.21.15.134:0/1901391922 conn(0x7f60740f8560 msgr2=0x7f60740f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.481+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 shutdown_connections 2024-03-22T07:28:36.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.481+0000 7f607a3cc700 1 -- 172.21.15.134:0/1901391922 wait complete. 2024-03-22T07:28:36.483 INFO:tasks.workunit.client.1.smithi195.stdout:1/498: mkdir d0/d70/d6b/d9c 0 2024-03-22T07:28:36.484 INFO:tasks.workunit.client.1.smithi195.stdout:9/763: read d2/f9c [2498899,128535] 0 2024-03-22T07:28:36.484 INFO:tasks.workunit.client.1.smithi195.stdout:3/582: mknod d3/df/d15/d1d/d5c/cc3 0 2024-03-22T07:28:36.488 INFO:tasks.workunit.client.1.smithi195.stdout:7/595: rename d0/d13/d14/d2f/l50 to d0/d13/d14/d29/d6e/lcc 0 2024-03-22T07:28:36.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/349: dwrite d3/d9/d37/f4f [0,4194304] 0 2024-03-22T07:28:36.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/350: readlink d3/d9/d37/d6f/l1e 0 2024-03-22T07:28:36.490 INFO:tasks.workunit.client.0.smithi134.stdout:8/522: unlink d1/d15/d42/d12/l5c 0 2024-03-22T07:28:36.490 INFO:tasks.workunit.client.1.smithi195.stdout:3/583: dread d3/df/d15/d1d/d5c/d47/f66 [4194304,4194304] 0 2024-03-22T07:28:36.490 INFO:tasks.workunit.client.1.smithi195.stdout:3/584: getdents d3/df/d15/d1d/d5c/d47/d67/d80/db8/dc0 0 2024-03-22T07:28:36.491 INFO:tasks.workunit.client.1.smithi195.stdout:3/585: chown d3/df/d50 44 1 2024-03-22T07:28:36.492 INFO:tasks.workunit.client.1.smithi195.stdout:0/611: mkdir d1/d4/dd/df/d44/db4 0 2024-03-22T07:28:36.492 INFO:tasks.workunit.client.1.smithi195.stdout:0/612: chown d1/d4/dd/df/d2b/d63 69 1 2024-03-22T07:28:36.495 INFO:tasks.workunit.client.1.smithi195.stdout:4/602: truncate d13/d63/d79/d68/f82 7259477 0 2024-03-22T07:28:36.499 INFO:tasks.workunit.client.1.smithi195.stdout:5/646: mknod d9/d2d/d58/cd3 0 2024-03-22T07:28:36.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/586: write d3/df/d15/d1d/d5c/d47/f59 [3479712,106376] 0 2024-03-22T07:28:36.501 INFO:tasks.workunit.client.0.smithi134.stdout:2/360: rename d2/d5/d8/d31/l39 to d2/d5/d8/d5d/d5f/l70 0 2024-03-22T07:28:36.502 INFO:tasks.workunit.client.1.smithi195.stdout:8/666: mkdir da/d17/d32/d61/d88/dc9 0 2024-03-22T07:28:36.503 INFO:tasks.workunit.client.1.smithi195.stdout:0/613: dread d1/d4/dd/df/d44/d6f/f79 [0,4194304] 0 2024-03-22T07:28:36.503 INFO:tasks.workunit.client.0.smithi134.stdout:3/378: mknod d4/d8/d45/c7e 0 2024-03-22T07:28:36.505 INFO:tasks.workunit.client.1.smithi195.stdout:1/499: symlink d0/d2/d9/l9d 0 2024-03-22T07:28:36.506 INFO:tasks.workunit.client.1.smithi195.stdout:7/596: dwrite d0/d13/d14/d29/d35/d6d/f93 [0,4194304] 0 2024-03-22T07:28:36.506 INFO:tasks.workunit.client.1.smithi195.stdout:7/597: fdatasync d0/d13/d14/f8 0 2024-03-22T07:28:36.506 INFO:tasks.workunit.client.0.smithi134.stdout:1/409: sync 2024-03-22T07:28:36.506 INFO:tasks.workunit.client.0.smithi134.stdout:4/440: sync 2024-03-22T07:28:36.508 INFO:tasks.workunit.client.0.smithi134.stdout:8/523: dwrite d1/d15/d57/d79/f9f [0,4194304] 0 2024-03-22T07:28:36.509 INFO:tasks.workunit.client.0.smithi134.stdout:6/317: symlink d2/d6e/l78 0 2024-03-22T07:28:36.509 INFO:tasks.workunit.client.0.smithi134.stdout:6/318: readlink d2/d1b/d1d/l5f 0 2024-03-22T07:28:36.509 INFO:tasks.workunit.client.0.smithi134.stdout:6/319: dread - d2/d1b/f45 zero size 2024-03-22T07:28:36.516 INFO:tasks.workunit.client.1.smithi195.stdout:9/764: rename d2/d4/d23/d74/fd3 to d2/dad/dff/f10f 0 2024-03-22T07:28:36.525 INFO:tasks.workunit.client.0.smithi134.stdout:4/441: creat d2/f97 x:0 0 0 2024-03-22T07:28:36.533 INFO:tasks.workunit.client.0.smithi134.stdout:8/524: mkdir d1/d15/d42/d76/d8f/dad/dae 0 2024-03-22T07:28:36.534 INFO:tasks.workunit.client.1.smithi195.stdout:5/647: creat d9/d7f/fd4 x:0 0 0 2024-03-22T07:28:36.534 INFO:tasks.workunit.client.0.smithi134.stdout:1/410: dwrite d5/da/d13/d1e/f22 [0,4194304] 0 2024-03-22T07:28:36.534 INFO:tasks.workunit.client.0.smithi134.stdout:1/411: creat d5/d1d/f90 x:0 0 0 2024-03-22T07:28:36.535 INFO:tasks.workunit.client.0.smithi134.stdout:2/361: unlink d2/d5/d8/l15 0 2024-03-22T07:28:36.536 INFO:tasks.workunit.client.0.smithi134.stdout:2/362: read d2/d5/d22/d52/f4d [3786838,48682] 0 2024-03-22T07:28:36.536 INFO:tasks.workunit.client.0.smithi134.stdout:2/363: fsync d2/f3a 0 2024-03-22T07:28:36.537 INFO:tasks.workunit.client.0.smithi134.stdout:4/442: mkdir d2/d98 0 2024-03-22T07:28:36.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/614: dwrite d1/d10/d1f/d40/d43/f4c [0,4194304] 0 2024-03-22T07:28:36.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/615: readlink d1/l2 0 2024-03-22T07:28:36.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/616: chown d1/d4/dd/df/d67/c8a 142793 1 2024-03-22T07:28:36.539 INFO:tasks.workunit.client.1.smithi195.stdout:3/587: unlink d3/df/d15/d1d/d5c/d47/d67/lbd 0 2024-03-22T07:28:36.539 INFO:tasks.workunit.client.0.smithi134.stdout:3/379: dwrite d4/d8/d23/f70 [0,4194304] 0 2024-03-22T07:28:36.539 INFO:tasks.workunit.client.0.smithi134.stdout:3/380: chown d4/d8/c18 145483 1 2024-03-22T07:28:36.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/588: read d3/df/d15/d1d/d5c/d47/f4d [4672977,46799] 0 2024-03-22T07:28:36.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/589: fdatasync d3/d22/fc1 0 2024-03-22T07:28:36.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/500: dwrite d0/d70/d97/d39/f68 [4194304,4194304] 0 2024-03-22T07:28:36.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/501: chown d0/d2/d27 3121677 1 2024-03-22T07:28:36.541 INFO:tasks.workunit.client.1.smithi195.stdout:1/502: truncate d0/d2/d6/f84 544225 0 2024-03-22T07:28:36.541 INFO:tasks.workunit.client.1.smithi195.stdout:8/667: rmdir da/d82/dc6 39 2024-03-22T07:28:36.549 INFO:tasks.workunit.client.0.smithi134.stdout:8/525: dread d1/d15/d42/f2b [0,4194304] 0 2024-03-22T07:28:36.549 INFO:tasks.workunit.client.0.smithi134.stdout:8/526: truncate d1/f50 564678 0 2024-03-22T07:28:36.549 INFO:tasks.workunit.client.0.smithi134.stdout:8/527: fsync d1/d15/d42/d12/f37 0 2024-03-22T07:28:36.550 INFO:tasks.workunit.client.1.smithi195.stdout:7/598: mknod d0/d13/ccd 0 2024-03-22T07:28:36.550 INFO:tasks.workunit.client.1.smithi195.stdout:7/599: truncate d0/d13/d22/d57/fad 872656 0 2024-03-22T07:28:36.550 INFO:tasks.workunit.client.1.smithi195.stdout:7/600: creat d0/d13/d14/d2b/fce x:0 0 0 2024-03-22T07:28:36.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/412: mknod d5/da/c91 0 2024-03-22T07:28:36.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/413: fsync d5/da/d1b/d27/d39/f69 0 2024-03-22T07:28:36.552 INFO:tasks.workunit.client.1.smithi195.stdout:3/590: dread d3/df/d15/d1d/d5c/d47/d67/d80/f43 [0,4194304] 0 2024-03-22T07:28:36.553 INFO:tasks.workunit.client.1.smithi195.stdout:4/603: rename d13/d2a/d7d to d13/d63/dcb 0 2024-03-22T07:28:36.554 INFO:tasks.workunit.client.1.smithi195.stdout:8/668: read da/f4e [2291935,74119] 0 2024-03-22T07:28:36.554 INFO:tasks.workunit.client.0.smithi134.stdout:2/364: symlink d2/d5/d8/d31/l71 0 2024-03-22T07:28:36.555 INFO:tasks.workunit.client.1.smithi195.stdout:5/648: symlink d9/d2d/d8f/ld5 0 2024-03-22T07:28:36.555 INFO:tasks.workunit.client.1.smithi195.stdout:7/601: dread d0/d13/d14/d29/d35/d3a/f5d [0,4194304] 0 2024-03-22T07:28:36.556 INFO:tasks.workunit.client.1.smithi195.stdout:5/649: dread d9/d22/fb4 [0,4194304] 0 2024-03-22T07:28:36.556 INFO:tasks.workunit.client.1.smithi195.stdout:5/650: chown d9/d12/d1d/d36/fa3 4916 1 2024-03-22T07:28:36.557 INFO:tasks.workunit.client.0.smithi134.stdout:4/443: rmdir d2/d96 0 2024-03-22T07:28:36.560 INFO:tasks.workunit.client.1.smithi195.stdout:7/602: write d0/d13/d14/d29/f33 [2856536,104796] 0 2024-03-22T07:28:36.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/651: dread d9/d12/f52 [0,4194304] 0 2024-03-22T07:28:36.563 INFO:tasks.workunit.client.0.smithi134.stdout:3/381: mkdir d4/d8/d7f 0 2024-03-22T07:28:36.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/617: truncate d1/d4/d22/f6d 2678105 0 2024-03-22T07:28:36.572 INFO:tasks.workunit.client.0.smithi134.stdout:4/444: creat d2/d98/f99 x:0 0 0 2024-03-22T07:28:36.577 INFO:tasks.workunit.client.0.smithi134.stdout:3/382: mknod d4/d10/d6c/c80 0 2024-03-22T07:28:36.578 INFO:tasks.workunit.client.1.smithi195.stdout:3/591: symlink d3/dbf/lc4 0 2024-03-22T07:28:36.578 INFO:tasks.workunit.client.0.smithi134.stdout:8/528: rmdir d1/d15/d5b 39 2024-03-22T07:28:36.579 INFO:tasks.workunit.client.1.smithi195.stdout:2/590: sync 2024-03-22T07:28:36.584 INFO:tasks.workunit.client.1.smithi195.stdout:4/604: link d13/d63/dcb/la9 d13/d2a/d7e/d85/lcc 0 2024-03-22T07:28:36.586 INFO:tasks.workunit.client.0.smithi134.stdout:1/414: truncate d5/fb 269556 0 2024-03-22T07:28:36.587 INFO:tasks.workunit.client.1.smithi195.stdout:7/603: dwrite d0/d13/d14/d20/d40/d82/daa/fc2 [0,4194304] 0 2024-03-22T07:28:36.588 INFO:tasks.workunit.client.1.smithi195.stdout:0/618: dwrite d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:36.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/669: mkdir da/d82/dc6/d53/dca 0 2024-03-22T07:28:36.593 INFO:tasks.workunit.client.0.smithi134.stdout:2/365: rmdir d2/d5/d22/d52/d3c 39 2024-03-22T07:28:36.594 INFO:tasks.workunit.client.1.smithi195.stdout:6/544: sync 2024-03-22T07:28:36.595 INFO:tasks.workunit.client.1.smithi195.stdout:5/652: symlink d9/d2d/d84/d92/ld6 0 2024-03-22T07:28:36.597 INFO:tasks.workunit.client.0.smithi134.stdout:4/445: mkdir d2/d15/d35/d37/d76/d9a 0 2024-03-22T07:28:36.597 INFO:tasks.workunit.client.0.smithi134.stdout:4/446: fsync d2/d15/d35/d37/f8c 0 2024-03-22T07:28:36.598 INFO:tasks.workunit.client.1.smithi195.stdout:7/604: dread d0/d13/d22/f23 [0,4194304] 0 2024-03-22T07:28:36.601 INFO:tasks.workunit.client.1.smithi195.stdout:9/765: rename d2/d4/fb8 to d2/d4/d6/f110 0 2024-03-22T07:28:36.602 INFO:tasks.workunit.client.0.smithi134.stdout:8/529: dwrite d1/f4b [0,4194304] 0 2024-03-22T07:28:36.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/383: write d4/d22/d29/d50/f6f [1634289,52461] 0 2024-03-22T07:28:36.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/384: readlink d4/d22/d29/l47 0 2024-03-22T07:28:36.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/385: stat d4/d10/c38 0 2024-03-22T07:28:36.603 INFO:tasks.workunit.client.1.smithi195.stdout:5/653: dread d9/d12/d1d/f5e [0,4194304] 0 2024-03-22T07:28:36.603 INFO:tasks.workunit.client.0.smithi134.stdout:4/447: dread d2/d1d/f7d [0,4194304] 0 2024-03-22T07:28:36.604 INFO:tasks.workunit.client.1.smithi195.stdout:3/592: mknod d3/df/d15/d1d/d5c/d47/d67/d93/da2/cc5 0 2024-03-22T07:28:36.606 INFO:tasks.workunit.client.1.smithi195.stdout:2/591: symlink d2/d3/d1a/lc2 0 2024-03-22T07:28:36.607 INFO:tasks.workunit.client.0.smithi134.stdout:1/415: mkdir d5/d1d/d49/d92 0 2024-03-22T07:28:36.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/545: mknod d5/d16/d45/d53/d59/d87/cc3 0 2024-03-22T07:28:36.619 INFO:tasks.workunit.client.1.smithi195.stdout:7/605: mkdir d0/d13/d14/d29/dcf 0 2024-03-22T07:28:36.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/530: mknod d1/d15/d42/d12/d20/d69/caf 0 2024-03-22T07:28:36.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/531: chown d1/d15/d57/d79/l95 80 1 2024-03-22T07:28:36.622 INFO:tasks.workunit.client.1.smithi195.stdout:1/503: rename d0/d2/d27/l36 to d0/d70/d97/d39/l9e 0 2024-03-22T07:28:36.625 INFO:tasks.workunit.client.0.smithi134.stdout:3/386: mknod d4/d8/d7f/c81 0 2024-03-22T07:28:36.627 INFO:tasks.workunit.client.0.smithi134.stdout:4/448: symlink d2/d25/d48/d6e/l9b 0 2024-03-22T07:28:36.628 INFO:tasks.workunit.client.1.smithi195.stdout:1/504: dread d0/d2/d6/f8b [0,4194304] 0 2024-03-22T07:28:36.628 INFO:tasks.workunit.client.1.smithi195.stdout:1/505: chown d0/d2/d27 623 1 2024-03-22T07:28:36.629 INFO:tasks.workunit.client.1.smithi195.stdout:3/593: truncate d3/df/d15/d1d/f30 4769381 0 2024-03-22T07:28:36.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/416: mkdir d5/d93 0 2024-03-22T07:28:36.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/417: dread - d5/da/d1b/d27/d39/f82 zero size 2024-03-22T07:28:36.635 INFO:tasks.workunit.client.1.smithi195.stdout:7/606: mknod d0/d13/d14/d29/cd0 0 2024-03-22T07:28:36.636 INFO:tasks.workunit.client.0.smithi134.stdout:3/387: write d4/d8/f19 [408336,25222] 0 2024-03-22T07:28:36.638 INFO:tasks.workunit.client.1.smithi195.stdout:4/605: rename d13/d63/dcb to d13/d63/d79/dcd 0 2024-03-22T07:28:36.638 INFO:tasks.workunit.client.1.smithi195.stdout:4/606: write d13/f34 [3560486,60869] 0 2024-03-22T07:28:36.640 INFO:tasks.workunit.client.1.smithi195.stdout:0/619: dwrite d1/d4/dd/df/d44/d6f/f71 [4194304,4194304] 0 2024-03-22T07:28:36.640 INFO:tasks.workunit.client.1.smithi195.stdout:1/506: symlink d0/d2/d27/l9f 0 2024-03-22T07:28:36.640 INFO:tasks.workunit.client.1.smithi195.stdout:5/654: dwrite d9/d22/f2b [0,4194304] 0 2024-03-22T07:28:36.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/607: dread d0/d13/f46 [0,4194304] 0 2024-03-22T07:28:36.640 INFO:tasks.workunit.client.1.smithi195.stdout:7/608: write d0/d13/d14/d29/f89 [354179,18554] 0 2024-03-22T07:28:36.642 INFO:tasks.workunit.client.0.smithi134.stdout:5/390: sync 2024-03-22T07:28:36.643 INFO:tasks.workunit.client.1.smithi195.stdout:3/594: creat d3/dbf/fc6 x:0 0 0 2024-03-22T07:28:36.643 INFO:tasks.workunit.client.1.smithi195.stdout:3/595: readlink d3/df/d15/la7 0 2024-03-22T07:28:36.643 INFO:tasks.workunit.client.1.smithi195.stdout:8/670: dwrite da/d82/dc6/d53/d8d/f92 [4194304,4194304] 0 2024-03-22T07:28:36.644 INFO:tasks.workunit.client.0.smithi134.stdout:2/366: dwrite d2/d5/d8/d31/f5b [0,4194304] 0 2024-03-22T07:28:36.644 INFO:tasks.workunit.client.0.smithi134.stdout:2/367: fdatasync d2/d5/d22/d52/d3c/d4f/f6d 0 2024-03-22T07:28:36.644 INFO:tasks.workunit.client.0.smithi134.stdout:2/368: write d2/d5/d22/d52/d3c/d4f/f6d [258003,58083] 0 2024-03-22T07:28:36.644 INFO:tasks.workunit.client.0.smithi134.stdout:3/388: mkdir d4/d22/d29/d82 0 2024-03-22T07:28:36.645 INFO:tasks.workunit.client.0.smithi134.stdout:1/418: write f1 [3690175,45278] 0 2024-03-22T07:28:36.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/655: read d9/d2d/f65 [1544813,119864] 0 2024-03-22T07:28:36.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/656: stat d9/d22/d7b/d98/dbe 0 2024-03-22T07:28:36.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/657: fdatasync d9/d2d/f51 0 2024-03-22T07:28:36.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/658: chown d9/ff 11953 1 2024-03-22T07:28:36.646 INFO:tasks.workunit.client.1.smithi195.stdout:5/659: readlink d9/d22/d7b/l8e 0 2024-03-22T07:28:36.646 INFO:tasks.workunit.client.1.smithi195.stdout:6/546: mknod d5/d16/cc4 0 2024-03-22T07:28:36.647 INFO:tasks.workunit.client.0.smithi134.stdout:4/449: dwrite d2/f62 [0,4194304] 0 2024-03-22T07:28:36.647 INFO:tasks.workunit.client.0.smithi134.stdout:5/391: link d1/c32 d1/d8/d20/d62/c86 0 2024-03-22T07:28:36.651 INFO:tasks.workunit.client.1.smithi195.stdout:2/592: rename d2/d3/d24/c57 to d2/d3/d7/d19/d22/d26/d99/cc3 0 2024-03-22T07:28:36.655 INFO:tasks.workunit.client.0.smithi134.stdout:1/419: read d5/f20 [62394,1718] 0 2024-03-22T07:28:36.659 INFO:tasks.workunit.client.1.smithi195.stdout:4/607: mknod d13/d15/d44/cce 0 2024-03-22T07:28:36.660 INFO:tasks.workunit.client.0.smithi134.stdout:5/392: read d1/d8/f1b [2762255,16447] 0 2024-03-22T07:28:36.661 INFO:tasks.workunit.client.0.smithi134.stdout:2/369: creat d2/d5/d22/d52/d3c/d60/f72 x:0 0 0 2024-03-22T07:28:36.662 INFO:tasks.workunit.client.1.smithi195.stdout:0/620: creat d1/d10/d4d/da6/fb5 x:0 0 0 2024-03-22T07:28:36.663 INFO:tasks.workunit.client.0.smithi134.stdout:3/389: link d4/d10/d4b/c4d d4/d22/d29/c83 0 2024-03-22T07:28:36.663 INFO:tasks.workunit.client.0.smithi134.stdout:3/390: chown d4/d8/d69/d6a 65142 1 2024-03-22T07:28:36.664 INFO:tasks.workunit.client.1.smithi195.stdout:1/507: mkdir d0/d2/d9/d2a/da0 0 2024-03-22T07:28:36.667 INFO:tasks.workunit.client.1.smithi195.stdout:6/547: dwrite d5/d16/d5a/f8d [0,4194304] 0 2024-03-22T07:28:36.668 INFO:tasks.workunit.client.1.smithi195.stdout:7/609: mknod d0/d13/d14/d29/cd1 0 2024-03-22T07:28:36.668 INFO:tasks.workunit.client.1.smithi195.stdout:7/610: readlink d0/d13/d14/d20/l2e 0 2024-03-22T07:28:36.670 INFO:tasks.workunit.client.1.smithi195.stdout:3/596: mknod d3/df/d15/d1d/d5c/d47/d67/cc7 0 2024-03-22T07:28:36.673 INFO:tasks.workunit.client.0.smithi134.stdout:4/450: creat d2/d2a/d80/f9c x:0 0 0 2024-03-22T07:28:36.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.673+0000 7f1fd7567700 1 -- 172.21.15.134:0/2817547926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 msgr2=0x7f1fd00fae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:36.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.673+0000 7f1fd7567700 1 --2- 172.21.15.134:0/2817547926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd00fae90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc004940 tx=0x7f1fcc009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:36.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.677+0000 7f1fd7567700 1 -- 172.21.15.134:0/2817547926 shutdown_connections 2024-03-22T07:28:36.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.677+0000 7f1fd7567700 1 --2- 172.21.15.134:0/2817547926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd00fae90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.677+0000 7f1fd7567700 1 --2- 172.21.15.134:0/2817547926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd00fc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.677+0000 7f1fd7567700 1 -- 172.21.15.134:0/2817547926 >> 172.21.15.134:0/2817547926 conn(0x7f1fd00f6ba0 msgr2=0x7f1fd00f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:36.678 INFO:tasks.workunit.client.0.smithi134.stdout:1/420: dwrite d5/da/d13/d1e/d45/f7f [4194304,4194304] 0 2024-03-22T07:28:36.678 INFO:tasks.workunit.client.0.smithi134.stdout:5/393: rmdir d1/d8/d16 39 2024-03-22T07:28:36.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.677+0000 7f1fd7567700 1 -- 172.21.15.134:0/2817547926 shutdown_connections 2024-03-22T07:28:36.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.678+0000 7f1fd7567700 1 -- 172.21.15.134:0/2817547926 wait complete. 2024-03-22T07:28:36.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.679+0000 7f1fd7567700 1 Processor -- start 2024-03-22T07:28:36.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.679+0000 7f1fd7567700 1 -- start start 2024-03-22T07:28:36.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.680+0000 7f1fd7567700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd010b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:36.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.680+0000 7f1fd7567700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd010bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:36.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.680+0000 7f1fd7567700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd010c390 con 0x7f1fd00fca80 2024-03-22T07:28:36.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.680+0000 7f1fd7567700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd010cbd0 con 0x7f1fd00fc130 2024-03-22T07:28:36.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.682+0000 7f1fd5303700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd010b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.682+0000 7f1fd5303700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd010b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:50082/0 (socket says 172.21.15.134:50082) 2024-03-22T07:28:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.682+0000 7f1fd5303700 1 -- 172.21.15.134:0/1320280623 learned_addr learned my addr 172.21.15.134:0/1320280623 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.682+0000 7f1fd4b02700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd010bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:36.684 INFO:tasks.workunit.client.1.smithi195.stdout:8/671: unlink da/c22 0 2024-03-22T07:28:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.683+0000 7f1fd4b02700 1 -- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 msgr2=0x7f1fd010b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.683+0000 7f1fd4b02700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd010b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:36.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.683+0000 7f1fd4b02700 1 -- 172.21.15.134:0/1320280623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc005040 con 0x7f1fd00fca80 2024-03-22T07:28:36.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.683+0000 7f1fd5303700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd010b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:28:36.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.684+0000 7f1fd4b02700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd010bd40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00b970 tx=0x7f1fcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:36.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.685+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fcc00e040 con 0x7f1fd00fca80 2024-03-22T07:28:36.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.685+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd010ce50 con 0x7f1fd00fca80 2024-03-22T07:28:36.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.685+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd010d410 con 0x7f1fd00fca80 2024-03-22T07:28:36.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.685+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fcc004290 con 0x7f1fd00fca80 2024-03-22T07:28:36.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.687+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fcc01c630 con 0x7f1fd00fca80 2024-03-22T07:28:36.688 INFO:tasks.workunit.client.0.smithi134.stdout:2/370: creat d2/d5/d22/d52/d3c/d4f/d62/f73 x:0 0 0 2024-03-22T07:28:36.691 INFO:tasks.workunit.client.0.smithi134.stdout:3/391: creat d4/d10/d6c/f84 x:0 0 0 2024-03-22T07:28:36.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.690+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd005f5f0 con 0x7f1fd00fca80 2024-03-22T07:28:36.692 INFO:tasks.workunit.client.1.smithi195.stdout:9/766: write d2/d4/d6/d18/f36 [2654168,115244] 0 2024-03-22T07:28:36.693 INFO:tasks.workunit.client.1.smithi195.stdout:9/767: write d2/d4/f9f [831445,47716] 0 2024-03-22T07:28:36.695 INFO:tasks.workunit.client.1.smithi195.stdout:2/593: creat d2/fc4 x:0 0 0 2024-03-22T07:28:36.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.694+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) v1 ==== 45715+0+0 (secure 0 0 0) 0x7f1fcc00bbf0 con 0x7f1fd00fca80 2024-03-22T07:28:36.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.694+0000 7f1fc1ffb700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f1fbc0385d0 0x7f1fbc03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:36.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.694+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1fcc04d5b0 con 0x7f1fd00fca80 2024-03-22T07:28:36.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.696+0000 7f1fd5303700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f1fbc0385d0 0x7f1fbc03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:36.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.699+0000 7f1fd5303700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f1fbc0385d0 0x7f1fbc03aa80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1fc401afd0 tx=0x7f1fc4009040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:36.702 INFO:tasks.workunit.client.0.smithi134.stdout:2/371: dread d2/f1c [0,4194304] 0 2024-03-22T07:28:36.703 INFO:tasks.workunit.client.1.smithi195.stdout:4/608: link d13/d2a/fbd d13/d2a/d7e/d8c/fcf 0 2024-03-22T07:28:36.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:36.702+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1fcc013420 con 0x7f1fd00fca80 2024-03-22T07:28:36.704 INFO:tasks.workunit.client.0.smithi134.stdout:1/421: creat d5/d93/f94 x:0 0 0 2024-03-22T07:28:36.705 INFO:tasks.workunit.client.1.smithi195.stdout:0/621: stat d1/d4/dd/lb3 0 2024-03-22T07:28:36.705 INFO:tasks.workunit.client.0.smithi134.stdout:1/422: dread d5/da/d68/f6b [0,4194304] 0 2024-03-22T07:28:36.707 INFO:tasks.workunit.client.0.smithi134.stdout:3/392: rmdir d4/d8/d45/d77 0 2024-03-22T07:28:36.707 INFO:tasks.workunit.client.0.smithi134.stdout:3/393: dread - d4/d22/d29/d50/f63 zero size 2024-03-22T07:28:36.707 INFO:tasks.workunit.client.0.smithi134.stdout:3/394: read d4/d22/d29/d50/f6f [1023194,97588] 0 2024-03-22T07:28:36.709 INFO:tasks.workunit.client.0.smithi134.stdout:2/372: symlink d2/d5/d22/d52/d3c/d4f/l74 0 2024-03-22T07:28:36.710 INFO:tasks.workunit.client.1.smithi195.stdout:6/548: dread d5/d6d/f7b [0,4194304] 0 2024-03-22T07:28:36.711 INFO:tasks.workunit.client.0.smithi134.stdout:1/423: rename d5/da/d1b/d27/d39/f69 to d5/d1d/d49/f95 0 2024-03-22T07:28:36.713 INFO:tasks.workunit.client.1.smithi195.stdout:7/611: mknod d0/cd2 0 2024-03-22T07:28:36.713 INFO:tasks.workunit.client.1.smithi195.stdout:7/612: creat d0/d13/d14/d80/fd3 x:0 0 0 2024-03-22T07:28:36.713 INFO:tasks.workunit.client.1.smithi195.stdout:7/613: dread - d0/d13/d14/d2b/fce zero size 2024-03-22T07:28:36.715 INFO:tasks.workunit.client.0.smithi134.stdout:4/451: dwrite d2/fd [0,4194304] 0 2024-03-22T07:28:36.715 INFO:tasks.workunit.client.0.smithi134.stdout:4/452: write d2/d1d/f90 [686599,10416] 0 2024-03-22T07:28:36.715 INFO:tasks.workunit.client.0.smithi134.stdout:4/453: chown d2/d15/d35/d37/d76/d9a 37629 1 2024-03-22T07:28:36.715 INFO:tasks.workunit.client.0.smithi134.stdout:4/454: readlink d2/d1d/l20 0 2024-03-22T07:28:36.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/394: dwrite d1/d8/d3f/d75/f76 [0,4194304] 0 2024-03-22T07:28:36.716 INFO:tasks.workunit.client.0.smithi134.stdout:5/395: write d1/d8/d16/f74 [523852,24712] 0 2024-03-22T07:28:36.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/672: creat da/d17/d32/d61/fcb x:0 0 0 2024-03-22T07:28:36.716 INFO:tasks.workunit.client.1.smithi195.stdout:8/673: stat da/dc/l55 0 2024-03-22T07:28:36.716 INFO:tasks.workunit.client.1.smithi195.stdout:3/597: dwrite d3/fab [0,4194304] 0 2024-03-22T07:28:36.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/373: write d2/d5/d8/d5d/f66 [4898005,46401] 0 2024-03-22T07:28:36.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/374: truncate d2/f3a 418738 0 2024-03-22T07:28:36.719 INFO:tasks.workunit.client.1.smithi195.stdout:1/508: dwrite d0/f26 [4194304,4194304] 0 2024-03-22T07:28:36.722 INFO:tasks.workunit.client.1.smithi195.stdout:3/598: dread d3/df/f4a [0,4194304] 0 2024-03-22T07:28:36.722 INFO:tasks.workunit.client.1.smithi195.stdout:3/599: stat d3/df/d15/d1d/d5c/f44 0 2024-03-22T07:28:36.724 INFO:tasks.workunit.client.1.smithi195.stdout:9/768: rename d2/d4/f1a to d2/d4/d1d/d9b/f111 0 2024-03-22T07:28:36.724 INFO:tasks.workunit.client.1.smithi195.stdout:9/769: write d2/d4/d6/f49 [2252398,85394] 0 2024-03-22T07:28:36.724 INFO:tasks.workunit.client.1.smithi195.stdout:2/594: mknod d2/d3/d21/d60/cc5 0 2024-03-22T07:28:36.724 INFO:tasks.workunit.client.1.smithi195.stdout:2/595: truncate d2/d3/d24/f39 2206384 0 2024-03-22T07:28:36.724 INFO:tasks.workunit.client.1.smithi195.stdout:4/609: dwrite f9 [0,4194304] 0 2024-03-22T07:28:36.727 INFO:tasks.workunit.client.1.smithi195.stdout:0/622: rmdir d1/d4/d83 39 2024-03-22T07:28:36.727 INFO:tasks.workunit.client.0.smithi134.stdout:1/424: dread d5/da/d13/d1e/d45/f7f [4194304,4194304] 0 2024-03-22T07:28:36.734 INFO:tasks.workunit.client.1.smithi195.stdout:6/549: unlink d5/d5e/d34/d55/d3b/d6e/d3c/f3d 0 2024-03-22T07:28:36.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/674: dread da/de/f5b [0,4194304] 0 2024-03-22T07:28:36.734 INFO:tasks.workunit.client.1.smithi195.stdout:8/675: chown da/dc/da4 221552 1 2024-03-22T07:28:36.735 INFO:tasks.workunit.client.1.smithi195.stdout:2/596: dread d2/d3/d7/d5c/f6c [0,4194304] 0 2024-03-22T07:28:36.742 INFO:tasks.workunit.client.0.smithi134.stdout:4/455: dread d2/d15/d35/f63 [0,4194304] 0 2024-03-22T07:28:36.742 INFO:tasks.workunit.client.0.smithi134.stdout:4/456: fdatasync d2/d1d/f24 0 2024-03-22T07:28:36.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/425: creat d5/da/d1b/f96 x:0 0 0 2024-03-22T07:28:36.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/426: write d5/da/f26 [4392176,93900] 0 2024-03-22T07:28:36.751 INFO:tasks.workunit.client.0.smithi134.stdout:2/375: dwrite d2/f4c [0,4194304] 0 2024-03-22T07:28:36.753 INFO:tasks.workunit.client.1.smithi195.stdout:1/509: mknod d0/d2/d27/ca1 0 2024-03-22T07:28:36.756 INFO:tasks.workunit.client.0.smithi134.stdout:4/457: rmdir d2/d15/d35/d37/d76 39 2024-03-22T07:28:36.756 INFO:tasks.workunit.client.0.smithi134.stdout:4/458: fsync d2/d15/f30 0 2024-03-22T07:28:36.756 INFO:tasks.workunit.client.0.smithi134.stdout:1/427: dread d5/da/f21 [0,4194304] 0 2024-03-22T07:28:36.759 INFO:tasks.workunit.client.1.smithi195.stdout:3/600: mknod d3/df/d15/d1d/d5c/d47/d67/d93/da2/cc8 0 2024-03-22T07:28:36.760 INFO:tasks.workunit.client.1.smithi195.stdout:9/770: mkdir d2/d4/d6/dd1/d112 0 2024-03-22T07:28:36.761 INFO:tasks.workunit.client.1.smithi195.stdout:4/610: rmdir d13 39 2024-03-22T07:28:36.761 INFO:tasks.workunit.client.1.smithi195.stdout:4/611: fsync d13/d63/d36/d5f/d83/fba 0 2024-03-22T07:28:36.762 INFO:tasks.workunit.client.0.smithi134.stdout:3/395: dwrite d4/d22/d29/f30 [0,4194304] 0 2024-03-22T07:28:36.768 INFO:tasks.workunit.client.0.smithi134.stdout:5/396: dwrite d1/d8/d20/f70 [0,4194304] 0 2024-03-22T07:28:36.769 INFO:tasks.workunit.client.0.smithi134.stdout:1/428: read d5/da/d13/d1e/f22 [3557878,33300] 0 2024-03-22T07:28:36.769 INFO:tasks.workunit.client.0.smithi134.stdout:1/429: dread - d5/d1d/d49/f88 zero size 2024-03-22T07:28:36.770 INFO:tasks.workunit.client.1.smithi195.stdout:5/660: truncate d9/d22/f2b 1050294 0 2024-03-22T07:28:36.770 INFO:tasks.workunit.client.1.smithi195.stdout:0/623: rmdir d1 39 2024-03-22T07:28:36.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/459: dread d2/f46 [0,4194304] 0 2024-03-22T07:28:36.776 INFO:tasks.workunit.client.0.smithi134.stdout:4/460: fsync d2/d15/f13 0 2024-03-22T07:28:36.776 INFO:tasks.workunit.client.1.smithi195.stdout:6/550: symlink d5/d5e/d34/d55/d4b/da2/dad/lc5 0 2024-03-22T07:28:36.779 INFO:tasks.workunit.client.1.smithi195.stdout:5/661: write d9/d7f/f81 [2883277,61314] 0 2024-03-22T07:28:36.780 INFO:tasks.workunit.client.1.smithi195.stdout:6/551: dread d5/d5e/d34/d55/d4b/da2/d1a/f71 [0,4194304] 0 2024-03-22T07:28:36.780 INFO:tasks.workunit.client.1.smithi195.stdout:8/676: symlink da/d17/d32/d61/d88/dc9/lcc 0 2024-03-22T07:28:36.782 INFO:tasks.workunit.client.1.smithi195.stdout:0/624: dread d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:36.782 INFO:tasks.workunit.client.1.smithi195.stdout:2/597: symlink d2/d3/d7/da/lc6 0 2024-03-22T07:28:36.784 INFO:tasks.workunit.client.1.smithi195.stdout:1/510: truncate d0/d2/d6/f4b 1250054 0 2024-03-22T07:28:36.784 INFO:tasks.workunit.client.1.smithi195.stdout:1/511: readlink d0/l2b 0 2024-03-22T07:28:36.785 INFO:tasks.workunit.client.1.smithi195.stdout:1/512: chown d0/d70/d97/d39/d64/d7a/f57 3 1 2024-03-22T07:28:36.792 INFO:tasks.workunit.client.0.smithi134.stdout:3/396: link d4/d10/d6c/f78 d4/d8/d5c/f85 0 2024-03-22T07:28:36.792 INFO:tasks.workunit.client.0.smithi134.stdout:5/397: dwrite d1/d8/d20/d62/d68/f7c [0,4194304] 0 2024-03-22T07:28:36.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/598: write d2/d1e/f64 [701162,31545] 0 2024-03-22T07:28:36.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/599: chown d2/d3/d1a/l75 17331 1 2024-03-22T07:28:36.793 INFO:tasks.workunit.client.1.smithi195.stdout:2/600: write d2/d3/d21/d4c/fb2 [1428661,102435] 0 2024-03-22T07:28:36.794 INFO:tasks.workunit.client.0.smithi134.stdout:2/376: getdents d2/d5/d22/d52/d3c/d60 0 2024-03-22T07:28:36.794 INFO:tasks.workunit.client.0.smithi134.stdout:2/377: readlink d2/d5/d54/l6a 0 2024-03-22T07:28:36.794 INFO:tasks.workunit.client.0.smithi134.stdout:4/461: dwrite d2/d15/f11 [0,4194304] 0 2024-03-22T07:28:36.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/430: creat d5/da/d13/d1e/d63/f97 x:0 0 0 2024-03-22T07:28:36.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/431: write d5/da/d1b/f1c [1465842,64221] 0 2024-03-22T07:28:36.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/432: creat d5/da/d13/f98 x:0 0 0 2024-03-22T07:28:36.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/433: fsync d5/da/d1b/f1f 0 2024-03-22T07:28:36.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/434: chown d5/l7 1 1 2024-03-22T07:28:36.798 INFO:tasks.workunit.client.0.smithi134.stdout:3/397: rmdir d4/d22/d3c 39 2024-03-22T07:28:36.801 INFO:tasks.workunit.client.1.smithi195.stdout:8/677: dwrite da/de/fbb [0,4194304] 0 2024-03-22T07:28:36.801 INFO:tasks.workunit.client.1.smithi195.stdout:8/678: fdatasync da/d82/dc6/f93 0 2024-03-22T07:28:36.803 INFO:tasks.workunit.client.0.smithi134.stdout:5/398: symlink d1/d4/d5f/l87 0 2024-03-22T07:28:36.803 INFO:tasks.workunit.client.0.smithi134.stdout:5/399: fsync d1/d8/f66 0 2024-03-22T07:28:36.805 INFO:tasks.workunit.client.0.smithi134.stdout:2/378: mkdir d2/d5/d8/d5d/d5f/d75 0 2024-03-22T07:28:36.805 INFO:tasks.workunit.client.0.smithi134.stdout:2/379: chown d2/d5/d22/d52/d3c/f69 2430 1 2024-03-22T07:28:36.810 INFO:tasks.workunit.client.1.smithi195.stdout:3/601: creat d3/d18/d89/d70/db5/fc9 x:0 0 0 2024-03-22T07:28:36.810 INFO:tasks.workunit.client.0.smithi134.stdout:4/462: dwrite d2/d2a/d80/f9c [0,4194304] 0 2024-03-22T07:28:36.813 INFO:tasks.workunit.client.1.smithi195.stdout:9/771: truncate d2/d4/d32/d6d/deb/ff6 2877510 0 2024-03-22T07:28:36.813 INFO:tasks.workunit.client.1.smithi195.stdout:9/772: write d2/d4/d32/f3a [969192,14772] 0 2024-03-22T07:28:36.813 INFO:tasks.workunit.client.1.smithi195.stdout:9/773: chown d2/d4/d32/c101 0 1 2024-03-22T07:28:36.813 INFO:tasks.workunit.client.0.smithi134.stdout:1/435: symlink d5/d1d/d49/d92/l99 0 2024-03-22T07:28:36.814 INFO:tasks.workunit.client.1.smithi195.stdout:4/612: mkdir d13/d15/d6b/dd0 0 2024-03-22T07:28:36.818 INFO:tasks.workunit.client.0.smithi134.stdout:3/398: unlink d4/d10/c37 0 2024-03-22T07:28:36.818 INFO:tasks.workunit.client.0.smithi134.stdout:3/399: creat d4/d10/d6c/f86 x:0 0 0 2024-03-22T07:28:36.818 INFO:tasks.workunit.client.0.smithi134.stdout:3/400: chown d4/d22/d29/d82 1651 1 2024-03-22T07:28:36.819 INFO:tasks.workunit.client.0.smithi134.stdout:3/401: write d4/d8/d5c/f85 [421605,10866] 0 2024-03-22T07:28:36.819 INFO:tasks.workunit.client.0.smithi134.stdout:5/400: dread - d1/d8/d20/d62/d65/f77 zero size 2024-03-22T07:28:36.819 INFO:tasks.workunit.client.0.smithi134.stdout:5/401: fdatasync d1/d4/f1a 0 2024-03-22T07:28:36.819 INFO:tasks.workunit.client.0.smithi134.stdout:0/422: sync 2024-03-22T07:28:36.819 INFO:tasks.workunit.client.0.smithi134.stdout:7/569: sync 2024-03-22T07:28:36.819 INFO:tasks.workunit.client.0.smithi134.stdout:7/570: fsync d1/de/d11/d48/f3c 0 2024-03-22T07:28:36.820 INFO:tasks.workunit.client.1.smithi195.stdout:5/662: mknod d9/d22/cd7 0 2024-03-22T07:28:36.820 INFO:tasks.workunit.client.1.smithi195.stdout:5/663: creat d9/da8/fd8 x:0 0 0 2024-03-22T07:28:36.820 INFO:tasks.workunit.client.1.smithi195.stdout:5/664: readlink d9/d12/d1d/d36/d7d/l83 0 2024-03-22T07:28:36.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/463: write d2/d2a/d80/f9c [2178169,62519] 0 2024-03-22T07:28:36.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/380: creat d2/d5/d22/d52/f76 x:0 0 0 2024-03-22T07:28:36.824 INFO:tasks.workunit.client.1.smithi195.stdout:6/552: rename d5/d5e/l61 to d5/d5e/d34/d55/lc6 0 2024-03-22T07:28:36.824 INFO:tasks.workunit.client.1.smithi195.stdout:6/553: chown d5/d5e/d34/d55/ca9 262106 1 2024-03-22T07:28:36.824 INFO:tasks.workunit.client.1.smithi195.stdout:6/554: getdents d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba 0 2024-03-22T07:28:36.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/602: dwrite d3/df/d15/d1d/d5c/d47/f66 [0,4194304] 0 2024-03-22T07:28:36.827 INFO:tasks.workunit.client.1.smithi195.stdout:1/513: creat d0/d70/d97/d41/d47/d4a/fa2 x:0 0 0 2024-03-22T07:28:36.828 INFO:tasks.workunit.client.1.smithi195.stdout:1/514: write d0/d2/d9/d2a/f80 [1095952,101771] 0 2024-03-22T07:28:36.830 INFO:tasks.workunit.client.1.smithi195.stdout:2/601: creat d2/d3/db/fc7 x:0 0 0 2024-03-22T07:28:36.831 INFO:tasks.workunit.client.0.smithi134.stdout:3/402: dread d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:36.834 INFO:tasks.workunit.client.0.smithi134.stdout:5/402: dread d1/d8/d16/f59 [4194304,4194304] 0 2024-03-22T07:28:36.836 INFO:tasks.workunit.client.1.smithi195.stdout:1/515: dread d0/d70/d97/d39/f68 [4194304,4194304] 0 2024-03-22T07:28:36.837 INFO:tasks.workunit.client.0.smithi134.stdout:2/381: dwrite d2/f3a [0,4194304] 0 2024-03-22T07:28:36.837 INFO:tasks.workunit.client.0.smithi134.stdout:4/464: read d2/d25/d48/f4b [2337710,8158] 0 2024-03-22T07:28:36.837 INFO:tasks.workunit.client.0.smithi134.stdout:4/465: write d2/d25/d48/d6e/d7b/f8e [618397,105163] 0 2024-03-22T07:28:36.837 INFO:tasks.workunit.client.0.smithi134.stdout:4/466: write d2/d15/d35/f78 [462337,37276] 0 2024-03-22T07:28:36.837 INFO:tasks.workunit.client.0.smithi134.stdout:4/467: chown d2/d25/c44 17 1 2024-03-22T07:28:36.838 INFO:tasks.workunit.client.0.smithi134.stdout:1/436: mknod d5/d1d/d2d/c9a 0 2024-03-22T07:28:36.838 INFO:tasks.workunit.client.1.smithi195.stdout:1/516: dread d0/d2/d9/d2a/f86 [0,4194304] 0 2024-03-22T07:28:36.840 INFO:tasks.workunit.client.1.smithi195.stdout:8/679: mknod da/d82/dc6/d53/d8d/ccd 0 2024-03-22T07:28:36.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/423: mknod dc/de/d55/d60/c7e 0 2024-03-22T07:28:36.842 INFO:tasks.workunit.client.0.smithi134.stdout:0/424: creat dc/d17/f7f x:0 0 0 2024-03-22T07:28:36.845 INFO:tasks.workunit.client.0.smithi134.stdout:7/571: rename d1/de/d11/d2b/fab to d1/d19/fb8 0 2024-03-22T07:28:36.847 INFO:tasks.workunit.client.0.smithi134.stdout:3/403: mknod d4/d22/d3c/c87 0 2024-03-22T07:28:36.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/665: getdents d9 0 2024-03-22T07:28:36.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/666: fdatasync d9/d12/d14/f4b 0 2024-03-22T07:28:36.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/667: fdatasync d9/f25 0 2024-03-22T07:28:36.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/668: chown d9/d12/d1d/d69/d78/c43 9590 1 2024-03-22T07:28:36.851 INFO:tasks.workunit.client.1.smithi195.stdout:5/669: truncate d9/d12/d1d/d36/fa6 4403771 0 2024-03-22T07:28:36.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/403: mknod d1/d8/d16/c88 0 2024-03-22T07:28:36.853 INFO:tasks.workunit.client.0.smithi134.stdout:6/320: sync 2024-03-22T07:28:36.853 INFO:tasks.workunit.client.0.smithi134.stdout:6/321: write d2/d1b/d4d/f54 [385958,70278] 0 2024-03-22T07:28:36.855 INFO:tasks.workunit.client.0.smithi134.stdout:1/437: dwrite d5/d1d/f90 [0,4194304] 0 2024-03-22T07:28:36.855 INFO:tasks.workunit.client.0.smithi134.stdout:5/404: dread d1/d8/d20/d62/d65/f53 [0,4194304] 0 2024-03-22T07:28:36.855 INFO:tasks.workunit.client.0.smithi134.stdout:5/405: creat d1/d8/d20/d62/f89 x:0 0 0 2024-03-22T07:28:36.856 INFO:tasks.workunit.client.1.smithi195.stdout:6/555: creat d5/d5e/d34/d55/dab/dbf/fc7 x:0 0 0 2024-03-22T07:28:36.856 INFO:tasks.workunit.client.1.smithi195.stdout:6/556: chown d5/d5e/d34/d55/d4b/da2/d1a/f54 50009 1 2024-03-22T07:28:36.858 INFO:tasks.workunit.client.1.smithi195.stdout:3/603: mknod d3/dbf/da0/cca 0 2024-03-22T07:28:36.860 INFO:tasks.workunit.client.0.smithi134.stdout:2/382: mknod d2/c77 0 2024-03-22T07:28:36.860 INFO:tasks.workunit.client.0.smithi134.stdout:2/383: stat d2/d5/d22/d52/c2e 0 2024-03-22T07:28:36.860 INFO:tasks.workunit.client.0.smithi134.stdout:2/384: stat d2/d5/d8/d31/l43 0 2024-03-22T07:28:36.861 INFO:tasks.workunit.client.1.smithi195.stdout:2/602: creat d2/d3/d7/da/d1b/d98/fc8 x:0 0 0 2024-03-22T07:28:36.862 INFO:tasks.workunit.client.1.smithi195.stdout:7/614: sync 2024-03-22T07:28:36.863 INFO:tasks.workunit.client.0.smithi134.stdout:9/351: sync 2024-03-22T07:28:36.865 INFO:tasks.workunit.client.1.smithi195.stdout:9/774: mkdir d2/d4/d113 0 2024-03-22T07:28:36.868 INFO:tasks.workunit.client.1.smithi195.stdout:5/670: link d9/d2d/d58/l6d d9/d73/dbb/ld9 0 2024-03-22T07:28:36.869 INFO:tasks.workunit.client.0.smithi134.stdout:0/425: symlink dc/de/d55/l80 0 2024-03-22T07:28:36.870 INFO:tasks.workunit.client.0.smithi134.stdout:0/426: stat dc 0 2024-03-22T07:28:36.872 INFO:tasks.workunit.client.0.smithi134.stdout:7/572: mknod d1/dae/cb9 0 2024-03-22T07:28:36.872 INFO:tasks.workunit.client.0.smithi134.stdout:7/573: fsync d1/d40/f51 0 2024-03-22T07:28:36.872 INFO:tasks.workunit.client.0.smithi134.stdout:7/574: chown d1/de/d41/d87/d8f/f9d 26430 1 2024-03-22T07:28:36.874 INFO:tasks.workunit.client.1.smithi195.stdout:6/557: dwrite d5/d16/d45/d53/d59/d87/fb6 [0,4194304] 0 2024-03-22T07:28:36.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/468: rename d2/d15/l2b to d2/d15/d35/d37/d76/d9a/l9d 0 2024-03-22T07:28:36.878 INFO:tasks.workunit.client.0.smithi134.stdout:3/404: mkdir d4/d22/d3c/d88 0 2024-03-22T07:28:36.880 INFO:tasks.workunit.client.0.smithi134.stdout:7/575: dread d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:36.880 INFO:tasks.workunit.client.0.smithi134.stdout:3/405: read d4/d8/d5c/f85 [47032,39981] 0 2024-03-22T07:28:36.882 INFO:tasks.workunit.client.0.smithi134.stdout:6/322: link d2/f43 d2/d1b/d4d/d65/d73/f79 0 2024-03-22T07:28:36.883 INFO:tasks.workunit.client.1.smithi195.stdout:7/615: unlink d0/d13/d14/d29/d35/d6d/f93 0 2024-03-22T07:28:36.886 INFO:tasks.workunit.client.1.smithi195.stdout:7/616: dread d0/d13/f73 [0,4194304] 0 2024-03-22T07:28:36.886 INFO:tasks.workunit.client.1.smithi195.stdout:7/617: dread - d0/d13/d14/d80/d9c/fbb zero size 2024-03-22T07:28:36.886 INFO:tasks.workunit.client.1.smithi195.stdout:0/625: rename d1/d4/d42 to d1/d10/d1f/d40/d47/db6 0 2024-03-22T07:28:36.888 INFO:tasks.workunit.client.0.smithi134.stdout:1/438: mkdir d5/da/d13/d1e/d9b 0 2024-03-22T07:28:36.888 INFO:tasks.workunit.client.0.smithi134.stdout:1/439: truncate d5/da/d13/f51 8409562 0 2024-03-22T07:28:36.889 INFO:tasks.workunit.client.1.smithi195.stdout:6/558: mknod d5/d5e/d34/d55/d3b/d6e/d56/d8f/cc8 0 2024-03-22T07:28:36.893 INFO:tasks.workunit.client.1.smithi195.stdout:3/604: mknod d3/d18/ccb 0 2024-03-22T07:28:36.896 INFO:tasks.workunit.client.0.smithi134.stdout:5/406: chown d1/d8/d20/d62/d65/c6a 1161 1 2024-03-22T07:28:36.896 INFO:tasks.workunit.client.1.smithi195.stdout:2/603: rmdir d2/d3/d7/da/d18 39 2024-03-22T07:28:36.899 INFO:tasks.workunit.client.1.smithi195.stdout:0/626: dread d1/d10/d1f/f21 [0,4194304] 0 2024-03-22T07:28:36.899 INFO:tasks.workunit.client.1.smithi195.stdout:0/627: chown d1/d4/dd/df/d6b/f81 139 1 2024-03-22T07:28:36.900 INFO:tasks.workunit.client.1.smithi195.stdout:9/775: symlink d2/d4/d6/d18/d50/l114 0 2024-03-22T07:28:36.904 INFO:tasks.workunit.client.1.smithi195.stdout:7/618: creat d0/d98/dab/fd4 x:0 0 0 2024-03-22T07:28:36.905 INFO:tasks.workunit.client.0.smithi134.stdout:1/440: dwrite d5/d93/f94 [0,4194304] 0 2024-03-22T07:28:36.907 INFO:tasks.workunit.client.1.smithi195.stdout:4/613: rename f12 to d13/d15/d6b/da6/db3/fd1 0 2024-03-22T07:28:36.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/559: mknod d5/d5e/d34/d55/d3b/d7f/db4/cc9 0 2024-03-22T07:28:36.909 INFO:tasks.workunit.client.1.smithi195.stdout:6/560: dread - d5/d16/d45/d53/d59/d87/f9f zero size 2024-03-22T07:28:36.909 INFO:tasks.workunit.client.0.smithi134.stdout:5/407: write d1/d8/d16/f40 [1320873,72721] 0 2024-03-22T07:28:36.910 INFO:tasks.workunit.client.1.smithi195.stdout:2/604: mkdir d2/d3/d7/d19/d22/dc9 0 2024-03-22T07:28:36.911 INFO:tasks.workunit.client.0.smithi134.stdout:2/385: symlink d2/d5/d8/d31/l78 0 2024-03-22T07:28:36.913 INFO:tasks.workunit.client.1.smithi195.stdout:0/628: truncate d1/d4/dd/df/f3e 4148861 0 2024-03-22T07:28:36.917 INFO:tasks.workunit.client.1.smithi195.stdout:9/776: getdents d2/d4/d6/d18 0 2024-03-22T07:28:36.917 INFO:tasks.workunit.client.0.smithi134.stdout:0/427: link dc/d17/f78 dc/de/d55/d65/f81 0 2024-03-22T07:28:36.917 INFO:tasks.workunit.client.0.smithi134.stdout:9/352: creat d3/d9/f7c x:0 0 0 2024-03-22T07:28:36.917 INFO:tasks.workunit.client.0.smithi134.stdout:9/353: fdatasync d3/d9/df/d57/d67/f6c 0 2024-03-22T07:28:36.918 INFO:tasks.workunit.client.0.smithi134.stdout:0/428: write dc/f29 [170940,130155] 0 2024-03-22T07:28:36.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/354: dread d3/d9/d37/d6f/f5d [0,4194304] 0 2024-03-22T07:28:36.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/355: chown d3/d9/d37/d6f/d54/f68 7 1 2024-03-22T07:28:36.919 INFO:tasks.workunit.client.1.smithi195.stdout:1/517: rename d0/d2/d27/l69 to d0/d70/d97/d41/d47/la3 0 2024-03-22T07:28:36.920 INFO:tasks.workunit.client.0.smithi134.stdout:5/408: dread d1/d8/d3f/d75/f76 [0,4194304] 0 2024-03-22T07:28:36.921 INFO:tasks.workunit.client.0.smithi134.stdout:4/469: rename d2/d15/d35/d37/d76/d9a/l9d to d2/d15/d66/l9e 0 2024-03-22T07:28:36.923 INFO:tasks.workunit.client.1.smithi195.stdout:4/614: mkdir d13/d2a/d7e/d8c/dd2 0 2024-03-22T07:28:36.928 INFO:tasks.workunit.client.0.smithi134.stdout:3/406: unlink d4/d22/d29/f46 0 2024-03-22T07:28:36.930 INFO:tasks.workunit.client.0.smithi134.stdout:9/356: dread d3/d9/df/f26 [0,4194304] 0 2024-03-22T07:28:36.930 INFO:tasks.workunit.client.1.smithi195.stdout:2/605: mkdir d2/d3/d21/dca 0 2024-03-22T07:28:36.931 INFO:tasks.workunit.client.0.smithi134.stdout:7/576: mknod d1/d19/d32/cba 0 2024-03-22T07:28:36.932 INFO:tasks.workunit.client.0.smithi134.stdout:7/577: write d1/de/d11/d2b/d69/f8c [923474,42014] 0 2024-03-22T07:28:36.932 INFO:tasks.workunit.client.1.smithi195.stdout:0/629: getdents d1/d10/d19/d20 0 2024-03-22T07:28:36.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/680: rename da/d17/d32/d7d/f85 to da/d17/d32/d78/fce 0 2024-03-22T07:28:36.935 INFO:tasks.workunit.client.1.smithi195.stdout:8/681: write da/d82/dc6/d53/f96 [4758232,93341] 0 2024-03-22T07:28:36.936 INFO:tasks.workunit.client.0.smithi134.stdout:6/323: link d2/d1b/d1d/d5e/c71 d2/c7a 0 2024-03-22T07:28:36.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/518: mkdir d0/d2/d9/da4 0 2024-03-22T07:28:36.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/519: creat d0/d70/d97/d39/d64/d7a/fa5 x:0 0 0 2024-03-22T07:28:36.939 INFO:tasks.workunit.client.1.smithi195.stdout:0/630: write d1/d4/dd/df/d44/f50 [2098938,13961] 0 2024-03-22T07:28:36.939 INFO:tasks.workunit.client.1.smithi195.stdout:0/631: write d1/d10/d1f/f64 [3504050,55901] 0 2024-03-22T07:28:36.939 INFO:tasks.workunit.client.1.smithi195.stdout:0/632: chown d1/d10/d1f/d40/d47/c92 41397 1 2024-03-22T07:28:36.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/606: link d2/d3/d7/ca3 d2/d3/db/db3/ccb 0 2024-03-22T07:28:36.941 INFO:tasks.workunit.client.1.smithi195.stdout:2/607: write d2/d3/d7/da/d18/fbc [894730,36016] 0 2024-03-22T07:28:36.941 INFO:tasks.workunit.client.0.smithi134.stdout:8/532: sync 2024-03-22T07:28:36.942 INFO:tasks.workunit.client.1.smithi195.stdout:9/777: dwrite d2/d4/d6/db/f6c [0,4194304] 0 2024-03-22T07:28:36.942 INFO:tasks.workunit.client.1.smithi195.stdout:9/778: chown d2/d4/d32/ce7 26142408 1 2024-03-22T07:28:36.945 INFO:tasks.workunit.client.1.smithi195.stdout:5/671: rename d9/f96 to d9/d73/dbb/fda 0 2024-03-22T07:28:36.945 INFO:tasks.workunit.client.1.smithi195.stdout:5/672: read - d9/da8/fd8 zero size 2024-03-22T07:28:36.947 INFO:tasks.workunit.client.1.smithi195.stdout:6/561: dwrite d5/d5e/d34/d55/f3e [0,4194304] 0 2024-03-22T07:28:36.948 INFO:tasks.workunit.client.0.smithi134.stdout:2/386: creat d2/d5/f79 x:0 0 0 2024-03-22T07:28:36.950 INFO:tasks.workunit.client.1.smithi195.stdout:7/619: dwrite d0/d13/d14/d20/d40/d82/da0/d59/f5f [0,4194304] 0 2024-03-22T07:28:36.950 INFO:tasks.workunit.client.0.smithi134.stdout:1/441: dwrite d5/da/d13/f98 [0,4194304] 0 2024-03-22T07:28:36.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/470: dwrite d2/d15/f30 [0,4194304] 0 2024-03-22T07:28:36.950 INFO:tasks.workunit.client.0.smithi134.stdout:4/471: write d2/d2a/d80/f9c [857669,95947] 0 2024-03-22T07:28:36.950 INFO:tasks.workunit.client.0.smithi134.stdout:0/429: mkdir dc/de/d55/d65/d82 0 2024-03-22T07:28:36.951 INFO:tasks.workunit.client.0.smithi134.stdout:0/430: read dc/d18/f44 [929811,70948] 0 2024-03-22T07:28:36.953 INFO:tasks.workunit.client.1.smithi195.stdout:8/682: symlink da/d17/d32/lcf 0 2024-03-22T07:28:36.958 INFO:tasks.workunit.client.0.smithi134.stdout:8/533: dwrite d1/d15/d42/d49/f5f [0,4194304] 0 2024-03-22T07:28:36.958 INFO:tasks.workunit.client.0.smithi134.stdout:8/534: fsync d1/f24 0 2024-03-22T07:28:36.959 INFO:tasks.workunit.client.0.smithi134.stdout:3/407: link d4/d8/d23/l2f d4/d8/d69/d6a/l89 0 2024-03-22T07:28:36.960 INFO:tasks.workunit.client.0.smithi134.stdout:3/408: fdatasync d4/d22/d29/f2e 0 2024-03-22T07:28:36.960 INFO:tasks.workunit.client.0.smithi134.stdout:3/409: write d4/d22/f25 [992769,99551] 0 2024-03-22T07:28:36.962 INFO:tasks.workunit.client.1.smithi195.stdout:8/683: write da/f6b [2134340,115714] 0 2024-03-22T07:28:36.963 INFO:tasks.workunit.client.1.smithi195.stdout:1/520: symlink d0/d70/d6a/la6 0 2024-03-22T07:28:36.965 INFO:tasks.workunit.client.0.smithi134.stdout:0/431: dread dc/f29 [0,4194304] 0 2024-03-22T07:28:36.965 INFO:tasks.workunit.client.0.smithi134.stdout:9/357: unlink d3/d9/d37/d3c/f46 0 2024-03-22T07:28:36.966 INFO:tasks.workunit.client.0.smithi134.stdout:9/358: fdatasync d3/d9/df/f61 0 2024-03-22T07:28:36.969 INFO:tasks.workunit.client.1.smithi195.stdout:4/615: getdents d13/d63/d3e 0 2024-03-22T07:28:36.974 INFO:tasks.workunit.client.0.smithi134.stdout:7/578: symlink d1/da8/lbb 0 2024-03-22T07:28:36.974 INFO:tasks.workunit.client.1.smithi195.stdout:7/620: dwrite d0/d13/d22/d57/d7b/d8c/f92 [4194304,4194304] 0 2024-03-22T07:28:36.977 INFO:tasks.workunit.client.0.smithi134.stdout:8/535: dwrite d1/d4/d61/d85/f8d [0,4194304] 0 2024-03-22T07:28:36.978 INFO:tasks.workunit.client.0.smithi134.stdout:2/387: mknod d2/d5/d22/d52/d3c/d60/c7a 0 2024-03-22T07:28:36.979 INFO:tasks.workunit.client.1.smithi195.stdout:7/621: write d0/d13/f46 [2163559,76037] 0 2024-03-22T07:28:36.979 INFO:tasks.workunit.client.1.smithi195.stdout:7/622: creat d0/d13/d14/d80/fd5 x:0 0 0 2024-03-22T07:28:36.981 INFO:tasks.workunit.client.1.smithi195.stdout:0/633: creat d1/d10/d19/d20/fb7 x:0 0 0 2024-03-22T07:28:36.984 INFO:tasks.workunit.client.1.smithi195.stdout:2/608: creat d2/d3/db/fcc x:0 0 0 2024-03-22T07:28:36.985 INFO:tasks.workunit.client.0.smithi134.stdout:1/442: mknod d5/d1d/c9c 0 2024-03-22T07:28:36.991 INFO:tasks.workunit.client.0.smithi134.stdout:0/432: dwrite dc/d18/f1d [4194304,4194304] 0 2024-03-22T07:28:36.992 INFO:tasks.workunit.client.1.smithi195.stdout:9/779: mknod d2/d4/d1d/ddc/c115 0 2024-03-22T07:28:36.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/472: link d2/d15/l29 d2/d25/d48/d6e/l9f 0 2024-03-22T07:28:36.997 INFO:tasks.workunit.client.1.smithi195.stdout:3/605: rename d3/df/f4a to d3/df/d15/fcc 0 2024-03-22T07:28:36.999 INFO:tasks.workunit.client.0.smithi134.stdout:2/388: dwrite d2/d5/d22/f23 [0,4194304] 0 2024-03-22T07:28:37.001 INFO:tasks.workunit.client.0.smithi134.stdout:3/410: creat d4/d22/d3c/f8a x:0 0 0 2024-03-22T07:28:37.001 INFO:tasks.workunit.client.0.smithi134.stdout:3/411: write d4/d10/f33 [887023,63392] 0 2024-03-22T07:28:37.003 INFO:tasks.workunit.client.1.smithi195.stdout:2/609: dwrite d2/d3/d7/d19/d22/d26/f4b [0,4194304] 0 2024-03-22T07:28:37.004 INFO:tasks.workunit.client.0.smithi134.stdout:7/579: mkdir d1/de/d11/d48/dbc 0 2024-03-22T07:28:37.006 INFO:tasks.workunit.client.0.smithi134.stdout:7/580: dread d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:37.006 INFO:tasks.workunit.client.0.smithi134.stdout:4/473: dread d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:37.009 INFO:tasks.workunit.client.1.smithi195.stdout:8/684: mknod da/d17/d32/d61/cd0 0 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/685: stat da/d17/l37 0 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/686: fdatasync da/d82/dc6/f87 0 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/687: readlink da/d17/d32/d61/l75 0 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/688: creat da/d17/d32/d61/d88/d91/fd1 x:0 0 0 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.1.smithi195.stdout:8/689: chown da/c69 1578 1 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/536: mkdir d1/d46/db0 0 2024-03-22T07:28:37.010 INFO:tasks.workunit.client.0.smithi134.stdout:8/537: write d1/d15/d57/d79/f9f [4966624,106337] 0 2024-03-22T07:28:37.011 INFO:tasks.workunit.client.1.smithi195.stdout:1/521: symlink d0/d2/d9/d2a/la7 0 2024-03-22T07:28:37.011 INFO:tasks.workunit.client.1.smithi195.stdout:1/522: write d0/d70/f77 [930115,30978] 0 2024-03-22T07:28:37.015 INFO:tasks.workunit.client.1.smithi195.stdout:4/616: rmdir d13/d2a/d7e/d85/dc9 0 2024-03-22T07:28:37.016 INFO:tasks.workunit.client.0.smithi134.stdout:6/324: getdents d2/d1b/d1d/d5e 0 2024-03-22T07:28:37.020 INFO:tasks.workunit.client.0.smithi134.stdout:8/538: dread d1/d15/d42/d12/d20/f70 [0,4194304] 0 2024-03-22T07:28:37.026 INFO:tasks.workunit.client.0.smithi134.stdout:5/409: rename d1/d8/d3f to d1/d8/d20/d8a 0 2024-03-22T07:28:37.026 INFO:tasks.workunit.client.1.smithi195.stdout:7/623: link d0/d13/d14/c72 d0/d13/d14/d20/cd6 0 2024-03-22T07:28:37.026 INFO:tasks.workunit.client.1.smithi195.stdout:9/780: creat d2/d4/d32/d6d/d78/d107/f116 x:0 0 0 2024-03-22T07:28:37.028 INFO:tasks.workunit.client.1.smithi195.stdout:6/562: rename d5/d5e/d34/d55/d4b/da2/f21 to d5/d5e/d34/d55/d3b/d7f/fca 0 2024-03-22T07:28:37.029 INFO:tasks.workunit.client.1.smithi195.stdout:3/606: getdents d3/df/d15/d1d/d5c/d47/d67/d80/db8 0 2024-03-22T07:28:37.031 INFO:tasks.workunit.client.0.smithi134.stdout:7/581: dwrite d1/de/d11/f16 [4194304,4194304] 0 2024-03-22T07:28:37.032 INFO:tasks.workunit.client.0.smithi134.stdout:8/539: unlink d1/d4/d61/f87 0 2024-03-22T07:28:37.035 INFO:tasks.workunit.client.1.smithi195.stdout:1/523: creat d0/d70/d6a/fa8 x:0 0 0 2024-03-22T07:28:37.036 INFO:tasks.workunit.client.0.smithi134.stdout:6/325: link d2/d3f/c37 d2/d1b/d1d/d2b/c7b 0 2024-03-22T07:28:37.036 INFO:tasks.workunit.client.0.smithi134.stdout:6/326: chown d2/f35 307345 1 2024-03-22T07:28:37.036 INFO:tasks.workunit.client.0.smithi134.stdout:6/327: readlink d2/d6e/l78 0 2024-03-22T07:28:37.036 INFO:tasks.workunit.client.0.smithi134.stdout:6/328: fdatasync d2/d1b/d1d/d2b/f53 0 2024-03-22T07:28:37.037 INFO:tasks.workunit.client.1.smithi195.stdout:4/617: stat d13/d2a/d7e/d85/lcc 0 2024-03-22T07:28:37.037 INFO:tasks.workunit.client.0.smithi134.stdout:5/410: read d1/d8/d16/f59 [2374015,110904] 0 2024-03-22T07:28:37.038 INFO:tasks.workunit.client.1.smithi195.stdout:8/690: dwrite da/d17/fc5 [0,4194304] 0 2024-03-22T07:28:37.038 INFO:tasks.workunit.client.1.smithi195.stdout:9/781: creat d2/d4/d6/db5/de3/f117 x:0 0 0 2024-03-22T07:28:37.040 INFO:tasks.workunit.client.0.smithi134.stdout:7/582: rmdir d1/d19/d9c/db0 0 2024-03-22T07:28:37.040 INFO:tasks.workunit.client.0.smithi134.stdout:7/583: fsync d1/de/d11/fb2 0 2024-03-22T07:28:37.042 INFO:tasks.workunit.client.1.smithi195.stdout:7/624: dwrite d0/d13/d14/d29/d35/f60 [0,4194304] 0 2024-03-22T07:28:37.042 INFO:tasks.workunit.client.0.smithi134.stdout:1/443: rename d5/da/d1b/d27/d60/d72/d7c to d5/da/d13/d1e/d63/d9d 0 2024-03-22T07:28:37.042 INFO:tasks.workunit.client.0.smithi134.stdout:1/444: creat d5/d1d/d49/f9e x:0 0 0 2024-03-22T07:28:37.043 INFO:tasks.workunit.client.1.smithi195.stdout:0/634: rename d1/d10/d19/d20/c5a to d1/d4/dd/cb8 0 2024-03-22T07:28:37.045 INFO:tasks.workunit.client.1.smithi195.stdout:6/563: rmdir d5/d5e/d34/d55/d4b/da2/d1a 39 2024-03-22T07:28:37.045 INFO:tasks.workunit.client.1.smithi195.stdout:6/564: dread - d5/d5e/d34/d55/d4b/da2/fb3 zero size 2024-03-22T07:28:37.045 INFO:tasks.workunit.client.1.smithi195.stdout:6/565: read - d5/d5e/d34/d55/d4b/da2/d4a/f8c zero size 2024-03-22T07:28:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: [22/Mar/2024:07:28:35] ENGINE Bus STARTING 2024-03-22T07:28:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: [22/Mar/2024:07:28:35] ENGINE Serving on https://172.21.15.195:7150 2024-03-22T07:28:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: [22/Mar/2024:07:28:35] ENGINE Serving on http://172.21.15.195:8765 2024-03-22T07:28:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: [22/Mar/2024:07:28:35] ENGINE Bus STARTED 2024-03-22T07:28:37.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-03-22T07:28:37.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: mgrmap e23: smithi195.jxfsnc(active, since 2s) 2024-03-22T07:28:37.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:36 smithi134 ceph-mon[29057]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:37.046 INFO:tasks.workunit.client.0.smithi134.stdout:5/411: mknod d1/d8/d20/d62/c8b 0 2024-03-22T07:28:37.047 INFO:tasks.workunit.client.1.smithi195.stdout:3/607: creat d3/d18/fcd x:0 0 0 2024-03-22T07:28:37.047 INFO:tasks.workunit.client.1.smithi195.stdout:3/608: truncate d3/df/d15/d1d/d5c/f6c 209485 0 2024-03-22T07:28:37.048 INFO:tasks.workunit.client.0.smithi134.stdout:7/584: creat d1/de/d11/d97/fbd x:0 0 0 2024-03-22T07:28:37.049 INFO:tasks.workunit.client.1.smithi195.stdout:3/609: dread d3/df/d15/d1d/d5c/f53 [0,4194304] 0 2024-03-22T07:28:37.051 INFO:tasks.workunit.client.1.smithi195.stdout:3/610: dread d3/df/d15/d1d/d5c/d47/d67/f8d [0,4194304] 0 2024-03-22T07:28:37.051 INFO:tasks.workunit.client.1.smithi195.stdout:3/611: chown d3/d18/f26 255 1 2024-03-22T07:28:37.051 INFO:tasks.workunit.client.1.smithi195.stdout:3/612: stat d3/d22/f8a 0 2024-03-22T07:28:37.053 INFO:tasks.workunit.client.0.smithi134.stdout:4/474: rename d2/d15/f1e to d2/d25/d48/d87/fa0 0 2024-03-22T07:28:37.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.055+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fd010d740 con 0x7f1fbc0385d0 2024-03-22T07:28:37.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/618: unlink d13/d15/d6b/l9a 0 2024-03-22T07:28:37.058 INFO:tasks.workunit.client.1.smithi195.stdout:4/619: chown d13/f9c 6771 1 2024-03-22T07:28:37.058 INFO:tasks.workunit.client.1.smithi195.stdout:3/613: read d3/df/d15/d1d/d5c/d47/f66 [2353935,42118] 0 2024-03-22T07:28:37.058 INFO:tasks.workunit.client.1.smithi195.stdout:5/673: truncate d9/d12/d1d/d36/f49 2801854 0 2024-03-22T07:28:37.059 INFO:tasks.workunit.client.0.smithi134.stdout:1/445: creat d5/da/d13/d1e/d9b/f9f x:0 0 0 2024-03-22T07:28:37.061 INFO:tasks.workunit.client.0.smithi134.stdout:6/329: mknod d2/d1b/d1d/d2b/c7c 0 2024-03-22T07:28:37.066 INFO:tasks.workunit.client.0.smithi134.stdout:7/585: mknod d1/d19/d9c/db3/cbe 0 2024-03-22T07:28:37.067 INFO:tasks.workunit.client.1.smithi195.stdout:6/566: dwrite d5/f3a [0,4194304] 0 2024-03-22T07:28:37.067 INFO:tasks.workunit.client.1.smithi195.stdout:6/567: truncate d5/f51 1892192 0 2024-03-22T07:28:37.067 INFO:tasks.workunit.client.1.smithi195.stdout:6/568: chown d5/d16/d45/d53/d59/c96 20 1 2024-03-22T07:28:37.067 INFO:tasks.workunit.client.1.smithi195.stdout:8/691: symlink da/ld2 0 2024-03-22T07:28:37.069 INFO:tasks.workunit.client.1.smithi195.stdout:6/569: dread d5/d5e/d34/d55/d4b/da2/d1a/f4d [0,4194304] 0 2024-03-22T07:28:37.070 INFO:tasks.workunit.client.0.smithi134.stdout:1/446: dread d5/f9 [0,4194304] 0 2024-03-22T07:28:37.070 INFO:tasks.workunit.client.0.smithi134.stdout:1/447: creat d5/da/d13/d1e/d45/fa0 x:0 0 0 2024-03-22T07:28:37.070 INFO:tasks.workunit.client.1.smithi195.stdout:9/782: mknod d2/d4/d6/db/d20/d47/c118 0 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.072+0000 7f1fc1ffb700 1 -- 172.21.15.134:0/1320280623 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f1fd010d740 con 0x7f1fbc0385d0 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 2m ago 7m 25.0M - 0.25.0 c8568f914cd2 0ce3f68acd2f 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (8m) 2m ago 8m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (7m) 12s ago 7m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 2m ago 7m 85.2M - 9.4.7 954c08fa6188 8cd534e3bc25 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (2m) 2m ago 2m 15.7M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (2m) 2m ago 2m 10.4M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (2m) 12s ago 2m 12.7M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (2m) 12s ago 2m 11.7M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:28:37.073 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (25s) 12s ago 7m 106M - 19.0.0-1667-gdb0330b1 4f325f8440e9 06db0bc1a216 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (9m) 2m ago 9m 46.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (6m) 12s ago 6m 33.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 2m ago 8m 15.4M - 1.5.0 0da6a335fe13 645fc1dfbabe 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 12s ago 7m 16.6M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 2m ago 6m 46.4M 4288M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 2m ago 5m 46.2M 4288M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 2m ago 5m 44.1M 4288M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (4m) 12s ago 4m 123M 5312M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (4m) 12s ago 4m 110M 5312M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (4m) 12s ago 4m 106M 5312M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:28:37.074 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 2m ago 7m 52.4M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f1fbc0385d0 msgr2=0x7f1fbc03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f1fbc0385d0 0x7f1fbc03aa80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1fc401afd0 tx=0x7f1fc4009040 comp rx=0 tx=0).stop 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 msgr2=0x7f1fd010bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd010bd40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00b970 tx=0x7f1fcc009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 shutdown_connections 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fd00fc130 0x7f1fd010b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f1fbc0385d0 0x7f1fbc03aa80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 --2- 172.21.15.134:0/1320280623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd00fca80 0x7f1fd010bd40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.074+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 >> 172.21.15.134:0/1320280623 conn(0x7f1fd00f6ba0 msgr2=0x7f1fd00f82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.075+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 shutdown_connections 2024-03-22T07:28:37.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.075+0000 7f1fd7567700 1 -- 172.21.15.134:0/1320280623 wait complete. 2024-03-22T07:28:37.077 INFO:tasks.workunit.client.1.smithi195.stdout:5/674: dwrite d9/d2d/d58/f93 [0,4194304] 0 2024-03-22T07:28:37.077 INFO:tasks.workunit.client.1.smithi195.stdout:5/675: dread d9/d2d/f51 [0,4194304] 0 2024-03-22T07:28:37.077 INFO:tasks.workunit.client.1.smithi195.stdout:5/676: stat d9/d2d/d8f 0 2024-03-22T07:28:37.079 INFO:tasks.workunit.client.0.smithi134.stdout:7/586: mkdir d1/de/d11/d48/daf/dbf 0 2024-03-22T07:28:37.081 INFO:tasks.workunit.client.1.smithi195.stdout:7/625: mkdir d0/d98/dab/dd7 0 2024-03-22T07:28:37.086 INFO:tasks.workunit.client.0.smithi134.stdout:1/448: mkdir d5/da/d68/da1 0 2024-03-22T07:28:37.086 INFO:tasks.workunit.client.0.smithi134.stdout:1/449: read - d5/da/d1b/d27/f80 zero size 2024-03-22T07:28:37.087 INFO:tasks.workunit.client.1.smithi195.stdout:0/635: symlink d1/d4/dd/d66/d80/lb9 0 2024-03-22T07:28:37.091 INFO:tasks.workunit.client.1.smithi195.stdout:1/524: dwrite d0/d2/d6/f62 [0,4194304] 0 2024-03-22T07:28:37.091 INFO:tasks.workunit.client.1.smithi195.stdout:1/525: read d0/d70/d97/d39/f65 [892435,41193] 0 2024-03-22T07:28:37.091 INFO:tasks.workunit.client.1.smithi195.stdout:1/526: write d0/d70/d97/d41/d47/d4a/f4c [1420288,24989] 0 2024-03-22T07:28:37.091 INFO:tasks.workunit.client.1.smithi195.stdout:1/527: chown d0/d2/d9/da4 0 1 2024-03-22T07:28:37.091 INFO:tasks.workunit.client.1.smithi195.stdout:3/614: unlink d3/d22/l5f 0 2024-03-22T07:28:37.092 INFO:tasks.workunit.client.0.smithi134.stdout:7/587: truncate d1/de/d11/d48/f65 899405 0 2024-03-22T07:28:37.093 INFO:tasks.workunit.client.0.smithi134.stdout:7/588: creat d1/de/d11/d2b/d31/fc0 x:0 0 0 2024-03-22T07:28:37.094 INFO:tasks.workunit.client.0.smithi134.stdout:7/589: write d1/de/d11/d2b/d31/f8a [821174,107961] 0 2024-03-22T07:28:37.094 INFO:tasks.workunit.client.0.smithi134.stdout:7/590: truncate d1/de/d11/d2b/d31/f83 653424 0 2024-03-22T07:28:37.096 INFO:tasks.workunit.client.0.smithi134.stdout:1/450: creat d5/da/d13/d1e/d67/fa2 x:0 0 0 2024-03-22T07:28:37.103 INFO:tasks.workunit.client.0.smithi134.stdout:8/540: rename d1/d15/d42/d44 to d1/d15/d42/d76/d8f/dad/db1 0 2024-03-22T07:28:37.103 INFO:tasks.workunit.client.0.smithi134.stdout:8/541: creat d1/d15/d42/d76/fb2 x:0 0 0 2024-03-22T07:28:37.104 INFO:tasks.workunit.client.1.smithi195.stdout:8/692: mkdir da/de/db3/dc7/dd3 0 2024-03-22T07:28:37.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/570: mkdir d5/d5e/d34/d55/dcb 0 2024-03-22T07:28:37.113 INFO:tasks.workunit.client.1.smithi195.stdout:9/783: rename d2/d4/d32/d6d/d78/d107/f116 to d2/d4/d32/d6d/d78/d107/f119 0 2024-03-22T07:28:37.117 INFO:tasks.workunit.client.0.smithi134.stdout:1/451: link d5/da/d1b/f36 d5/da/d68/da1/fa3 0 2024-03-22T07:28:37.117 INFO:tasks.workunit.client.1.smithi195.stdout:8/693: write da/f4f [3091942,90102] 0 2024-03-22T07:28:37.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/542: dread d1/d4/f22 [0,4194304] 0 2024-03-22T07:28:37.119 INFO:tasks.workunit.client.0.smithi134.stdout:7/591: dwrite d1/d40/fa2 [0,4194304] 0 2024-03-22T07:28:37.121 INFO:tasks.workunit.client.0.smithi134.stdout:5/412: rename d1/d8/d16/c3c to d1/d4/d5f/c8c 0 2024-03-22T07:28:37.125 INFO:tasks.workunit.client.1.smithi195.stdout:5/677: creat d9/d22/d7b/fdb x:0 0 0 2024-03-22T07:28:37.126 INFO:tasks.workunit.client.0.smithi134.stdout:1/452: dread f3 [0,4194304] 0 2024-03-22T07:28:37.126 INFO:tasks.workunit.client.0.smithi134.stdout:1/453: stat d5/da/d68/da1 0 2024-03-22T07:28:37.129 INFO:tasks.workunit.client.1.smithi195.stdout:7/626: symlink d0/d13/d14/d20/d40/d82/da6/dc8/ld8 0 2024-03-22T07:28:37.129 INFO:tasks.workunit.client.1.smithi195.stdout:7/627: chown d0/d13/d14/d29/d35/d3a/f5d 2539 1 2024-03-22T07:28:37.129 INFO:tasks.workunit.client.1.smithi195.stdout:7/628: write d0/d13/d14/d2b/fc5 [76681,10678] 0 2024-03-22T07:28:37.131 INFO:tasks.workunit.client.1.smithi195.stdout:2/610: rename d2/d3/d7/d19/d22/d26/d3c/f47 to d2/fcd 0 2024-03-22T07:28:37.132 INFO:tasks.workunit.client.0.smithi134.stdout:7/592: dread d1/de/d11/f16 [0,4194304] 0 2024-03-22T07:28:37.132 INFO:tasks.workunit.client.0.smithi134.stdout:7/593: chown d1/de/d11/d2b/d31/c5c 59792 1 2024-03-22T07:28:37.132 INFO:tasks.workunit.client.0.smithi134.stdout:7/594: read - d1/de/d11/d48/f8b zero size 2024-03-22T07:28:37.132 INFO:tasks.workunit.client.0.smithi134.stdout:5/413: write d1/d8/d20/f3e [669935,91523] 0 2024-03-22T07:28:37.133 INFO:tasks.workunit.client.1.smithi195.stdout:0/636: creat d1/d4/dd/df/d44/d8d/fba x:0 0 0 2024-03-22T07:28:37.133 INFO:tasks.workunit.client.1.smithi195.stdout:0/637: fdatasync d1/d4/dd/d66/d80/f6a 0 2024-03-22T07:28:37.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/629: write d0/f71 [4915886,32356] 0 2024-03-22T07:28:37.138 INFO:tasks.workunit.client.1.smithi195.stdout:3/615: unlink d3/df/d15/d1d/d5c/d47/d67/d80/f78 0 2024-03-22T07:28:37.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/611: dread d2/d3/d7/d19/f33 [0,4194304] 0 2024-03-22T07:28:37.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/612: write d2/d3/d7/d19/d22/fa9 [1277469,1913] 0 2024-03-22T07:28:37.141 INFO:tasks.workunit.client.1.smithi195.stdout:2/613: fsync d2/d3/d21/d4c/fb2 0 2024-03-22T07:28:37.143 INFO:tasks.workunit.client.0.smithi134.stdout:7/595: write d1/de/f5a [4102902,111082] 0 2024-03-22T07:28:37.143 INFO:tasks.workunit.client.0.smithi134.stdout:7/596: truncate d1/f33 2815337 0 2024-03-22T07:28:37.143 INFO:tasks.workunit.client.1.smithi195.stdout:0/638: write d1/d10/d1f/d40/d47/f84 [2347419,24146] 0 2024-03-22T07:28:37.148 INFO:tasks.workunit.client.0.smithi134.stdout:8/543: creat d1/d4/d38/fb3 x:0 0 0 2024-03-22T07:28:37.150 INFO:tasks.workunit.client.0.smithi134.stdout:4/475: rename d2/d1d/f54 to d2/fa1 0 2024-03-22T07:28:37.151 INFO:tasks.workunit.client.0.smithi134.stdout:4/476: fsync d2/d98/f99 0 2024-03-22T07:28:37.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/597: dread d1/de/d11/f6a [0,4194304] 0 2024-03-22T07:28:37.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/598: dread - d1/de/d11/d2b/d69/fa0 zero size 2024-03-22T07:28:37.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/599: stat d1/de/d11/d48/d52/d46/la3 0 2024-03-22T07:28:37.153 INFO:tasks.workunit.client.0.smithi134.stdout:1/454: mkdir d5/da/d1b/d27/d39/da4 0 2024-03-22T07:28:37.153 INFO:tasks.workunit.client.0.smithi134.stdout:1/455: fsync d5/da/d13/d1e/d34/f3e 0 2024-03-22T07:28:37.154 INFO:tasks.workunit.client.1.smithi195.stdout:8/694: symlink da/d82/dc6/d53/d8d/ld4 0 2024-03-22T07:28:37.155 INFO:tasks.workunit.client.0.smithi134.stdout:8/544: write d1/d4/f47 [3626101,53047] 0 2024-03-22T07:28:37.156 INFO:tasks.workunit.client.0.smithi134.stdout:1/456: dread d5/da/d1b/f1c [0,4194304] 0 2024-03-22T07:28:37.158 INFO:tasks.workunit.client.1.smithi195.stdout:5/678: unlink d9/d2d/d84/f9d 0 2024-03-22T07:28:37.159 INFO:tasks.workunit.client.1.smithi195.stdout:5/679: chown d9/d2d/l74 68826825 1 2024-03-22T07:28:37.159 INFO:tasks.workunit.client.1.smithi195.stdout:5/680: creat d9/d7f/fdc x:0 0 0 2024-03-22T07:28:37.159 INFO:tasks.workunit.client.0.smithi134.stdout:5/414: stat d1/c29 0 2024-03-22T07:28:37.159 INFO:tasks.workunit.client.0.smithi134.stdout:4/477: dread d2/d15/d35/d37/d76/f7c [0,4194304] 0 2024-03-22T07:28:37.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/620: rename d13/f73 to d13/d63/d3e/d5c/d65/fd3 0 2024-03-22T07:28:37.162 INFO:tasks.workunit.client.1.smithi195.stdout:4/621: stat d13/d15/d6b/dd0 0 2024-03-22T07:28:37.164 INFO:tasks.workunit.client.0.smithi134.stdout:6/330: rename d2/d1b/d1d/d2b to d2/d1b/d1d/d5e/d6f/d7d 0 2024-03-22T07:28:37.166 INFO:tasks.workunit.client.0.smithi134.stdout:7/600: mkdir d1/de/d11/d48/dbc/dc1 0 2024-03-22T07:28:37.168 INFO:tasks.workunit.client.1.smithi195.stdout:7/630: creat d0/d13/d14/d20/d40/d82/da0/fd9 x:0 0 0 2024-03-22T07:28:37.168 INFO:tasks.workunit.client.1.smithi195.stdout:7/631: chown d0/d13/d14/l6c 5931858 1 2024-03-22T07:28:37.170 INFO:tasks.workunit.client.0.smithi134.stdout:8/545: mkdir d1/d46/d75/d8b/db4 0 2024-03-22T07:28:37.172 INFO:tasks.workunit.client.1.smithi195.stdout:3/616: creat d3/df/fce x:0 0 0 2024-03-22T07:28:37.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/457: creat d5/d1d/d49/d92/fa5 x:0 0 0 2024-03-22T07:28:37.178 INFO:tasks.workunit.client.1.smithi195.stdout:2/614: creat d2/d3/d7/da/d18/fce x:0 0 0 2024-03-22T07:28:37.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/617: read d3/d18/d89/f90 [1284751,38192] 0 2024-03-22T07:28:37.179 INFO:tasks.workunit.client.0.smithi134.stdout:5/415: symlink d1/d8/d20/l8d 0 2024-03-22T07:28:37.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/615: dread d2/d3/d1a/f3a [0,4194304] 0 2024-03-22T07:28:37.181 INFO:tasks.workunit.client.0.smithi134.stdout:4/478: truncate f1 228573 0 2024-03-22T07:28:37.183 INFO:tasks.workunit.client.0.smithi134.stdout:6/331: link d2/d1b/d4d/f54 d2/d3f/d28/f7e 0 2024-03-22T07:28:37.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/332: stat d2 0 2024-03-22T07:28:37.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/333: chown d2/d1b/f2f 1005785515 1 2024-03-22T07:28:37.187 INFO:tasks.workunit.client.0.smithi134.stdout:4/479: write d2/d15/d35/d37/d76/f7c [1677800,78995] 0 2024-03-22T07:28:37.188 INFO:tasks.workunit.client.0.smithi134.stdout:7/601: creat d1/de/d11/d48/d52/d46/fc2 x:0 0 0 2024-03-22T07:28:37.188 INFO:tasks.workunit.client.0.smithi134.stdout:8/546: dwrite d1/d15/d42/f2b [4194304,4194304] 0 2024-03-22T07:28:37.189 INFO:tasks.workunit.client.0.smithi134.stdout:7/602: dread d1/d40/f7f [4194304,4194304] 0 2024-03-22T07:28:37.191 INFO:tasks.workunit.client.0.smithi134.stdout:1/458: symlink d5/da/d1b/d27/d39/la6 0 2024-03-22T07:28:37.191 INFO:tasks.workunit.client.0.smithi134.stdout:1/459: creat d5/d1d/d2d/fa7 x:0 0 0 2024-03-22T07:28:37.194 INFO:tasks.workunit.client.0.smithi134.stdout:5/416: rename d1/d8/d16/f4d to d1/d8/d20/d62/f8e 0 2024-03-22T07:28:37.194 INFO:tasks.workunit.client.0.smithi134.stdout:5/417: truncate d1/d8/d20/f5c 567570 0 2024-03-22T07:28:37.200 INFO:tasks.workunit.client.0.smithi134.stdout:4/480: creat d2/d25/d48/d87/fa2 x:0 0 0 2024-03-22T07:28:37.202 INFO:tasks.workunit.client.1.smithi195.stdout:8/695: symlink da/d17/d32/ld5 0 2024-03-22T07:28:37.202 INFO:tasks.workunit.client.1.smithi195.stdout:8/696: truncate da/dc/d71/fc1 792455 0 2024-03-22T07:28:37.202 INFO:tasks.workunit.client.1.smithi195.stdout:8/697: fdatasync da/de/f5b 0 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: [22/Mar/2024:07:28:35] ENGINE Bus STARTING 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: [22/Mar/2024:07:28:35] ENGINE Serving on https://172.21.15.195:7150 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: [22/Mar/2024:07:28:35] ENGINE Serving on http://172.21.15.195:8765 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: [22/Mar/2024:07:28:35] ENGINE Bus STARTED 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: pgmap v4: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: mgrmap e23: smithi195.jxfsnc(active, since 2s) 2024-03-22T07:28:37.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:36 smithi195 ceph-mon[36144]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:37.206 INFO:tasks.workunit.client.1.smithi195.stdout:5/681: creat d9/d12/d1d/d69/fdd x:0 0 0 2024-03-22T07:28:37.206 INFO:tasks.workunit.client.0.smithi134.stdout:7/603: truncate d1/de/d11/d48/f6b 2867258 0 2024-03-22T07:28:37.206 INFO:tasks.workunit.client.0.smithi134.stdout:6/334: dwrite d2/d1b/d4d/d65/d73/f79 [0,4194304] 0 2024-03-22T07:28:37.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/528: rename d0/d2/d6/f42 to d0/d70/d97/d39/fa9 0 2024-03-22T07:28:37.209 INFO:tasks.workunit.client.1.smithi195.stdout:1/529: chown d0/d2/l23 66 1 2024-03-22T07:28:37.211 INFO:tasks.workunit.client.1.smithi195.stdout:4/622: symlink d13/d15/d6b/ld4 0 2024-03-22T07:28:37.212 INFO:tasks.workunit.client.0.smithi134.stdout:1/460: getdents d5/da/d13/d1e/d34 0 2024-03-22T07:28:37.214 INFO:tasks.workunit.client.1.smithi195.stdout:7/632: mknod d0/d13/d14/d20/d40/d82/da0/d59/cda 0 2024-03-22T07:28:37.216 INFO:tasks.workunit.client.0.smithi134.stdout:5/418: creat d1/d8/d83/f8f x:0 0 0 2024-03-22T07:28:37.217 INFO:tasks.workunit.client.1.smithi195.stdout:3/618: creat d3/df/d50/fcf x:0 0 0 2024-03-22T07:28:37.218 INFO:tasks.workunit.client.1.smithi195.stdout:5/682: dwrite f0 [0,4194304] 0 2024-03-22T07:28:37.219 INFO:tasks.workunit.client.0.smithi134.stdout:4/481: rename d2/d15/f51 to d2/d2a/d50/fa3 0 2024-03-22T07:28:37.220 INFO:tasks.workunit.client.1.smithi195.stdout:8/698: mkdir da/d82/dc6/d53/d8d/dd6 0 2024-03-22T07:28:37.221 INFO:tasks.workunit.client.1.smithi195.stdout:8/699: read da/de/f2d [1135834,38521] 0 2024-03-22T07:28:37.221 INFO:tasks.workunit.client.0.smithi134.stdout:1/461: dread d5/da/d13/f98 [0,4194304] 0 2024-03-22T07:28:37.221 INFO:tasks.workunit.client.0.smithi134.stdout:8/547: symlink d1/d15/d42/lb5 0 2024-03-22T07:28:37.224 INFO:tasks.workunit.client.1.smithi195.stdout:9/784: rename d2/d4/c103 to d2/d4/d6/db/d20/d47/c11a 0 2024-03-22T07:28:37.226 INFO:tasks.workunit.client.0.smithi134.stdout:5/419: truncate d1/d8/d20/d62/d65/f64 520627 0 2024-03-22T07:28:37.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.226+0000 7f8ed9444700 1 -- 172.21.15.134:0/872267031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 msgr2=0x7f8ed40fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.228 INFO:tasks.workunit.client.1.smithi195.stdout:4/623: link d13/d63/d79/d68/fc2 d13/d63/d36/fd5 0 2024-03-22T07:28:37.229 INFO:tasks.workunit.client.1.smithi195.stdout:4/624: stat d13/d63/d79/d68/fc2 0 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.226+0000 7f8ed9444700 1 --2- 172.21.15.134:0/872267031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed40fd710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4004940 tx=0x7f8ec4009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.226+0000 7f8ed9444700 1 -- 172.21.15.134:0/872267031 shutdown_connections 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.226+0000 7f8ed9444700 1 --2- 172.21.15.134:0/872267031 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ed40fdc50 0x7f8ed40fc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.226+0000 7f8ed9444700 1 --2- 172.21.15.134:0/872267031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed40fd710 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.226+0000 7f8ed9444700 1 -- 172.21.15.134:0/872267031 >> 172.21.15.134:0/872267031 conn(0x7f8ed40f6be0 msgr2=0x7f8ed40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.227+0000 7f8ed9444700 1 -- 172.21.15.134:0/872267031 shutdown_connections 2024-03-22T07:28:37.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.227+0000 7f8ed9444700 1 -- 172.21.15.134:0/872267031 wait complete. 2024-03-22T07:28:37.230 INFO:tasks.workunit.client.1.smithi195.stdout:1/530: getdents d0/d70/d97/d39 0 2024-03-22T07:28:37.231 INFO:tasks.workunit.client.1.smithi195.stdout:1/531: fdatasync d0/d2/d9/d2a/f86 0 2024-03-22T07:28:37.231 INFO:tasks.workunit.client.1.smithi195.stdout:9/785: dread d2/d4/d32/d6d/deb/ff6 [0,4194304] 0 2024-03-22T07:28:37.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.228+0000 7f8ed9444700 1 Processor -- start 2024-03-22T07:28:37.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.228+0000 7f8ed9444700 1 -- start start 2024-03-22T07:28:37.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed9444700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:37.231 INFO:tasks.workunit.client.0.smithi134.stdout:6/335: dwrite d2/f4b [0,4194304] 0 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed9444700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ed40fdc50 0x7f8ed410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed410d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45884/0 (socket says 172.21.15.134:45884) 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed410e430 con 0x7f8ed40fd300 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed2ffd700 1 -- 172.21.15.134:0/2566203341 learned_addr learned my addr 172.21.15.134:0/2566203341 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.229+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed410e5a0 con 0x7f8ed40fdc50 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ed2ffd700 1 -- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ed40fdc50 msgr2=0x7f8ed410de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ed2ffd700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ed40fdc50 0x7f8ed410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ed2ffd700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4005040 con 0x7f8ed40fd300 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ed2ffd700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed410d8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4013870 tx=0x7f8ec4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec4021070 con 0x7f8ed40fd300 2024-03-22T07:28:37.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed4112fa0 con 0x7f8ed40fd300 2024-03-22T07:28:37.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.230+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed4113480 con 0x7f8ed40fd300 2024-03-22T07:28:37.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.231+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ec4026410 con 0x7f8ed40fd300 2024-03-22T07:28:37.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.231+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec400e070 con 0x7f8ed40fd300 2024-03-22T07:28:37.234 INFO:tasks.workunit.client.0.smithi134.stdout:4/482: mkdir d2/d25/d48/da4 0 2024-03-22T07:28:37.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.232+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec00052e0 con 0x7f8ed40fd300 2024-03-22T07:28:37.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/625: dread d13/f3a [0,4194304] 0 2024-03-22T07:28:37.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.234+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 23) v1 ==== 45715+0+0 (secure 0 0 0) 0x7f8ec4013af0 con 0x7f8ed40fd300 2024-03-22T07:28:37.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.234+0000 7f8ebb7fe700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8ebc0387a0 0x7f8ebc03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:37.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.234+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8ec404d720 con 0x7f8ed40fd300 2024-03-22T07:28:37.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.235+0000 7f8ed27fc700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8ebc0387a0 0x7f8ebc03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:37.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/548: write d1/d15/d42/d76/d8f/dad/db1/f3e [4135251,118189] 0 2024-03-22T07:28:37.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/549: dread - d1/d15/d57/f89 zero size 2024-03-22T07:28:37.238 INFO:tasks.workunit.client.0.smithi134.stdout:1/462: rename d5/d1d/d2d/c9a to d5/da/d13/d1e/d34/ca8 0 2024-03-22T07:28:37.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/619: mknod d3/df/d15/d1d/d5c/d47/dbb/cd0 0 2024-03-22T07:28:37.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/620: fsync d3/df/d15/d1d/d5c/f6c 0 2024-03-22T07:28:37.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/621: write d3/df/d15/d1d/d5c/f83 [304858,39998] 0 2024-03-22T07:28:37.240 INFO:tasks.workunit.client.0.smithi134.stdout:7/604: dread d1/de/d11/d48/f6b [0,4194304] 0 2024-03-22T07:28:37.240 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.239+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8ec401c640 con 0x7f8ed40fd300 2024-03-22T07:28:37.241 INFO:tasks.workunit.client.1.smithi195.stdout:4/626: dread d13/d2a/d7e/d8c/f9f [4194304,4194304] 0 2024-03-22T07:28:37.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.241+0000 7f8ed27fc700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8ebc0387a0 0x7f8ebc03ac50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4066240 tx=0x7f8ec800b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:37.246 INFO:tasks.workunit.client.0.smithi134.stdout:5/420: dwrite d1/d8/d20/f3b [0,4194304] 0 2024-03-22T07:28:37.249 INFO:tasks.workunit.client.1.smithi195.stdout:5/683: symlink d9/d73/dbb/lde 0 2024-03-22T07:28:37.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/616: rename d2/d3/d21/d60/d81/d9a/f44 to d2/d3/d7/d19/d22/d26/d99/dbf/fcf 0 2024-03-22T07:28:37.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/617: chown d2/d3/db/fc7 906608 1 2024-03-22T07:28:37.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/618: chown d2/d3/dac 4659 1 2024-03-22T07:28:37.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/619: creat d2/d3/db/d82/fd0 x:0 0 0 2024-03-22T07:28:37.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/620: write d2/d3/f74 [758987,36886] 0 2024-03-22T07:28:37.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/622: unlink d3/d22/l61 0 2024-03-22T07:28:37.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/627: mkdir d13/d2a/d7e/dd6 0 2024-03-22T07:28:37.259 INFO:tasks.workunit.client.1.smithi195.stdout:4/628: dread - d13/d63/d3e/f42 zero size 2024-03-22T07:28:37.262 INFO:tasks.workunit.client.0.smithi134.stdout:1/463: dwrite d5/da/d13/d1e/d63/f97 [0,4194304] 0 2024-03-22T07:28:37.262 INFO:tasks.workunit.client.0.smithi134.stdout:1/464: fdatasync d5/d1d/f75 0 2024-03-22T07:28:37.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/465: creat d5/d1d/fa9 x:0 0 0 2024-03-22T07:28:37.263 INFO:tasks.workunit.client.0.smithi134.stdout:8/550: dwrite d1/f2e [0,4194304] 0 2024-03-22T07:28:37.263 INFO:tasks.workunit.client.1.smithi195.stdout:5/684: mknod d9/d2d/d84/dcf/cdf 0 2024-03-22T07:28:37.263 INFO:tasks.workunit.client.1.smithi195.stdout:5/685: chown d9/d2d/d84/dcf/fc0 211432507 1 2024-03-22T07:28:37.263 INFO:tasks.workunit.client.1.smithi195.stdout:5/686: write d9/d12/d1d/d69/d78/d41/fbd [662869,67789] 0 2024-03-22T07:28:37.264 INFO:tasks.workunit.client.1.smithi195.stdout:6/571: sync 2024-03-22T07:28:37.265 INFO:tasks.workunit.client.0.smithi134.stdout:6/336: unlink d2/f2e 0 2024-03-22T07:28:37.265 INFO:tasks.workunit.client.0.smithi134.stdout:6/337: write d2/d1b/d1d/d5e/f70 [545912,93352] 0 2024-03-22T07:28:37.265 INFO:tasks.workunit.client.1.smithi195.stdout:6/572: dread d5/d5e/d34/d55/d3b/f50 [0,4194304] 0 2024-03-22T07:28:37.267 INFO:tasks.workunit.client.0.smithi134.stdout:9/359: sync 2024-03-22T07:28:37.268 INFO:tasks.workunit.client.1.smithi195.stdout:7/633: rename d0/d13/d22/l2c to d0/d13/d14/d5b/ldb 0 2024-03-22T07:28:37.271 INFO:tasks.workunit.client.0.smithi134.stdout:4/483: creat d2/d25/d48/fa5 x:0 0 0 2024-03-22T07:28:37.271 INFO:tasks.workunit.client.0.smithi134.stdout:4/484: write d2/d25/d48/d6e/d7b/f8e [1008903,47544] 0 2024-03-22T07:28:37.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/634: dread d0/d13/d14/d20/d40/d82/da0/f9f [0,4194304] 0 2024-03-22T07:28:37.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/635: readlink d0/d13/d14/l7f 0 2024-03-22T07:28:37.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/636: write d0/d13/d14/d20/d40/d82/da0/d59/f7c [1142670,22073] 0 2024-03-22T07:28:37.273 INFO:tasks.workunit.client.1.smithi195.stdout:7/637: chown d0/d13/d14/d2f/c5c 109 1 2024-03-22T07:28:37.273 INFO:tasks.workunit.client.1.smithi195.stdout:7/638: write d0/d13/d14/d29/d35/d6d/f7a [1277189,72883] 0 2024-03-22T07:28:37.274 INFO:tasks.workunit.client.0.smithi134.stdout:2/389: sync 2024-03-22T07:28:37.274 INFO:tasks.workunit.client.0.smithi134.stdout:3/412: sync 2024-03-22T07:28:37.276 INFO:tasks.workunit.client.1.smithi195.stdout:2/621: creat d2/d3/dac/dad/fd1 x:0 0 0 2024-03-22T07:28:37.276 INFO:tasks.workunit.client.1.smithi195.stdout:0/639: sync 2024-03-22T07:28:37.276 INFO:tasks.workunit.client.1.smithi195.stdout:2/622: fsync d2/d3/db/fcc 0 2024-03-22T07:28:37.276 INFO:tasks.workunit.client.1.smithi195.stdout:2/623: chown d2/d3/d7/da/d18/fce 14882107 1 2024-03-22T07:28:37.278 INFO:tasks.workunit.client.0.smithi134.stdout:7/605: link d1/d40/f9f d1/de/d11/d2b/d31/d85/fc3 0 2024-03-22T07:28:37.278 INFO:tasks.workunit.client.0.smithi134.stdout:7/606: write d1/de/d11/d48/fc [127045,9538] 0 2024-03-22T07:28:37.279 INFO:tasks.workunit.client.1.smithi195.stdout:1/532: symlink d0/d70/d97/laa 0 2024-03-22T07:28:37.280 INFO:tasks.workunit.client.0.smithi134.stdout:0/433: sync 2024-03-22T07:28:37.281 INFO:tasks.workunit.client.0.smithi134.stdout:4/485: dread d2/d15/f39 [0,4194304] 0 2024-03-22T07:28:37.281 INFO:tasks.workunit.client.0.smithi134.stdout:4/486: chown d2/d15/d35 4 1 2024-03-22T07:28:37.282 INFO:tasks.workunit.client.1.smithi195.stdout:3/623: mkdir d3/dbf/da0/dd1 0 2024-03-22T07:28:37.285 INFO:tasks.workunit.client.1.smithi195.stdout:4/629: symlink d13/d63/d79/ld7 0 2024-03-22T07:28:37.286 INFO:tasks.workunit.client.0.smithi134.stdout:5/421: mkdir d1/d90 0 2024-03-22T07:28:37.288 INFO:tasks.workunit.client.0.smithi134.stdout:6/338: dwrite d2/d1b/f29 [0,4194304] 0 2024-03-22T07:28:37.288 INFO:tasks.workunit.client.0.smithi134.stdout:6/339: stat d2/d3f/l49 0 2024-03-22T07:28:37.289 INFO:tasks.workunit.client.0.smithi134.stdout:6/340: write d2/d1b/d1d/d5e/d6f/d7d/f3a [1032925,121925] 0 2024-03-22T07:28:37.293 INFO:tasks.workunit.client.0.smithi134.stdout:1/466: creat d5/faa x:0 0 0 2024-03-22T07:28:37.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/467: creat d5/da/d1b/d27/fab x:0 0 0 2024-03-22T07:28:37.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/468: readlink d5/d1d/l25 0 2024-03-22T07:28:37.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/469: stat d5/d1d/d49/d92 0 2024-03-22T07:28:37.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/470: dread - d5/d1d/d49/f8a zero size 2024-03-22T07:28:37.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/471: dread - d5/da/d1b/f36 zero size 2024-03-22T07:28:37.294 INFO:tasks.workunit.client.1.smithi195.stdout:0/640: symlink d1/d4/dd/df/d44/lbb 0 2024-03-22T07:28:37.295 INFO:tasks.workunit.client.1.smithi195.stdout:2/624: getdents d2/d3/d7/d19/d22/d26 0 2024-03-22T07:28:37.297 INFO:tasks.workunit.client.1.smithi195.stdout:1/533: unlink d0/d2/l98 0 2024-03-22T07:28:37.299 INFO:tasks.workunit.client.0.smithi134.stdout:9/360: link d3/f25 d3/d9/df/f7d 0 2024-03-22T07:28:37.300 INFO:tasks.workunit.client.1.smithi195.stdout:3/624: creat d3/dbf/da0/dd1/fd2 x:0 0 0 2024-03-22T07:28:37.301 INFO:tasks.workunit.client.0.smithi134.stdout:3/413: symlink d4/d8/d69/d6a/l8b 0 2024-03-22T07:28:37.301 INFO:tasks.workunit.client.0.smithi134.stdout:3/414: write d4/d8/f13 [448183,105508] 0 2024-03-22T07:28:37.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/434: dwrite dc/d17/f77 [0,4194304] 0 2024-03-22T07:28:37.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/435: creat dc/d18/d72/f83 x:0 0 0 2024-03-22T07:28:37.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/436: dread - dc/de/f50 zero size 2024-03-22T07:28:37.303 INFO:tasks.workunit.client.1.smithi195.stdout:4/630: mknod d13/d63/d3e/d5c/cd8 0 2024-03-22T07:28:37.303 INFO:tasks.workunit.client.0.smithi134.stdout:7/607: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:37.304 INFO:tasks.workunit.client.0.smithi134.stdout:2/390: symlink d2/d5/d8/d5d/d5f/d75/l7b 0 2024-03-22T07:28:37.307 INFO:tasks.workunit.client.0.smithi134.stdout:4/487: unlink d2/d2a/d50/fa3 0 2024-03-22T07:28:37.310 INFO:tasks.workunit.client.1.smithi195.stdout:2/625: write d2/d3/d1a/f37 [519938,64361] 0 2024-03-22T07:28:37.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/422: symlink d1/d8/l91 0 2024-03-22T07:28:37.311 INFO:tasks.workunit.client.1.smithi195.stdout:3/625: dread d3/d18/f26 [0,4194304] 0 2024-03-22T07:28:37.312 INFO:tasks.workunit.client.1.smithi195.stdout:7/639: rmdir d0/d13/d22/d57 39 2024-03-22T07:28:37.315 INFO:tasks.workunit.client.1.smithi195.stdout:1/534: dwrite d0/d70/d97/d41/d47/d4a/d66/f6d [0,4194304] 0 2024-03-22T07:28:37.316 INFO:tasks.workunit.client.1.smithi195.stdout:8/700: rename da/d17/d32/d7d/d8e to da/de/db3/dd7 0 2024-03-22T07:28:37.316 INFO:tasks.workunit.client.1.smithi195.stdout:1/535: chown d0/d70/d97/d41/d47/f8f 949 1 2024-03-22T07:28:37.318 INFO:tasks.workunit.client.0.smithi134.stdout:6/341: rename d2/d1b/f45 to d2/d3f/d28/d6b/f7f 0 2024-03-22T07:28:37.319 INFO:tasks.workunit.client.0.smithi134.stdout:6/342: chown d2/f4b 397965 1 2024-03-22T07:28:37.324 INFO:tasks.workunit.client.0.smithi134.stdout:5/423: write d1/d4/f2b [3790940,14733] 0 2024-03-22T07:28:37.324 INFO:tasks.workunit.client.0.smithi134.stdout:5/424: write d1/d8/d16/f74 [372848,27273] 0 2024-03-22T07:28:37.325 INFO:tasks.workunit.client.1.smithi195.stdout:3/626: creat d3/dbf/da0/fd3 x:0 0 0 2024-03-22T07:28:37.325 INFO:tasks.workunit.client.1.smithi195.stdout:7/640: creat d0/fdc x:0 0 0 2024-03-22T07:28:37.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/786: rename d2/d4/d6/db/d20/l34 to d2/d4/d6/db/d20/d47/dee/l11b 0 2024-03-22T07:28:37.326 INFO:tasks.workunit.client.1.smithi195.stdout:9/787: chown d2/d4/d1d/c4d 456987 1 2024-03-22T07:28:37.326 INFO:tasks.workunit.client.1.smithi195.stdout:3/627: dread d3/d18/d89/f6d [0,4194304] 0 2024-03-22T07:28:37.330 INFO:tasks.workunit.client.0.smithi134.stdout:9/361: creat d3/d9/df/d57/f7e x:0 0 0 2024-03-22T07:28:37.332 INFO:tasks.workunit.client.0.smithi134.stdout:3/415: rmdir d4/d8/d5c 39 2024-03-22T07:28:37.333 INFO:tasks.workunit.client.1.smithi195.stdout:2/626: getdents d2/d3/d7/da/de 0 2024-03-22T07:28:37.333 INFO:tasks.workunit.client.1.smithi195.stdout:2/627: chown d2/d3/fa5 973178332 1 2024-03-22T07:28:37.333 INFO:tasks.workunit.client.1.smithi195.stdout:8/701: write da/de/fbb [1673770,51954] 0 2024-03-22T07:28:37.333 INFO:tasks.workunit.client.1.smithi195.stdout:8/702: fsync da/dc/f7b 0 2024-03-22T07:28:37.333 INFO:tasks.workunit.client.1.smithi195.stdout:8/703: fdatasync da/d82/dc6/faa 0 2024-03-22T07:28:37.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/573: dwrite d5/d6d/f7b [0,4194304] 0 2024-03-22T07:28:37.336 INFO:tasks.workunit.client.0.smithi134.stdout:1/472: dwrite d5/da/d13/d1e/d63/f97 [4194304,4194304] 0 2024-03-22T07:28:37.337 INFO:tasks.workunit.client.1.smithi195.stdout:4/631: dwrite fe [0,4194304] 0 2024-03-22T07:28:37.342 INFO:tasks.workunit.client.0.smithi134.stdout:5/425: dwrite d1/d8/d20/f5c [0,4194304] 0 2024-03-22T07:28:37.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/628: dread d2/d3/d7/d19/d22/d26/f2c [0,4194304] 0 2024-03-22T07:28:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/629: write d2/d3/f74 [673896,69444] 0 2024-03-22T07:28:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/630: write d2/d3/d21/d60/d81/f84 [730939,26781] 0 2024-03-22T07:28:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/631: fdatasync d2/d3/d21/d60/f85 0 2024-03-22T07:28:37.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/632: chown d2/d3/d7/d5c 27582 1 2024-03-22T07:28:37.347 INFO:tasks.workunit.client.1.smithi195.stdout:2/633: dread d2/d3/d7/d5c/f6c [0,4194304] 0 2024-03-22T07:28:37.347 INFO:tasks.workunit.client.1.smithi195.stdout:5/687: rename d9/d12/d1d/d36/c8b to d9/d22/d7b/d98/dbe/ce0 0 2024-03-22T07:28:37.347 INFO:tasks.workunit.client.1.smithi195.stdout:2/634: read d2/d3/d1a/f50 [672959,32262] 0 2024-03-22T07:28:37.349 INFO:tasks.workunit.client.1.smithi195.stdout:2/635: dread d2/d3/d21/d60/d7c/f90 [0,4194304] 0 2024-03-22T07:28:37.350 INFO:tasks.workunit.client.1.smithi195.stdout:2/636: write d2/d3/d21/d60/d7c/f90 [103123,103512] 0 2024-03-22T07:28:37.351 INFO:tasks.workunit.client.1.smithi195.stdout:2/637: getdents d2/d3/d21/dca 0 2024-03-22T07:28:37.351 INFO:tasks.workunit.client.1.smithi195.stdout:9/788: creat d2/d4/d113/f11c x:0 0 0 2024-03-22T07:28:37.352 INFO:tasks.workunit.client.0.smithi134.stdout:0/437: creat dc/de/f84 x:0 0 0 2024-03-22T07:28:37.353 INFO:tasks.workunit.client.1.smithi195.stdout:3/628: mknod d3/df/d15/d1d/cd4 0 2024-03-22T07:28:37.355 INFO:tasks.workunit.client.0.smithi134.stdout:7/608: mkdir d1/d19/d9c/db3/dc4 0 2024-03-22T07:28:37.357 INFO:tasks.workunit.client.1.smithi195.stdout:1/536: mkdir d0/d70/d97/dab 0 2024-03-22T07:28:37.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/574: dwrite d5/d16/d5a/f8d [0,4194304] 0 2024-03-22T07:28:37.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/575: read - d5/d5e/d34/d55/dab/dbf/fc7 zero size 2024-03-22T07:28:37.359 INFO:tasks.workunit.client.0.smithi134.stdout:2/391: mkdir d2/d5/d22/d52/d3c/d60/d7c 0 2024-03-22T07:28:37.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/704: link da/dc/l55 da/de/db3/dc7/ld8 0 2024-03-22T07:28:37.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/705: write da/f4f [4849445,69613] 0 2024-03-22T07:28:37.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/706: dread - da/d17/d32/d61/fcb zero size 2024-03-22T07:28:37.364 INFO:tasks.workunit.client.1.smithi195.stdout:7/641: write d0/d13/d14/d29/d35/d3a/f3e [751488,4496] 0 2024-03-22T07:28:37.364 INFO:tasks.workunit.client.0.smithi134.stdout:4/488: link d2/l83 d2/d1d/la6 0 2024-03-22T07:28:37.366 INFO:tasks.workunit.client.0.smithi134.stdout:6/343: creat d2/d1b/d1d/d5e/d63/f80 x:0 0 0 2024-03-22T07:28:37.369 INFO:tasks.workunit.client.1.smithi195.stdout:4/632: creat d13/d15/d44/fd9 x:0 0 0 2024-03-22T07:28:37.369 INFO:tasks.workunit.client.0.smithi134.stdout:3/416: unlink d4/d8/d69/d6a/l8b 0 2024-03-22T07:28:37.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/473: mkdir d5/da/d13/dac 0 2024-03-22T07:28:37.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/474: fsync d5/d93/f94 0 2024-03-22T07:28:37.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/641: rename d1/d10/d1f/d40 to d1/d4/d12/d6c/dbc 0 2024-03-22T07:28:37.373 INFO:tasks.workunit.client.1.smithi195.stdout:3/629: symlink d3/d18/d89/d92/ld5 0 2024-03-22T07:28:37.373 INFO:tasks.workunit.client.1.smithi195.stdout:3/630: fsync d3/dbf/da0/fd3 0 2024-03-22T07:28:37.374 INFO:tasks.workunit.client.1.smithi195.stdout:1/537: mknod d0/d2/cac 0 2024-03-22T07:28:37.375 INFO:tasks.workunit.client.1.smithi195.stdout:5/688: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:37.376 INFO:tasks.workunit.client.1.smithi195.stdout:9/789: dwrite d2/d4/d6/d18/d50/f91 [0,4194304] 0 2024-03-22T07:28:37.376 INFO:tasks.workunit.client.1.smithi195.stdout:9/790: readlink d2/d4/d32/d6d/lc6 0 2024-03-22T07:28:37.378 INFO:tasks.workunit.client.1.smithi195.stdout:2/638: dwrite d2/d3/d7/da/d4e/fb1 [0,4194304] 0 2024-03-22T07:28:37.378 INFO:tasks.workunit.client.1.smithi195.stdout:2/639: fsync d2/d3/d7/d19/d22/d26/f2c 0 2024-03-22T07:28:37.378 INFO:tasks.workunit.client.1.smithi195.stdout:6/576: rmdir d5/d5e/d34/d55/d3b/d7f 39 2024-03-22T07:28:37.382 INFO:tasks.workunit.client.1.smithi195.stdout:4/633: creat d13/d2a/d7e/d8c/fda x:0 0 0 2024-03-22T07:28:37.382 INFO:tasks.workunit.client.1.smithi195.stdout:7/642: dwrite d0/d13/d14/d29/d35/d3a/f5d [0,4194304] 0 2024-03-22T07:28:37.382 INFO:tasks.workunit.client.1.smithi195.stdout:4/634: dread - d13/d63/d3e/f42 zero size 2024-03-22T07:28:37.384 INFO:tasks.workunit.client.1.smithi195.stdout:8/707: rename da/d82/lad to da/d82/dc6/d53/d8d/dd6/ld9 0 2024-03-22T07:28:37.386 INFO:tasks.workunit.client.1.smithi195.stdout:2/640: dread d2/d3/d7/d19/d22/d26/f4b [0,4194304] 0 2024-03-22T07:28:37.386 INFO:tasks.workunit.client.1.smithi195.stdout:2/641: dread - d2/d3/d7/da/d4e/f56 zero size 2024-03-22T07:28:37.388 INFO:tasks.workunit.client.1.smithi195.stdout:0/642: mkdir d1/d4/d12/d6c/dbd 0 2024-03-22T07:28:37.389 INFO:tasks.workunit.client.1.smithi195.stdout:9/791: dwrite d2/d4/d6/db/d20/d47/f10d [0,4194304] 0 2024-03-22T07:28:37.389 INFO:tasks.workunit.client.1.smithi195.stdout:9/792: stat d2/d4/d6/d18/d50/f91 0 2024-03-22T07:28:37.390 INFO:tasks.workunit.client.1.smithi195.stdout:3/631: link d3/f29 d3/dbf/fd6 0 2024-03-22T07:28:37.392 INFO:tasks.workunit.client.1.smithi195.stdout:1/538: mkdir d0/d2/d6/dad 0 2024-03-22T07:28:37.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/635: dread d13/f17 [0,4194304] 0 2024-03-22T07:28:37.392 INFO:tasks.workunit.client.0.smithi134.stdout:5/426: truncate d1/d8/d20/f70 4712383 0 2024-03-22T07:28:37.393 INFO:tasks.workunit.client.0.smithi134.stdout:5/427: creat d1/d8/d20/d62/f92 x:0 0 0 2024-03-22T07:28:37.393 INFO:tasks.workunit.client.0.smithi134.stdout:5/428: dread - d1/f7f zero size 2024-03-22T07:28:37.393 INFO:tasks.workunit.client.1.smithi195.stdout:5/689: rmdir d9/d22/d46/db2 39 2024-03-22T07:28:37.394 INFO:tasks.workunit.client.1.smithi195.stdout:5/690: fdatasync d9/d12/d1d/d69/d78/d41/f8d 0 2024-03-22T07:28:37.394 INFO:tasks.workunit.client.1.smithi195.stdout:5/691: write d9/f25 [4752292,46034] 0 2024-03-22T07:28:37.394 INFO:tasks.workunit.client.0.smithi134.stdout:0/438: mkdir dc/d18/d85 0 2024-03-22T07:28:37.395 INFO:tasks.workunit.client.1.smithi195.stdout:8/708: write da/de/db3/dd7/fa1 [923664,26034] 0 2024-03-22T07:28:37.396 INFO:tasks.workunit.client.0.smithi134.stdout:7/609: symlink d1/de/d11/d48/d52/d46/lc5 0 2024-03-22T07:28:37.399 INFO:tasks.workunit.client.1.smithi195.stdout:3/632: dread d3/d18/d89/f90 [0,4194304] 0 2024-03-22T07:28:37.401 INFO:tasks.workunit.client.0.smithi134.stdout:4/489: rename d2/d25/d48/d6e/l9b to d2/d15/d35/d37/la7 0 2024-03-22T07:28:37.403 INFO:tasks.workunit.client.0.smithi134.stdout:6/344: truncate d2/f17 1563849 0 2024-03-22T07:28:37.403 INFO:tasks.workunit.client.0.smithi134.stdout:6/345: dread - d2/d1b/f6c zero size 2024-03-22T07:28:37.404 INFO:tasks.workunit.client.1.smithi195.stdout:8/709: dread da/d17/d32/d61/f72 [0,4194304] 0 2024-03-22T07:28:37.404 INFO:tasks.workunit.client.1.smithi195.stdout:8/710: fdatasync da/de/db3/dd7/fa0 0 2024-03-22T07:28:37.404 INFO:tasks.workunit.client.1.smithi195.stdout:0/643: dwrite d1/d4/dd/d66/d80/fac [0,4194304] 0 2024-03-22T07:28:37.404 INFO:tasks.workunit.client.1.smithi195.stdout:0/644: write d1/d4/f18 [2278159,23449] 0 2024-03-22T07:28:37.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/610: write d1/d19/f2f [1734629,111048] 0 2024-03-22T07:28:37.405 INFO:tasks.workunit.client.1.smithi195.stdout:6/577: creat d5/d5e/d34/d55/d3b/d7f/fcc x:0 0 0 2024-03-22T07:28:37.405 INFO:tasks.workunit.client.0.smithi134.stdout:9/362: getdents d3/d9 0 2024-03-22T07:28:37.408 INFO:tasks.workunit.client.1.smithi195.stdout:7/643: rename d0/l24 to d0/d98/dab/ldd 0 2024-03-22T07:28:37.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/475: unlink d5/da/d13/f51 0 2024-03-22T07:28:37.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/476: fsync d5/da/d13/d1e/d34/f43 0 2024-03-22T07:28:37.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/477: dread - d5/d1d/fa9 zero size 2024-03-22T07:28:37.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/478: truncate d5/d1d/d49/f5c 4734277 0 2024-03-22T07:28:37.410 INFO:tasks.workunit.client.1.smithi195.stdout:9/793: symlink d2/d4/d32/d6d/deb/l11d 0 2024-03-22T07:28:37.414 INFO:tasks.workunit.client.1.smithi195.stdout:1/539: link d0/d2/d27/l9f d0/d70/d97/d41/d47/d4a/lae 0 2024-03-22T07:28:37.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/429: symlink d1/l93 0 2024-03-22T07:28:37.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/430: chown d1/d4/f1a 1405953701 1 2024-03-22T07:28:37.416 INFO:tasks.workunit.client.1.smithi195.stdout:4/636: mknod d13/d63/d3e/d5c/d65/cdb 0 2024-03-22T07:28:37.417 INFO:tasks.workunit.client.0.smithi134.stdout:0/439: symlink dc/de/d55/d65/d82/l86 0 2024-03-22T07:28:37.425 INFO:tasks.workunit.client.0.smithi134.stdout:3/417: dwrite f0 [0,4194304] 0 2024-03-22T07:28:37.425 INFO:tasks.workunit.client.0.smithi134.stdout:3/418: truncate d4/d10/d6c/f86 706461 0 2024-03-22T07:28:37.426 INFO:tasks.workunit.client.1.smithi195.stdout:8/711: rmdir da/d82/dc6 39 2024-03-22T07:28:37.435 INFO:tasks.workunit.client.1.smithi195.stdout:0/645: link d1/d4/dd/d66/d80/fac d1/d4/d12/d6c/d87/fbe 0 2024-03-22T07:28:37.437 INFO:tasks.workunit.client.1.smithi195.stdout:7/644: dwrite d0/d13/d14/d2f/dae/dc3/fc7 [0,4194304] 0 2024-03-22T07:28:37.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/419: dread d4/d8/d23/f3a [0,4194304] 0 2024-03-22T07:28:37.438 INFO:tasks.workunit.client.0.smithi134.stdout:2/392: rmdir d2/d5 39 2024-03-22T07:28:37.439 INFO:tasks.workunit.client.0.smithi134.stdout:0/440: dwrite dc/d18/f1b [4194304,4194304] 0 2024-03-22T07:28:37.441 INFO:tasks.workunit.client.1.smithi195.stdout:6/578: symlink d5/d5e/d34/d55/d3b/d6e/lcd 0 2024-03-22T07:28:37.441 INFO:tasks.workunit.client.1.smithi195.stdout:6/579: fsync d5/d5e/d34/d55/dab/dbf/fc7 0 2024-03-22T07:28:37.444 INFO:tasks.workunit.client.0.smithi134.stdout:4/490: mkdir d2/d15/d35/da8 0 2024-03-22T07:28:37.446 INFO:tasks.workunit.client.0.smithi134.stdout:3/420: write d4/d22/f20 [3354405,86888] 0 2024-03-22T07:28:37.446 INFO:tasks.workunit.client.0.smithi134.stdout:3/421: stat d4/d22/d29 0 2024-03-22T07:28:37.447 INFO:tasks.workunit.client.1.smithi195.stdout:2/642: rename d2/d3/d7/da/d4e/f83 to d2/d3/d7/d5c/fd2 0 2024-03-22T07:28:37.449 INFO:tasks.workunit.client.0.smithi134.stdout:6/346: rename d2/c7a to d2/d1b/d1d/d5e/d63/c81 0 2024-03-22T07:28:37.450 INFO:tasks.workunit.client.1.smithi195.stdout:9/794: rmdir d2/d4/d1d 39 2024-03-22T07:28:37.451 INFO:tasks.workunit.client.1.smithi195.stdout:8/712: dwrite da/dc/d71/fc1 [0,4194304] 0 2024-03-22T07:28:37.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/540: mknod d0/d70/d97/d39/d64/d7a/caf 0 2024-03-22T07:28:37.456 INFO:tasks.workunit.client.1.smithi195.stdout:1/541: write d0/d2/d9/d2a/f80 [1871947,70320] 0 2024-03-22T07:28:37.457 INFO:tasks.workunit.client.0.smithi134.stdout:7/611: symlink d1/de/d11/d97/lc6 0 2024-03-22T07:28:37.457 INFO:tasks.workunit.client.0.smithi134.stdout:7/612: stat d1/de/d41 0 2024-03-22T07:28:37.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/637: symlink d13/d15/d44/ldc 0 2024-03-22T07:28:37.459 INFO:tasks.workunit.client.0.smithi134.stdout:9/363: mkdir d3/d9/d37/d5a/d7f 0 2024-03-22T07:28:37.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/633: symlink d3/ld7 0 2024-03-22T07:28:37.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/634: write d3/df/d15/f1c [1088163,56292] 0 2024-03-22T07:28:37.461 INFO:tasks.workunit.client.1.smithi195.stdout:3/635: chown d3/df/f96 54015970 1 2024-03-22T07:28:37.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/441: write dc/f57 [3994784,97716] 0 2024-03-22T07:28:37.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/442: chown dc/d18/f74 11 1 2024-03-22T07:28:37.462 INFO:tasks.workunit.client.0.smithi134.stdout:0/443: write dc/d18/d72/f7c [752248,41539] 0 2024-03-22T07:28:37.463 INFO:tasks.workunit.client.0.smithi134.stdout:1/479: unlink d5/d1d/d49/c65 0 2024-03-22T07:28:37.464 INFO:tasks.workunit.client.0.smithi134.stdout:1/480: creat d5/da/d13/d1e/d63/fad x:0 0 0 2024-03-22T07:28:37.464 INFO:tasks.workunit.client.0.smithi134.stdout:2/393: write d2/d5/d8/d5d/f66 [286954,67187] 0 2024-03-22T07:28:37.466 INFO:tasks.workunit.client.1.smithi195.stdout:1/542: write d0/d70/d97/d41/d47/f8f [2749558,116178] 0 2024-03-22T07:28:37.467 INFO:tasks.workunit.client.1.smithi195.stdout:0/646: dwrite d1/d4/dd/f3a [0,4194304] 0 2024-03-22T07:28:37.470 INFO:tasks.workunit.client.0.smithi134.stdout:5/431: truncate d1/d8/d16/f5a 3999656 0 2024-03-22T07:28:37.470 INFO:tasks.workunit.client.0.smithi134.stdout:4/491: dwrite d2/d25/d48/d6e/f82 [0,4194304] 0 2024-03-22T07:28:37.481 INFO:tasks.workunit.client.1.smithi195.stdout:7/645: symlink d0/d13/d14/d2f/dae/lde 0 2024-03-22T07:28:37.485 INFO:tasks.workunit.client.0.smithi134.stdout:3/422: mknod d4/d8/c8c 0 2024-03-22T07:28:37.485 INFO:tasks.workunit.client.0.smithi134.stdout:3/423: write d4/d22/f7c [476139,90049] 0 2024-03-22T07:28:37.486 INFO:tasks.workunit.client.1.smithi195.stdout:6/580: mknod d5/d5e/d34/d55/d4b/da2/cce 0 2024-03-22T07:28:37.489 INFO:tasks.workunit.client.0.smithi134.stdout:6/347: mknod d2/d1b/d1d/d5e/d6f/c82 0 2024-03-22T07:28:37.491 INFO:tasks.workunit.client.1.smithi195.stdout:7/646: dread d0/d13/f1e [0,4194304] 0 2024-03-22T07:28:37.493 INFO:tasks.workunit.client.0.smithi134.stdout:7/613: getdents d1/d19 0 2024-03-22T07:28:37.495 INFO:tasks.workunit.client.1.smithi195.stdout:5/692: rename d9/d2d/f51 to d9/d73/fe1 0 2024-03-22T07:28:37.497 INFO:tasks.workunit.client.0.smithi134.stdout:0/444: rename dc/f3e to dc/de/f87 0 2024-03-22T07:28:37.497 INFO:tasks.workunit.client.0.smithi134.stdout:0/445: write dc/de/d55/f56 [4986454,30069] 0 2024-03-22T07:28:37.498 INFO:tasks.workunit.client.1.smithi195.stdout:2/643: mknod d2/d3/d7/d19/d22/d26/d99/cd3 0 2024-03-22T07:28:37.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/795: symlink d2/d4/d6/dd1/d112/l11e 0 2024-03-22T07:28:37.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/796: creat d2/d4/d32/d6d/deb/f11f x:0 0 0 2024-03-22T07:28:37.500 INFO:tasks.workunit.client.1.smithi195.stdout:9/797: dread - d2/d4/d23/f108 zero size 2024-03-22T07:28:37.505 INFO:tasks.workunit.client.1.smithi195.stdout:3/636: rmdir d3/dbf/da0/da5 0 2024-03-22T07:28:37.509 INFO:tasks.workunit.client.1.smithi195.stdout:1/543: link d0/d2/d6/f71 d0/d2/d9/d2a/fb0 0 2024-03-22T07:28:37.510 INFO:tasks.workunit.client.1.smithi195.stdout:3/637: dread d3/df/d15/d1d/d5c/d47/d67/d80/f43 [0,4194304] 0 2024-03-22T07:28:37.510 INFO:tasks.workunit.client.1.smithi195.stdout:3/638: write d3/df/d15/d1d/d5c/d47/fb4 [771331,130837] 0 2024-03-22T07:28:37.515 INFO:tasks.workunit.client.1.smithi195.stdout:9/798: dwrite d2/d4/d23/d74/fcc [0,4194304] 0 2024-03-22T07:28:37.516 INFO:tasks.workunit.client.1.smithi195.stdout:5/693: write d9/d2d/f72 [3493701,53638] 0 2024-03-22T07:28:37.517 INFO:tasks.workunit.client.0.smithi134.stdout:1/481: dwrite d5/da/d13/d1e/f44 [4194304,4194304] 0 2024-03-22T07:28:37.517 INFO:tasks.workunit.client.0.smithi134.stdout:9/364: dwrite d3/d9/f18 [0,4194304] 0 2024-03-22T07:28:37.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/394: dwrite d2/f3e [4194304,4194304] 0 2024-03-22T07:28:37.518 INFO:tasks.workunit.client.0.smithi134.stdout:5/432: dwrite d1/d8/f46 [0,4194304] 0 2024-03-22T07:28:37.518 INFO:tasks.workunit.client.0.smithi134.stdout:5/433: write d1/d8/d20/f30 [282017,121032] 0 2024-03-22T07:28:37.519 INFO:tasks.workunit.client.1.smithi195.stdout:4/638: dwrite d13/f3a [0,4194304] 0 2024-03-22T07:28:37.519 INFO:tasks.workunit.client.1.smithi195.stdout:6/581: dwrite d5/d16/d45/d53/d59/d87/f94 [0,4194304] 0 2024-03-22T07:28:37.519 INFO:tasks.workunit.client.1.smithi195.stdout:6/582: creat d5/d16/d45/d53/d59/d87/fcf x:0 0 0 2024-03-22T07:28:37.520 INFO:tasks.workunit.client.1.smithi195.stdout:0/647: truncate d1/d4/d12/f55 2888821 0 2024-03-22T07:28:37.520 INFO:tasks.workunit.client.1.smithi195.stdout:0/648: chown d1 9 1 2024-03-22T07:28:37.521 INFO:tasks.workunit.client.0.smithi134.stdout:4/492: creat d2/d2a/d50/fa9 x:0 0 0 2024-03-22T07:28:37.531 INFO:tasks.workunit.client.0.smithi134.stdout:3/424: creat d4/d22/d29/d82/f8d x:0 0 0 2024-03-22T07:28:37.532 INFO:tasks.workunit.client.0.smithi134.stdout:3/425: creat d4/d22/d29/d82/f8e x:0 0 0 2024-03-22T07:28:37.532 INFO:tasks.workunit.client.0.smithi134.stdout:3/426: write d4/d8/f19 [4907102,36061] 0 2024-03-22T07:28:37.532 INFO:tasks.workunit.client.0.smithi134.stdout:3/427: write d4/d22/d29/d50/f7b [426446,15126] 0 2024-03-22T07:28:37.533 INFO:tasks.workunit.client.0.smithi134.stdout:1/482: write d5/da/d13/d1e/d63/f97 [5434217,69883] 0 2024-03-22T07:28:37.533 INFO:tasks.workunit.client.0.smithi134.stdout:1/483: read - d5/da/d1b/d27/f80 zero size 2024-03-22T07:28:37.533 INFO:tasks.workunit.client.0.smithi134.stdout:1/484: fsync d5/da/d1b/f36 0 2024-03-22T07:28:37.534 INFO:tasks.workunit.client.1.smithi195.stdout:1/544: dwrite d0/d2/d9/d2a/fb0 [0,4194304] 0 2024-03-22T07:28:37.535 INFO:tasks.workunit.client.0.smithi134.stdout:7/614: creat d1/dae/fc7 x:0 0 0 2024-03-22T07:28:37.535 INFO:tasks.workunit.client.0.smithi134.stdout:7/615: stat d1/de/d41/d87 0 2024-03-22T07:28:37.535 INFO:tasks.workunit.client.0.smithi134.stdout:7/616: read d1/de/d11/d2b/d31/d85/fc3 [131609,36936] 0 2024-03-22T07:28:37.538 INFO:tasks.workunit.client.1.smithi195.stdout:4/639: dwrite d13/d63/d3e/f97 [0,4194304] 0 2024-03-22T07:28:37.538 INFO:tasks.workunit.client.1.smithi195.stdout:4/640: creat d13/d15/d64/fdd x:0 0 0 2024-03-22T07:28:37.538 INFO:tasks.workunit.client.1.smithi195.stdout:4/641: truncate d13/d63/d3e/f7f 208339 0 2024-03-22T07:28:37.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/348: rename d2/d1b/d1d/d5e/d63/f80 to d2/d3f/f83 0 2024-03-22T07:28:37.543 INFO:tasks.workunit.client.0.smithi134.stdout:9/365: unlink d3/f27 0 2024-03-22T07:28:37.544 INFO:tasks.workunit.client.0.smithi134.stdout:2/395: symlink d2/d5/d22/d52/d3c/d4f/d6e/l7d 0 2024-03-22T07:28:37.544 INFO:tasks.workunit.client.0.smithi134.stdout:2/396: readlink d2/d5/d8/d31/l71 0 2024-03-22T07:28:37.547 INFO:tasks.workunit.client.0.smithi134.stdout:8/551: sync 2024-03-22T07:28:37.549 INFO:tasks.workunit.client.1.smithi195.stdout:9/799: dwrite d2/d4/d32/d6d/deb/ff6 [0,4194304] 0 2024-03-22T07:28:37.549 INFO:tasks.workunit.client.1.smithi195.stdout:9/800: dread - d2/d4/d32/f7c zero size 2024-03-22T07:28:37.549 INFO:tasks.workunit.client.1.smithi195.stdout:9/801: creat d2/d4/d6/d18/d50/d88/f120 x:0 0 0 2024-03-22T07:28:37.549 INFO:tasks.workunit.client.1.smithi195.stdout:9/802: chown d2/d4/d1d/ddc/f10c 0 1 2024-03-22T07:28:37.550 INFO:tasks.workunit.client.1.smithi195.stdout:9/803: read - d2/d4/d6/d18/d50/f100 zero size 2024-03-22T07:28:37.550 INFO:tasks.workunit.client.0.smithi134.stdout:4/493: dwrite f1 [0,4194304] 0 2024-03-22T07:28:37.553 INFO:tasks.workunit.client.1.smithi195.stdout:0/649: dwrite d1/d4/dd/d66/d80/f95 [0,4194304] 0 2024-03-22T07:28:37.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/647: link d0/d13/d14/d20/d40/d82/da0/f9f d0/d13/d14/d2f/fdf 0 2024-03-22T07:28:37.558 INFO:tasks.workunit.client.1.smithi195.stdout:7/648: dread - d0/d13/d14/d80/fd5 zero size 2024-03-22T07:28:37.559 INFO:tasks.workunit.client.1.smithi195.stdout:7/649: write d0/d13/d14/d2f/fdf [45425,58702] 0 2024-03-22T07:28:37.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/644: creat d2/d3/d7/d19/d22/d26/fd4 x:0 0 0 2024-03-22T07:28:37.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/645: dread - d2/d3/d7/d19/d22/d26/d3c/f9e zero size 2024-03-22T07:28:37.566 INFO:tasks.workunit.client.0.smithi134.stdout:3/428: getdents d4 0 2024-03-22T07:28:37.566 INFO:tasks.workunit.client.0.smithi134.stdout:3/429: chown d4/d22/c5b 3105527 1 2024-03-22T07:28:37.566 INFO:tasks.workunit.client.0.smithi134.stdout:3/430: readlink d4/l54 0 2024-03-22T07:28:37.566 INFO:tasks.workunit.client.0.smithi134.stdout:3/431: chown d4/d10/f4f 3693158 1 2024-03-22T07:28:37.567 INFO:tasks.workunit.client.1.smithi195.stdout:3/639: rename d3/d22/fa9 to d3/df/d15/fd8 0 2024-03-22T07:28:37.569 INFO:tasks.workunit.client.1.smithi195.stdout:5/694: symlink d9/d73/le2 0 2024-03-22T07:28:37.569 INFO:tasks.workunit.client.1.smithi195.stdout:5/695: readlink d9/d73/dbb/lcc 0 2024-03-22T07:28:37.569 INFO:tasks.workunit.client.1.smithi195.stdout:5/696: chown d9/d12/d1d/d36/d7d/l83 11947194 1 2024-03-22T07:28:37.569 INFO:tasks.workunit.client.0.smithi134.stdout:1/485: mkdir d5/da/d1b/d27/dae 0 2024-03-22T07:28:37.571 INFO:tasks.workunit.client.0.smithi134.stdout:1/486: write d5/da/d1b/d27/d60/f66 [315184,41345] 0 2024-03-22T07:28:37.571 INFO:tasks.workunit.client.0.smithi134.stdout:1/487: write d5/da/d1b/d27/fab [227503,28657] 0 2024-03-22T07:28:37.571 INFO:tasks.workunit.client.0.smithi134.stdout:7/617: truncate d1/f4 3307803 0 2024-03-22T07:28:37.575 INFO:tasks.workunit.client.0.smithi134.stdout:0/446: rename dc/d18/l49 to dc/de/d55/d65/l88 0 2024-03-22T07:28:37.576 INFO:tasks.workunit.client.0.smithi134.stdout:4/494: dwrite d2/d15/d35/d37/f8c [0,4194304] 0 2024-03-22T07:28:37.576 INFO:tasks.workunit.client.0.smithi134.stdout:4/495: creat d2/d2a/d80/d85/faa x:0 0 0 2024-03-22T07:28:37.578 INFO:tasks.workunit.client.0.smithi134.stdout:9/366: mkdir d3/d9/d37/d5a/d7f/d80 0 2024-03-22T07:28:37.581 INFO:tasks.workunit.client.0.smithi134.stdout:3/432: read f3 [3864394,108884] 0 2024-03-22T07:28:37.581 INFO:tasks.workunit.client.0.smithi134.stdout:8/552: getdents d1/d15/d42/d25 0 2024-03-22T07:28:37.585 INFO:tasks.workunit.client.1.smithi195.stdout:5/697: dwrite d9/d12/d1d/d36/f5a [0,4194304] 0 2024-03-22T07:28:37.588 INFO:tasks.workunit.client.1.smithi195.stdout:6/583: link d5/d16/d45/d53/d59/d87/f94 d5/d5e/d34/d55/d3b/d6e/d97/fd0 0 2024-03-22T07:28:37.590 INFO:tasks.workunit.client.1.smithi195.stdout:5/698: dread d9/d12/d1d/d69/d78/f7e [0,4194304] 0 2024-03-22T07:28:37.593 INFO:tasks.workunit.client.0.smithi134.stdout:0/447: dwrite f0 [0,4194304] 0 2024-03-22T07:28:37.593 INFO:tasks.workunit.client.0.smithi134.stdout:0/448: stat dc/d18/d72 0 2024-03-22T07:28:37.594 INFO:tasks.workunit.client.0.smithi134.stdout:5/434: rmdir d1/d8/d83 39 2024-03-22T07:28:37.595 INFO:tasks.workunit.client.0.smithi134.stdout:5/435: chown d1/d8/d20/l5e 342 1 2024-03-22T07:28:37.596 INFO:tasks.workunit.client.1.smithi195.stdout:6/584: write d5/d16/d45/d53/d59/d87/f94 [3891093,52964] 0 2024-03-22T07:28:37.597 INFO:tasks.workunit.client.0.smithi134.stdout:1/488: creat d5/da/d13/d1e/d62/faf x:0 0 0 2024-03-22T07:28:37.600 INFO:tasks.workunit.client.0.smithi134.stdout:7/618: symlink d1/de/d11/d48/d52/d46/lc8 0 2024-03-22T07:28:37.600 INFO:tasks.workunit.client.0.smithi134.stdout:7/619: dread - d1/de/d11/d48/d52/d46/f84 zero size 2024-03-22T07:28:37.600 INFO:tasks.workunit.client.0.smithi134.stdout:7/620: truncate d1/de/d11/d48/d52/d46/fb1 156314 0 2024-03-22T07:28:37.600 INFO:tasks.workunit.client.0.smithi134.stdout:7/621: creat d1/d40/fc9 x:0 0 0 2024-03-22T07:28:37.601 INFO:tasks.workunit.client.0.smithi134.stdout:7/622: chown d1/d40 30 1 2024-03-22T07:28:37.601 INFO:tasks.workunit.client.0.smithi134.stdout:7/623: creat d1/de/fca x:0 0 0 2024-03-22T07:28:37.601 INFO:tasks.workunit.client.0.smithi134.stdout:7/624: write d1/de/d11/d48/d52/d46/fc2 [96939,2576] 0 2024-03-22T07:28:37.601 INFO:tasks.workunit.client.1.smithi195.stdout:4/642: creat d13/d2a/d7e/d8c/dd2/fde x:0 0 0 2024-03-22T07:28:37.613 INFO:tasks.workunit.client.0.smithi134.stdout:6/349: rename d2/d1b/d4d/d65/d73 to d2/d1b/d1d/d5e/d84 0 2024-03-22T07:28:37.618 INFO:tasks.workunit.client.1.smithi195.stdout:9/804: getdents d2/d4/d6/db/d20 0 2024-03-22T07:28:37.618 INFO:tasks.workunit.client.1.smithi195.stdout:4/643: read d13/d63/d79/f45 [736521,32387] 0 2024-03-22T07:28:37.619 INFO:tasks.workunit.client.1.smithi195.stdout:6/585: dwrite d5/d5e/d34/d55/f2e [0,4194304] 0 2024-03-22T07:28:37.620 INFO:tasks.workunit.client.0.smithi134.stdout:4/496: link d2/c3d d2/d2a/d50/cab 0 2024-03-22T07:28:37.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/433: unlink d4/d22/d29/d50/f63 0 2024-03-22T07:28:37.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/434: fdatasync d4/d8/f13 0 2024-03-22T07:28:37.624 INFO:tasks.workunit.client.0.smithi134.stdout:3/435: chown d4/d8/f6e 100567557 1 2024-03-22T07:28:37.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/625: dwrite d1/de/d11/d48/f8b [0,4194304] 0 2024-03-22T07:28:37.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/626: fsync d1/de/d11/d2b/d31/f54 0 2024-03-22T07:28:37.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/627: fsync d1/dae/fc7 0 2024-03-22T07:28:37.627 INFO:tasks.workunit.client.0.smithi134.stdout:0/449: mkdir dc/d18/d89 0 2024-03-22T07:28:37.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/450: creat dc/de/d55/d60/f8a x:0 0 0 2024-03-22T07:28:37.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/451: readlink dc/de/d55/l80 0 2024-03-22T07:28:37.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/452: fsync dc/de/f87 0 2024-03-22T07:28:37.628 INFO:tasks.workunit.client.0.smithi134.stdout:0/453: readlink dc/de/l4b 0 2024-03-22T07:28:37.628 INFO:tasks.workunit.client.0.smithi134.stdout:6/350: read d2/f4b [1881298,11483] 0 2024-03-22T07:28:37.629 INFO:tasks.workunit.client.0.smithi134.stdout:5/436: unlink d1/d8/d20/d62/d65/l23 0 2024-03-22T07:28:37.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/489: creat d5/da/fb0 x:0 0 0 2024-03-22T07:28:37.630 INFO:tasks.workunit.client.0.smithi134.stdout:1/490: readlink d5/l4e 0 2024-03-22T07:28:37.634 INFO:tasks.workunit.client.0.smithi134.stdout:7/628: write d1/de/d11/f6a [478812,89555] 0 2024-03-22T07:28:37.637 INFO:tasks.workunit.client.1.smithi195.stdout:7/650: rmdir d0/d13/d14/d29/d35/d3a/d97 0 2024-03-22T07:28:37.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/454: dread dc/f20 [0,4194304] 0 2024-03-22T07:28:37.641 INFO:tasks.workunit.client.1.smithi195.stdout:9/805: dwrite d2/d4/d6/db/f6c [0,4194304] 0 2024-03-22T07:28:37.641 INFO:tasks.workunit.client.0.smithi134.stdout:8/553: rename d1/d15/d42/d12/d2a/c4e to d1/d15/d42/d76/d8f/dad/db1/cb6 0 2024-03-22T07:28:37.642 INFO:tasks.workunit.client.0.smithi134.stdout:8/554: fsync d1/d4/f54 0 2024-03-22T07:28:37.642 INFO:tasks.workunit.client.1.smithi195.stdout:2/646: link d2/d3/d21/f14 d2/d3/d7/da/de/fd5 0 2024-03-22T07:28:37.643 INFO:tasks.workunit.client.0.smithi134.stdout:4/497: mknod d2/d2a/cac 0 2024-03-22T07:28:37.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/498: write d2/d1d/f5e [1006760,15087] 0 2024-03-22T07:28:37.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/640: mkdir d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9 0 2024-03-22T07:28:37.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/641: readlink d3/d98/lb0 0 2024-03-22T07:28:37.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/642: chown d3/d18/d89/d70/db5/fc9 320 1 2024-03-22T07:28:37.649 INFO:tasks.workunit.client.0.smithi134.stdout:3/436: dwrite d4/d22/d29/f5e [0,4194304] 0 2024-03-22T07:28:37.650 INFO:tasks.workunit.client.0.smithi134.stdout:3/437: truncate d4/d22/f3e 818519 0 2024-03-22T07:28:37.653 INFO:tasks.workunit.client.0.smithi134.stdout:1/491: dwrite d5/d1d/d49/f95 [0,4194304] 0 2024-03-22T07:28:37.654 INFO:tasks.workunit.client.0.smithi134.stdout:0/455: dread dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:37.654 INFO:tasks.workunit.client.0.smithi134.stdout:0/456: chown dc/de/d55/c5f 139906 1 2024-03-22T07:28:37.655 INFO:tasks.workunit.client.1.smithi195.stdout:5/699: creat d9/d2d/d84/dcf/fe3 x:0 0 0 2024-03-22T07:28:37.655 INFO:tasks.workunit.client.1.smithi195.stdout:2/647: dread d2/d3/f31 [0,4194304] 0 2024-03-22T07:28:37.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/648: dread - d2/d3/fa5 zero size 2024-03-22T07:28:37.656 INFO:tasks.workunit.client.1.smithi195.stdout:2/649: write d2/d3/d1a/f50 [1102601,34381] 0 2024-03-22T07:28:37.656 INFO:tasks.workunit.client.1.smithi195.stdout:8/713: sync 2024-03-22T07:28:37.659 INFO:tasks.workunit.client.0.smithi134.stdout:0/457: dread dc/f1f [0,4194304] 0 2024-03-22T07:28:37.659 INFO:tasks.workunit.client.0.smithi134.stdout:6/351: creat d2/d1b/d1d/d5e/d6f/d7d/f85 x:0 0 0 2024-03-22T07:28:37.662 INFO:tasks.workunit.client.0.smithi134.stdout:7/629: creat d1/de/d41/fcb x:0 0 0 2024-03-22T07:28:37.662 INFO:tasks.workunit.client.0.smithi134.stdout:1/492: dread d5/d1d/d49/f5c [0,4194304] 0 2024-03-22T07:28:37.663 INFO:tasks.workunit.client.1.smithi195.stdout:0/650: mkdir d1/d10/d1f/dbf 0 2024-03-22T07:28:37.666 INFO:tasks.workunit.client.1.smithi195.stdout:7/651: creat d0/d13/d14/d29/fe0 x:0 0 0 2024-03-22T07:28:37.666 INFO:tasks.workunit.client.1.smithi195.stdout:7/652: write d0/d13/d14/d29/f33 [410752,26919] 0 2024-03-22T07:28:37.666 INFO:tasks.workunit.client.1.smithi195.stdout:7/653: chown d0/d13/d14/d29/d6e/lcc 494684 1 2024-03-22T07:28:37.666 INFO:tasks.workunit.client.1.smithi195.stdout:7/654: creat d0/d13/d14/d29/fe1 x:0 0 0 2024-03-22T07:28:37.669 INFO:tasks.workunit.client.1.smithi195.stdout:9/806: symlink d2/d4/d6/db/da8/l121 0 2024-03-22T07:28:37.671 INFO:tasks.workunit.client.0.smithi134.stdout:9/367: rename l2 to d3/d9/df/d12/l81 0 2024-03-22T07:28:37.671 INFO:tasks.workunit.client.0.smithi134.stdout:9/368: chown d3/d9/df/d12/d3b/l74 17773 1 2024-03-22T07:28:37.671 INFO:tasks.workunit.client.0.smithi134.stdout:9/369: fdatasync d3/d9/df/d12/f1d 0 2024-03-22T07:28:37.671 INFO:tasks.workunit.client.0.smithi134.stdout:3/438: dwrite d4/d8/f6e [4194304,4194304] 0 2024-03-22T07:28:37.671 INFO:tasks.workunit.client.0.smithi134.stdout:3/439: rename d4/d10 to d4/d10/d4b/d8f 22 2024-03-22T07:28:37.672 INFO:tasks.workunit.client.0.smithi134.stdout:8/555: truncate d1/d4/d61/d85/f8d 54129 0 2024-03-22T07:28:37.672 INFO:tasks.workunit.client.0.smithi134.stdout:8/556: readlink d1/d15/d42/d12/l97 0 2024-03-22T07:28:37.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/700: dwrite d9/d12/f52 [4194304,4194304] 0 2024-03-22T07:28:37.674 INFO:tasks.workunit.client.1.smithi195.stdout:5/701: fsync d9/d22/d7b/d98/fc7 0 2024-03-22T07:28:37.674 INFO:tasks.workunit.client.0.smithi134.stdout:4/499: symlink d2/d15/d35/lad 0 2024-03-22T07:28:37.680 INFO:tasks.workunit.client.1.smithi195.stdout:9/807: dwrite d2/d4/d6/db/d20/d47/fea [4194304,4194304] 0 2024-03-22T07:28:37.682 INFO:tasks.workunit.client.1.smithi195.stdout:3/643: link d3/d18/d89/d8c/d9d/caf d3/d18/d89/d92/cda 0 2024-03-22T07:28:37.682 INFO:tasks.workunit.client.1.smithi195.stdout:3/644: readlink l1 0 2024-03-22T07:28:37.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/650: creat d2/d3/db/fd6 x:0 0 0 2024-03-22T07:28:37.687 INFO:tasks.workunit.client.1.smithi195.stdout:2/651: chown d2/d3/d7/d19/f28 1726 1 2024-03-22T07:28:37.687 INFO:tasks.workunit.client.1.smithi195.stdout:2/652: write d2/d3/d1a/fbd [862212,60160] 0 2024-03-22T07:28:37.687 INFO:tasks.workunit.client.1.smithi195.stdout:2/653: write d2/d3/d7/da/de/fd5 [4288414,47896] 0 2024-03-22T07:28:37.689 INFO:tasks.workunit.client.1.smithi195.stdout:8/714: symlink da/d82/dc6/lda 0 2024-03-22T07:28:37.690 INFO:tasks.workunit.client.1.smithi195.stdout:2/654: dread d2/d3/d7/d19/d22/d26/f2c [0,4194304] 0 2024-03-22T07:28:37.690 INFO:tasks.workunit.client.1.smithi195.stdout:2/655: chown d2/d3/d21/d60/d81/d9a/c91 129683372 1 2024-03-22T07:28:37.692 INFO:tasks.workunit.client.1.smithi195.stdout:4/644: rmdir d13/d63/d79 39 2024-03-22T07:28:37.692 INFO:tasks.workunit.client.1.smithi195.stdout:4/645: write d13/f4f [46923,60795] 0 2024-03-22T07:28:37.692 INFO:tasks.workunit.client.1.smithi195.stdout:4/646: chown d13/d2a/f70 40560 1 2024-03-22T07:28:37.693 INFO:tasks.workunit.client.1.smithi195.stdout:8/715: dread da/d82/dc6/d53/f5e [0,4194304] 0 2024-03-22T07:28:37.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/586: getdents d5/d5e/d34/d55/d3b/d7f 0 2024-03-22T07:28:37.694 INFO:tasks.workunit.client.1.smithi195.stdout:6/587: read - d5/d5e/f84 zero size 2024-03-22T07:28:37.695 INFO:tasks.workunit.client.1.smithi195.stdout:6/588: stat d5/d16/d45/d53/d59 0 2024-03-22T07:28:37.706 INFO:tasks.workunit.client.1.smithi195.stdout:7/655: rmdir d0/d13/d14/d29/da2 39 2024-03-22T07:28:37.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/702: mkdir d9/d12/de4 0 2024-03-22T07:28:37.710 INFO:tasks.workunit.client.0.smithi134.stdout:0/458: truncate dc/de/f6a 621547 0 2024-03-22T07:28:37.711 INFO:tasks.workunit.client.0.smithi134.stdout:0/459: write dc/d17/f48 [835219,28787] 0 2024-03-22T07:28:37.711 INFO:tasks.workunit.client.1.smithi195.stdout:1/545: rename d0/d70 to d0/d2/d6/dad/db1 0 2024-03-22T07:28:37.712 INFO:tasks.workunit.client.0.smithi134.stdout:6/352: mknod d2/c86 0 2024-03-22T07:28:37.713 INFO:tasks.workunit.client.1.smithi195.stdout:9/808: mkdir d2/d122 0 2024-03-22T07:28:37.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/370: mknod d3/d9/d37/d3c/c82 0 2024-03-22T07:28:37.716 INFO:tasks.workunit.client.0.smithi134.stdout:9/371: chown d3/d9/df/d12/f2a 186 1 2024-03-22T07:28:37.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/656: mknod d2/d3/db/db3/cd7 0 2024-03-22T07:28:37.717 INFO:tasks.workunit.client.1.smithi195.stdout:2/657: dread - d2/d3/d24/f9f zero size 2024-03-22T07:28:37.719 INFO:tasks.workunit.client.0.smithi134.stdout:3/440: creat d4/d10/d4b/f90 x:0 0 0 2024-03-22T07:28:37.721 INFO:tasks.workunit.client.1.smithi195.stdout:4/647: dwrite d13/d63/d3e/d5c/f69 [0,4194304] 0 2024-03-22T07:28:37.722 INFO:tasks.workunit.client.1.smithi195.stdout:6/589: dwrite d5/d16/d5b/f79 [0,4194304] 0 2024-03-22T07:28:37.724 INFO:tasks.workunit.client.0.smithi134.stdout:8/557: mknod d1/d15/d57/d79/cb7 0 2024-03-22T07:28:37.725 INFO:tasks.workunit.client.1.smithi195.stdout:1/546: read d0/d2/d6/dad/db1/d97/d39/fa9 [1345626,123746] 0 2024-03-22T07:28:37.726 INFO:tasks.workunit.client.0.smithi134.stdout:6/353: dread d2/d1b/f2f [0,4194304] 0 2024-03-22T07:28:37.728 INFO:tasks.workunit.client.0.smithi134.stdout:9/372: write d3/d9/d37/d6f/d54/f68 [1842780,7667] 0 2024-03-22T07:28:37.730 INFO:tasks.workunit.client.0.smithi134.stdout:9/373: dread d3/d9/d37/d6f/f5d [0,4194304] 0 2024-03-22T07:28:37.732 INFO:tasks.workunit.client.0.smithi134.stdout:4/500: symlink d2/d2a/d80/lae 0 2024-03-22T07:28:37.732 INFO:tasks.workunit.client.0.smithi134.stdout:4/501: creat d2/d25/d48/d87/faf x:0 0 0 2024-03-22T07:28:37.734 INFO:tasks.workunit.client.0.smithi134.stdout:4/502: read d2/d1d/f7d [117868,75846] 0 2024-03-22T07:28:37.734 INFO:tasks.workunit.client.0.smithi134.stdout:4/503: stat d2/d98/f99 0 2024-03-22T07:28:37.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.741+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 24) v1 ==== 45771+0+0 (secure 0 0 0) 0x7f8ec404b3a0 con 0x7f8ed40fd300 2024-03-22T07:28:37.743 INFO:tasks.workunit.client.0.smithi134.stdout:7/630: getdents d1/de/d11/d2b 0 2024-03-22T07:28:37.745 INFO:tasks.workunit.client.1.smithi195.stdout:7/656: symlink d0/d13/d14/d20/le2 0 2024-03-22T07:28:37.745 INFO:tasks.workunit.client.1.smithi195.stdout:7/657: chown d0/d13/d22/c31 88850 1 2024-03-22T07:28:37.745 INFO:tasks.workunit.client.0.smithi134.stdout:8/558: dwrite d1/d15/d42/d76/d8f/dad/db1/f9b [0,4194304] 0 2024-03-22T07:28:37.745 INFO:tasks.workunit.client.0.smithi134.stdout:6/354: dwrite d2/f43 [4194304,4194304] 0 2024-03-22T07:28:37.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/493: getdents d5/da/d68 0 2024-03-22T07:28:37.747 INFO:tasks.workunit.client.1.smithi195.stdout:5/703: mknod d9/d2d/d84/dcf/ce5 0 2024-03-22T07:28:37.749 INFO:tasks.workunit.client.0.smithi134.stdout:3/441: creat d4/d8/d45/f91 x:0 0 0 2024-03-22T07:28:37.750 INFO:tasks.workunit.client.0.smithi134.stdout:3/442: fdatasync d4/d8/f12 0 2024-03-22T07:28:37.753 INFO:tasks.workunit.client.1.smithi195.stdout:0/651: rename d1/d10/d19/d20/f56 to d1/d4/d12/d6c/dbc/d43/fc0 0 2024-03-22T07:28:37.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/374: creat d3/d9/d37/d6f/d54/f83 x:0 0 0 2024-03-22T07:28:37.755 INFO:tasks.workunit.client.1.smithi195.stdout:9/809: mknod d2/d4/d6/db/da8/c123 0 2024-03-22T07:28:37.756 INFO:tasks.workunit.client.1.smithi195.stdout:3/645: getdents d3/df/d15/d1d 0 2024-03-22T07:28:37.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/810: dread d2/d4/d32/d6d/d78/ffa [0,4194304] 0 2024-03-22T07:28:37.757 INFO:tasks.workunit.client.1.smithi195.stdout:9/811: write d2/f27 [756100,24626] 0 2024-03-22T07:28:37.757 INFO:tasks.workunit.client.0.smithi134.stdout:4/504: dwrite d2/d1d/f72 [0,4194304] 0 2024-03-22T07:28:37.757 INFO:tasks.workunit.client.0.smithi134.stdout:0/460: rmdir dc/d18/d72 39 2024-03-22T07:28:37.757 INFO:tasks.workunit.client.0.smithi134.stdout:0/461: stat dc/de/d55/f63 0 2024-03-22T07:28:37.759 INFO:tasks.workunit.client.1.smithi195.stdout:2/658: link d2/d3/d24/cbb d2/d3/d7/da/d18/cd8 0 2024-03-22T07:28:37.760 INFO:tasks.workunit.client.1.smithi195.stdout:4/648: mkdir d13/d63/d7a/ddf 0 2024-03-22T07:28:37.764 INFO:tasks.workunit.client.0.smithi134.stdout:1/494: mknod d5/da/d68/da1/cb1 0 2024-03-22T07:28:37.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/355: dwrite d2/d1b/f29 [0,4194304] 0 2024-03-22T07:28:37.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/356: dread - d2/d1b/f6c zero size 2024-03-22T07:28:37.768 INFO:tasks.workunit.client.0.smithi134.stdout:9/375: mknod d3/d9/df/d12/d3b/c84 0 2024-03-22T07:28:37.769 INFO:tasks.workunit.client.1.smithi195.stdout:6/590: symlink d5/d5e/d34/d55/d3b/d7f/db4/ld1 0 2024-03-22T07:28:37.772 INFO:tasks.workunit.client.1.smithi195.stdout:1/547: creat d0/d2/d6/dad/db1/d6b/d9c/fb2 x:0 0 0 2024-03-22T07:28:37.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/658: creat d0/d13/d14/d20/d40/d82/db8/fe3 x:0 0 0 2024-03-22T07:28:37.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/659: chown d0/d13/d22/d28/f85 55659 1 2024-03-22T07:28:37.775 INFO:tasks.workunit.client.1.smithi195.stdout:7/660: write d0/d13/d14/d29/f89 [1450498,36085] 0 2024-03-22T07:28:37.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/505: link d2/d98/f99 d2/d15/d35/d37/d76/fb0 0 2024-03-22T07:28:37.778 INFO:tasks.workunit.client.1.smithi195.stdout:4/649: dwrite d13/d63/d79/f45 [0,4194304] 0 2024-03-22T07:28:37.779 INFO:tasks.workunit.client.1.smithi195.stdout:5/704: symlink d9/d22/d7b/le6 0 2024-03-22T07:28:37.779 INFO:tasks.workunit.client.1.smithi195.stdout:5/705: write d9/f1c [1790892,30810] 0 2024-03-22T07:28:37.779 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.778+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ec0005860 con 0x7f8ed40fd300 2024-03-22T07:28:37.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.779+0000 7f8ebb7fe700 1 -- 172.21.15.134:0/2566203341 <== mon.0 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8ec4012de0 con 0x7f8ed40fd300 2024-03-22T07:28:37.780 INFO:tasks.workunit.client.1.smithi195.stdout:5/706: read d9/d2d/f40 [105224,61400] 0 2024-03-22T07:28:37.780 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:28:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:28:37.780 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 12, 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:28:37.781 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:28:37.782 INFO:tasks.workunit.client.1.smithi195.stdout:1/548: write d0/d2/d6/dad/db1/d97/d41/d47/f49 [270235,40435] 0 2024-03-22T07:28:37.782 INFO:tasks.workunit.client.0.smithi134.stdout:0/462: link dc/d18/f66 dc/d18/d72/f8b 0 2024-03-22T07:28:37.783 INFO:tasks.workunit.client.1.smithi195.stdout:0/652: mknod d1/d4/d12/d6c/dbc/d47/cc1 0 2024-03-22T07:28:37.783 INFO:tasks.workunit.client.1.smithi195.stdout:0/653: fdatasync d1/d10/d19/f65 0 2024-03-22T07:28:37.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8ebc0387a0 msgr2=0x7f8ebc03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8ebc0387a0 0x7f8ebc03ac50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4066240 tx=0x7f8ec800b040 comp rx=0 tx=0).stop 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 msgr2=0x7f8ed410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed410d8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4013870 tx=0x7f8ec4009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 shutdown_connections 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8ebc0387a0 0x7f8ebc03ac50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40fd300 0x7f8ed410d8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 --2- 172.21.15.134:0/2566203341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ed40fdc50 0x7f8ed410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.784 INFO:tasks.workunit.client.0.smithi134.stdout:8/559: dread d1/d15/d42/d12/d20/d41/fa3 [0,4194304] 0 2024-03-22T07:28:37.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 >> 172.21.15.134:0/2566203341 conn(0x7f8ed40f6be0 msgr2=0x7f8ed40f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:37.785 INFO:tasks.workunit.client.0.smithi134.stdout:8/560: write d1/d4/d38/fb3 [932752,69807] 0 2024-03-22T07:28:37.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 shutdown_connections 2024-03-22T07:28:37.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.782+0000 7f8ed9444700 1 -- 172.21.15.134:0/2566203341 wait complete. 2024-03-22T07:28:37.785 INFO:tasks.workunit.client.0.smithi134.stdout:1/495: read f3 [2238158,69556] 0 2024-03-22T07:28:37.786 INFO:tasks.workunit.client.0.smithi134.stdout:1/496: chown d5/da/f26 101 1 2024-03-22T07:28:37.788 INFO:tasks.workunit.client.0.smithi134.stdout:7/631: rmdir d1/de/d11/d48 39 2024-03-22T07:28:37.788 INFO:tasks.workunit.client.0.smithi134.stdout:7/632: truncate d1/d19/d32/f4d 1211862 0 2024-03-22T07:28:37.790 INFO:tasks.workunit.client.0.smithi134.stdout:9/376: write d3/d9/f18 [4192957,85690] 0 2024-03-22T07:28:37.790 INFO:tasks.workunit.client.0.smithi134.stdout:9/377: dread - d3/d9/f7c zero size 2024-03-22T07:28:37.793 INFO:tasks.workunit.client.0.smithi134.stdout:3/443: getdents d4/d10/d6c 0 2024-03-22T07:28:37.793 INFO:tasks.workunit.client.1.smithi195.stdout:9/812: creat d2/d4/d23/d74/f124 x:0 0 0 2024-03-22T07:28:37.793 INFO:tasks.workunit.client.0.smithi134.stdout:9/378: dread d3/d9/d37/d6f/f32 [0,4194304] 0 2024-03-22T07:28:37.793 INFO:tasks.workunit.client.0.smithi134.stdout:9/379: write d3/d9/d37/d6f/f2e [1448192,112429] 0 2024-03-22T07:28:37.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/561: dread d1/d15/f19 [0,4194304] 0 2024-03-22T07:28:37.796 INFO:tasks.workunit.client.1.smithi195.stdout:2/659: rename d2/l1f to d2/d3/d24/ld9 0 2024-03-22T07:28:37.797 INFO:tasks.workunit.client.1.smithi195.stdout:2/660: write d2/d3/d21/d40/f8c [844707,28882] 0 2024-03-22T07:28:37.797 INFO:tasks.workunit.client.1.smithi195.stdout:7/661: dwrite d0/d13/d14/f8 [0,4194304] 0 2024-03-22T07:28:37.798 INFO:tasks.workunit.client.0.smithi134.stdout:1/497: dread d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:37.798 INFO:tasks.workunit.client.0.smithi134.stdout:1/498: write d5/da/d1b/f30 [436761,80246] 0 2024-03-22T07:28:37.798 INFO:tasks.workunit.client.0.smithi134.stdout:1/499: readlink d5/d1d/d2d/l5e 0 2024-03-22T07:28:37.798 INFO:tasks.workunit.client.0.smithi134.stdout:1/500: write d5/f4d [2552333,123520] 0 2024-03-22T07:28:37.800 INFO:tasks.workunit.client.1.smithi195.stdout:6/591: symlink d5/d16/d45/d53/ld2 0 2024-03-22T07:28:37.802 INFO:tasks.workunit.client.1.smithi195.stdout:4/650: mknod d13/d2a/d7e/d85/ce0 0 2024-03-22T07:28:37.803 INFO:tasks.workunit.client.0.smithi134.stdout:1/501: dread d5/da/d13/d1e/f22 [0,4194304] 0 2024-03-22T07:28:37.809 INFO:tasks.workunit.client.1.smithi195.stdout:5/707: mkdir d9/d7f/de7 0 2024-03-22T07:28:37.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/549: mkdir d0/d2/d6/dad/db1/d97/d39/d40/db3 0 2024-03-22T07:28:37.809 INFO:tasks.workunit.client.1.smithi195.stdout:1/550: dread - d0/d2/d6/dad/db1/d97/d39/d64/d7a/fa5 zero size 2024-03-22T07:28:37.810 INFO:tasks.workunit.client.1.smithi195.stdout:1/551: write d0/d2/d6/dad/db1/d97/d39/d64/d7a/f57 [2806454,80694] 0 2024-03-22T07:28:37.811 INFO:tasks.workunit.client.0.smithi134.stdout:6/357: mknod d2/d3f/c87 0 2024-03-22T07:28:37.811 INFO:tasks.workunit.client.0.smithi134.stdout:6/358: write d2/d3f/d28/d6b/f7f [879724,74927] 0 2024-03-22T07:28:37.812 INFO:tasks.workunit.client.1.smithi195.stdout:0/654: rmdir d1/d10/d4d 39 2024-03-22T07:28:37.814 INFO:tasks.workunit.client.1.smithi195.stdout:2/661: rename d2/d3/d7/fc0 to d2/d3/dac/dad/fda 0 2024-03-22T07:28:37.815 INFO:tasks.workunit.client.0.smithi134.stdout:4/506: mknod d2/d98/cb1 0 2024-03-22T07:28:37.816 INFO:tasks.workunit.client.0.smithi134.stdout:0/463: truncate dc/f29 355034 0 2024-03-22T07:28:37.821 INFO:tasks.workunit.client.0.smithi134.stdout:3/444: symlink d4/d22/d3c/l92 0 2024-03-22T07:28:37.822 INFO:tasks.workunit.client.1.smithi195.stdout:3/646: dwrite d3/d18/f2b [4194304,4194304] 0 2024-03-22T07:28:37.823 INFO:tasks.workunit.client.0.smithi134.stdout:7/633: dwrite d1/de/d41/d87/d8f/f9d [0,4194304] 0 2024-03-22T07:28:37.823 INFO:tasks.workunit.client.1.smithi195.stdout:9/813: dwrite d2/d4/d6/d18/f43 [0,4194304] 0 2024-03-22T07:28:37.824 INFO:tasks.workunit.client.0.smithi134.stdout:9/380: link d3/d9/d37/d6f/f2e d3/d9/df/d57/d67/d5f/f85 0 2024-03-22T07:28:37.826 INFO:tasks.workunit.client.0.smithi134.stdout:3/445: dread d4/d10/f36 [0,4194304] 0 2024-03-22T07:28:37.826 INFO:tasks.workunit.client.0.smithi134.stdout:3/446: truncate d4/d22/d3c/f8a 1030621 0 2024-03-22T07:28:37.829 INFO:tasks.workunit.client.0.smithi134.stdout:8/562: rename d1/d4/d61/d85/f91 to d1/d4/d6e/fb8 0 2024-03-22T07:28:37.833 INFO:tasks.workunit.client.0.smithi134.stdout:1/502: unlink d5/l7 0 2024-03-22T07:28:37.835 INFO:tasks.workunit.client.1.smithi195.stdout:7/662: creat d0/d13/d14/d29/dcf/fe4 x:0 0 0 2024-03-22T07:28:37.837 INFO:tasks.workunit.client.1.smithi195.stdout:6/592: symlink d5/d5e/d34/d55/ld3 0 2024-03-22T07:28:37.837 INFO:tasks.workunit.client.1.smithi195.stdout:1/552: dread d0/d2/d6/dad/db1/d97/d41/d47/f49 [0,4194304] 0 2024-03-22T07:28:37.838 INFO:tasks.workunit.client.0.smithi134.stdout:4/507: mknod d2/d15/d35/cb2 0 2024-03-22T07:28:37.840 INFO:tasks.workunit.client.1.smithi195.stdout:4/651: link c1 d13/d63/d21/ce1 0 2024-03-22T07:28:37.843 INFO:tasks.workunit.client.1.smithi195.stdout:0/655: symlink d1/lc2 0 2024-03-22T07:28:37.844 INFO:tasks.workunit.client.0.smithi134.stdout:8/563: dread d1/d15/d42/d76/d8f/dad/db1/f9b [0,4194304] 0 2024-03-22T07:28:37.845 INFO:tasks.workunit.client.0.smithi134.stdout:2/397: sync 2024-03-22T07:28:37.845 INFO:tasks.workunit.client.0.smithi134.stdout:5/437: sync 2024-03-22T07:28:37.845 INFO:tasks.workunit.client.0.smithi134.stdout:2/398: readlink d2/d5/d22/d52/d3c/d4f/d6e/l7d 0 2024-03-22T07:28:37.846 INFO:tasks.workunit.client.1.smithi195.stdout:2/662: symlink d2/d3/db/db3/ldb 0 2024-03-22T07:28:37.846 INFO:tasks.workunit.client.1.smithi195.stdout:2/663: creat d2/d3/d7/d19/fdc x:0 0 0 2024-03-22T07:28:37.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/564: dread d1/d15/d42/f28 [0,4194304] 0 2024-03-22T07:28:37.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/565: chown d1/d46/d75/d8b/db4 42204 1 2024-03-22T07:28:37.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/566: write d1/d15/d42/d76/d8f/dad/db1/f3e [2377208,24118] 0 2024-03-22T07:28:37.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/567: chown d1/d15/d42/d12 2 1 2024-03-22T07:28:37.847 INFO:tasks.workunit.client.0.smithi134.stdout:8/568: write d1/d4/d6e/fb8 [832727,20808] 0 2024-03-22T07:28:37.848 INFO:tasks.workunit.client.1.smithi195.stdout:5/708: dwrite d9/da8/fd8 [0,4194304] 0 2024-03-22T07:28:37.848 INFO:tasks.workunit.client.0.smithi134.stdout:0/464: dwrite dc/d17/f78 [0,4194304] 0 2024-03-22T07:28:37.848 INFO:tasks.workunit.client.1.smithi195.stdout:2/664: dread d2/d3/d1a/fbd [0,4194304] 0 2024-03-22T07:28:37.849 INFO:tasks.workunit.client.0.smithi134.stdout:7/634: rmdir d1/de/d41/d87 39 2024-03-22T07:28:37.849 INFO:tasks.workunit.client.0.smithi134.stdout:3/447: dwrite d4/d8/d45/f91 [0,4194304] 0 2024-03-22T07:28:37.850 INFO:tasks.workunit.client.1.smithi195.stdout:1/553: dread d0/d2/d9/f61 [0,4194304] 0 2024-03-22T07:28:37.851 INFO:tasks.workunit.client.1.smithi195.stdout:3/647: dwrite d3/f2d [0,4194304] 0 2024-03-22T07:28:37.851 INFO:tasks.workunit.client.1.smithi195.stdout:1/554: fsync d0/d2/d9/f81 0 2024-03-22T07:28:37.852 INFO:tasks.workunit.client.1.smithi195.stdout:4/652: dread d13/d63/f18 [0,4194304] 0 2024-03-22T07:28:37.854 INFO:tasks.workunit.client.1.smithi195.stdout:9/814: creat d2/d4/d32/f125 x:0 0 0 2024-03-22T07:28:37.857 INFO:tasks.workunit.client.1.smithi195.stdout:7/663: symlink d0/d13/d14/d20/d40/d82/da0/le5 0 2024-03-22T07:28:37.861 INFO:tasks.workunit.client.1.smithi195.stdout:6/593: creat d5/d5e/d34/d55/d3b/d7f/fd4 x:0 0 0 2024-03-22T07:28:37.864 INFO:tasks.workunit.client.1.smithi195.stdout:0/656: mknod d1/d4/d12/d6c/dbc/d47/cc3 0 2024-03-22T07:28:37.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/657: creat d1/d4/dd/df/d44/d8d/fc4 x:0 0 0 2024-03-22T07:28:37.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/658: fdatasync d1/d10/d1f/f2c 0 2024-03-22T07:28:37.867 INFO:tasks.workunit.client.0.smithi134.stdout:1/503: getdents d5/da/d13/d1e 0 2024-03-22T07:28:37.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/716: sync 2024-03-22T07:28:37.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/508: symlink d2/d15/d35/lb3 0 2024-03-22T07:28:37.873 INFO:tasks.workunit.client.0.smithi134.stdout:5/438: creat d1/d4/f94 x:0 0 0 2024-03-22T07:28:37.875 INFO:tasks.workunit.client.0.smithi134.stdout:5/439: dread d1/f60 [0,4194304] 0 2024-03-22T07:28:37.876 INFO:tasks.workunit.client.1.smithi195.stdout:9/815: dwrite d2/d4/d1d/fce [0,4194304] 0 2024-03-22T07:28:37.876 INFO:tasks.workunit.client.0.smithi134.stdout:9/381: dwrite d3/f8 [0,4194304] 0 2024-03-22T07:28:37.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/709: creat d9/d22/dd1/fe8 x:0 0 0 2024-03-22T07:28:37.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/710: fdatasync d9/f25 0 2024-03-22T07:28:37.877 INFO:tasks.workunit.client.1.smithi195.stdout:5/711: fsync d9/d73/da1/f3c 0 2024-03-22T07:28:37.878 INFO:tasks.workunit.client.1.smithi195.stdout:2/665: read - d2/d3/d21/d40/fa0 zero size 2024-03-22T07:28:37.879 INFO:tasks.workunit.client.1.smithi195.stdout:5/712: dread d9/d12/d1d/f32 [0,4194304] 0 2024-03-22T07:28:37.880 INFO:tasks.workunit.client.1.smithi195.stdout:5/713: write d9/d7f/fdc [281389,130396] 0 2024-03-22T07:28:37.880 INFO:tasks.workunit.client.0.smithi134.stdout:8/569: rename d1/d4/f47 to d1/d46/d75/d8b/fb9 0 2024-03-22T07:28:37.880 INFO:tasks.workunit.client.1.smithi195.stdout:2/666: dread d2/d3/d7/d19/d22/fa9 [0,4194304] 0 2024-03-22T07:28:37.881 INFO:tasks.workunit.client.1.smithi195.stdout:5/714: write d9/d12/d1d/d69/d78/fb1 [401249,71689] 0 2024-03-22T07:28:37.882 INFO:tasks.workunit.client.1.smithi195.stdout:5/715: creat d9/d22/d7b/fe9 x:0 0 0 2024-03-22T07:28:37.884 INFO:tasks.workunit.client.1.smithi195.stdout:9/816: dread d2/d4/d32/d6d/deb/ff6 [0,4194304] 0 2024-03-22T07:28:37.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/648: creat d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9/fdb x:0 0 0 2024-03-22T07:28:37.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/649: creat d3/dbf/fdc x:0 0 0 2024-03-22T07:28:37.884 INFO:tasks.workunit.client.1.smithi195.stdout:3/650: chown d3/df/d15/d1d/l41 52 1 2024-03-22T07:28:37.885 INFO:tasks.workunit.client.1.smithi195.stdout:3/651: dread - d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9/fdb zero size 2024-03-22T07:28:37.885 INFO:tasks.workunit.client.1.smithi195.stdout:3/652: chown d3/df/d15/d1d/l60 189476581 1 2024-03-22T07:28:37.885 INFO:tasks.workunit.client.0.smithi134.stdout:0/465: link dc/d17/f77 dc/de/d55/f8c 0 2024-03-22T07:28:37.887 INFO:tasks.workunit.client.1.smithi195.stdout:1/555: creat d0/d2/d9/da4/fb4 x:0 0 0 2024-03-22T07:28:37.887 INFO:tasks.workunit.client.0.smithi134.stdout:0/466: read dc/d18/d72/f7c [234160,43982] 0 2024-03-22T07:28:37.887 INFO:tasks.workunit.client.0.smithi134.stdout:0/467: chown dc/de/f23 7238 1 2024-03-22T07:28:37.888 INFO:tasks.workunit.client.1.smithi195.stdout:4/653: link d13/d63/d79/c80 d13/d63/d79/ce2 0 2024-03-22T07:28:37.891 INFO:tasks.workunit.client.1.smithi195.stdout:6/594: mkdir d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/dd5 0 2024-03-22T07:28:37.895 INFO:tasks.workunit.client.0.smithi134.stdout:1/504: creat d5/da/d13/d1e/d63/d9d/fb2 x:0 0 0 2024-03-22T07:28:37.896 INFO:tasks.workunit.client.1.smithi195.stdout:4/654: dread d13/d63/d36/f50 [0,4194304] 0 2024-03-22T07:28:37.897 INFO:tasks.workunit.client.1.smithi195.stdout:0/659: creat d1/d4/d12/d6c/dbd/fc5 x:0 0 0 2024-03-22T07:28:37.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/509: symlink d2/d25/d48/lb4 0 2024-03-22T07:28:37.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/510: chown d2/d25/d48/d6e/f73 58 1 2024-03-22T07:28:37.900 INFO:tasks.workunit.client.1.smithi195.stdout:0/660: dread d1/d4/d12/d6c/dbc/d43/fc0 [0,4194304] 0 2024-03-22T07:28:37.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/399: mkdir d2/d5/d8/d7e 0 2024-03-22T07:28:37.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/400: write d2/d5/d8/d5d/d5f/f6f [739767,21034] 0 2024-03-22T07:28:37.901 INFO:tasks.workunit.client.1.smithi195.stdout:1/556: dwrite d0/d2/d9/d2a/f86 [0,4194304] 0 2024-03-22T07:28:37.901 INFO:tasks.workunit.client.1.smithi195.stdout:8/717: rmdir da/dc/d71 39 2024-03-22T07:28:37.903 INFO:tasks.workunit.client.0.smithi134.stdout:2/401: dread d2/d5/d8/f1b [0,4194304] 0 2024-03-22T07:28:37.903 INFO:tasks.workunit.client.0.smithi134.stdout:2/402: write d2/f1a [900663,21564] 0 2024-03-22T07:28:37.903 INFO:tasks.workunit.client.0.smithi134.stdout:2/403: write d2/d5/f79 [985593,45959] 0 2024-03-22T07:28:37.903 INFO:tasks.workunit.client.0.smithi134.stdout:2/404: write d2/d5/d54/f63 [127937,34994] 0 2024-03-22T07:28:37.903 INFO:tasks.workunit.client.0.smithi134.stdout:2/405: stat d2/d5/d8/d5d/d5f/d75/l7b 0 2024-03-22T07:28:37.908 INFO:tasks.workunit.client.0.smithi134.stdout:3/448: rename d4/d22/d29/c57 to d4/d10/c93 0 2024-03-22T07:28:37.908 INFO:tasks.workunit.client.0.smithi134.stdout:3/449: chown d4/d8/d69 4232651 1 2024-03-22T07:28:37.909 INFO:tasks.workunit.client.0.smithi134.stdout:3/450: read d4/d22/d29/d50/f7b [258221,72053] 0 2024-03-22T07:28:37.912 INFO:tasks.workunit.client.0.smithi134.stdout:8/570: truncate d1/d15/d42/d49/f5f 1074315 0 2024-03-22T07:28:37.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/667: unlink d2/d3/d21/d4c/l4f 0 2024-03-22T07:28:37.922 INFO:tasks.workunit.client.1.smithi195.stdout:2/668: chown d2/d3/d7/da/d1b 9276 1 2024-03-22T07:28:37.927 INFO:tasks.workunit.client.1.smithi195.stdout:5/716: truncate d9/f6f 154908 0 2024-03-22T07:28:37.930 INFO:tasks.workunit.client.0.smithi134.stdout:4/511: unlink d2/d15/d35/d37/c42 0 2024-03-22T07:28:37.931 INFO:tasks.workunit.client.1.smithi195.stdout:9/817: mkdir d2/d4/d6/db/da8/d126 0 2024-03-22T07:28:37.931 INFO:tasks.workunit.client.1.smithi195.stdout:9/818: creat d2/f127 x:0 0 0 2024-03-22T07:28:37.932 INFO:tasks.workunit.client.0.smithi134.stdout:2/406: dwrite d2/d5/d8/d5d/d5f/f6f [0,4194304] 0 2024-03-22T07:28:37.932 INFO:tasks.workunit.client.0.smithi134.stdout:8/571: dwrite d1/d15/fa6 [0,4194304] 0 2024-03-22T07:28:37.934 INFO:tasks.workunit.client.0.smithi134.stdout:5/440: mkdir d1/d8/d20/d62/d65/d95 0 2024-03-22T07:28:37.935 INFO:tasks.workunit.client.0.smithi134.stdout:5/441: read - d1/d8/f63 zero size 2024-03-22T07:28:37.935 INFO:tasks.workunit.client.0.smithi134.stdout:5/442: chown d1/d8/c24 8213894 1 2024-03-22T07:28:37.935 INFO:tasks.workunit.client.1.smithi195.stdout:3/653: mknod d3/df/d15/d1d/cdd 0 2024-03-22T07:28:37.937 INFO:tasks.workunit.client.0.smithi134.stdout:9/382: rename d3/d9/d37/d3c/f6d to d3/d9/df/f86 0 2024-03-22T07:28:37.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/595: mknod d5/d5e/d34/d55/dcb/cd6 0 2024-03-22T07:28:37.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/596: truncate d5/d5e/d34/d55/d3b/d6e/d97/fbd 20383 0 2024-03-22T07:28:37.940 INFO:tasks.workunit.client.0.smithi134.stdout:3/451: creat d4/f94 x:0 0 0 2024-03-22T07:28:37.942 INFO:tasks.workunit.client.1.smithi195.stdout:4/655: rename d13/f4f to d13/d15/d44/fe3 0 2024-03-22T07:28:37.942 INFO:tasks.workunit.client.1.smithi195.stdout:4/656: chown d13/d63/d36/l67 21020665 1 2024-03-22T07:28:37.942 INFO:tasks.workunit.client.1.smithi195.stdout:4/657: chown d13/d15/d44/l59 2 1 2024-03-22T07:28:37.942 INFO:tasks.workunit.client.1.smithi195.stdout:4/658: fdatasync d13/d63/d36/fd5 0 2024-03-22T07:28:37.945 INFO:tasks.workunit.client.0.smithi134.stdout:0/468: getdents dc/d18 0 2024-03-22T07:28:37.952 INFO:tasks.workunit.client.0.smithi134.stdout:4/512: mknod d2/d15/d35/d37/d76/cb5 0 2024-03-22T07:28:37.952 INFO:tasks.workunit.client.0.smithi134.stdout:4/513: readlink d2/d1d/l20 0 2024-03-22T07:28:37.956 INFO:tasks.workunit.client.1.smithi195.stdout:1/557: mkdir d0/d2/d27/db5 0 2024-03-22T07:28:37.957 INFO:tasks.workunit.client.0.smithi134.stdout:2/407: rmdir d2/d5/d8 39 2024-03-22T07:28:37.958 INFO:tasks.workunit.client.0.smithi134.stdout:2/408: write d2/d5/d22/f5e [755023,27773] 0 2024-03-22T07:28:37.961 INFO:tasks.workunit.client.1.smithi195.stdout:8/718: unlink da/dc/c41 0 2024-03-22T07:28:37.961 INFO:tasks.workunit.client.1.smithi195.stdout:3/654: dwrite d3/df/d15/d1d/d5c/f53 [0,4194304] 0 2024-03-22T07:28:37.961 INFO:tasks.workunit.client.1.smithi195.stdout:3/655: write d3/dbf/fd6 [1078895,44853] 0 2024-03-22T07:28:37.961 INFO:tasks.workunit.client.1.smithi195.stdout:3/656: truncate d3/df/fce 251194 0 2024-03-22T07:28:37.962 INFO:tasks.workunit.client.1.smithi195.stdout:6/597: dwrite d5/d5e/d34/d55/d4b/da2/d4a/fbe [0,4194304] 0 2024-03-22T07:28:37.962 INFO:tasks.workunit.client.1.smithi195.stdout:6/598: truncate d5/d5e/d34/d55/d4b/da2/d1a/f54 1426032 0 2024-03-22T07:28:37.962 INFO:tasks.workunit.client.1.smithi195.stdout:3/657: dread d3/d22/f8a [0,4194304] 0 2024-03-22T07:28:37.963 INFO:tasks.workunit.client.1.smithi195.stdout:5/717: write d9/f6f [47051,2650] 0 2024-03-22T07:28:37.964 INFO:tasks.workunit.client.1.smithi195.stdout:2/669: mkdir d2/d3/d21/ddd 0 2024-03-22T07:28:37.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.964+0000 7fb51b040700 1 -- 172.21.15.134:0/3789483125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fbcd0 msgr2=0x7fb5140fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.964+0000 7fb51b040700 1 --2- 172.21.15.134:0/3789483125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fbcd0 0x7fb5140fc0e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb508004940 tx=0x7fb508009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:37.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.965+0000 7fb51b040700 1 -- 172.21.15.134:0/3789483125 shutdown_connections 2024-03-22T07:28:37.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.965+0000 7fb51b040700 1 --2- 172.21.15.134:0/3789483125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fcf80 0x7fb5140fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.965+0000 7fb51b040700 1 --2- 172.21.15.134:0/3789483125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fbcd0 0x7fb5140fc0e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.965+0000 7fb51b040700 1 -- 172.21.15.134:0/3789483125 >> 172.21.15.134:0/3789483125 conn(0x7fb5140f7430 msgr2=0x7fb5140f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:37.967 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:37 smithi134 ceph-mon[29057]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:37.967 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:37 smithi134 ceph-mon[29057]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:37.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.966+0000 7fb51b040700 1 -- 172.21.15.134:0/3789483125 shutdown_connections 2024-03-22T07:28:37.969 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.968+0000 7fb51b040700 1 -- 172.21.15.134:0/3789483125 wait complete. 2024-03-22T07:28:37.970 INFO:tasks.workunit.client.0.smithi134.stdout:8/572: creat d1/d15/d57/d79/fba x:0 0 0 2024-03-22T07:28:37.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.969+0000 7fb51b040700 1 Processor -- start 2024-03-22T07:28:37.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.970+0000 7fb51b040700 1 -- start start 2024-03-22T07:28:37.972 INFO:tasks.workunit.client.1.smithi195.stdout:9/819: truncate d2/d4/d6/db/d20/fc0 30226 0 2024-03-22T07:28:37.972 INFO:tasks.workunit.client.1.smithi195.stdout:9/820: stat d2/d4/d6/db/d20/d4a 0 2024-03-22T07:28:37.973 INFO:tasks.workunit.client.1.smithi195.stdout:9/821: read - d2/d4/d32/d6d/deb/f11f zero size 2024-03-22T07:28:37.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.970+0000 7fb51b040700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 0x7fb514113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:37.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.970+0000 7fb51b040700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fcf80 0x7fb514114410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:37.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.970+0000 7fb51b040700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514114a10 con 0x7fb5140fbcd0 2024-03-22T07:28:37.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.970+0000 7fb51b040700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514115260 con 0x7fb5140fcf80 2024-03-22T07:28:37.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb518ddc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 0x7fb514113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:37.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb518ddc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 0x7fb514113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45902/0 (socket says 172.21.15.134:45902) 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb518ddc700 1 -- 172.21.15.134:0/754734010 learned_addr learned my addr 172.21.15.134:0/754734010 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb513fff700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fcf80 0x7fb514114410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb518ddc700 1 -- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fcf80 msgr2=0x7fb514114410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb518ddc700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fcf80 0x7fb514114410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb518ddc700 1 -- 172.21.15.134:0/754734010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508005040 con 0x7fb5140fbcd0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.971+0000 7fb513fff700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fcf80 0x7fb514114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.972+0000 7fb518ddc700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 0x7fb514113ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb508013870 tx=0x7fb508009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.972+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50800e070 con 0x7fb5140fbcd0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.972+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb50801cab0 con 0x7fb5140fbcd0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.972+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb50800bb70 con 0x7fb5140fbcd0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.972+0000 7fb51b040700 1 -- 172.21.15.134:0/754734010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5141154e0 con 0x7fb5140fbcd0 2024-03-22T07:28:37.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.972+0000 7fb51b040700 1 -- 172.21.15.134:0/754734010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5141159c0 con 0x7fb5140fbcd0 2024-03-22T07:28:37.976 INFO:tasks.workunit.client.0.smithi134.stdout:8/573: write d1/d15/d57/d79/f9f [1498759,67372] 0 2024-03-22T07:28:37.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.974+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 45771+0+0 (secure 0 0 0) 0x7fb508026460 con 0x7fb5140fbcd0 2024-03-22T07:28:37.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.974+0000 7fb5117fa700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb5040388d0 0x7fb50403ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:37.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.974+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb50804edf0 con 0x7fb5140fbcd0 2024-03-22T07:28:37.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.975+0000 7fb51b040700 1 -- 172.21.15.134:0/754734010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51405f5f0 con 0x7fb5140fbcd0 2024-03-22T07:28:37.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.975+0000 7fb513fff700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb5040388d0 0x7fb50403ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:37.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.975+0000 7fb513fff700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb5040388d0 0x7fb50403ad80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb500009fd0 tx=0x7fb50000b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:37.977 INFO:tasks.workunit.client.1.smithi195.stdout:0/661: rename d1/d4/dd/df/f11 to d1/d10/fc6 0 2024-03-22T07:28:37.977 INFO:tasks.workunit.client.1.smithi195.stdout:0/662: truncate d1/d4/dd/df/d44/d8d/fc4 884285 0 2024-03-22T07:28:37.978 INFO:tasks.workunit.client.1.smithi195.stdout:4/659: dread d13/d63/d36/f8d [0,4194304] 0 2024-03-22T07:28:37.979 INFO:tasks.workunit.client.0.smithi134.stdout:9/383: creat d3/d9/d37/d5a/d7f/d80/f87 x:0 0 0 2024-03-22T07:28:37.981 INFO:tasks.workunit.client.0.smithi134.stdout:3/452: unlink d4/d10/f4f 0 2024-03-22T07:28:37.982 INFO:tasks.workunit.client.0.smithi134.stdout:0/469: dwrite dc/d18/f5e [0,4194304] 0 2024-03-22T07:28:37.983 INFO:tasks.workunit.client.0.smithi134.stdout:2/409: unlink d2/c1f 0 2024-03-22T07:28:37.985 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:37.984+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb508013910 con 0x7fb5140fbcd0 2024-03-22T07:28:37.987 INFO:tasks.workunit.client.0.smithi134.stdout:5/443: mknod d1/d8/d20/d62/d65/c96 0 2024-03-22T07:28:37.989 INFO:tasks.workunit.client.1.smithi195.stdout:3/658: dwrite d3/dbf/da0/fd3 [0,4194304] 0 2024-03-22T07:28:37.989 INFO:tasks.workunit.client.1.smithi195.stdout:3/659: write d3/f29 [877166,125879] 0 2024-03-22T07:28:37.989 INFO:tasks.workunit.client.1.smithi195.stdout:2/670: dwrite d2/d3/db/fd6 [0,4194304] 0 2024-03-22T07:28:37.993 INFO:tasks.workunit.client.0.smithi134.stdout:8/574: mkdir d1/d15/d42/d12/dbb 0 2024-03-22T07:28:37.993 INFO:tasks.workunit.client.0.smithi134.stdout:3/453: dread d4/d10/f11 [0,4194304] 0 2024-03-22T07:28:37.994 INFO:tasks.workunit.client.1.smithi195.stdout:6/599: symlink d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/dd5/ld7 0 2024-03-22T07:28:37.995 INFO:tasks.workunit.client.0.smithi134.stdout:1/505: rename d5/da/d1b/f96 to d5/da/d1b/d27/d60/d72/fb3 0 2024-03-22T07:28:37.995 INFO:tasks.workunit.client.0.smithi134.stdout:1/506: read - d5/da/d13/d1e/d9b/f9f zero size 2024-03-22T07:28:37.995 INFO:tasks.workunit.client.0.smithi134.stdout:1/507: write d5/da/d1b/d27/fab [952517,39310] 0 2024-03-22T07:28:37.997 INFO:tasks.workunit.client.1.smithi195.stdout:5/718: mknod d9/d2d/d84/cea 0 2024-03-22T07:28:37.999 INFO:tasks.workunit.client.0.smithi134.stdout:9/384: creat d3/d9/d37/d5a/d7f/f88 x:0 0 0 2024-03-22T07:28:38.003 INFO:tasks.workunit.client.0.smithi134.stdout:8/575: dread d1/d15/d57/d8c/faa [0,4194304] 0 2024-03-22T07:28:38.003 INFO:tasks.workunit.client.0.smithi134.stdout:8/576: fsync d1/d15/d42/d76/d8f/dad/db1/f3e 0 2024-03-22T07:28:38.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/822: creat d2/d4/d6/db5/f128 x:0 0 0 2024-03-22T07:28:38.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/823: chown d2/d4/d32/d6d/d78/ffa 9897 1 2024-03-22T07:28:38.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/824: write d2/d4/f9f [67890,8006] 0 2024-03-22T07:28:38.006 INFO:tasks.workunit.client.1.smithi195.stdout:0/663: creat d1/d4/d12/d6c/d87/fc7 x:0 0 0 2024-03-22T07:28:38.006 INFO:tasks.workunit.client.1.smithi195.stdout:0/664: creat d1/d4/dd/df/d44/d8d/fc8 x:0 0 0 2024-03-22T07:28:38.008 INFO:tasks.workunit.client.0.smithi134.stdout:0/470: creat dc/f8d x:0 0 0 2024-03-22T07:28:38.010 INFO:tasks.workunit.client.1.smithi195.stdout:4/660: mkdir d13/d63/d7a/de4 0 2024-03-22T07:28:38.012 INFO:tasks.workunit.client.1.smithi195.stdout:5/719: fsync d9/f6f 0 2024-03-22T07:28:38.013 INFO:tasks.workunit.client.1.smithi195.stdout:2/671: dwrite d2/d3/d21/d60/d81/d9a/f9c [0,4194304] 0 2024-03-22T07:28:38.016 INFO:tasks.workunit.client.0.smithi134.stdout:5/444: creat d1/d8/d20/d62/d68/f97 x:0 0 0 2024-03-22T07:28:38.016 INFO:tasks.workunit.client.0.smithi134.stdout:5/445: write d1/d8/d83/f8f [862053,127087] 0 2024-03-22T07:28:38.018 INFO:tasks.workunit.client.0.smithi134.stdout:3/454: mknod d4/d8/d7f/c95 0 2024-03-22T07:28:38.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/720: dread d9/d12/d1d/d36/fa6 [0,4194304] 0 2024-03-22T07:28:38.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/721: stat d9/d12/d1d/d69/d78/f7e 0 2024-03-22T07:28:38.018 INFO:tasks.workunit.client.1.smithi195.stdout:5/722: write d9/d22/d46/f85 [951527,99427] 0 2024-03-22T07:28:38.020 INFO:tasks.workunit.client.1.smithi195.stdout:0/665: write d1/d4/dd/df/d44/d6f/f91 [378664,47030] 0 2024-03-22T07:28:38.020 INFO:tasks.workunit.client.0.smithi134.stdout:2/410: rename d2/l44 to d2/d5/d22/d52/d3c/d60/l7f 0 2024-03-22T07:28:38.020 INFO:tasks.workunit.client.0.smithi134.stdout:2/411: creat d2/f80 x:0 0 0 2024-03-22T07:28:38.021 INFO:tasks.workunit.client.0.smithi134.stdout:2/412: chown d2/d5/d8/f5a 31082 1 2024-03-22T07:28:38.023 INFO:tasks.workunit.client.1.smithi195.stdout:1/558: rmdir d0/d2/d9/d2a 39 2024-03-22T07:28:38.023 INFO:tasks.workunit.client.0.smithi134.stdout:1/508: mknod d5/da/d13/d1e/cb4 0 2024-03-22T07:28:38.025 INFO:tasks.workunit.client.1.smithi195.stdout:8/719: rmdir da/d17/d32/d61/d88/d91 39 2024-03-22T07:28:38.025 INFO:tasks.workunit.client.0.smithi134.stdout:9/385: mkdir d3/d9/d37/d5a/d89 0 2024-03-22T07:28:38.029 INFO:tasks.workunit.client.0.smithi134.stdout:8/577: creat d1/d15/d42/d76/d8f/dad/dae/fbc x:0 0 0 2024-03-22T07:28:38.031 INFO:tasks.workunit.client.0.smithi134.stdout:2/413: write d2/d5/d8/d31/f5b [1048978,12044] 0 2024-03-22T07:28:38.033 INFO:tasks.workunit.client.1.smithi195.stdout:1/559: dread d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/f6d [0,4194304] 0 2024-03-22T07:28:38.033 INFO:tasks.workunit.client.1.smithi195.stdout:1/560: getdents d0/d2/d27/db5 0 2024-03-22T07:28:38.034 INFO:tasks.workunit.client.1.smithi195.stdout:3/660: mknod d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9/cde 0 2024-03-22T07:28:38.039 INFO:tasks.workunit.client.0.smithi134.stdout:8/578: dread d1/f5d [0,4194304] 0 2024-03-22T07:28:38.039 INFO:tasks.workunit.client.0.smithi134.stdout:5/446: mknod d1/d8/d20/d62/d65/d82/c98 0 2024-03-22T07:28:38.044 INFO:tasks.workunit.client.0.smithi134.stdout:3/455: creat d4/d8/f96 x:0 0 0 2024-03-22T07:28:38.048 INFO:tasks.workunit.client.1.smithi195.stdout:9/825: rename d2/d4/d32/d6d/d78/fcb to d2/d4/d6/db/f129 0 2024-03-22T07:28:38.055 INFO:tasks.workunit.client.0.smithi134.stdout:2/414: creat d2/d5/d8/d31/f81 x:0 0 0 2024-03-22T07:28:38.055 INFO:tasks.workunit.client.0.smithi134.stdout:2/415: dread - d2/d5/d22/d52/d3c/d4f/d62/f73 zero size 2024-03-22T07:28:38.056 INFO:tasks.workunit.client.0.smithi134.stdout:0/471: dwrite dc/f29 [0,4194304] 0 2024-03-22T07:28:38.057 INFO:tasks.workunit.client.0.smithi134.stdout:0/472: chown dc/d17/f75 1 1 2024-03-22T07:28:38.057 INFO:tasks.workunit.client.0.smithi134.stdout:0/473: getdents dc/d18/d85 0 2024-03-22T07:28:38.057 INFO:tasks.workunit.client.0.smithi134.stdout:0/474: truncate dc/d17/f75 57308 0 2024-03-22T07:28:38.059 INFO:tasks.workunit.client.0.smithi134.stdout:5/447: rmdir d1/d8/d20/d8a 39 2024-03-22T07:28:38.062 INFO:tasks.workunit.client.1.smithi195.stdout:4/661: dwrite d13/d63/d3e/fc8 [0,4194304] 0 2024-03-22T07:28:38.064 INFO:tasks.workunit.client.0.smithi134.stdout:3/456: creat d4/d22/d29/f97 x:0 0 0 2024-03-22T07:28:38.069 INFO:tasks.workunit.client.1.smithi195.stdout:5/723: dwrite d9/d12/d1d/d69/fdd [0,4194304] 0 2024-03-22T07:28:38.069 INFO:tasks.workunit.client.0.smithi134.stdout:9/386: dwrite d3/d9/df/f7d [0,4194304] 0 2024-03-22T07:28:38.072 INFO:tasks.workunit.client.0.smithi134.stdout:0/475: creat dc/d18/f8e x:0 0 0 2024-03-22T07:28:38.075 INFO:tasks.workunit.client.0.smithi134.stdout:3/457: dread d4/d8/f19 [0,4194304] 0 2024-03-22T07:28:38.075 INFO:tasks.workunit.client.1.smithi195.stdout:5/724: dread d9/d12/f3d [0,4194304] 0 2024-03-22T07:28:38.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/509: dwrite d5/d1d/d2d/f6f [4194304,4194304] 0 2024-03-22T07:28:38.077 INFO:tasks.workunit.client.1.smithi195.stdout:5/725: dread d9/d22/fb4 [0,4194304] 0 2024-03-22T07:28:38.077 INFO:tasks.workunit.client.0.smithi134.stdout:2/416: dwrite d2/d5/d22/d52/f4b [0,4194304] 0 2024-03-22T07:28:38.077 INFO:tasks.workunit.client.0.smithi134.stdout:3/458: dread d4/d10/d4b/f4c [0,4194304] 0 2024-03-22T07:28:38.079 INFO:tasks.workunit.client.0.smithi134.stdout:8/579: dwrite d1/d15/d42/d76/f78 [0,4194304] 0 2024-03-22T07:28:38.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/476: rename dc/d18/l39 to dc/d18/d85/l8f 0 2024-03-22T07:28:38.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/477: truncate dc/de/f6a 735559 0 2024-03-22T07:28:38.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/478: chown dc/d18/d72/f7c 251966091 1 2024-03-22T07:28:38.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/479: chown dc/d17/f77 2494 1 2024-03-22T07:28:38.082 INFO:tasks.workunit.client.0.smithi134.stdout:0/480: truncate dc/d18/f79 746610 0 2024-03-22T07:28:38.087 INFO:tasks.workunit.client.0.smithi134.stdout:1/510: mkdir d5/da/d13/d1e/d34/db5 0 2024-03-22T07:28:38.087 INFO:tasks.workunit.client.0.smithi134.stdout:1/511: stat d5/da/d13/d1e/d67 0 2024-03-22T07:28:38.088 INFO:tasks.workunit.client.0.smithi134.stdout:1/512: creat d5/fb6 x:0 0 0 2024-03-22T07:28:38.088 INFO:tasks.workunit.client.0.smithi134.stdout:1/513: write d5/f23 [1945740,119301] 0 2024-03-22T07:28:38.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/387: dwrite d3/d9/d37/d6f/f32 [0,4194304] 0 2024-03-22T07:28:38.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/417: rmdir d2/d5/d22 39 2024-03-22T07:28:38.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/418: write d2/d5/d8/d31/f46 [530587,83295] 0 2024-03-22T07:28:38.090 INFO:tasks.workunit.client.1.smithi195.stdout:0/666: truncate d1/d10/d19/f65 2908534 0 2024-03-22T07:28:38.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/561: rmdir d0/d2/d6/dad 39 2024-03-22T07:28:38.091 INFO:tasks.workunit.client.1.smithi195.stdout:1/562: readlink d0/d2/d9/d2a/la7 0 2024-03-22T07:28:38.092 INFO:tasks.workunit.client.1.smithi195.stdout:3/661: getdents d3/df/d15/d1d/d5c/d47/d67/d80/d87 0 2024-03-22T07:28:38.092 INFO:tasks.workunit.client.1.smithi195.stdout:3/662: fsync d3/dbf/da0/dd1/fd2 0 2024-03-22T07:28:38.093 INFO:tasks.workunit.client.1.smithi195.stdout:6/600: mkdir d5/d16/dd8 0 2024-03-22T07:28:38.094 INFO:tasks.workunit.client.1.smithi195.stdout:6/601: readlink d5/d5e/d34/d55/ld3 0 2024-03-22T07:28:38.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/580: mkdir d1/d15/d42/d9e/dbd 0 2024-03-22T07:28:38.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/581: chown d1/d15/d42/d49 7 1 2024-03-22T07:28:38.095 INFO:tasks.workunit.client.0.smithi134.stdout:8/582: write d1/d15/d42/d12/f35 [2126182,69584] 0 2024-03-22T07:28:38.097 INFO:tasks.workunit.client.1.smithi195.stdout:8/720: rename da/d17/c36 to da/de/db3/dd7/cdb 0 2024-03-22T07:28:38.097 INFO:tasks.workunit.client.1.smithi195.stdout:8/721: fdatasync da/de/f2d 0 2024-03-22T07:28:38.097 INFO:tasks.workunit.client.1.smithi195.stdout:8/722: fdatasync da/de/db3/dd7/fc4 0 2024-03-22T07:28:38.098 INFO:tasks.workunit.client.0.smithi134.stdout:0/481: mkdir dc/d18/d89/d90 0 2024-03-22T07:28:38.098 INFO:tasks.workunit.client.1.smithi195.stdout:7/664: sync 2024-03-22T07:28:38.098 INFO:tasks.workunit.client.1.smithi195.stdout:9/826: mknod d2/d4/d23/c12a 0 2024-03-22T07:28:38.105 INFO:tasks.workunit.client.1.smithi195.stdout:7/665: dread d0/d13/d14/d20/d40/d82/da6/fbf [0,4194304] 0 2024-03-22T07:28:38.105 INFO:tasks.workunit.client.0.smithi134.stdout:1/514: link d5/da/c91 d5/da/d13/d1e/d34/db5/cb7 0 2024-03-22T07:28:38.108 INFO:tasks.workunit.client.0.smithi134.stdout:0/482: dread dc/d17/f41 [0,4194304] 0 2024-03-22T07:28:38.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/662: mknod d13/d63/d36/d5f/d83/ce5 0 2024-03-22T07:28:38.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/663: fdatasync fe 0 2024-03-22T07:28:38.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/664: stat d13/d15/d44/lbc 0 2024-03-22T07:28:38.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/665: chown d13/d63/d3e/d5c/da8 7498072 1 2024-03-22T07:28:38.114 INFO:tasks.workunit.client.0.smithi134.stdout:9/388: getdents d3/d9/d37/d6f 0 2024-03-22T07:28:38.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/726: rename d9/d12/d1d/d69/d78/d41/l66 to d9/d12/d1d/d69/d78/d41/leb 0 2024-03-22T07:28:38.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/727: fdatasync f3 0 2024-03-22T07:28:38.118 INFO:tasks.workunit.client.1.smithi195.stdout:5/728: fdatasync d9/d12/d1d/d36/fa6 0 2024-03-22T07:28:38.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/459: getdents d4 0 2024-03-22T07:28:38.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/460: chown d4/d8/d23/c3f 878805998 1 2024-03-22T07:28:38.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/563: dwrite d0/d2/d6/f8b [0,4194304] 0 2024-03-22T07:28:38.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/564: fsync d0/d2/d6/dad/db1/d6b/d9c/fb2 0 2024-03-22T07:28:38.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/565: write d0/d2/d6/dad/db1/d6a/fa8 [622431,67687] 0 2024-03-22T07:28:38.123 INFO:tasks.workunit.client.1.smithi195.stdout:8/723: dwrite da/d82/dc6/f87 [0,4194304] 0 2024-03-22T07:28:38.126 INFO:tasks.workunit.client.0.smithi134.stdout:8/583: symlink d1/d15/d42/d76/d8f/dad/dae/lbe 0 2024-03-22T07:28:38.128 INFO:tasks.workunit.client.1.smithi195.stdout:4/666: dread d13/d63/d79/f45 [0,4194304] 0 2024-03-22T07:28:38.128 INFO:tasks.workunit.client.1.smithi195.stdout:4/667: chown d13/d63/fc3 388674802 1 2024-03-22T07:28:38.128 INFO:tasks.workunit.client.1.smithi195.stdout:4/668: truncate d13/d63/d36/d9e/faa 1654409 0 2024-03-22T07:28:38.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/584: dread d1/d15/d42/d49/f5f [0,4194304] 0 2024-03-22T07:28:38.129 INFO:tasks.workunit.client.0.smithi134.stdout:1/515: truncate d5/da/f26 494306 0 2024-03-22T07:28:38.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/483: mknod dc/de/d55/d60/c91 0 2024-03-22T07:28:38.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/484: creat dc/d17/f92 x:0 0 0 2024-03-22T07:28:38.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/485: truncate dc/f4e 785695 0 2024-03-22T07:28:38.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/486: chown dc/f3c 65478 1 2024-03-22T07:28:38.131 INFO:tasks.workunit.client.0.smithi134.stdout:0/487: write dc/d18/d72/f8b [470097,13107] 0 2024-03-22T07:28:38.133 INFO:tasks.workunit.client.0.smithi134.stdout:1/516: dread d5/da/d1b/d27/fab [0,4194304] 0 2024-03-22T07:28:38.133 INFO:tasks.workunit.client.0.smithi134.stdout:0/488: dread dc/f1f [0,4194304] 0 2024-03-22T07:28:38.134 INFO:tasks.workunit.client.0.smithi134.stdout:9/389: unlink d3/d9/df/d57/d67/d5f/c6a 0 2024-03-22T07:28:38.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/669: write d13/d63/d3e/d5c/d65/f72 [1201477,2079] 0 2024-03-22T07:28:38.136 INFO:tasks.workunit.client.1.smithi195.stdout:4/670: readlink d13/d63/d21/l91 0 2024-03-22T07:28:38.137 INFO:tasks.workunit.client.0.smithi134.stdout:2/419: rmdir d2 39 2024-03-22T07:28:38.138 INFO:tasks.workunit.client.0.smithi134.stdout:2/420: write d2/d5/d8/d31/f56 [989887,88364] 0 2024-03-22T07:28:38.138 INFO:tasks.workunit.client.0.smithi134.stdout:3/461: dwrite d4/d22/d29/f2e [4194304,4194304] 0 2024-03-22T07:28:38.139 INFO:tasks.workunit.client.1.smithi195.stdout:4/671: write d13/d63/d36/d5f/d83/fbe [864257,834] 0 2024-03-22T07:28:38.140 INFO:tasks.workunit.client.1.smithi195.stdout:4/672: dread d13/d2a/d7e/f87 [0,4194304] 0 2024-03-22T07:28:38.142 INFO:tasks.workunit.client.0.smithi134.stdout:3/462: dread d4/d8/f12 [0,4194304] 0 2024-03-22T07:28:38.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/463: dread d4/d10/d4b/f65 [0,4194304] 0 2024-03-22T07:28:38.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/464: creat d4/d22/d3c/f98 x:0 0 0 2024-03-22T07:28:38.156 INFO:tasks.workunit.client.1.smithi195.stdout:2/672: rmdir d2 39 2024-03-22T07:28:38.159 INFO:tasks.workunit.client.0.smithi134.stdout:3/465: dwrite d4/d22/d29/d50/f7b [0,4194304] 0 2024-03-22T07:28:38.159 INFO:tasks.workunit.client.1.smithi195.stdout:0/667: symlink d1/d4/dd/df/lc9 0 2024-03-22T07:28:38.159 INFO:tasks.workunit.client.1.smithi195.stdout:0/668: write d1/d10/d19/d20/fb7 [965924,91830] 0 2024-03-22T07:28:38.159 INFO:tasks.workunit.client.1.smithi195.stdout:0/669: fdatasync d1/d10/d1f/f21 0 2024-03-22T07:28:38.160 INFO:tasks.workunit.client.0.smithi134.stdout:9/390: link d3/d9/d37/d6f/d54/f83 d3/d9/df/d57/d67/f8a 0 2024-03-22T07:28:38.162 INFO:tasks.workunit.client.1.smithi195.stdout:3/663: symlink d3/dbf/da0/ldf 0 2024-03-22T07:28:38.163 INFO:tasks.workunit.client.1.smithi195.stdout:2/673: dread d2/d3/d7/da/de/f65 [0,4194304] 0 2024-03-22T07:28:38.163 INFO:tasks.workunit.client.0.smithi134.stdout:2/421: creat d2/d5/d8/d7e/f82 x:0 0 0 2024-03-22T07:28:38.164 INFO:tasks.workunit.client.1.smithi195.stdout:6/602: creat d5/d6d/d95/fd9 x:0 0 0 2024-03-22T07:28:38.166 INFO:tasks.workunit.client.0.smithi134.stdout:0/489: write dc/d18/f2e [306619,890] 0 2024-03-22T07:28:38.167 INFO:tasks.workunit.client.1.smithi195.stdout:9/827: rename d2/d4/d1d/fce to d2/d122/f12b 0 2024-03-22T07:28:38.174 INFO:tasks.workunit.client.1.smithi195.stdout:7/666: link d0/d13/d22/d57/fb1 d0/d13/d14/d2f/dae/fe6 0 2024-03-22T07:28:38.176 INFO:tasks.workunit.client.0.smithi134.stdout:1/517: creat d5/da/d1b/d27/d39/da4/fb8 x:0 0 0 2024-03-22T07:28:38.176 INFO:tasks.workunit.client.1.smithi195.stdout:3/664: dread d3/df/d15/f1c [0,4194304] 0 2024-03-22T07:28:38.181 INFO:tasks.workunit.client.1.smithi195.stdout:3/665: dread d3/d18/d89/d70/f71 [0,4194304] 0 2024-03-22T07:28:38.181 INFO:tasks.workunit.client.1.smithi195.stdout:8/724: symlink da/d17/d32/d61/d88/ldc 0 2024-03-22T07:28:38.181 INFO:tasks.workunit.client.1.smithi195.stdout:8/725: dread - da/de/db3/dd7/fc4 zero size 2024-03-22T07:28:38.182 INFO:tasks.workunit.client.1.smithi195.stdout:7/667: read d0/d13/d14/d29/d35/f37 [2901776,53752] 0 2024-03-22T07:28:38.182 INFO:tasks.workunit.client.1.smithi195.stdout:7/668: chown d0/d13/d14/d29/d35/d3a/d7e/cca 18675929 1 2024-03-22T07:28:38.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/674: dwrite d2/d3/f79 [8388608,4194304] 0 2024-03-22T07:28:38.183 INFO:tasks.workunit.client.1.smithi195.stdout:2/675: write d2/d3/d21/d40/f5d [167472,86349] 0 2024-03-22T07:28:38.184 INFO:tasks.workunit.client.0.smithi134.stdout:9/391: symlink d3/d9/d37/d3c/d71/l8b 0 2024-03-22T07:28:38.189 INFO:tasks.workunit.client.1.smithi195.stdout:3/666: write d3/df/d15/d1d/d5c/d47/d67/d80/f7d [3608495,17820] 0 2024-03-22T07:28:38.189 INFO:tasks.workunit.client.0.smithi134.stdout:2/422: mkdir d2/d5/d8/d7e/d83 0 2024-03-22T07:28:38.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/490: link dc/d18/c1e dc/d18/d89/c93 0 2024-03-22T07:28:38.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/491: dread - dc/d18/f74 zero size 2024-03-22T07:28:38.191 INFO:tasks.workunit.client.1.smithi195.stdout:8/726: dread da/d82/dc6/d53/d8d/f92 [4194304,4194304] 0 2024-03-22T07:28:38.192 INFO:tasks.workunit.client.1.smithi195.stdout:8/727: chown da/de/db3/dc7/dd3 10770960 1 2024-03-22T07:28:38.192 INFO:tasks.workunit.client.1.smithi195.stdout:4/673: mknod d13/d2a/d7e/d8c/db7/ce6 0 2024-03-22T07:28:38.193 INFO:tasks.workunit.client.0.smithi134.stdout:1/518: mkdir d5/da/d13/db9 0 2024-03-22T07:28:38.193 INFO:tasks.workunit.client.0.smithi134.stdout:1/519: chown d5/da/c3c 336518 1 2024-03-22T07:28:38.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/466: getdents d4/d22/d29/d50 0 2024-03-22T07:28:38.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/467: write d4/d8/d45/f51 [1347063,55229] 0 2024-03-22T07:28:38.194 INFO:tasks.workunit.client.1.smithi195.stdout:6/603: symlink d5/d16/d45/d53/d59/lda 0 2024-03-22T07:28:38.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/392: mkdir d3/d9/d37/d3c/d71/d8c 0 2024-03-22T07:28:38.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/393: write d3/d9/f18 [4572678,58370] 0 2024-03-22T07:28:38.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/394: chown d3/d9/df/d12/f1d 29186 1 2024-03-22T07:28:38.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/423: creat d2/f84 x:0 0 0 2024-03-22T07:28:38.203 INFO:tasks.workunit.client.0.smithi134.stdout:2/424: write d2/f58 [185371,123025] 0 2024-03-22T07:28:38.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:37 smithi195 ceph-mon[36144]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:38.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:37 smithi195 ceph-mon[36144]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:38.205 INFO:tasks.workunit.client.1.smithi195.stdout:9/828: creat d2/d4/d6/db/d20/f12c x:0 0 0 2024-03-22T07:28:38.206 INFO:tasks.workunit.client.0.smithi134.stdout:0/492: rmdir dc/d18/d89/d90 0 2024-03-22T07:28:38.207 INFO:tasks.workunit.client.1.smithi195.stdout:7/669: mkdir d0/d13/d14/d29/d35/de7 0 2024-03-22T07:28:38.209 INFO:tasks.workunit.client.0.smithi134.stdout:1/520: link d5/da/f26 d5/da/d13/db9/fba 0 2024-03-22T07:28:38.210 INFO:tasks.workunit.client.1.smithi195.stdout:2/676: mknod d2/d3/d7/da/cde 0 2024-03-22T07:28:38.211 INFO:tasks.workunit.client.1.smithi195.stdout:8/728: dwrite da/f6b [0,4194304] 0 2024-03-22T07:28:38.211 INFO:tasks.workunit.client.1.smithi195.stdout:8/729: write da/d17/d32/d61/d88/d91/fa8 [477289,72042] 0 2024-03-22T07:28:38.211 INFO:tasks.workunit.client.0.smithi134.stdout:3/468: dwrite d4/d22/d29/f97 [0,4194304] 0 2024-03-22T07:28:38.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/667: mknod d3/d18/d89/d70/db5/ce0 0 2024-03-22T07:28:38.212 INFO:tasks.workunit.client.1.smithi195.stdout:3/668: readlink d3/df/l95 0 2024-03-22T07:28:38.213 INFO:tasks.workunit.client.1.smithi195.stdout:3/669: truncate d3/d22/fb3 564692 0 2024-03-22T07:28:38.213 INFO:tasks.workunit.client.1.smithi195.stdout:3/670: chown d3/df/d15/d1d/d5c/d47 71 1 2024-03-22T07:28:38.214 INFO:tasks.workunit.client.1.smithi195.stdout:4/674: creat d13/d63/d36/d9e/fe7 x:0 0 0 2024-03-22T07:28:38.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/425: symlink d2/d5/d8/d31/l85 0 2024-03-22T07:28:38.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/426: dread - d2/d5/d8/f42 zero size 2024-03-22T07:28:38.218 INFO:tasks.workunit.client.1.smithi195.stdout:0/670: getdents d1/d4/dd/d66/d80 0 2024-03-22T07:28:38.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/604: rename d5/f51 to d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/fdb 0 2024-03-22T07:28:38.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/605: dread - d5/d16/d5b/f7c zero size 2024-03-22T07:28:38.222 INFO:tasks.workunit.client.1.smithi195.stdout:6/606: write d5/d5e/d34/d55/d3b/d6e/d97/fd0 [3315310,69874] 0 2024-03-22T07:28:38.223 INFO:tasks.workunit.client.0.smithi134.stdout:0/493: mknod dc/d18/d89/c94 0 2024-03-22T07:28:38.224 INFO:tasks.workunit.client.1.smithi195.stdout:7/670: truncate d0/d13/d14/d20/f4b 464792 0 2024-03-22T07:28:38.226 INFO:tasks.workunit.client.0.smithi134.stdout:1/521: unlink d5/da/d13/d1e/c50 0 2024-03-22T07:28:38.227 INFO:tasks.workunit.client.1.smithi195.stdout:2/677: creat d2/d3/db/db3/fdf x:0 0 0 2024-03-22T07:28:38.228 INFO:tasks.workunit.client.1.smithi195.stdout:3/671: dwrite d3/df/d15/fd8 [0,4194304] 0 2024-03-22T07:28:38.228 INFO:tasks.workunit.client.1.smithi195.stdout:3/672: fdatasync d3/dbf/fd6 0 2024-03-22T07:28:38.234 INFO:tasks.workunit.client.0.smithi134.stdout:3/469: creat d4/d8/d23/f99 x:0 0 0 2024-03-22T07:28:38.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/522: dwrite d5/fe [0,4194304] 0 2024-03-22T07:28:38.243 INFO:tasks.workunit.client.0.smithi134.stdout:1/523: stat d5/d1d/d49/d92/l99 0 2024-03-22T07:28:38.245 INFO:tasks.workunit.client.1.smithi195.stdout:8/730: rename da/de/db3/dd7 to da/de/db3/ddd 0 2024-03-22T07:28:38.249 INFO:tasks.workunit.client.1.smithi195.stdout:0/671: mkdir d1/d4/dd/df/d44/d6f/dca 0 2024-03-22T07:28:38.249 INFO:tasks.workunit.client.1.smithi195.stdout:0/672: readlink d1/d4/d12/l15 0 2024-03-22T07:28:38.250 INFO:tasks.workunit.client.0.smithi134.stdout:0/494: mknod dc/d18/d89/c95 0 2024-03-22T07:28:38.250 INFO:tasks.workunit.client.0.smithi134.stdout:0/495: chown dc/l53 7268686 1 2024-03-22T07:28:38.250 INFO:tasks.workunit.client.0.smithi134.stdout:0/496: fdatasync dc/de/d55/f56 0 2024-03-22T07:28:38.250 INFO:tasks.workunit.client.0.smithi134.stdout:0/497: chown dc/d17/l42 18 1 2024-03-22T07:28:38.253 INFO:tasks.workunit.client.1.smithi195.stdout:4/675: rename d13/c62 to d13/d63/d36/d5f/d83/ce8 0 2024-03-22T07:28:38.256 INFO:tasks.workunit.client.0.smithi134.stdout:3/470: symlink d4/d22/d29/d82/l9a 0 2024-03-22T07:28:38.256 INFO:tasks.workunit.client.0.smithi134.stdout:1/524: dwrite d5/d1d/f77 [0,4194304] 0 2024-03-22T07:28:38.257 INFO:tasks.workunit.client.0.smithi134.stdout:1/525: readlink d5/da/d13/d1e/d62/l6d 0 2024-03-22T07:28:38.258 INFO:tasks.workunit.client.1.smithi195.stdout:6/607: mkdir d5/d5e/d34/d55/d4b/ddc 0 2024-03-22T07:28:38.260 INFO:tasks.workunit.client.0.smithi134.stdout:2/427: symlink d2/d5/l86 0 2024-03-22T07:28:38.262 INFO:tasks.workunit.client.1.smithi195.stdout:9/829: getdents d2/d4/d23/d74 0 2024-03-22T07:28:38.265 INFO:tasks.workunit.client.0.smithi134.stdout:0/498: symlink dc/de/d55/d65/l96 0 2024-03-22T07:28:38.266 INFO:tasks.workunit.client.0.smithi134.stdout:0/499: dread dc/d18/d72/f8b [0,4194304] 0 2024-03-22T07:28:38.267 INFO:tasks.workunit.client.0.smithi134.stdout:0/500: readlink dc/d17/l2c 0 2024-03-22T07:28:38.268 INFO:tasks.workunit.client.0.smithi134.stdout:3/471: rename d4/d22/d29/d50/f6f to d4/d8/d69/d6a/f9b 0 2024-03-22T07:28:38.270 INFO:tasks.workunit.client.1.smithi195.stdout:7/671: creat d0/d13/d22/d57/d7b/d8c/fe8 x:0 0 0 2024-03-22T07:28:38.270 INFO:tasks.workunit.client.1.smithi195.stdout:7/672: write d0/d13/d14/d29/f89 [251494,63002] 0 2024-03-22T07:28:38.271 INFO:tasks.workunit.client.0.smithi134.stdout:0/501: dread dc/d17/f41 [0,4194304] 0 2024-03-22T07:28:38.272 INFO:tasks.workunit.client.0.smithi134.stdout:0/502: fdatasync dc/d18/f1d 0 2024-03-22T07:28:38.273 INFO:tasks.workunit.client.1.smithi195.stdout:2/678: unlink d2/d1e/f64 0 2024-03-22T07:28:38.279 INFO:tasks.workunit.client.0.smithi134.stdout:1/526: mknod d5/da/d1b/d27/d60/cbb 0 2024-03-22T07:28:38.279 INFO:tasks.workunit.client.0.smithi134.stdout:1/527: chown d5/da/d1b/f1c 237233 1 2024-03-22T07:28:38.279 INFO:tasks.workunit.client.1.smithi195.stdout:5/729: sync 2024-03-22T07:28:38.280 INFO:tasks.workunit.client.1.smithi195.stdout:9/830: dwrite d2/d4/d6/d18/d50/d88/f9a [0,4194304] 0 2024-03-22T07:28:38.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/831: creat d2/d4/d32/f12d x:0 0 0 2024-03-22T07:28:38.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/832: creat d2/d4/d32/f12e x:0 0 0 2024-03-22T07:28:38.281 INFO:tasks.workunit.client.1.smithi195.stdout:4/676: dwrite d13/d63/d36/fc5 [0,4194304] 0 2024-03-22T07:28:38.281 INFO:tasks.workunit.client.1.smithi195.stdout:4/677: dread - d13/d15/faf zero size 2024-03-22T07:28:38.281 INFO:tasks.workunit.client.0.smithi134.stdout:3/472: rmdir d4/d22/d29/d50 39 2024-03-22T07:28:38.283 INFO:tasks.workunit.client.0.smithi134.stdout:2/428: getdents d2 0 2024-03-22T07:28:38.284 INFO:tasks.workunit.client.0.smithi134.stdout:3/473: mkdir d4/d8/d7f/d9c 0 2024-03-22T07:28:38.287 INFO:tasks.workunit.client.0.smithi134.stdout:0/503: dwrite dc/f3c [4194304,4194304] 0 2024-03-22T07:28:38.287 INFO:tasks.workunit.client.1.smithi195.stdout:5/730: dread d9/d12/d1d/d69/d78/f97 [0,4194304] 0 2024-03-22T07:28:38.288 INFO:tasks.workunit.client.0.smithi134.stdout:1/528: symlink d5/da/d1b/d27/d60/d72/lbc 0 2024-03-22T07:28:38.288 INFO:tasks.workunit.client.0.smithi134.stdout:1/529: stat d5/da/d13/d1e/d45/l87 0 2024-03-22T07:28:38.289 INFO:tasks.workunit.client.1.smithi195.stdout:0/673: mkdir d1/d4/dd/df/d44/d6f/dcb 0 2024-03-22T07:28:38.292 INFO:tasks.workunit.client.0.smithi134.stdout:2/429: creat d2/f87 x:0 0 0 2024-03-22T07:28:38.294 INFO:tasks.workunit.client.1.smithi195.stdout:6/608: mknod d5/d5e/d34/d55/d3b/d6e/cdd 0 2024-03-22T07:28:38.294 INFO:tasks.workunit.client.1.smithi195.stdout:6/609: write d5/d5e/d34/d55/d3b/d7f/fcc [773070,96396] 0 2024-03-22T07:28:38.296 INFO:tasks.workunit.client.0.smithi134.stdout:0/504: creat dc/de/d55/f97 x:0 0 0 2024-03-22T07:28:38.300 INFO:tasks.workunit.client.1.smithi195.stdout:7/673: symlink d0/d98/le9 0 2024-03-22T07:28:38.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/505: creat dc/de/d55/d65/d82/f98 x:0 0 0 2024-03-22T07:28:38.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/679: creat d2/d3/d7/d19/fe0 x:0 0 0 2024-03-22T07:28:38.304 INFO:tasks.workunit.client.0.smithi134.stdout:1/530: dwrite d5/da/d13/f98 [0,4194304] 0 2024-03-22T07:28:38.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/474: dwrite d4/d8/f49 [0,4194304] 0 2024-03-22T07:28:38.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/475: chown d4/d22/f20 9 1 2024-03-22T07:28:38.306 INFO:tasks.workunit.client.0.smithi134.stdout:2/430: truncate d2/d5/d8/f5a 307882 0 2024-03-22T07:28:38.312 INFO:tasks.workunit.client.0.smithi134.stdout:0/506: write dc/d17/f77 [1358125,123731] 0 2024-03-22T07:28:38.312 INFO:tasks.workunit.client.0.smithi134.stdout:0/507: fsync dc/d17/f75 0 2024-03-22T07:28:38.313 INFO:tasks.workunit.client.1.smithi195.stdout:1/566: sync 2024-03-22T07:28:38.314 INFO:tasks.workunit.client.1.smithi195.stdout:7/674: dwrite d0/d13/d22/d57/fad [0,4194304] 0 2024-03-22T07:28:38.314 INFO:tasks.workunit.client.1.smithi195.stdout:7/675: stat d0/d13/d14/d2f/f86 0 2024-03-22T07:28:38.314 INFO:tasks.workunit.client.0.smithi134.stdout:1/531: write d5/da/d13/d1e/d45/f7f [1424097,79369] 0 2024-03-22T07:28:38.317 INFO:tasks.workunit.client.1.smithi195.stdout:9/833: symlink d2/d4/d32/d6d/deb/l12f 0 2024-03-22T07:28:38.317 INFO:tasks.workunit.client.1.smithi195.stdout:4/678: rmdir d13/d63/d79/d68 39 2024-03-22T07:28:38.318 INFO:tasks.workunit.client.1.smithi195.stdout:4/679: dread - d13/d15/d64/fc1 zero size 2024-03-22T07:28:38.319 INFO:tasks.workunit.client.1.smithi195.stdout:5/731: symlink d9/d12/d1d/d36/d7d/dd2/lec 0 2024-03-22T07:28:38.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/674: mknod d1/d4/dd/df/d44/d8d/ccc 0 2024-03-22T07:28:38.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/675: write d1/d4/d12/d6c/d87/fc7 [766759,66412] 0 2024-03-22T07:28:38.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/676: chown d1/d10/c7c 3056 1 2024-03-22T07:28:38.324 INFO:tasks.workunit.client.1.smithi195.stdout:0/677: fsync d1/d10/d1f/f9d 0 2024-03-22T07:28:38.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/732: write d9/d12/d1d/d36/fa3 [2194029,65882] 0 2024-03-22T07:28:38.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/733: creat d9/da8/fed x:0 0 0 2024-03-22T07:28:38.327 INFO:tasks.workunit.client.1.smithi195.stdout:5/734: readlink d9/d73/dbb/ld9 0 2024-03-22T07:28:38.328 INFO:tasks.workunit.client.1.smithi195.stdout:6/610: unlink d5/d16/d45/d53/d59/ca5 0 2024-03-22T07:28:38.328 INFO:tasks.workunit.client.1.smithi195.stdout:5/735: dread d9/d12/d14/f4b [0,4194304] 0 2024-03-22T07:28:38.330 INFO:tasks.workunit.client.0.smithi134.stdout:3/476: mknod d4/d10/d4b/c9d 0 2024-03-22T07:28:38.332 INFO:tasks.workunit.client.1.smithi195.stdout:2/680: rename d2/d3/d7/d19/l59 to d2/d3/d21/ddd/le1 0 2024-03-22T07:28:38.333 INFO:tasks.workunit.client.1.smithi195.stdout:2/681: dread - d2/d3/d21/d40/fa0 zero size 2024-03-22T07:28:38.334 INFO:tasks.workunit.client.1.smithi195.stdout:1/567: dwrite d0/d2/d6/f8b [0,4194304] 0 2024-03-22T07:28:38.339 INFO:tasks.workunit.client.0.smithi134.stdout:0/508: link dc/d17/f48 dc/d18/d89/f99 0 2024-03-22T07:28:38.340 INFO:tasks.workunit.client.1.smithi195.stdout:7/676: rmdir d0/d98 39 2024-03-22T07:28:38.341 INFO:tasks.workunit.client.1.smithi195.stdout:7/677: write d0/d13/d14/d2b/fc5 [1129836,105398] 0 2024-03-22T07:28:38.341 INFO:tasks.workunit.client.1.smithi195.stdout:7/678: creat d0/d13/d14/d80/d9c/fea x:0 0 0 2024-03-22T07:28:38.342 INFO:tasks.workunit.client.0.smithi134.stdout:1/532: creat d5/da/d68/da1/fbd x:0 0 0 2024-03-22T07:28:38.343 INFO:tasks.workunit.client.1.smithi195.stdout:5/736: dwrite d9/d12/d1d/d69/d78/f7e [0,4194304] 0 2024-03-22T07:28:38.344 INFO:tasks.workunit.client.1.smithi195.stdout:9/834: symlink d2/d4/d32/l130 0 2024-03-22T07:28:38.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/678: truncate d1/d4/dd/df/d44/d6f/f91 2095628 0 2024-03-22T07:28:38.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/679: chown d1/d4/dd/d66/c8e 496 1 2024-03-22T07:28:38.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/680: stat d1/d4/dd/df/c74 0 2024-03-22T07:28:38.348 INFO:tasks.workunit.client.0.smithi134.stdout:2/431: dread d2/d5/d8/d5d/d5f/f6f [0,4194304] 0 2024-03-22T07:28:38.348 INFO:tasks.workunit.client.0.smithi134.stdout:0/509: stat dc/d18/c3d 0 2024-03-22T07:28:38.348 INFO:tasks.workunit.client.0.smithi134.stdout:0/510: chown dc/d18/f5a 2 1 2024-03-22T07:28:38.348 INFO:tasks.workunit.client.0.smithi134.stdout:0/511: readlink dc/d18/l4c 0 2024-03-22T07:28:38.350 INFO:tasks.workunit.client.1.smithi195.stdout:5/737: dread d9/f1c [0,4194304] 0 2024-03-22T07:28:38.350 INFO:tasks.workunit.client.1.smithi195.stdout:5/738: write d9/d73/da1/fab [361627,63403] 0 2024-03-22T07:28:38.350 INFO:tasks.workunit.client.1.smithi195.stdout:5/739: dread - d9/d22/fbf zero size 2024-03-22T07:28:38.350 INFO:tasks.workunit.client.0.smithi134.stdout:2/432: creat d2/d5/d8/f88 x:0 0 0 2024-03-22T07:28:38.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/740: dread d9/d2d/f40 [0,4194304] 0 2024-03-22T07:28:38.352 INFO:tasks.workunit.client.1.smithi195.stdout:5/741: dread - d9/da8/fed zero size 2024-03-22T07:28:38.353 INFO:tasks.workunit.client.0.smithi134.stdout:3/477: dwrite d4/d8/f96 [0,4194304] 0 2024-03-22T07:28:38.354 INFO:tasks.workunit.client.0.smithi134.stdout:3/478: read d4/d8/d23/f60 [3612946,102050] 0 2024-03-22T07:28:38.354 INFO:tasks.workunit.client.0.smithi134.stdout:3/479: chown d4/d22/c68 476873 1 2024-03-22T07:28:38.354 INFO:tasks.workunit.client.0.smithi134.stdout:0/512: link dc/f20 dc/de/d55/f9a 0 2024-03-22T07:28:38.354 INFO:tasks.workunit.client.0.smithi134.stdout:0/513: stat dc/de/d55/d60/f8a 0 2024-03-22T07:28:38.356 INFO:tasks.workunit.client.1.smithi195.stdout:7/679: dread d0/d13/d14/d20/d40/d82/daa/fc2 [0,4194304] 0 2024-03-22T07:28:38.356 INFO:tasks.workunit.client.0.smithi134.stdout:2/433: creat d2/d5/d22/d52/d3c/f89 x:0 0 0 2024-03-22T07:28:38.357 INFO:tasks.workunit.client.1.smithi195.stdout:9/835: dread d2/d4/d32/f37 [0,4194304] 0 2024-03-22T07:28:38.357 INFO:tasks.workunit.client.1.smithi195.stdout:9/836: fsync d2/d4/d6/db/d20/f12c 0 2024-03-22T07:28:38.360 INFO:tasks.workunit.client.0.smithi134.stdout:1/533: dwrite d5/fb6 [0,4194304] 0 2024-03-22T07:28:38.360 INFO:tasks.workunit.client.0.smithi134.stdout:1/534: fsync d5/d1d/d49/f95 0 2024-03-22T07:28:38.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/682: link d2/d3/d7/d19/f28 d2/d3/fe2 0 2024-03-22T07:28:38.367 INFO:tasks.workunit.client.0.smithi134.stdout:0/514: truncate dc/de/f23 2996330 0 2024-03-22T07:28:38.368 INFO:tasks.workunit.client.1.smithi195.stdout:1/568: truncate d0/d2/d6/f71 925520 0 2024-03-22T07:28:38.370 INFO:tasks.workunit.client.0.smithi134.stdout:2/434: symlink d2/d5/d22/d52/d3c/d60/d7c/l8a 0 2024-03-22T07:28:38.370 INFO:tasks.workunit.client.0.smithi134.stdout:2/435: dread - d2/d5/d8/f42 zero size 2024-03-22T07:28:38.380 INFO:tasks.workunit.client.0.smithi134.stdout:2/436: rmdir d2/d5/d8/d5d 39 2024-03-22T07:28:38.381 INFO:tasks.workunit.client.0.smithi134.stdout:4/514: sync 2024-03-22T07:28:38.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/635: sync 2024-03-22T07:28:38.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/359: sync 2024-03-22T07:28:38.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/636: fdatasync d1/de/d11/d48/d52/d46/f61 0 2024-03-22T07:28:38.382 INFO:tasks.workunit.client.0.smithi134.stdout:7/637: write d1/de/d11/f6a [134081,113090] 0 2024-03-22T07:28:38.382 INFO:tasks.workunit.client.0.smithi134.stdout:7/638: chown d1/de/d11/d2b/d31/d85/f93 0 1 2024-03-22T07:28:38.382 INFO:tasks.workunit.client.1.smithi195.stdout:0/681: mkdir d1/d4/dd/df/d44/db4/dcd 0 2024-03-22T07:28:38.384 INFO:tasks.workunit.client.1.smithi195.stdout:5/742: symlink d9/d22/d7b/d98/dbe/lee 0 2024-03-22T07:28:38.385 INFO:tasks.workunit.client.1.smithi195.stdout:9/837: dwrite d2/d4/d23/d74/fcc [0,4194304] 0 2024-03-22T07:28:38.387 INFO:tasks.workunit.client.1.smithi195.stdout:7/680: dwrite d0/ff [0,4194304] 0 2024-03-22T07:28:38.388 INFO:tasks.workunit.client.0.smithi134.stdout:2/437: symlink d2/d5/d22/d52/d3c/d4f/d6e/l8b 0 2024-03-22T07:28:38.392 INFO:tasks.workunit.client.1.smithi195.stdout:0/682: dread d1/d4/d12/d6c/dbc/d43/fc0 [0,4194304] 0 2024-03-22T07:28:38.393 INFO:tasks.workunit.client.1.smithi195.stdout:0/683: fsync d1/d4/dd/df/d44/f50 0 2024-03-22T07:28:38.394 INFO:tasks.workunit.client.0.smithi134.stdout:6/360: link d2/d1b/f6c d2/d3f/f88 0 2024-03-22T07:28:38.395 INFO:tasks.workunit.client.1.smithi195.stdout:9/838: write d2/d4/d6/d18/d50/f59 [2416139,28383] 0 2024-03-22T07:28:38.395 INFO:tasks.workunit.client.1.smithi195.stdout:9/839: truncate d2/f82 1471101 0 2024-03-22T07:28:38.397 INFO:tasks.workunit.client.0.smithi134.stdout:7/639: write d1/de/d11/d48/f8b [3257729,94040] 0 2024-03-22T07:28:38.399 INFO:tasks.workunit.client.0.smithi134.stdout:2/438: write d2/d5/d22/f23 [1607283,85625] 0 2024-03-22T07:28:38.402 INFO:tasks.workunit.client.0.smithi134.stdout:3/480: dwrite d4/d8/f6e [8388608,4194304] 0 2024-03-22T07:28:38.404 INFO:tasks.workunit.client.0.smithi134.stdout:4/515: getdents d2/d15/d35/d37 0 2024-03-22T07:28:38.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/640: write d1/de/d11/fb2 [3916790,51883] 0 2024-03-22T07:28:38.405 INFO:tasks.workunit.client.0.smithi134.stdout:7/641: chown d1/de/d11/d2b/d31/f8e 8399701 1 2024-03-22T07:28:38.405 INFO:tasks.workunit.client.1.smithi195.stdout:4/680: rename d13/d2a to d13/d63/d79/de9 0 2024-03-22T07:28:38.405 INFO:tasks.workunit.client.1.smithi195.stdout:4/681: readlink d13/la5 0 2024-03-22T07:28:38.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/569: mknod d0/d2/d6/dad/db1/d97/d39/d64/cb6 0 2024-03-22T07:28:38.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/570: creat d0/d2/d9/da4/fb7 x:0 0 0 2024-03-22T07:28:38.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/571: read d0/d2/d6/dad/db1/d97/d39/f65 [783231,112516] 0 2024-03-22T07:28:38.408 INFO:tasks.workunit.client.1.smithi195.stdout:1/572: chown d0/d2/d6/dad/db1/d97/d39/d64/d7a/c7e 1612 1 2024-03-22T07:28:38.409 INFO:tasks.workunit.client.0.smithi134.stdout:6/361: symlink d2/d3f/l89 0 2024-03-22T07:28:38.412 INFO:tasks.workunit.client.1.smithi195.stdout:5/743: dwrite d9/d2d/d8f/fb6 [0,4194304] 0 2024-03-22T07:28:38.412 INFO:tasks.workunit.client.0.smithi134.stdout:0/515: dwrite dc/d18/f5e [0,4194304] 0 2024-03-22T07:28:38.412 INFO:tasks.workunit.client.0.smithi134.stdout:0/516: truncate dc/de/d55/d60/f8a 806978 0 2024-03-22T07:28:38.415 INFO:tasks.workunit.client.0.smithi134.stdout:1/535: dwrite d5/f20 [0,4194304] 0 2024-03-22T07:28:38.417 INFO:tasks.workunit.client.0.smithi134.stdout:2/439: symlink d2/d5/d54/l8c 0 2024-03-22T07:28:38.427 INFO:tasks.workunit.client.1.smithi195.stdout:4/682: dwrite d13/d63/d3e/d5c/f69 [4194304,4194304] 0 2024-03-22T07:28:38.428 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.426+0000 7fb51b040700 1 -- 172.21.15.134:0/754734010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb514103840 con 0x7fb5140fbcd0 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.428+0000 7fb5117fa700 1 -- 172.21.15.134:0/754734010 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7fb514103840 con 0x7fb5140fbcd0 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:28:38.429 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:28:38.430 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:38.431 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:38.432 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:28:38.432 INFO:tasks.workunit.client.0.smithi134.stdout:3/481: mknod d4/d8/c9e 0 2024-03-22T07:28:38.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.431+0000 7fb4feffd700 1 -- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb5040388d0 msgr2=0x7fb50403ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:38.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.431+0000 7fb4feffd700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb5040388d0 0x7fb50403ad80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb500009fd0 tx=0x7fb50000b040 comp rx=0 tx=0).stop 2024-03-22T07:28:38.432 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.431+0000 7fb4feffd700 1 -- 172.21.15.134:0/754734010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 msgr2=0x7fb514113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:38.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.431+0000 7fb4feffd700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 0x7fb514113ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb508013870 tx=0x7fb508009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:38.433 INFO:tasks.workunit.client.0.smithi134.stdout:0/517: dwrite dc/f20 [4194304,4194304] 0 2024-03-22T07:28:38.433 INFO:tasks.workunit.client.0.smithi134.stdout:4/516: truncate d2/d2a/d50/f59 3504199 0 2024-03-22T07:28:38.433 INFO:tasks.workunit.client.0.smithi134.stdout:4/517: read d2/d25/d48/f4b [3042333,75753] 0 2024-03-22T07:28:38.435 INFO:tasks.workunit.client.0.smithi134.stdout:7/642: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:38.436 INFO:tasks.workunit.client.1.smithi195.stdout:3/673: sync 2024-03-22T07:28:38.436 INFO:tasks.workunit.client.1.smithi195.stdout:8/731: sync 2024-03-22T07:28:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.435+0000 7fb4feffd700 1 -- 172.21.15.134:0/754734010 shutdown_connections 2024-03-22T07:28:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.435+0000 7fb4feffd700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb5040388d0 0x7fb50403ad80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.435+0000 7fb4feffd700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5140fbcd0 0x7fb514113ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.435+0000 7fb4feffd700 1 --2- 172.21.15.134:0/754734010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb5140fcf80 0x7fb514114410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.435+0000 7fb4feffd700 1 -- 172.21.15.134:0/754734010 >> 172.21.15.134:0/754734010 conn(0x7fb5140f7430 msgr2=0x7fb5140f8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.436+0000 7fb4feffd700 1 -- 172.21.15.134:0/754734010 shutdown_connections 2024-03-22T07:28:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.436+0000 7fb4feffd700 1 -- 172.21.15.134:0/754734010 wait complete. 2024-03-22T07:28:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:28:38.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/681: mkdir d0/d13/d14/d20/deb 0 2024-03-22T07:28:38.440 INFO:tasks.workunit.client.1.smithi195.stdout:7/682: chown d0/l12 368556 1 2024-03-22T07:28:38.443 INFO:tasks.workunit.client.1.smithi195.stdout:9/840: mknod d2/d4/d6/db/d20/c131 0 2024-03-22T07:28:38.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/611: rename d5/d16/d5a/cac to d5/d16/d45/d53/d59/cde 0 2024-03-22T07:28:38.446 INFO:tasks.workunit.client.1.smithi195.stdout:2/683: rename d2 to d2/d3/d21/d60/de3 22 2024-03-22T07:28:38.446 INFO:tasks.workunit.client.1.smithi195.stdout:0/684: rename d1/d4/d12 to d1/d4/d12/d6c/dbc/d47/dce 22 2024-03-22T07:28:38.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/612: chown d5/d5e/d34/d55/dab 89122381 1 2024-03-22T07:28:38.447 INFO:tasks.workunit.client.0.smithi134.stdout:1/536: symlink d5/da/d13/d1e/d63/d9d/lbe 0 2024-03-22T07:28:38.448 INFO:tasks.workunit.client.1.smithi195.stdout:6/613: read d5/d16/f43 [269395,16850] 0 2024-03-22T07:28:38.448 INFO:tasks.workunit.client.1.smithi195.stdout:6/614: chown d5/d16/d5a 659951 1 2024-03-22T07:28:38.448 INFO:tasks.workunit.client.0.smithi134.stdout:4/518: dwrite d2/d15/f13 [0,4194304] 0 2024-03-22T07:28:38.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/440: mknod d2/d5/d22/d52/d3c/d60/d7c/c8d 0 2024-03-22T07:28:38.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/441: chown d2/d5/d22/d52/d3c/d4f/f6d 464512 1 2024-03-22T07:28:38.450 INFO:tasks.workunit.client.1.smithi195.stdout:1/573: symlink d0/d2/d9/da4/lb8 0 2024-03-22T07:28:38.454 INFO:tasks.workunit.client.0.smithi134.stdout:0/518: rename dc/de/d55/d60/c91 to dc/de/d55/d60/c9b 0 2024-03-22T07:28:38.455 INFO:tasks.workunit.client.1.smithi195.stdout:5/744: symlink d9/d22/d7b/d98/lef 0 2024-03-22T07:28:38.458 INFO:tasks.workunit.client.1.smithi195.stdout:4/683: unlink d13/d15/d64/l74 0 2024-03-22T07:28:38.461 INFO:tasks.workunit.client.1.smithi195.stdout:8/732: mkdir da/dde 0 2024-03-22T07:28:38.462 INFO:tasks.workunit.client.1.smithi195.stdout:7/683: rmdir d0/d13/d14/d29/da2 39 2024-03-22T07:28:38.462 INFO:tasks.workunit.client.1.smithi195.stdout:7/684: readlink d0/d13/d14/d29/d35/d3a/l75 0 2024-03-22T07:28:38.465 INFO:tasks.workunit.client.1.smithi195.stdout:9/841: creat d2/d4/d6/d18/f132 x:0 0 0 2024-03-22T07:28:38.465 INFO:tasks.workunit.client.1.smithi195.stdout:9/842: chown d2/d4/d6/dd1/d112/l11e 2 1 2024-03-22T07:28:38.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/684: mknod d2/d3/d7/d5c/da4/ce4 0 2024-03-22T07:28:38.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/685: truncate d2/d3/f74 1310069 0 2024-03-22T07:28:38.466 INFO:tasks.workunit.client.1.smithi195.stdout:2/686: chown d2/l4 151021683 1 2024-03-22T07:28:38.467 INFO:tasks.workunit.client.1.smithi195.stdout:0/685: truncate d1/d4/dd/d66/d80/f8f 735362 0 2024-03-22T07:28:38.468 INFO:tasks.workunit.client.0.smithi134.stdout:7/643: link d1/de/d11/d48/d52/d46/la3 d1/dae/lcc 0 2024-03-22T07:28:38.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/733: dread da/dc/f12 [0,4194304] 0 2024-03-22T07:28:38.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/734: write da/de/fbb [1116436,26722] 0 2024-03-22T07:28:38.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/735: chown da/d82/dc6 414368369 1 2024-03-22T07:28:38.469 INFO:tasks.workunit.client.1.smithi195.stdout:8/736: read - da/d82/dc6/f93 zero size 2024-03-22T07:28:38.471 INFO:tasks.workunit.client.0.smithi134.stdout:6/362: rmdir d2/d3f 39 2024-03-22T07:28:38.472 INFO:tasks.workunit.client.1.smithi195.stdout:5/745: dwrite d9/da8/fc6 [0,4194304] 0 2024-03-22T07:28:38.473 INFO:tasks.workunit.client.1.smithi195.stdout:5/746: readlink d9/lcd 0 2024-03-22T07:28:38.473 INFO:tasks.workunit.client.1.smithi195.stdout:5/747: chown d9/f45 1939 1 2024-03-22T07:28:38.473 INFO:tasks.workunit.client.1.smithi195.stdout:5/748: fsync d9/d12/d1d/f32 0 2024-03-22T07:28:38.473 INFO:tasks.workunit.client.0.smithi134.stdout:6/363: dread d2/d1b/d1d/d5e/d6f/d7d/f3a [0,4194304] 0 2024-03-22T07:28:38.473 INFO:tasks.workunit.client.0.smithi134.stdout:6/364: dread - d2/d1b/f6c zero size 2024-03-22T07:28:38.473 INFO:tasks.workunit.client.1.smithi195.stdout:6/615: getdents d5/d5e 0 2024-03-22T07:28:38.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/537: mknod d5/da/d1b/d27/dae/cbf 0 2024-03-22T07:28:38.474 INFO:tasks.workunit.client.0.smithi134.stdout:1/538: fsync d5/da/d1b/f30 0 2024-03-22T07:28:38.475 INFO:tasks.workunit.client.1.smithi195.stdout:6/616: dread d5/d5e/d34/fa6 [0,4194304] 0 2024-03-22T07:28:38.475 INFO:tasks.workunit.client.1.smithi195.stdout:1/574: mknod d0/d2/d6/dad/db1/d97/d39/d40/cb9 0 2024-03-22T07:28:38.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/519: creat d2/d25/d74/fb6 x:0 0 0 2024-03-22T07:28:38.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/520: chown d2/d15/d35/cb2 3141 1 2024-03-22T07:28:38.478 INFO:tasks.workunit.client.0.smithi134.stdout:4/521: readlink d2/d15/d35/lb3 0 2024-03-22T07:28:38.482 INFO:tasks.workunit.client.1.smithi195.stdout:9/843: creat d2/d4/d6/d18/d50/f133 x:0 0 0 2024-03-22T07:28:38.483 INFO:tasks.workunit.client.1.smithi195.stdout:7/685: dwrite d0/d13/d14/d29/d35/f37 [4194304,4194304] 0 2024-03-22T07:28:38.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/395: sync 2024-03-22T07:28:38.484 INFO:tasks.workunit.client.0.smithi134.stdout:5/448: sync 2024-03-22T07:28:38.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/585: sync 2024-03-22T07:28:38.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/586: fdatasync d1/d15/f19 0 2024-03-22T07:28:38.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/482: getdents d4/d8 0 2024-03-22T07:28:38.485 INFO:tasks.workunit.client.0.smithi134.stdout:9/396: dread d3/d9/df/f49 [0,4194304] 0 2024-03-22T07:28:38.486 INFO:tasks.workunit.client.1.smithi195.stdout:2/687: truncate d2/d3/d21/d40/f9b 2500057 0 2024-03-22T07:28:38.490 INFO:tasks.workunit.client.1.smithi195.stdout:7/686: dread d0/d13/d22/d28/f64 [0,4194304] 0 2024-03-22T07:28:38.491 INFO:tasks.workunit.client.1.smithi195.stdout:0/686: creat d1/d4/d12/d6c/dbc/fcf x:0 0 0 2024-03-22T07:28:38.494 INFO:tasks.workunit.client.1.smithi195.stdout:8/737: symlink da/de/db3/ddd/ldf 0 2024-03-22T07:28:38.494 INFO:tasks.workunit.client.1.smithi195.stdout:8/738: fsync da/d82/f9c 0 2024-03-22T07:28:38.495 INFO:tasks.workunit.client.1.smithi195.stdout:1/575: dwrite d0/d2/d6/dad/db1/d97/d41/d47/d4a/f83 [4194304,4194304] 0 2024-03-22T07:28:38.495 INFO:tasks.workunit.client.1.smithi195.stdout:1/576: chown d0/d2/d6/dad/db1/d6a/la6 404507375 1 2024-03-22T07:28:38.495 INFO:tasks.workunit.client.1.smithi195.stdout:5/749: dwrite d9/da8/fca [0,4194304] 0 2024-03-22T07:28:38.495 INFO:tasks.workunit.client.0.smithi134.stdout:6/365: mkdir d2/d1b/d1d/d5e/d84/d8a 0 2024-03-22T07:28:38.498 INFO:tasks.workunit.client.1.smithi195.stdout:3/674: rename d3/d22/fc1 to d3/fe1 0 2024-03-22T07:28:38.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/675: creat d3/dbf/da0/fe2 x:0 0 0 2024-03-22T07:28:38.499 INFO:tasks.workunit.client.1.smithi195.stdout:3/676: read d3/df/d15/f1c [3242746,109225] 0 2024-03-22T07:28:38.501 INFO:tasks.workunit.client.0.smithi134.stdout:1/539: rename d5/faa to d5/da/d13/d1e/d62/fc0 0 2024-03-22T07:28:38.505 INFO:tasks.workunit.client.0.smithi134.stdout:4/522: creat d2/d15/d66/fb7 x:0 0 0 2024-03-22T07:28:38.505 INFO:tasks.workunit.client.0.smithi134.stdout:4/523: creat d2/d2a/d50/fb8 x:0 0 0 2024-03-22T07:28:38.505 INFO:tasks.workunit.client.1.smithi195.stdout:5/750: dread d9/da8/fca [0,4194304] 0 2024-03-22T07:28:38.506 INFO:tasks.workunit.client.0.smithi134.stdout:2/442: truncate d2/f4c 3144291 0 2024-03-22T07:28:38.507 INFO:tasks.workunit.client.1.smithi195.stdout:4/684: getdents d13/d63/d3e/d5c/da8 0 2024-03-22T07:28:38.507 INFO:tasks.workunit.client.1.smithi195.stdout:4/685: chown d13/d63/d36/d5f/d83/ce8 1153184 1 2024-03-22T07:28:38.509 INFO:tasks.workunit.client.0.smithi134.stdout:5/449: mknod d1/d8/d20/d62/d65/d82/c99 0 2024-03-22T07:28:38.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/677: dread d3/f24 [0,4194304] 0 2024-03-22T07:28:38.511 INFO:tasks.workunit.client.1.smithi195.stdout:9/844: symlink d2/d4/d1d/d9b/l134 0 2024-03-22T07:28:38.511 INFO:tasks.workunit.client.1.smithi195.stdout:9/845: creat d2/d4/d6/d18/f135 x:0 0 0 2024-03-22T07:28:38.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/524: dread d2/f46 [0,4194304] 0 2024-03-22T07:28:38.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/525: creat d2/d15/d35/fb9 x:0 0 0 2024-03-22T07:28:38.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/526: stat d2/d15/f61 0 2024-03-22T07:28:38.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/527: creat d2/d25/d48/fba x:0 0 0 2024-03-22T07:28:38.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/528: write d2/f97 [456471,21355] 0 2024-03-22T07:28:38.517 INFO:tasks.workunit.client.0.smithi134.stdout:8/587: mkdir d1/d46/dbf 0 2024-03-22T07:28:38.522 INFO:tasks.workunit.client.0.smithi134.stdout:3/483: mknod d4/d22/c9f 0 2024-03-22T07:28:38.525 INFO:tasks.workunit.client.1.smithi195.stdout:2/688: getdents d2/d3/d7/da/d1b 0 2024-03-22T07:28:38.525 INFO:tasks.workunit.client.1.smithi195.stdout:2/689: chown d2/d3/d7/da/l3f 73983807 1 2024-03-22T07:28:38.525 INFO:tasks.workunit.client.1.smithi195.stdout:2/690: creat d2/d3/db/db3/fe5 x:0 0 0 2024-03-22T07:28:38.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/397: symlink d3/d9/d37/d3c/l8d 0 2024-03-22T07:28:38.527 INFO:tasks.workunit.client.0.smithi134.stdout:9/398: write d3/d9/d37/d5a/d7f/f88 [245208,130995] 0 2024-03-22T07:28:38.528 INFO:tasks.workunit.client.1.smithi195.stdout:7/687: mkdir d0/d13/d14/d2b/dec 0 2024-03-22T07:28:38.534 INFO:tasks.workunit.client.0.smithi134.stdout:0/519: rmdir dc/de/d55 39 2024-03-22T07:28:38.536 INFO:tasks.workunit.client.1.smithi195.stdout:5/751: dwrite d9/da8/fd8 [0,4194304] 0 2024-03-22T07:28:38.536 INFO:tasks.workunit.client.1.smithi195.stdout:8/739: creat da/d17/d32/d61/d88/dc9/fe0 x:0 0 0 2024-03-22T07:28:38.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/644: getdents d1/dae 0 2024-03-22T07:28:38.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/645: creat d1/de/d11/d2b/d31/fcd x:0 0 0 2024-03-22T07:28:38.538 INFO:tasks.workunit.client.0.smithi134.stdout:7/646: chown d1/de/d11/d48/daf/dbf 1721859238 1 2024-03-22T07:28:38.541 INFO:tasks.workunit.client.0.smithi134.stdout:9/399: dread f1 [0,4194304] 0 2024-03-22T07:28:38.541 INFO:tasks.workunit.client.0.smithi134.stdout:9/400: fsync d3/d9/f7c 0 2024-03-22T07:28:38.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/366: creat d2/d3f/f8b x:0 0 0 2024-03-22T07:28:38.543 INFO:tasks.workunit.client.1.smithi195.stdout:1/577: mkdir d0/d2/d9/dba 0 2024-03-22T07:28:38.544 INFO:tasks.workunit.client.0.smithi134.stdout:4/529: dwrite d2/d25/f1c [0,4194304] 0 2024-03-22T07:28:38.544 INFO:tasks.workunit.client.0.smithi134.stdout:4/530: write d2/f97 [926997,53398] 0 2024-03-22T07:28:38.545 INFO:tasks.workunit.client.0.smithi134.stdout:1/540: rename d5/da/d13/d1e/d62/fc0 to d5/da/d61/fc1 0 2024-03-22T07:28:38.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/578: write d0/d2/d9/f61 [2234390,30573] 0 2024-03-22T07:28:38.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/579: write d0/d2/d6/dad/db1/d97/d39/d64/d7a/f57 [1014519,63222] 0 2024-03-22T07:28:38.550 INFO:tasks.workunit.client.1.smithi195.stdout:1/580: fsync d0/d2/f2e 0 2024-03-22T07:28:38.551 INFO:tasks.workunit.client.1.smithi195.stdout:6/617: rename d5/d16/d45/d53/d92 to d5/d5e/d34/d55/d4b/da2/d82/ddf 0 2024-03-22T07:28:38.551 INFO:tasks.workunit.client.0.smithi134.stdout:8/588: dwrite d1/d4/d6e/f73 [0,4194304] 0 2024-03-22T07:28:38.552 INFO:tasks.workunit.client.1.smithi195.stdout:1/581: write d0/d2/d6/f2f [319116,42813] 0 2024-03-22T07:28:38.552 INFO:tasks.workunit.client.1.smithi195.stdout:1/582: fdatasync d0/d2/fe 0 2024-03-22T07:28:38.552 INFO:tasks.workunit.client.1.smithi195.stdout:1/583: fsync d0/d2/d9/d2a/f80 0 2024-03-22T07:28:38.553 INFO:tasks.workunit.client.1.smithi195.stdout:0/687: write d1/d4/dd/f51 [2759508,98644] 0 2024-03-22T07:28:38.553 INFO:tasks.workunit.client.1.smithi195.stdout:0/688: chown d1/d4/dd/df/d44/d6f/f71 1353 1 2024-03-22T07:28:38.553 INFO:tasks.workunit.client.1.smithi195.stdout:0/689: readlink d1/d4/d12/d6c/dbc/d47/db6/lab 0 2024-03-22T07:28:38.555 INFO:tasks.workunit.client.0.smithi134.stdout:5/450: link d1/d4/lb d1/d8/d16/d4a/l9a 0 2024-03-22T07:28:38.556 INFO:tasks.workunit.client.1.smithi195.stdout:4/686: mknod d13/d63/d7a/ddf/cea 0 2024-03-22T07:28:38.557 INFO:tasks.workunit.client.0.smithi134.stdout:4/531: fdatasync d2/f97 0 2024-03-22T07:28:38.557 INFO:tasks.workunit.client.1.smithi195.stdout:8/740: dwrite da/d82/dc6/f87 [4194304,4194304] 0 2024-03-22T07:28:38.558 INFO:tasks.workunit.client.1.smithi195.stdout:3/678: mknod d3/df/d15/d1d/d5c/d47/d67/d80/ce3 0 2024-03-22T07:28:38.560 INFO:tasks.workunit.client.0.smithi134.stdout:2/443: write d2/f3e [2319776,49186] 0 2024-03-22T07:28:38.560 INFO:tasks.workunit.client.0.smithi134.stdout:2/444: stat d2/d5/d8/d5d/d5f/f6f 0 2024-03-22T07:28:38.561 INFO:tasks.workunit.client.0.smithi134.stdout:3/484: symlink d4/d10/d4b/la0 0 2024-03-22T07:28:38.563 INFO:tasks.workunit.client.0.smithi134.stdout:3/485: dread d4/d22/f7c [0,4194304] 0 2024-03-22T07:28:38.563 INFO:tasks.workunit.client.0.smithi134.stdout:0/520: getdents dc/d18/d85 0 2024-03-22T07:28:38.563 INFO:tasks.workunit.client.0.smithi134.stdout:0/521: fsync dc/d17/f21 0 2024-03-22T07:28:38.563 INFO:tasks.workunit.client.0.smithi134.stdout:0/522: fsync dc/d18/f74 0 2024-03-22T07:28:38.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/647: mknod d1/de/cce 0 2024-03-22T07:28:38.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/648: readlink d1/de/d11/d48/d52/d46/lc8 0 2024-03-22T07:28:38.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/649: write d1/d19/d32/f4d [1584637,24582] 0 2024-03-22T07:28:38.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/650: fdatasync d1/d40/f9f 0 2024-03-22T07:28:38.569 INFO:tasks.workunit.client.0.smithi134.stdout:7/651: stat d1/d19/d9c/db3/cbe 0 2024-03-22T07:28:38.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/691: mknod d2/d3/d21/d60/ce6 0 2024-03-22T07:28:38.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/692: write d2/d3/db/f88 [5162307,101443] 0 2024-03-22T07:28:38.570 INFO:tasks.workunit.client.1.smithi195.stdout:2/693: chown d2/d3/d1a/l8f 9865 1 2024-03-22T07:28:38.571 INFO:tasks.workunit.client.0.smithi134.stdout:9/401: mkdir d3/d9/d37/d3c/d71/d8e 0 2024-03-22T07:28:38.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/688: rmdir d0/d13/d14/d29/da2 39 2024-03-22T07:28:38.573 INFO:tasks.workunit.client.0.smithi134.stdout:6/367: truncate d2/d1b/d4d/f54 237906 0 2024-03-22T07:28:38.576 INFO:tasks.workunit.client.0.smithi134.stdout:1/541: symlink d5/da/d13/d1e/d63/lc2 0 2024-03-22T07:28:38.576 INFO:tasks.workunit.client.0.smithi134.stdout:1/542: dread - d5/da/d13/d1e/d45/fa0 zero size 2024-03-22T07:28:38.580 INFO:tasks.workunit.client.0.smithi134.stdout:5/451: creat d1/d8/d20/d62/d65/d82/f9b x:0 0 0 2024-03-22T07:28:38.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/532: rename d2/d25/l2e to d2/d2a/d93/lbb 0 2024-03-22T07:28:38.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/533: readlink d2/d2a/d93/lbb 0 2024-03-22T07:28:38.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/534: write d2/d15/d35/f5d [1414752,113877] 0 2024-03-22T07:28:38.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/535: creat d2/d1d/fbc x:0 0 0 2024-03-22T07:28:38.582 INFO:tasks.workunit.client.0.smithi134.stdout:4/536: fsync d2/d2a/d50/f5c 0 2024-03-22T07:28:38.583 INFO:tasks.workunit.client.0.smithi134.stdout:3/486: symlink d4/d22/d3c/d88/la1 0 2024-03-22T07:28:38.584 INFO:tasks.workunit.client.0.smithi134.stdout:9/402: link d3/d9/df/l23 d3/d9/d37/l8f 0 2024-03-22T07:28:38.585 INFO:tasks.workunit.client.0.smithi134.stdout:4/537: write d2/d1d/f5e [937868,12341] 0 2024-03-22T07:28:38.585 INFO:tasks.workunit.client.0.smithi134.stdout:0/523: dwrite dc/d18/f66 [0,4194304] 0 2024-03-22T07:28:38.585 INFO:tasks.workunit.client.0.smithi134.stdout:0/524: readlink dc/de/l3b 0 2024-03-22T07:28:38.585 INFO:tasks.workunit.client.0.smithi134.stdout:0/525: fdatasync dc/d17/f21 0 2024-03-22T07:28:38.586 INFO:tasks.workunit.client.0.smithi134.stdout:2/445: dwrite d2/f3e [4194304,4194304] 0 2024-03-22T07:28:38.586 INFO:tasks.workunit.client.0.smithi134.stdout:6/368: unlink d2/l9 0 2024-03-22T07:28:38.590 INFO:tasks.workunit.client.0.smithi134.stdout:1/543: mknod d5/da/d68/cc3 0 2024-03-22T07:28:38.591 INFO:tasks.workunit.client.0.smithi134.stdout:1/544: chown f3 1943384708 1 2024-03-22T07:28:38.591 INFO:tasks.workunit.client.0.smithi134.stdout:1/545: stat d5/da/d1b/d27/d60/d72 0 2024-03-22T07:28:38.591 INFO:tasks.workunit.client.1.smithi195.stdout:5/752: rename d9/d2d/d84/cb9 to d9/d22/d46/db2/cf0 0 2024-03-22T07:28:38.593 INFO:tasks.workunit.client.1.smithi195.stdout:6/618: symlink d5/d5e/d34/d55/d4b/da2/d1a/le0 0 2024-03-22T07:28:38.596 INFO:tasks.workunit.client.0.smithi134.stdout:8/589: link d1/d15/d42/d12/d20/f74 d1/d15/d42/d76/d8f/dad/dae/fc0 0 2024-03-22T07:28:38.596 INFO:tasks.workunit.client.1.smithi195.stdout:1/584: getdents d0 0 2024-03-22T07:28:38.599 INFO:tasks.workunit.client.1.smithi195.stdout:7/689: dwrite d0/f71 [0,4194304] 0 2024-03-22T07:28:38.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/452: unlink d1/d8/d20/l34 0 2024-03-22T07:28:38.600 INFO:tasks.workunit.client.0.smithi134.stdout:5/453: chown d1/d8/d20/f54 16888 1 2024-03-22T07:28:38.600 INFO:tasks.workunit.client.0.smithi134.stdout:2/446: write d2/d5/d8/d5d/d5f/f6f [1997406,32260] 0 2024-03-22T07:28:38.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/690: mknod d1/d4/d12/d6c/d7b/cd0 0 2024-03-22T07:28:38.601 INFO:tasks.workunit.client.1.smithi195.stdout:0/691: chown d1/d4/c24 78453 1 2024-03-22T07:28:38.602 INFO:tasks.workunit.client.0.smithi134.stdout:8/590: dread d1/f5d [0,4194304] 0 2024-03-22T07:28:38.602 INFO:tasks.workunit.client.0.smithi134.stdout:8/591: write d1/d15/d42/d12/f35 [2463567,114233] 0 2024-03-22T07:28:38.602 INFO:tasks.workunit.client.0.smithi134.stdout:8/592: fsync d1/d4/f22 0 2024-03-22T07:28:38.603 INFO:tasks.workunit.client.1.smithi195.stdout:4/687: symlink d13/d63/leb 0 2024-03-22T07:28:38.607 INFO:tasks.workunit.client.0.smithi134.stdout:9/403: link d3/d9/d37/f4f d3/d9/df/f90 0 2024-03-22T07:28:38.611 INFO:tasks.workunit.client.1.smithi195.stdout:8/741: unlink da/l2c 0 2024-03-22T07:28:38.611 INFO:tasks.workunit.client.1.smithi195.stdout:8/742: getdents da/dc/d71 0 2024-03-22T07:28:38.621 INFO:tasks.workunit.client.1.smithi195.stdout:2/694: creat d2/d3/d21/d60/d81/d9a/fe7 x:0 0 0 2024-03-22T07:28:38.622 INFO:tasks.workunit.client.0.smithi134.stdout:4/538: mknod d2/d98/cbd 0 2024-03-22T07:28:38.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/652: dwrite d1/d19/fb8 [0,4194304] 0 2024-03-22T07:28:38.631 INFO:tasks.workunit.client.1.smithi195.stdout:3/679: rename d3/df/l6e to d3/df/d15/d1d/d5c/d47/d67/le4 0 2024-03-22T07:28:38.632 INFO:tasks.workunit.client.0.smithi134.stdout:0/526: link dc/d18/l7b dc/l9c 0 2024-03-22T07:28:38.632 INFO:tasks.workunit.client.0.smithi134.stdout:0/527: fdatasync dc/d18/f1b 0 2024-03-22T07:28:38.634 INFO:tasks.workunit.client.0.smithi134.stdout:6/369: link d2/d3f/d28/c59 d2/d1b/d1d/d5e/c8c 0 2024-03-22T07:28:38.634 INFO:tasks.workunit.client.0.smithi134.stdout:6/370: dread - d2/d3f/f8b zero size 2024-03-22T07:28:38.634 INFO:tasks.workunit.client.0.smithi134.stdout:6/371: chown d2/d3f/d28/d6b 2 1 2024-03-22T07:28:38.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.637+0000 7fc24affd700 1 -- 172.21.15.134:0/4185549900 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc244009650 con 0x7fc24c0662e0 2024-03-22T07:28:38.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.637+0000 7fc2526fa700 1 -- 172.21.15.134:0/4185549900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 msgr2=0x7fc24c0fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:38.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.637+0000 7fc2526fa700 1 --2- 172.21.15.134:0/4185549900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 0x7fc24c0fd7b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc244009d60 tx=0x7fc244004d10 comp rx=0 tx=0).stop 2024-03-22T07:28:38.639 INFO:tasks.workunit.client.0.smithi134.stdout:3/487: dwrite d4/d22/f7c [0,4194304] 0 2024-03-22T07:28:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.638+0000 7fc2526fa700 1 -- 172.21.15.134:0/4185549900 shutdown_connections 2024-03-22T07:28:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.638+0000 7fc2526fa700 1 --2- 172.21.15.134:0/4185549900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.638+0000 7fc2526fa700 1 --2- 172.21.15.134:0/4185549900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 0x7fc24c0fd7b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.638+0000 7fc2526fa700 1 -- 172.21.15.134:0/4185549900 >> 172.21.15.134:0/4185549900 conn(0x7fc24c0f7430 msgr2=0x7fc24c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:38.640 INFO:tasks.workunit.client.0.smithi134.stdout:1/546: mknod d5/da/d1b/cc4 0 2024-03-22T07:28:38.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.639+0000 7fc2526fa700 1 -- 172.21.15.134:0/4185549900 shutdown_connections 2024-03-22T07:28:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.639+0000 7fc2526fa700 1 -- 172.21.15.134:0/4185549900 wait complete. 2024-03-22T07:28:38.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc2526fa700 1 Processor -- start 2024-03-22T07:28:38.641 INFO:tasks.workunit.client.1.smithi195.stdout:1/585: mknod d0/d2/d6/dad/db1/d97/d39/d64/cbb 0 2024-03-22T07:28:38.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc2526fa700 1 -- start start 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc2526fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 0x7fc24c10b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc2526fa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c10be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc2526fa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c10c520 con 0x7fc24c0662e0 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc2526fa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c10cd10 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c10be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c10be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:50116/0 (socket says 172.21.15.134:50116) 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.640+0000 7fc24b7fe700 1 -- 172.21.15.134:0/3668001988 learned_addr learned my addr 172.21.15.134:0/3668001988 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc24bfff700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 0x7fc24c10b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc24b7fe700 1 -- 172.21.15.134:0/3668001988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 msgr2=0x7fc24c10b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc24b7fe700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 0x7fc24c10b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc24b7fe700 1 -- 172.21.15.134:0/3668001988 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc244009940 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc24b7fe700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c10be90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc24000b580 tx=0x7fc2400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc24000f6f0 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc24000fd20 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.644 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.641+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc240011ea0 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.644 INFO:tasks.workunit.client.0.smithi134.stdout:0/528: dread dc/d18/d72/f7c [0,4194304] 0 2024-03-22T07:28:38.644 INFO:tasks.workunit.client.0.smithi134.stdout:5/454: truncate d1/d8/d20/f5c 1140258 0 2024-03-22T07:28:38.644 INFO:tasks.workunit.client.0.smithi134.stdout:5/455: chown d1/c32 589 1 2024-03-22T07:28:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.642+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c10cff0 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.642+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c10d530 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.644+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 45771+0+0 (secure 0 0 0) 0x7fc24000f850 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.644+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c05f5f0 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.644+0000 7fc248ff9700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fc234038890 0x7fc23403ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.644+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc24004bee0 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.644+0000 7fc24bfff700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fc234038890 0x7fc23403ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:38.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.645+0000 7fc24bfff700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fc234038890 0x7fc23403ad40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc244009310 tx=0x7fc244004d10 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:38.647 INFO:tasks.workunit.client.0.smithi134.stdout:2/447: creat d2/d5/d22/d52/d3c/d60/f8e x:0 0 0 2024-03-22T07:28:38.649 INFO:tasks.workunit.client.1.smithi195.stdout:1/586: write d0/d2/d6/f62 [2049020,47789] 0 2024-03-22T07:28:38.650 INFO:tasks.workunit.client.1.smithi195.stdout:1/587: read d0/d2/d6/dad/db1/d6a/fa8 [460379,86475] 0 2024-03-22T07:28:38.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/593: truncate d1/d4/f4a 164417 0 2024-03-22T07:28:38.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:38.649+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc24000fe90 con 0x7fc24c0fdcf0 2024-03-22T07:28:38.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/653: rename d1/de/d41/d87/l99 to d1/de/d11/d48/daf/dbf/lcf 0 2024-03-22T07:28:38.665 INFO:tasks.workunit.client.1.smithi195.stdout:3/680: dread d3/dbf/da0/fd3 [0,4194304] 0 2024-03-22T07:28:38.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/372: unlink d2/d3f/d28/d6b/f7f 0 2024-03-22T07:28:38.666 INFO:tasks.workunit.client.0.smithi134.stdout:6/373: write d2/f69 [768328,22851] 0 2024-03-22T07:28:38.669 INFO:tasks.workunit.client.1.smithi195.stdout:7/690: rename d0/d13/d14/d20/l2e to d0/d13/d14/d20/led 0 2024-03-22T07:28:38.669 INFO:tasks.workunit.client.1.smithi195.stdout:7/691: write d0/d13/d14/d20/d40/d82/da0/d59/f5f [4430265,94896] 0 2024-03-22T07:28:38.669 INFO:tasks.workunit.client.0.smithi134.stdout:8/594: dread d1/d15/d42/d76/d8f/dad/db1/f3a [0,4194304] 0 2024-03-22T07:28:38.672 INFO:tasks.workunit.client.1.smithi195.stdout:6/619: rename d5/d5e/d34/d55/d3b/d6e/d56/d8f/faf to d5/d5e/d34/d55/d4b/da2/d4a/fe1 0 2024-03-22T07:28:38.675 INFO:tasks.workunit.client.1.smithi195.stdout:5/753: rmdir d9/da8 39 2024-03-22T07:28:38.675 INFO:tasks.workunit.client.0.smithi134.stdout:1/547: dread f1 [0,4194304] 0 2024-03-22T07:28:38.677 INFO:tasks.workunit.client.0.smithi134.stdout:0/529: creat dc/d18/d85/f9d x:0 0 0 2024-03-22T07:28:38.678 INFO:tasks.workunit.client.0.smithi134.stdout:0/530: chown dc/d18/c68 5462499 1 2024-03-22T07:28:38.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/688: dwrite d13/d15/f98 [0,4194304] 0 2024-03-22T07:28:38.682 INFO:tasks.workunit.client.1.smithi195.stdout:3/681: creat d3/df/d15/d1d/d5c/fe5 x:0 0 0 2024-03-22T07:28:38.686 INFO:tasks.workunit.client.0.smithi134.stdout:2/448: unlink d2/d5/d22/d52/d3c/d4f/d62/f73 0 2024-03-22T07:28:38.687 INFO:tasks.workunit.client.0.smithi134.stdout:9/404: dwrite d3/d9/df/d12/d3b/f42 [4194304,4194304] 0 2024-03-22T07:28:38.688 INFO:tasks.workunit.client.0.smithi134.stdout:9/405: read - d3/d9/d37/d6f/d54/f83 zero size 2024-03-22T07:28:38.688 INFO:tasks.workunit.client.1.smithi195.stdout:7/692: symlink d0/d13/d22/d57/d7b/d8c/lee 0 2024-03-22T07:28:38.692 INFO:tasks.workunit.client.0.smithi134.stdout:3/488: rename d4/d10/d4b/f4c to d4/d8/d69/fa2 0 2024-03-22T07:28:38.694 INFO:tasks.workunit.client.1.smithi195.stdout:5/754: mkdir d9/d22/d46/df1 0 2024-03-22T07:28:38.694 INFO:tasks.workunit.client.1.smithi195.stdout:9/846: sync 2024-03-22T07:28:38.695 INFO:tasks.workunit.client.1.smithi195.stdout:9/847: write d2/d4/d6/d18/f135 [171982,71257] 0 2024-03-22T07:28:38.695 INFO:tasks.workunit.client.1.smithi195.stdout:9/848: readlink d2/d4/d23/l80 0 2024-03-22T07:28:38.695 INFO:tasks.workunit.client.0.smithi134.stdout:6/374: creat d2/d1b/d1d/d5e/f8d x:0 0 0 2024-03-22T07:28:38.699 INFO:tasks.workunit.client.0.smithi134.stdout:5/456: read d1/d8/d20/d62/d65/f15 [1689266,31885] 0 2024-03-22T07:28:38.700 INFO:tasks.workunit.client.0.smithi134.stdout:5/457: fsync d1/d4/d5f/f84 0 2024-03-22T07:28:38.700 INFO:tasks.workunit.client.0.smithi134.stdout:8/595: link d1/d46/f9c d1/d15/d42/d12/d2a/fc1 0 2024-03-22T07:28:38.701 INFO:tasks.workunit.client.1.smithi195.stdout:0/692: dwrite d1/d4/dd/df/d6b/f81 [0,4194304] 0 2024-03-22T07:28:38.702 INFO:tasks.workunit.client.0.smithi134.stdout:7/654: dwrite d1/de/d11/d48/f3c [0,4194304] 0 2024-03-22T07:28:38.702 INFO:tasks.workunit.client.0.smithi134.stdout:7/655: chown d1/de/d11/d48/d52/d46/f84 2379 1 2024-03-22T07:28:38.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/695: dwrite d2/d3/d21/d40/f5d [0,4194304] 0 2024-03-22T07:28:38.702 INFO:tasks.workunit.client.1.smithi195.stdout:2/696: write d2/d3/d1a/fb4 [684087,68252] 0 2024-03-22T07:28:38.702 INFO:tasks.workunit.client.1.smithi195.stdout:8/743: dwrite da/d17/d32/f59 [0,4194304] 0 2024-03-22T07:28:38.702 INFO:tasks.workunit.client.1.smithi195.stdout:1/588: dwrite d0/d2/d9/da4/fb4 [0,4194304] 0 2024-03-22T07:28:38.703 INFO:tasks.workunit.client.0.smithi134.stdout:1/548: dwrite d5/da/d13/f6c [0,4194304] 0 2024-03-22T07:28:38.704 INFO:tasks.workunit.client.1.smithi195.stdout:4/689: creat d13/fec x:0 0 0 2024-03-22T07:28:38.705 INFO:tasks.workunit.client.0.smithi134.stdout:0/531: symlink dc/d17/l9e 0 2024-03-22T07:28:38.705 INFO:tasks.workunit.client.0.smithi134.stdout:0/532: fdatasync dc/d18/f26 0 2024-03-22T07:28:38.705 INFO:tasks.workunit.client.0.smithi134.stdout:0/533: fdatasync dc/de/f23 0 2024-03-22T07:28:38.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/534: write dc/d18/d72/f7c [352752,92626] 0 2024-03-22T07:28:38.706 INFO:tasks.workunit.client.1.smithi195.stdout:1/589: dread d0/d2/d6/dad/db1/d6a/fa8 [0,4194304] 0 2024-03-22T07:28:38.706 INFO:tasks.workunit.client.1.smithi195.stdout:3/682: mknod d3/d18/d89/d70/db5/ce6 0 2024-03-22T07:28:38.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/693: rename d0/d13/d14/d29/d6e to d0/d13/d22/def 0 2024-03-22T07:28:38.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/694: dread - d0/d13/d14/d29/fe1 zero size 2024-03-22T07:28:38.711 INFO:tasks.workunit.client.0.smithi134.stdout:2/449: rmdir d2/d5/d22/d52/d3c/d4f/d6e 39 2024-03-22T07:28:38.713 INFO:tasks.workunit.client.1.smithi195.stdout:6/620: getdents d5/d16/d5b 0 2024-03-22T07:28:38.713 INFO:tasks.workunit.client.1.smithi195.stdout:6/621: dread - d5/d5e/d34/d55/d4b/d5f/f60 zero size 2024-03-22T07:28:38.713 INFO:tasks.workunit.client.1.smithi195.stdout:6/622: fdatasync d5/d5e/d34/d55/d3b/d7f/fca 0 2024-03-22T07:28:38.713 INFO:tasks.workunit.client.1.smithi195.stdout:1/590: write d0/d2/d6/dad/db1/d97/d41/d47/d4a/f83 [8085959,109780] 0 2024-03-22T07:28:38.717 INFO:tasks.workunit.client.0.smithi134.stdout:2/450: dread d2/d5/d22/d52/f4d [0,4194304] 0 2024-03-22T07:28:38.718 INFO:tasks.workunit.client.0.smithi134.stdout:9/406: mknod d3/d9/df/d12/c91 0 2024-03-22T07:28:38.718 INFO:tasks.workunit.client.1.smithi195.stdout:5/755: dwrite d9/d73/fe1 [0,4194304] 0 2024-03-22T07:28:38.719 INFO:tasks.workunit.client.1.smithi195.stdout:2/697: dwrite d2/d3/dac/dad/fda [0,4194304] 0 2024-03-22T07:28:38.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/690: dread d13/d63/d79/de9/d7e/fb6 [0,4194304] 0 2024-03-22T07:28:38.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/691: write d13/d15/f98 [5230386,50023] 0 2024-03-22T07:28:38.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/692: chown d13/d63/d3e/d5c/d65 3683000 1 2024-03-22T07:28:38.723 INFO:tasks.workunit.client.1.smithi195.stdout:4/693: stat d13/d63/d36/d5f/fb0 0 2024-03-22T07:28:38.723 INFO:tasks.workunit.client.1.smithi195.stdout:0/693: creat d1/d4/dd/df/d44/d6f/dae/fd1 x:0 0 0 2024-03-22T07:28:38.728 INFO:tasks.workunit.client.0.smithi134.stdout:3/489: creat d4/d8/fa3 x:0 0 0 2024-03-22T07:28:38.730 INFO:tasks.workunit.client.1.smithi195.stdout:2/698: write d2/d3/dac/dad/fda [815464,94125] 0 2024-03-22T07:28:38.733 INFO:tasks.workunit.client.0.smithi134.stdout:5/458: stat d1/d4/l47 0 2024-03-22T07:28:38.733 INFO:tasks.workunit.client.0.smithi134.stdout:5/459: chown d1/d8/d20/f71 3 1 2024-03-22T07:28:38.735 INFO:tasks.workunit.client.1.smithi195.stdout:8/744: rmdir da/d17/d32/d61/d88/d91 39 2024-03-22T07:28:38.735 INFO:tasks.workunit.client.1.smithi195.stdout:8/745: readlink da/de/db3/ddd/lab 0 2024-03-22T07:28:38.735 INFO:tasks.workunit.client.1.smithi195.stdout:8/746: chown da/d82/dc6/d53/d8d/la7 20385043 1 2024-03-22T07:28:38.736 INFO:tasks.workunit.client.0.smithi134.stdout:8/596: chown d1/d15/d42/c6a 503735 1 2024-03-22T07:28:38.736 INFO:tasks.workunit.client.0.smithi134.stdout:8/597: truncate d1/d4/f54 751477 0 2024-03-22T07:28:38.736 INFO:tasks.workunit.client.1.smithi195.stdout:1/591: dwrite d0/d2/fe [4194304,4194304] 0 2024-03-22T07:28:38.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/756: dwrite d9/d2d/d8f/fb6 [0,4194304] 0 2024-03-22T07:28:38.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/757: creat d9/d2d/d8f/ff2 x:0 0 0 2024-03-22T07:28:38.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/758: readlink d9/d73/l9b 0 2024-03-22T07:28:38.740 INFO:tasks.workunit.client.1.smithi195.stdout:5/759: write d9/d2d/f72 [64048,41623] 0 2024-03-22T07:28:38.749 INFO:tasks.workunit.client.0.smithi134.stdout:7/656: symlink d1/dae/ld0 0 2024-03-22T07:28:38.752 INFO:tasks.workunit.client.1.smithi195.stdout:3/683: creat d3/fe7 x:0 0 0 2024-03-22T07:28:38.752 INFO:tasks.workunit.client.1.smithi195.stdout:3/684: chown d3/dbf/da0/fe2 1662814 1 2024-03-22T07:28:38.752 INFO:tasks.workunit.client.1.smithi195.stdout:3/685: write d3/d18/d89/f90 [3870296,98604] 0 2024-03-22T07:28:38.754 INFO:tasks.workunit.client.1.smithi195.stdout:7/695: mknod d0/d13/d14/d2b/dec/cf0 0 2024-03-22T07:28:38.755 INFO:tasks.workunit.client.0.smithi134.stdout:3/490: dwrite d4/d10/d4b/f90 [0,4194304] 0 2024-03-22T07:28:38.757 INFO:tasks.workunit.client.1.smithi195.stdout:6/623: creat d5/d5e/d34/d55/d4b/da2/d1a/fe2 x:0 0 0 2024-03-22T07:28:38.757 INFO:tasks.workunit.client.1.smithi195.stdout:6/624: chown d5/d16/d45/d53/f62 6114179 1 2024-03-22T07:28:38.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/549: truncate d5/fe 3316207 0 2024-03-22T07:28:38.758 INFO:tasks.workunit.client.0.smithi134.stdout:1/550: fsync d5/da/d13/f3f 0 2024-03-22T07:28:38.760 INFO:tasks.workunit.client.1.smithi195.stdout:2/699: dwrite d2/d3/d7/d5c/f6c [0,4194304] 0 2024-03-22T07:28:38.760 INFO:tasks.workunit.client.1.smithi195.stdout:5/760: dwrite d9/d22/f2b [0,4194304] 0 2024-03-22T07:28:38.762 INFO:tasks.workunit.client.0.smithi134.stdout:0/535: symlink dc/d18/d89/l9f 0 2024-03-22T07:28:38.767 INFO:tasks.workunit.client.0.smithi134.stdout:9/407: rmdir d3/d9/df/d12/d3b 39 2024-03-22T07:28:38.769 INFO:tasks.workunit.client.0.smithi134.stdout:6/375: link d2/d1b/d1d/d5e/f8d d2/d3f/d28/d6b/f8e 0 2024-03-22T07:28:38.771 INFO:tasks.workunit.client.1.smithi195.stdout:4/694: mkdir d13/d15/d6b/da6/ded 0 2024-03-22T07:28:38.772 INFO:tasks.workunit.client.0.smithi134.stdout:3/491: dread d4/d8/d69/d6a/f9b [0,4194304] 0 2024-03-22T07:28:38.772 INFO:tasks.workunit.client.0.smithi134.stdout:3/492: chown d4/d22/d29/f67 62 1 2024-03-22T07:28:38.772 INFO:tasks.workunit.client.0.smithi134.stdout:0/536: dread dc/d17/f48 [0,4194304] 0 2024-03-22T07:28:38.772 INFO:tasks.workunit.client.0.smithi134.stdout:5/460: mkdir d1/d8/d20/d62/d68/d9c 0 2024-03-22T07:28:38.773 INFO:tasks.workunit.client.1.smithi195.stdout:0/694: truncate d1/d4/d12/d6c/dbc/d43/f4c 2590001 0 2024-03-22T07:28:38.775 INFO:tasks.workunit.client.0.smithi134.stdout:8/598: truncate d1/d15/f2c 1841374 0 2024-03-22T07:28:38.775 INFO:tasks.workunit.client.0.smithi134.stdout:8/599: write d1/d15/d42/d76/f78 [4309372,68981] 0 2024-03-22T07:28:38.775 INFO:tasks.workunit.client.0.smithi134.stdout:8/600: truncate d1/f50 739361 0 2024-03-22T07:28:38.776 INFO:tasks.workunit.client.1.smithi195.stdout:8/747: creat da/dc/da4/fe1 x:0 0 0 2024-03-22T07:28:38.777 INFO:tasks.workunit.client.1.smithi195.stdout:8/748: dread da/de/f45 [0,4194304] 0 2024-03-22T07:28:38.778 INFO:tasks.workunit.client.1.smithi195.stdout:5/761: dwrite d9/d22/d46/f88 [0,4194304] 0 2024-03-22T07:28:38.778 INFO:tasks.workunit.client.0.smithi134.stdout:7/657: creat d1/de/d11/d48/d52/d46/fd1 x:0 0 0 2024-03-22T07:28:38.778 INFO:tasks.workunit.client.0.smithi134.stdout:7/658: creat d1/d40/fd2 x:0 0 0 2024-03-22T07:28:38.779 INFO:tasks.workunit.client.1.smithi195.stdout:1/592: creat d0/d2/d6/dad/db1/d97/d41/d47/d4a/fbc x:0 0 0 2024-03-22T07:28:38.785 INFO:tasks.workunit.client.0.smithi134.stdout:1/551: rmdir d5/da/d68 39 2024-03-22T07:28:38.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/686: mknod d3/d98/ce8 0 2024-03-22T07:28:38.787 INFO:tasks.workunit.client.1.smithi195.stdout:3/687: write d3/dbf/fdc [672539,96357] 0 2024-03-22T07:28:38.789 INFO:tasks.workunit.client.0.smithi134.stdout:2/451: truncate d2/d5/d8/d5d/d5f/f6f 636504 0 2024-03-22T07:28:38.792 INFO:tasks.workunit.client.1.smithi195.stdout:7/696: mknod d0/d13/d22/cf1 0 2024-03-22T07:28:38.792 INFO:tasks.workunit.client.1.smithi195.stdout:7/697: readlink d0/d13/d22/d57/d7b/la5 0 2024-03-22T07:28:38.795 INFO:tasks.workunit.client.1.smithi195.stdout:6/625: mkdir d5/d5e/d34/d55/d4b/da2/dad/de3 0 2024-03-22T07:28:38.796 INFO:tasks.workunit.client.1.smithi195.stdout:3/688: write d3/df/d15/d1d/d5c/f53 [1795075,84032] 0 2024-03-22T07:28:38.800 INFO:tasks.workunit.client.0.smithi134.stdout:1/552: dwrite d5/da/d13/d1e/d34/f43 [0,4194304] 0 2024-03-22T07:28:38.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/698: dwrite d0/d13/d14/d2f/dae/fcb [0,4194304] 0 2024-03-22T07:28:38.813 INFO:tasks.workunit.client.1.smithi195.stdout:7/699: fdatasync d0/ff 0 2024-03-22T07:28:38.847 INFO:tasks.workunit.client.1.smithi195.stdout:2/700: mknod d2/d3/d21/d4c/ce8 0 2024-03-22T07:28:38.848 INFO:tasks.workunit.client.1.smithi195.stdout:2/701: chown d2/d3/fa5 3300 1 2024-03-22T07:28:38.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/695: truncate d13/f1a 3191209 0 2024-03-22T07:28:38.853 INFO:tasks.workunit.client.0.smithi134.stdout:2/452: write d2/d5/d8/d5d/d5f/f6f [30940,80525] 0 2024-03-22T07:28:38.854 INFO:tasks.workunit.client.1.smithi195.stdout:0/695: mkdir d1/d4/dd/df/d44/d8d/dd2 0 2024-03-22T07:28:38.857 INFO:tasks.workunit.client.1.smithi195.stdout:8/749: getdents da/d82/dc6/d53 0 2024-03-22T07:28:38.858 INFO:tasks.workunit.client.1.smithi195.stdout:8/750: write da/de/f2d [1367700,109830] 0 2024-03-22T07:28:38.858 INFO:tasks.workunit.client.1.smithi195.stdout:8/751: truncate da/d17/d32/d61/d88/d91/f9f 1168286 0 2024-03-22T07:28:38.859 INFO:tasks.workunit.client.1.smithi195.stdout:4/696: write d13/d63/d79/d68/f82 [4543098,130126] 0 2024-03-22T07:28:38.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/762: symlink d9/d2d/d8f/lf3 0 2024-03-22T07:28:38.860 INFO:tasks.workunit.client.1.smithi195.stdout:4/697: dread - d13/d15/d44/fd9 zero size 2024-03-22T07:28:38.860 INFO:tasks.workunit.client.1.smithi195.stdout:5/763: write d9/d12/f47 [3586577,7249] 0 2024-03-22T07:28:38.861 INFO:tasks.workunit.client.0.smithi134.stdout:6/376: rmdir d2/d1b/d1d/d5e/d84/d8a 0 2024-03-22T07:28:38.861 INFO:tasks.workunit.client.1.smithi195.stdout:1/593: truncate d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/f6d 3499209 0 2024-03-22T07:28:38.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/493: symlink d4/d8/d23/la4 0 2024-03-22T07:28:38.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/494: fsync d4/f66 0 2024-03-22T07:28:38.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/495: truncate d4/f94 146319 0 2024-03-22T07:28:38.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/496: stat d4/d10/d6c/f84 0 2024-03-22T07:28:38.865 INFO:tasks.workunit.client.0.smithi134.stdout:0/537: unlink dc/d18/f1b 0 2024-03-22T07:28:38.869 INFO:tasks.workunit.client.1.smithi195.stdout:4/698: dread d13/f14 [0,4194304] 0 2024-03-22T07:28:38.871 INFO:tasks.workunit.client.0.smithi134.stdout:8/601: creat d1/d15/d42/d76/d8f/dad/fc2 x:0 0 0 2024-03-22T07:28:38.875 INFO:tasks.workunit.client.0.smithi134.stdout:7/659: mknod d1/d19/d9c/db3/cd3 0 2024-03-22T07:28:38.875 INFO:tasks.workunit.client.0.smithi134.stdout:7/660: chown d1/d19/d9c/db3/cd3 5926 1 2024-03-22T07:28:38.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/553: mknod d5/da/d13/d1e/d63/cc5 0 2024-03-22T07:28:38.876 INFO:tasks.workunit.client.0.smithi134.stdout:1/554: creat d5/d1d/d2d/fc6 x:0 0 0 2024-03-22T07:28:38.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/555: write d5/da/d1b/d27/d39/da4/fb8 [407504,44774] 0 2024-03-22T07:28:38.878 INFO:tasks.workunit.client.1.smithi195.stdout:3/689: mknod d3/df/d15/d1d/d5c/d47/d67/d80/db8/ce9 0 2024-03-22T07:28:38.878 INFO:tasks.workunit.client.1.smithi195.stdout:3/690: dread d3/f84 [0,4194304] 0 2024-03-22T07:28:38.878 INFO:tasks.workunit.client.1.smithi195.stdout:3/691: write d3/df/d15/d1d/d5c/d47/d67/d80/f7d [418655,72812] 0 2024-03-22T07:28:38.881 INFO:tasks.workunit.client.0.smithi134.stdout:0/538: write dc/d18/f5e [3467263,91075] 0 2024-03-22T07:28:38.881 INFO:tasks.workunit.client.0.smithi134.stdout:0/539: chown dc/l58 1 1 2024-03-22T07:28:38.892 INFO:tasks.workunit.client.0.smithi134.stdout:5/461: creat d1/d8/d16/f9d x:0 0 0 2024-03-22T07:28:38.892 INFO:tasks.workunit.client.0.smithi134.stdout:5/462: creat d1/d8/d20/d62/d68/f9e x:0 0 0 2024-03-22T07:28:38.897 INFO:tasks.workunit.client.1.smithi195.stdout:7/700: symlink d0/lf2 0 2024-03-22T07:28:38.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/453: creat d2/f8f x:0 0 0 2024-03-22T07:28:38.930 INFO:tasks.workunit.client.0.smithi134.stdout:8/602: truncate d1/d15/d42/d76/d8f/dad/db1/f52 4061661 0 2024-03-22T07:28:38.930 INFO:tasks.workunit.client.0.smithi134.stdout:8/603: truncate d1/d15/d42/d76/d8f/dad/dae/fc0 1314839 0 2024-03-22T07:28:38.930 INFO:tasks.workunit.client.0.smithi134.stdout:8/604: write d1/d46/d75/d8b/fb9 [541142,2369] 0 2024-03-22T07:28:38.934 INFO:tasks.workunit.client.0.smithi134.stdout:7/661: creat d1/de/d11/fd4 x:0 0 0 2024-03-22T07:28:38.938 INFO:tasks.workunit.client.0.smithi134.stdout:8/605: dread d1/d15/d42/d12/f37 [0,4194304] 0 2024-03-22T07:28:38.939 INFO:tasks.workunit.client.0.smithi134.stdout:1/556: symlink d5/da/d13/d1e/d63/lc7 0 2024-03-22T07:28:38.941 INFO:tasks.workunit.client.0.smithi134.stdout:7/662: dread d1/f4 [0,4194304] 0 2024-03-22T07:28:38.941 INFO:tasks.workunit.client.0.smithi134.stdout:0/540: unlink dc/d17/f92 0 2024-03-22T07:28:38.950 INFO:tasks.workunit.client.0.smithi134.stdout:9/408: rename d3/d9/df/c52 to d3/d9/df/d12/c92 0 2024-03-22T07:28:38.955 INFO:tasks.workunit.client.0.smithi134.stdout:5/463: truncate d1/d8/d16/f59 5861701 0 2024-03-22T07:28:38.956 INFO:tasks.workunit.client.1.smithi195.stdout:9/849: sync 2024-03-22T07:28:38.961 INFO:tasks.workunit.client.0.smithi134.stdout:1/557: unlink d5/d1d/d2d/fa7 0 2024-03-22T07:28:38.961 INFO:tasks.workunit.client.0.smithi134.stdout:1/558: creat d5/d1d/d49/d92/fc8 x:0 0 0 2024-03-22T07:28:38.962 INFO:tasks.workunit.client.0.smithi134.stdout:1/559: truncate d5/da/d13/d1e/d9b/f9f 898024 0 2024-03-22T07:28:38.962 INFO:tasks.workunit.client.0.smithi134.stdout:1/560: write d5/fb6 [4879524,66520] 0 2024-03-22T07:28:38.962 INFO:tasks.workunit.client.0.smithi134.stdout:1/561: truncate d5/da/d61/fc1 899101 0 2024-03-22T07:28:38.963 INFO:tasks.workunit.client.0.smithi134.stdout:7/663: mknod d1/d40/cd5 0 2024-03-22T07:28:38.966 INFO:tasks.workunit.client.0.smithi134.stdout:0/541: mkdir dc/d18/d89/da0 0 2024-03-22T07:28:38.971 INFO:tasks.workunit.client.0.smithi134.stdout:6/377: mkdir d2/d1b/d8f 0 2024-03-22T07:28:38.973 INFO:tasks.workunit.client.0.smithi134.stdout:7/664: read d1/de/d11/d48/d52/f3e [3935607,95148] 0 2024-03-22T07:28:38.974 INFO:tasks.workunit.client.0.smithi134.stdout:5/464: creat d1/d8/d16/d4a/f9f x:0 0 0 2024-03-22T07:28:38.974 INFO:tasks.workunit.client.0.smithi134.stdout:5/465: write d1/d8/d16/f74 [1503062,62872] 0 2024-03-22T07:28:38.976 INFO:tasks.workunit.client.1.smithi195.stdout:0/696: symlink d1/d4/dd/df/d44/db4/ld3 0 2024-03-22T07:28:38.976 INFO:tasks.workunit.client.1.smithi195.stdout:0/697: dread - d1/d4/dd/d66/f88 zero size 2024-03-22T07:28:38.981 INFO:tasks.workunit.client.0.smithi134.stdout:8/606: mknod d1/d15/d42/d12/d20/d69/cc3 0 2024-03-22T07:28:38.981 INFO:tasks.workunit.client.0.smithi134.stdout:9/409: dread d3/f55 [0,4194304] 0 2024-03-22T07:28:38.981 INFO:tasks.workunit.client.0.smithi134.stdout:9/410: write d3/d9/d37/d6f/d54/f83 [727031,11773] 0 2024-03-22T07:28:38.981 INFO:tasks.workunit.client.0.smithi134.stdout:9/411: read - d3/d9/df/d12/d3b/f6e zero size 2024-03-22T07:28:38.981 INFO:tasks.workunit.client.0.smithi134.stdout:9/412: write d3/d9/d37/f47 [1259484,27878] 0 2024-03-22T07:28:38.982 INFO:tasks.workunit.client.0.smithi134.stdout:6/378: dread d2/d1b/f2f [0,4194304] 0 2024-03-22T07:28:38.982 INFO:tasks.workunit.client.0.smithi134.stdout:9/413: write d3/d9/d37/d6f/f5d [753393,73663] 0 2024-03-22T07:28:38.983 INFO:tasks.workunit.client.0.smithi134.stdout:6/379: write d2/d1b/d4d/f54 [143541,7469] 0 2024-03-22T07:28:38.984 INFO:tasks.workunit.client.0.smithi134.stdout:6/380: truncate d2/d1b/d1d/d5e/f66 1239610 0 2024-03-22T07:28:38.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/752: mkdir da/de/db3/ddd/de2 0 2024-03-22T07:28:38.987 INFO:tasks.workunit.client.1.smithi195.stdout:8/753: fdatasync da/d82/dc6/d53/f8f 0 2024-03-22T07:28:38.988 INFO:tasks.workunit.client.0.smithi134.stdout:1/562: link d5/da/f21 d5/d93/fc9 0 2024-03-22T07:28:38.994 INFO:tasks.workunit.client.0.smithi134.stdout:0/542: unlink dc/f20 0 2024-03-22T07:28:38.995 INFO:tasks.workunit.client.0.smithi134.stdout:5/466: dwrite d1/f57 [0,4194304] 0 2024-03-22T07:28:38.995 INFO:tasks.workunit.client.1.smithi195.stdout:5/764: mknod d9/d22/cf4 0 2024-03-22T07:28:38.997 INFO:tasks.workunit.client.1.smithi195.stdout:4/699: creat d13/d63/d7a/ddf/fee x:0 0 0 2024-03-22T07:28:39.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/381: dread d2/f43 [4194304,4194304] 0 2024-03-22T07:28:39.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.002+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc24c10d910 con 0x7fc234038890 2024-03-22T07:28:39.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:38 smithi134 ceph-mon[29057]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-03-22T07:28:39.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:38 smithi134 ceph-mon[29057]: mgrmap e24: smithi195.jxfsnc(active, since 4s) 2024-03-22T07:28:39.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:38 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2566203341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:28:39.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:38 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/754734010' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:28:39.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/692: creat d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea x:0 0 0 2024-03-22T07:28:39.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/693: creat d3/d18/d89/d70/db5/feb x:0 0 0 2024-03-22T07:28:39.004 INFO:tasks.workunit.client.1.smithi195.stdout:3/694: readlink d3/df/d15/d1d/d5c/d47/d67/d80/d87/l9c 0 2024-03-22T07:28:39.004 INFO:tasks.workunit.client.0.smithi134.stdout:8/607: dwrite d1/d15/f2c [0,4194304] 0 2024-03-22T07:28:39.004 INFO:tasks.workunit.client.0.smithi134.stdout:1/563: rmdir d5/da/d13 39 2024-03-22T07:28:39.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/414: dwrite d3/d9/df/d12/f58 [0,4194304] 0 2024-03-22T07:28:39.009 INFO:tasks.workunit.client.0.smithi134.stdout:5/467: getdents d1/d8/d20/d8a/d75 0 2024-03-22T07:28:39.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.011+0000 7fc248ff9700 1 -- 172.21.15.134:0/3668001988 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc24c10d910 con 0x7fc234038890 2024-03-22T07:28:39.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/382: unlink d2/d1b/d1d/d5e/d6f/d7d/f53 0 2024-03-22T07:28:39.012 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:28:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:28:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:28:39.012 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:28:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:28:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/21 daemons upgraded", 2024-03-22T07:28:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-03-22T07:28:39.013 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:28:39.013 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:28:39.014 INFO:tasks.workunit.client.1.smithi195.stdout:2/702: rename d2/d3/d1a/lb8 to d2/le9 0 2024-03-22T07:28:39.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fc234038890 msgr2=0x7fc23403ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:39.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fc234038890 0x7fc23403ad40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc244009310 tx=0x7fc244004d10 comp rx=0 tx=0).stop 2024-03-22T07:28:39.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 msgr2=0x7fc24c10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:39.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c10be90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc24000b580 tx=0x7fc2400091a0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 shutdown_connections 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fc234038890 0x7fc23403ad40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc24c0662e0 0x7fc24c10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 --2- 172.21.15.134:0/3668001988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc24c0fdcf0 0x7fc24c10be90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 >> 172.21.15.134:0/3668001988 conn(0x7fc24c0f7430 msgr2=0x7fc24c0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 shutdown_connections 2024-03-22T07:28:39.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.014+0000 7fc2526fa700 1 -- 172.21.15.134:0/3668001988 wait complete. 2024-03-22T07:28:39.016 INFO:tasks.workunit.client.1.smithi195.stdout:0/698: getdents d1/d4/dd/df/d2b/d63 0 2024-03-22T07:28:39.017 INFO:tasks.workunit.client.0.smithi134.stdout:8/608: rmdir d1/d46/db0 0 2024-03-22T07:28:39.017 INFO:tasks.workunit.client.0.smithi134.stdout:8/609: stat d1/d46/l88 0 2024-03-22T07:28:39.017 INFO:tasks.workunit.client.0.smithi134.stdout:8/610: fsync d1/f67 0 2024-03-22T07:28:39.017 INFO:tasks.workunit.client.0.smithi134.stdout:8/611: truncate d1/d15/d42/f28 1139085 0 2024-03-22T07:28:39.018 INFO:tasks.workunit.client.0.smithi134.stdout:8/612: write d1/d15/d42/d76/d8f/dad/dae/fc0 [2116210,71781] 0 2024-03-22T07:28:39.018 INFO:tasks.workunit.client.1.smithi195.stdout:8/754: rmdir da/d17/d32 39 2024-03-22T07:28:39.020 INFO:tasks.workunit.client.0.smithi134.stdout:1/564: link d5/da/d1b/d27/c8f d5/da/d13/d1e/d62/cca 0 2024-03-22T07:28:39.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/700: unlink c5 0 2024-03-22T07:28:39.023 INFO:tasks.workunit.client.1.smithi195.stdout:2/703: dread d2/d3/d7/da/d1b/f29 [0,4194304] 0 2024-03-22T07:28:39.023 INFO:tasks.workunit.client.1.smithi195.stdout:2/704: chown d2/d3/f79 655534 1 2024-03-22T07:28:39.023 INFO:tasks.workunit.client.1.smithi195.stdout:2/705: fsync d2/d3/d7/da/f72 0 2024-03-22T07:28:39.028 INFO:tasks.workunit.client.1.smithi195.stdout:7/701: rmdir d0/d98/dab 39 2024-03-22T07:28:39.028 INFO:tasks.workunit.client.1.smithi195.stdout:7/702: write d0/d13/d14/d80/fd3 [395611,13445] 0 2024-03-22T07:28:39.030 INFO:tasks.workunit.client.0.smithi134.stdout:0/543: getdents dc/d17 0 2024-03-22T07:28:39.030 INFO:tasks.workunit.client.0.smithi134.stdout:0/544: creat dc/d18/fa1 x:0 0 0 2024-03-22T07:28:39.030 INFO:tasks.workunit.client.0.smithi134.stdout:6/383: dwrite d2/d3f/f32 [0,4194304] 0 2024-03-22T07:28:39.030 INFO:tasks.workunit.client.0.smithi134.stdout:6/384: write d2/d3f/d28/d6b/f67 [2776989,44699] 0 2024-03-22T07:28:39.031 INFO:tasks.workunit.client.1.smithi195.stdout:2/706: dread d2/d3/d24/f5f [0,4194304] 0 2024-03-22T07:28:39.032 INFO:tasks.workunit.client.1.smithi195.stdout:1/594: rename d0/d2/d6/dad/db1/d97/d39/d40/cb9 to d0/d2/d6/dad/db1/d97/d39/d40/db3/cbd 0 2024-03-22T07:28:39.033 INFO:tasks.workunit.client.0.smithi134.stdout:5/468: mkdir d1/da0 0 2024-03-22T07:28:39.034 INFO:tasks.workunit.client.0.smithi134.stdout:5/469: fsync d1/d8/d20/d62/d65/f77 0 2024-03-22T07:28:39.034 INFO:tasks.workunit.client.1.smithi195.stdout:0/699: getdents d1/d4/d12/d6c 0 2024-03-22T07:28:39.037 INFO:tasks.workunit.client.0.smithi134.stdout:9/415: getdents d3/d9/df/d12 0 2024-03-22T07:28:39.037 INFO:tasks.workunit.client.0.smithi134.stdout:8/613: dread d1/d15/d42/d12/d20/f3c [0,4194304] 0 2024-03-22T07:28:39.037 INFO:tasks.workunit.client.0.smithi134.stdout:8/614: readlink d1/d4/d38/l56 0 2024-03-22T07:28:39.039 INFO:tasks.workunit.client.1.smithi195.stdout:8/755: getdents da/d82/dc6/d53/d8d/dd6 0 2024-03-22T07:28:39.039 INFO:tasks.workunit.client.1.smithi195.stdout:8/756: write da/d82/dc6/f93 [642444,103247] 0 2024-03-22T07:28:39.039 INFO:tasks.workunit.client.1.smithi195.stdout:8/757: chown da/d17/f99 42662 1 2024-03-22T07:28:39.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/565: mknod d5/da/d61/ccb 0 2024-03-22T07:28:39.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/566: dread - d5/d1d/d49/f9e zero size 2024-03-22T07:28:39.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/567: creat d5/da/d13/d1e/d62/fcc x:0 0 0 2024-03-22T07:28:39.041 INFO:tasks.workunit.client.0.smithi134.stdout:1/568: write d5/da/d1b/d27/d39/da4/fb8 [407999,71422] 0 2024-03-22T07:28:39.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/707: dread d2/d3/f79 [4194304,4194304] 0 2024-03-22T07:28:39.041 INFO:tasks.workunit.client.1.smithi195.stdout:2/708: truncate d2/d3/d21/d60/d81/d9a/f70 2014184 0 2024-03-22T07:28:39.042 INFO:tasks.workunit.client.1.smithi195.stdout:4/701: truncate d13/f34 2665938 0 2024-03-22T07:28:39.046 INFO:tasks.workunit.client.1.smithi195.stdout:7/703: creat d0/d13/d14/d20/d40/d82/da0/d59/d79/ff3 x:0 0 0 2024-03-22T07:28:39.047 INFO:tasks.workunit.client.0.smithi134.stdout:0/545: creat dc/d18/d72/fa2 x:0 0 0 2024-03-22T07:28:39.054 INFO:tasks.workunit.client.0.smithi134.stdout:1/569: dread d5/d1d/f90 [0,4194304] 0 2024-03-22T07:28:39.056 INFO:tasks.workunit.client.0.smithi134.stdout:5/470: readlink d1/d8/d20/d62/d65/l48 0 2024-03-22T07:28:39.056 INFO:tasks.workunit.client.0.smithi134.stdout:6/385: truncate d2/d1b/d1d/d5e/d63/f64 587349 0 2024-03-22T07:28:39.056 INFO:tasks.workunit.client.0.smithi134.stdout:6/386: stat d2/l2a 0 2024-03-22T07:28:39.057 INFO:tasks.workunit.client.1.smithi195.stdout:8/758: symlink da/dc/le3 0 2024-03-22T07:28:39.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/759: write da/d82/f8c [986780,119466] 0 2024-03-22T07:28:39.058 INFO:tasks.workunit.client.1.smithi195.stdout:8/760: chown da/d82/dc6/d53 7432 1 2024-03-22T07:28:39.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/709: symlink d2/d3/d7/da/de/lea 0 2024-03-22T07:28:39.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/710: creat d2/d3/db/db3/feb x:0 0 0 2024-03-22T07:28:39.061 INFO:tasks.workunit.client.1.smithi195.stdout:2/711: chown d2/d3/d21/d60/d81/d9a/caa 61288 1 2024-03-22T07:28:39.062 INFO:tasks.workunit.client.0.smithi134.stdout:9/416: symlink d3/d9/d37/d5a/d6b/l93 0 2024-03-22T07:28:39.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/615: creat d1/fc4 x:0 0 0 2024-03-22T07:28:39.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/616: dread - d1/d15/d57/d79/fba zero size 2024-03-22T07:28:39.063 INFO:tasks.workunit.client.0.smithi134.stdout:8/617: creat d1/d15/d42/d76/fc5 x:0 0 0 2024-03-22T07:28:39.065 INFO:tasks.workunit.client.1.smithi195.stdout:0/700: creat d1/d4/dd/d66/fd4 x:0 0 0 2024-03-22T07:28:39.066 INFO:tasks.workunit.client.1.smithi195.stdout:9/850: rename d2/d4/d6/db/d20/d47/cc1 to d2/d4/d6/d18/d50/c136 0 2024-03-22T07:28:39.066 INFO:tasks.workunit.client.1.smithi195.stdout:9/851: chown d2/d4/d6/db/lf0 8760037 1 2024-03-22T07:28:39.067 INFO:tasks.workunit.client.1.smithi195.stdout:9/852: dread - d2/d4/d6/d18/f132 zero size 2024-03-22T07:28:39.068 INFO:tasks.workunit.client.1.smithi195.stdout:8/761: mknod da/d17/ce4 0 2024-03-22T07:28:39.069 INFO:tasks.workunit.client.0.smithi134.stdout:1/570: symlink d5/da/d13/d1e/d62/lcd 0 2024-03-22T07:28:39.069 INFO:tasks.workunit.client.0.smithi134.stdout:1/571: read d5/da/d1b/d27/d60/f66 [450392,61416] 0 2024-03-22T07:28:39.070 INFO:tasks.workunit.client.0.smithi134.stdout:1/572: stat d5/d1d/d49/f88 0 2024-03-22T07:28:39.073 INFO:tasks.workunit.client.1.smithi195.stdout:0/701: creat d1/d4/d12/d6c/dbc/d47/db6/fd5 x:0 0 0 2024-03-22T07:28:39.074 INFO:tasks.workunit.client.0.smithi134.stdout:6/387: link d2/d3f/f88 d2/d1b/d4d/f90 0 2024-03-22T07:28:39.074 INFO:tasks.workunit.client.0.smithi134.stdout:6/388: write d2/f17 [1125435,126615] 0 2024-03-22T07:28:39.074 INFO:tasks.workunit.client.0.smithi134.stdout:9/417: dread d3/d9/df/f90 [0,4194304] 0 2024-03-22T07:28:39.075 INFO:tasks.workunit.client.1.smithi195.stdout:5/765: rename d9/d22/d46/db2/lae to d9/d73/da1/lf5 0 2024-03-22T07:28:39.077 INFO:tasks.workunit.client.0.smithi134.stdout:4/539: sync 2024-03-22T07:28:39.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/702: dwrite d13/d15/f98 [0,4194304] 0 2024-03-22T07:28:39.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/703: write d13/d15/faf [933157,96558] 0 2024-03-22T07:28:39.077 INFO:tasks.workunit.client.1.smithi195.stdout:4/704: write d13/d63/d36/fbf [643334,120616] 0 2024-03-22T07:28:39.078 INFO:tasks.workunit.client.1.smithi195.stdout:7/704: dwrite d0/d98/dab/fd4 [0,4194304] 0 2024-03-22T07:28:39.078 INFO:tasks.workunit.client.1.smithi195.stdout:9/853: creat d2/dad/f137 x:0 0 0 2024-03-22T07:28:39.078 INFO:tasks.workunit.client.1.smithi195.stdout:9/854: readlink d2/d4/d23/d74/lba 0 2024-03-22T07:28:39.079 INFO:tasks.workunit.client.1.smithi195.stdout:3/695: rmdir d3/dbf 39 2024-03-22T07:28:39.079 INFO:tasks.workunit.client.1.smithi195.stdout:3/696: creat d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9/fec x:0 0 0 2024-03-22T07:28:39.079 INFO:tasks.workunit.client.1.smithi195.stdout:3/697: stat d3/f91 0 2024-03-22T07:28:39.080 INFO:tasks.workunit.client.0.smithi134.stdout:0/546: dwrite dc/f29 [4194304,4194304] 0 2024-03-22T07:28:39.080 INFO:tasks.workunit.client.0.smithi134.stdout:8/618: link d1/d15/d42/d76/d8f/dad/fc2 d1/d15/d42/d12/fc6 0 2024-03-22T07:28:39.080 INFO:tasks.workunit.client.0.smithi134.stdout:0/547: readlink dc/l58 0 2024-03-22T07:28:39.080 INFO:tasks.workunit.client.0.smithi134.stdout:0/548: fsync dc/d17/f7f 0 2024-03-22T07:28:39.080 INFO:tasks.workunit.client.0.smithi134.stdout:0/549: fdatasync dc/d17/f48 0 2024-03-22T07:28:39.080 INFO:tasks.workunit.client.0.smithi134.stdout:0/550: write dc/d17/f41 [486996,87810] 0 2024-03-22T07:28:39.081 INFO:tasks.workunit.client.1.smithi195.stdout:8/762: stat da/de/db3/ddd/cdb 0 2024-03-22T07:28:39.084 INFO:tasks.workunit.client.0.smithi134.stdout:1/573: mkdir d5/da/dce 0 2024-03-22T07:28:39.085 INFO:tasks.workunit.client.1.smithi195.stdout:9/855: write d2/d4/d6/db/f9d [1409708,48798] 0 2024-03-22T07:28:39.086 INFO:tasks.workunit.client.0.smithi134.stdout:5/471: mkdir d1/d8/da1 0 2024-03-22T07:28:39.087 INFO:tasks.workunit.client.0.smithi134.stdout:5/472: write d1/d8/d20/d62/d65/f53 [1494492,101159] 0 2024-03-22T07:28:39.087 INFO:tasks.workunit.client.0.smithi134.stdout:5/473: dread - d1/d8/d20/d8a/f78 zero size 2024-03-22T07:28:39.092 INFO:tasks.workunit.client.1.smithi195.stdout:0/702: creat d1/d4/dd/d3f/fd6 x:0 0 0 2024-03-22T07:28:39.093 INFO:tasks.workunit.client.1.smithi195.stdout:9/856: dread d2/d4/d6/db/d20/d4a/f5e [0,4194304] 0 2024-03-22T07:28:39.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/595: rename d0/d2/d27/f30 to d0/d2/d6/dad/db1/d97/d39/d64/fbe 0 2024-03-22T07:28:39.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/596: readlink d0/d2/d6/dad/db1/d97/d41/d47/la3 0 2024-03-22T07:28:39.095 INFO:tasks.workunit.client.1.smithi195.stdout:1/597: chown d0/d2/d6/dad/db1/d6a 44213033 1 2024-03-22T07:28:39.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/540: mknod d2/d2a/d93/cbe 0 2024-03-22T07:28:39.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/541: truncate d2/d2a/d80/d85/f88 160030 0 2024-03-22T07:28:39.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/542: write d2/d15/d35/f63 [4378902,38244] 0 2024-03-22T07:28:39.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/543: chown d2/d15/f13 1992557 1 2024-03-22T07:28:39.098 INFO:tasks.workunit.client.0.smithi134.stdout:4/544: chown d2/d15/d35/f78 22921 1 2024-03-22T07:28:39.098 INFO:tasks.workunit.client.0.smithi134.stdout:4/545: chown d2/d15/f13 2287087 1 2024-03-22T07:28:39.098 INFO:tasks.workunit.client.1.smithi195.stdout:4/705: mkdir d13/d15/d6b/da6/ded/def 0 2024-03-22T07:28:39.098 INFO:tasks.workunit.client.1.smithi195.stdout:4/706: read - d13/d63/d79/d68/fc2 zero size 2024-03-22T07:28:39.101 INFO:tasks.workunit.client.0.smithi134.stdout:8/619: unlink d1/d4/d61/c64 0 2024-03-22T07:28:39.104 INFO:tasks.workunit.client.0.smithi134.stdout:1/574: mknod d5/da/d13/d1e/d63/d9d/ccf 0 2024-03-22T07:28:39.105 INFO:tasks.workunit.client.1.smithi195.stdout:5/766: dwrite d9/d2d/d84/dcf/fc0 [0,4194304] 0 2024-03-22T07:28:39.108 INFO:tasks.workunit.client.1.smithi195.stdout:7/705: creat d0/d98/dab/dd7/ff4 x:0 0 0 2024-03-22T07:28:39.109 INFO:tasks.workunit.client.0.smithi134.stdout:0/551: dwrite dc/d17/f77 [0,4194304] 0 2024-03-22T07:28:39.109 INFO:tasks.workunit.client.0.smithi134.stdout:0/552: write dc/d17/f7f [894065,96586] 0 2024-03-22T07:28:39.110 INFO:tasks.workunit.client.1.smithi195.stdout:3/698: dwrite d3/df/d15/d1d/d5c/f72 [0,4194304] 0 2024-03-22T07:28:39.112 INFO:tasks.workunit.client.0.smithi134.stdout:3/497: rename d4/d10/f2c to d4/d10/d6c/fa5 0 2024-03-22T07:28:39.118 INFO:tasks.workunit.client.0.smithi134.stdout:5/474: read d1/d8/d20/d62/d65/f67 [147350,96066] 0 2024-03-22T07:28:39.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/665: rename d1/de/d41/c77 to d1/de/d41/cd6 0 2024-03-22T07:28:39.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/666: chown d1/de/d11/d2b/fb6 72244 1 2024-03-22T07:28:39.118 INFO:tasks.workunit.client.0.smithi134.stdout:7/667: write d1/d19/d32/f4d [2177094,41469] 0 2024-03-22T07:28:39.118 INFO:tasks.workunit.client.0.smithi134.stdout:6/389: mknod d2/d1b/d1d/d5e/d6f/d7d/c91 0 2024-03-22T07:28:39.118 INFO:tasks.workunit.client.0.smithi134.stdout:6/390: stat d2/d1b/f29 0 2024-03-22T07:28:39.120 INFO:tasks.workunit.client.1.smithi195.stdout:8/763: write da/d17/d32/d61/d88/d91/f9f [2214499,121752] 0 2024-03-22T07:28:39.120 INFO:tasks.workunit.client.0.smithi134.stdout:9/418: getdents d3/d9/df/d57/d67/d5f 0 2024-03-22T07:28:39.124 INFO:tasks.workunit.client.0.smithi134.stdout:8/620: symlink d1/d15/d42/d12/d20/d69/lc7 0 2024-03-22T07:28:39.124 INFO:tasks.workunit.client.0.smithi134.stdout:8/621: chown d1/d4/d61/d85/f8d 8562 1 2024-03-22T07:28:39.125 INFO:tasks.workunit.client.1.smithi195.stdout:6/626: sync 2024-03-22T07:28:39.125 INFO:tasks.workunit.client.1.smithi195.stdout:6/627: chown d5/d5e/d34/d55/d3b/d6e/d3c/f6c 59040 1 2024-03-22T07:28:39.130 INFO:tasks.workunit.client.1.smithi195.stdout:2/712: rename d2/d3/db/db3/cd7 to d2/d3/d7/d19/d22/d26/d99/dbf/cec 0 2024-03-22T07:28:39.132 INFO:tasks.workunit.client.0.smithi134.stdout:4/546: dwrite d2/d15/d35/f78 [0,4194304] 0 2024-03-22T07:28:39.132 INFO:tasks.workunit.client.0.smithi134.stdout:4/547: creat d2/d2a/d50/fbf x:0 0 0 2024-03-22T07:28:39.133 INFO:tasks.workunit.client.1.smithi195.stdout:5/767: dwrite d9/d22/fb4 [0,4194304] 0 2024-03-22T07:28:39.133 INFO:tasks.workunit.client.1.smithi195.stdout:1/598: creat d0/d2/d6/dad/db1/d97/d39/d40/db3/fbf x:0 0 0 2024-03-22T07:28:39.134 INFO:tasks.workunit.client.0.smithi134.stdout:2/454: rename d2/d5/d22/d52/d3c/d4f/f6d to d2/d5/d8/d5d/f90 0 2024-03-22T07:28:39.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/707: symlink d13/d63/d79/de9/d7e/d85/lf0 0 2024-03-22T07:28:39.135 INFO:tasks.workunit.client.1.smithi195.stdout:4/708: stat d13/d63/d36/d9e 0 2024-03-22T07:28:39.136 INFO:tasks.workunit.client.0.smithi134.stdout:1/575: dwrite f3 [0,4194304] 0 2024-03-22T07:28:39.136 INFO:tasks.workunit.client.0.smithi134.stdout:1/576: chown d5/da/d13/d1e/d62 137 1 2024-03-22T07:28:39.136 INFO:tasks.workunit.client.0.smithi134.stdout:3/498: dwrite d4/d22/d29/f67 [0,4194304] 0 2024-03-22T07:28:39.136 INFO:tasks.workunit.client.0.smithi134.stdout:3/499: write d4/d22/d3c/f73 [410533,59319] 0 2024-03-22T07:28:39.138 INFO:tasks.workunit.client.0.smithi134.stdout:5/475: unlink d1/d8/d20/c28 0 2024-03-22T07:28:39.140 INFO:tasks.workunit.client.1.smithi195.stdout:0/703: creat d1/d4/dd/df/d44/fd7 x:0 0 0 2024-03-22T07:28:39.141 INFO:tasks.workunit.client.0.smithi134.stdout:9/419: creat d3/d9/f94 x:0 0 0 2024-03-22T07:28:39.143 INFO:tasks.workunit.client.1.smithi195.stdout:7/706: creat d0/d13/d14/d20/d40/d82/da0/ff5 x:0 0 0 2024-03-22T07:28:39.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/548: write d2/d15/d35/d37/f55 [315574,98816] 0 2024-03-22T07:28:39.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/549: readlink d2/d2a/l86 0 2024-03-22T07:28:39.144 INFO:tasks.workunit.client.1.smithi195.stdout:4/709: dread d13/d63/d36/f50 [0,4194304] 0 2024-03-22T07:28:39.144 INFO:tasks.workunit.client.0.smithi134.stdout:8/622: unlink d1/d15/d42/d12/l4c 0 2024-03-22T07:28:39.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/668: rename d1/d19/d32/f92 to d1/de/d41/fd7 0 2024-03-22T07:28:39.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/669: creat d1/de/fd8 x:0 0 0 2024-03-22T07:28:39.153 INFO:tasks.workunit.client.1.smithi195.stdout:3/699: mkdir d3/df/d15/d1d/d5c/d47/d67/ded 0 2024-03-22T07:28:39.153 INFO:tasks.workunit.client.0.smithi134.stdout:4/550: dread d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:39.153 INFO:tasks.workunit.client.0.smithi134.stdout:4/551: chown d2/d2a/d80/lae 56519987 1 2024-03-22T07:28:39.154 INFO:tasks.workunit.client.1.smithi195.stdout:3/700: dread d3/df/d15/d1d/d5c/f6f [0,4194304] 0 2024-03-22T07:28:39.154 INFO:tasks.workunit.client.1.smithi195.stdout:3/701: chown d3/df/d15/d1d/d5c/d47/d67/d80/d87/l9c 6 1 2024-03-22T07:28:39.154 INFO:tasks.workunit.client.1.smithi195.stdout:3/702: truncate d3/d18/d89/f6d 515316 0 2024-03-22T07:28:39.154 INFO:tasks.workunit.client.1.smithi195.stdout:3/703: stat d3/dbf/da0/dd1 0 2024-03-22T07:28:39.155 INFO:tasks.workunit.client.1.smithi195.stdout:8/764: mknod da/d17/d32/d61/dc2/dc3/ce5 0 2024-03-22T07:28:39.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/577: dwrite d5/da/d68/da1/fbd [0,4194304] 0 2024-03-22T07:28:39.162 INFO:tasks.workunit.client.1.smithi195.stdout:6/628: mknod d5/d5e/d34/d55/d4b/d5f/ce4 0 2024-03-22T07:28:39.162 INFO:tasks.workunit.client.1.smithi195.stdout:6/629: write d5/d5e/d34/d55/d3b/d6e/d3c/f6c [445464,29416] 0 2024-03-22T07:28:39.164 INFO:tasks.workunit.client.0.smithi134.stdout:3/500: unlink d4/d10/c1b 0 2024-03-22T07:28:39.164 INFO:tasks.workunit.client.0.smithi134.stdout:3/501: write d4/d10/d4b/f65 [1074802,51056] 0 2024-03-22T07:28:39.164 INFO:tasks.workunit.client.0.smithi134.stdout:3/502: readlink d4/l6 0 2024-03-22T07:28:39.164 INFO:tasks.workunit.client.0.smithi134.stdout:3/503: fsync d4/d22/d29/d82/f8e 0 2024-03-22T07:28:39.166 INFO:tasks.workunit.client.1.smithi195.stdout:9/857: rmdir d2/d4/d32/d6d/deb 39 2024-03-22T07:28:39.172 INFO:tasks.workunit.client.1.smithi195.stdout:2/713: mkdir d2/d3/d21/d60/d81/da8/ded 0 2024-03-22T07:28:39.175 INFO:tasks.workunit.client.0.smithi134.stdout:9/420: unlink d3/d9/d37/d6f/d54/l79 0 2024-03-22T07:28:39.178 INFO:tasks.workunit.client.0.smithi134.stdout:8/623: creat d1/d15/d42/d12/d20/fc8 x:0 0 0 2024-03-22T07:28:39.178 INFO:tasks.workunit.client.0.smithi134.stdout:8/624: chown d1/d15/d42/d12/f37 59348 1 2024-03-22T07:28:39.178 INFO:tasks.workunit.client.0.smithi134.stdout:8/625: readlink d1/d46/l88 0 2024-03-22T07:28:39.179 INFO:tasks.workunit.client.1.smithi195.stdout:2/714: dread d2/d3/d7/da/d1b/f29 [0,4194304] 0 2024-03-22T07:28:39.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/710: dwrite d13/d15/f6f [0,4194304] 0 2024-03-22T07:28:39.179 INFO:tasks.workunit.client.1.smithi195.stdout:4/711: readlink d13/d63/d79/de9/l43 0 2024-03-22T07:28:39.181 INFO:tasks.workunit.client.0.smithi134.stdout:6/391: rename d2/d1b/d1d/d5e/d6f/d7d/c91 to d2/d1b/d8f/c92 0 2024-03-22T07:28:39.181 INFO:tasks.workunit.client.0.smithi134.stdout:6/392: chown d2/d3f/l51 102931231 1 2024-03-22T07:28:39.184 INFO:tasks.workunit.client.1.smithi195.stdout:1/599: mkdir d0/d2/d9/da4/dc0 0 2024-03-22T07:28:39.185 INFO:tasks.workunit.client.0.smithi134.stdout:7/670: symlink d1/de/d8d/ld9 0 2024-03-22T07:28:39.185 INFO:tasks.workunit.client.0.smithi134.stdout:7/671: readlink d1/d19/d32/l76 0 2024-03-22T07:28:39.187 INFO:tasks.workunit.client.1.smithi195.stdout:6/630: dwrite d5/d5e/d34/d55/d3b/d6e/d3c/f44 [4194304,4194304] 0 2024-03-22T07:28:39.187 INFO:tasks.workunit.client.1.smithi195.stdout:6/631: chown d5/d5e/d34/d55/d3b/d7f/db4/ld1 234904411 1 2024-03-22T07:28:39.187 INFO:tasks.workunit.client.1.smithi195.stdout:0/704: mkdir d1/d4/d22/dd8 0 2024-03-22T07:28:39.188 INFO:tasks.workunit.client.0.smithi134.stdout:3/504: dwrite d4/d22/f32 [0,4194304] 0 2024-03-22T07:28:39.188 INFO:tasks.workunit.client.0.smithi134.stdout:3/505: readlink d4/d10/d4b/la0 0 2024-03-22T07:28:39.190 INFO:tasks.workunit.client.0.smithi134.stdout:4/552: mkdir d2/d15/d35/d37/dc0 0 2024-03-22T07:28:39.191 INFO:tasks.workunit.client.0.smithi134.stdout:4/553: truncate d2/d1d/f90 938951 0 2024-03-22T07:28:39.192 INFO:tasks.workunit.client.1.smithi195.stdout:7/707: link d0/d13/d14/d20/d40/d82/da0/d59/cda d0/d13/d14/d29/da2/cf6 0 2024-03-22T07:28:39.196 INFO:tasks.workunit.client.1.smithi195.stdout:0/705: dread d1/d4/d12/d6c/d87/fbe [0,4194304] 0 2024-03-22T07:28:39.196 INFO:tasks.workunit.client.1.smithi195.stdout:3/704: creat d3/d18/d89/d76/fee x:0 0 0 2024-03-22T07:28:39.196 INFO:tasks.workunit.client.1.smithi195.stdout:3/705: truncate d3/f58 310594 0 2024-03-22T07:28:39.196 INFO:tasks.workunit.client.1.smithi195.stdout:3/706: write d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea [846766,9762] 0 2024-03-22T07:28:39.196 INFO:tasks.workunit.client.1.smithi195.stdout:3/707: write d3/f24 [5435295,46392] 0 2024-03-22T07:28:39.197 INFO:tasks.workunit.client.0.smithi134.stdout:7/672: dread d1/d19/d32/f4d [0,4194304] 0 2024-03-22T07:28:39.202 INFO:tasks.workunit.client.0.smithi134.stdout:3/506: dread d4/d8/f49 [0,4194304] 0 2024-03-22T07:28:39.202 INFO:tasks.workunit.client.0.smithi134.stdout:3/507: dread - d4/d8/fa3 zero size 2024-03-22T07:28:39.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/765: mkdir da/d82/dc6/d53/d8d/dd6/de6 0 2024-03-22T07:28:39.203 INFO:tasks.workunit.client.1.smithi195.stdout:8/766: write da/de/fbf [704554,51966] 0 2024-03-22T07:28:39.203 INFO:tasks.workunit.client.1.smithi195.stdout:2/715: dwrite d2/d3/db/fc7 [0,4194304] 0 2024-03-22T07:28:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:38 smithi195 ceph-mon[36144]: pgmap v5: 65 pgs: 65 active+clean; 2.0 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail 2024-03-22T07:28:39.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:38 smithi195 ceph-mon[36144]: mgrmap e24: smithi195.jxfsnc(active, since 4s) 2024-03-22T07:28:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:38 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2566203341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:28:39.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:38 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/754734010' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.204+0000 7fdab8852700 1 -- 172.21.15.134:0/2793998975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fc910 msgr2=0x7fdab40fad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.205+0000 7fdab8852700 1 --2- 172.21.15.134:0/2793998975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fc910 0x7fdab40fad20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4004940 tx=0x7fdaa4009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.205+0000 7fdab8852700 1 -- 172.21.15.134:0/2793998975 shutdown_connections 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.205+0000 7fdab8852700 1 --2- 172.21.15.134:0/2793998975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fc910 0x7fdab40fad20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.205+0000 7fdab8852700 1 --2- 172.21.15.134:0/2793998975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fbfc0 0x7fdab40fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.205+0000 7fdab8852700 1 -- 172.21.15.134:0/2793998975 >> 172.21.15.134:0/2793998975 conn(0x7fdab40f6a30 msgr2=0x7fdab40f8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.206+0000 7fdab8852700 1 -- 172.21.15.134:0/2793998975 shutdown_connections 2024-03-22T07:28:39.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.206+0000 7fdab8852700 1 -- 172.21.15.134:0/2793998975 wait complete. 2024-03-22T07:28:39.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.207+0000 7fdab8852700 1 Processor -- start 2024-03-22T07:28:39.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.207+0000 7fdab8852700 1 -- start start 2024-03-22T07:28:39.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.207+0000 7fdab8852700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fbfc0 0x7fdab4113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:39.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.207+0000 7fdab8852700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 0x7fdab4114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:39.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.207+0000 7fdab8852700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4114a40 con 0x7fdab40fc910 2024-03-22T07:28:39.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.207+0000 7fdab8852700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4115180 con 0x7fdab40fbfc0 2024-03-22T07:28:39.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.208+0000 7fdab37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fbfc0 0x7fdab4113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:39.210 INFO:tasks.workunit.client.0.smithi134.stdout:1/578: mkdir d5/d1d/dd0 0 2024-03-22T07:28:39.210 INFO:tasks.workunit.client.0.smithi134.stdout:1/579: write d5/d1d/d49/f9e [132961,110544] 0 2024-03-22T07:28:39.210 INFO:tasks.workunit.client.0.smithi134.stdout:1/580: fdatasync d5/da/d61/fc1 0 2024-03-22T07:28:39.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 0x7fdab4114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:39.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 0x7fdab4114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45938/0 (socket says 172.21.15.134:45938) 2024-03-22T07:28:39.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 -- 172.21.15.134:0/3067101292 learned_addr learned my addr 172.21.15.134:0/3067101292 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:28:39.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 -- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fbfc0 msgr2=0x7fdab4113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:39.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fbfc0 0x7fdab4113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 -- 172.21.15.134:0/3067101292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4005040 con 0x7fdab40fc910 2024-03-22T07:28:39.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.209+0000 7fdab2ffd700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 0x7fdab4114440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400b3b0 tx=0x7fdaa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:39.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.210+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa400e070 con 0x7fdab40fc910 2024-03-22T07:28:39.212 INFO:tasks.workunit.client.0.smithi134.stdout:1/581: dread d5/da/d13/d1e/d34/f59 [0,4194304] 0 2024-03-22T07:28:39.212 INFO:tasks.workunit.client.0.smithi134.stdout:1/582: write d5/d1d/d49/f70 [930655,12864] 0 2024-03-22T07:28:39.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.210+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab4115400 con 0x7fdab40fc910 2024-03-22T07:28:39.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.210+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab41159c0 con 0x7fdab40fc910 2024-03-22T07:28:39.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.210+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaa4009430 con 0x7fdab40fc910 2024-03-22T07:28:39.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.211+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa4013bb0 con 0x7fdab40fc910 2024-03-22T07:28:39.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.212+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 45771+0+0 (secure 0 0 0) 0x7fdaa4013d10 con 0x7fdab40fc910 2024-03-22T07:28:39.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.212+0000 7fda9bfff700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fda9c0388d0 0x7fda9c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:28:39.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.212+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa00052e0 con 0x7fdab40fc910 2024-03-22T07:28:39.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.212+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fdaa404d550 con 0x7fdab40fc910 2024-03-22T07:28:39.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.213+0000 7fdab37fe700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fda9c0388d0 0x7fda9c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:28:39.214 INFO:tasks.workunit.client.1.smithi195.stdout:9/858: rename d2/d4/d6/db/da8/c123 to d2/d4/d1d/d9b/c138 0 2024-03-22T07:28:39.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.213+0000 7fdab37fe700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fda9c0388d0 0x7fda9c03ad80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8004f40 tx=0x7fdaa800b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:28:39.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.218+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fdaa40236d0 con 0x7fdab40fc910 2024-03-22T07:28:39.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/768: getdents d9/d2d/d84/d92 0 2024-03-22T07:28:39.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/769: write d9/d12/d14/f4b [1505703,84054] 0 2024-03-22T07:28:39.306 INFO:tasks.workunit.client.0.smithi134.stdout:9/421: truncate d3/d9/df/d12/f1f 3579274 0 2024-03-22T07:28:39.306 INFO:tasks.workunit.client.0.smithi134.stdout:9/422: write d3/d9/df/d57/d67/f6c [729987,112477] 0 2024-03-22T07:28:39.306 INFO:tasks.workunit.client.0.smithi134.stdout:9/423: write d3/d9/f18 [1529357,98269] 0 2024-03-22T07:28:39.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/632: creat d5/d16/dd8/fe5 x:0 0 0 2024-03-22T07:28:39.307 INFO:tasks.workunit.client.1.smithi195.stdout:6/633: creat d5/d5e/d34/d55/d4b/da2/d1a/fe6 x:0 0 0 2024-03-22T07:28:39.310 INFO:tasks.workunit.client.0.smithi134.stdout:8/626: symlink d1/d15/d7b/d83/lc9 0 2024-03-22T07:28:39.310 INFO:tasks.workunit.client.0.smithi134.stdout:8/627: write d1/d15/d5b/f81 [638022,130814] 0 2024-03-22T07:28:39.312 INFO:tasks.workunit.client.1.smithi195.stdout:5/770: dwrite d9/d2d/f72 [4194304,4194304] 0 2024-03-22T07:28:39.312 INFO:tasks.workunit.client.1.smithi195.stdout:7/708: truncate d0/d13/d14/d20/d40/d82/da0/f9f 210546 0 2024-03-22T07:28:39.312 INFO:tasks.workunit.client.1.smithi195.stdout:7/709: write d0/d13/d22/d57/f84 [1759705,120113] 0 2024-03-22T07:28:39.312 INFO:tasks.workunit.client.1.smithi195.stdout:7/710: read d0/d13/f46 [1113107,114832] 0 2024-03-22T07:28:39.317 INFO:tasks.workunit.client.0.smithi134.stdout:9/424: dread d3/d9/df/f26 [4194304,4194304] 0 2024-03-22T07:28:39.321 INFO:tasks.workunit.client.1.smithi195.stdout:3/708: mkdir d3/d18/d89/d76/def 0 2024-03-22T07:28:39.323 INFO:tasks.workunit.client.0.smithi134.stdout:2/455: rename d2/d5/d22/f23 to d2/d5/d22/d52/d3c/d60/f91 0 2024-03-22T07:28:39.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/767: symlink da/de/db3/ddd/de2/le7 0 2024-03-22T07:28:39.327 INFO:tasks.workunit.client.1.smithi195.stdout:8/768: chown da/d82/dc6/d53/f96 331413829 1 2024-03-22T07:28:39.327 INFO:tasks.workunit.client.0.smithi134.stdout:6/393: symlink d2/d1b/d4d/d65/l93 0 2024-03-22T07:28:39.331 INFO:tasks.workunit.client.0.smithi134.stdout:4/554: symlink d2/d15/lc1 0 2024-03-22T07:28:39.332 INFO:tasks.workunit.client.0.smithi134.stdout:4/555: dread d2/d2a/d80/d85/f88 [0,4194304] 0 2024-03-22T07:28:39.332 INFO:tasks.workunit.client.0.smithi134.stdout:4/556: creat d2/d1d/fc2 x:0 0 0 2024-03-22T07:28:39.334 INFO:tasks.workunit.client.1.smithi195.stdout:8/769: write da/d17/d32/d61/f72 [351416,59639] 0 2024-03-22T07:28:39.336 INFO:tasks.workunit.client.0.smithi134.stdout:7/673: rmdir d1/de/d11/d48/d52 39 2024-03-22T07:28:39.338 INFO:tasks.workunit.client.1.smithi195.stdout:6/634: dwrite d5/d5e/d34/d55/d3b/d6e/d97/fbd [0,4194304] 0 2024-03-22T07:28:39.340 INFO:tasks.workunit.client.1.smithi195.stdout:2/716: getdents d2/d3/d21/d4c 0 2024-03-22T07:28:39.346 INFO:tasks.workunit.client.0.smithi134.stdout:1/583: link d5/da/d13/c16 d5/da/d13/db9/cd1 0 2024-03-22T07:28:39.347 INFO:tasks.workunit.client.0.smithi134.stdout:8/628: dwrite d1/d46/f62 [0,4194304] 0 2024-03-22T07:28:39.348 INFO:tasks.workunit.client.1.smithi195.stdout:3/709: dwrite d3/df/d15/d1d/d5c/f72 [0,4194304] 0 2024-03-22T07:28:39.348 INFO:tasks.workunit.client.0.smithi134.stdout:6/394: dwrite d2/d1b/d4d/f90 [0,4194304] 0 2024-03-22T07:28:39.350 INFO:tasks.workunit.client.0.smithi134.stdout:1/584: dread d5/d1d/d2d/f57 [0,4194304] 0 2024-03-22T07:28:39.355 INFO:tasks.workunit.client.0.smithi134.stdout:0/553: mknod dc/d18/ca3 0 2024-03-22T07:28:39.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/710: dwrite d3/f3f [4194304,4194304] 0 2024-03-22T07:28:39.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/600: rename d0/d2/d6/dad/db1/d97/d41/d47/d4a/f4c to d0/d2/d9/da4/dc0/fc1 0 2024-03-22T07:28:39.365 INFO:tasks.workunit.client.1.smithi195.stdout:1/601: fdatasync d0/d2/d6/f4b 0 2024-03-22T07:28:39.365 INFO:tasks.workunit.client.0.smithi134.stdout:6/395: dwrite d2/d3f/d28/f7e [0,4194304] 0 2024-03-22T07:28:39.367 INFO:tasks.workunit.client.1.smithi195.stdout:9/859: symlink d2/d4/d6/db/l139 0 2024-03-22T07:28:39.368 INFO:tasks.workunit.client.1.smithi195.stdout:9/860: fsync d2/d4/d6/ff4 0 2024-03-22T07:28:39.368 INFO:tasks.workunit.client.1.smithi195.stdout:9/861: fdatasync d2/d4/d32/d6d/deb/ff8 0 2024-03-22T07:28:39.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/602: dread d0/d2/d6/dad/db1/d97/d41/f5a [0,4194304] 0 2024-03-22T07:28:39.378 INFO:tasks.workunit.client.1.smithi195.stdout:3/711: dwrite d3/f2d [0,4194304] 0 2024-03-22T07:28:39.380 INFO:tasks.workunit.client.0.smithi134.stdout:9/425: unlink d3/d9/f10 0 2024-03-22T07:28:39.380 INFO:tasks.workunit.client.0.smithi134.stdout:9/426: creat d3/d9/d37/d5a/d7f/d80/f95 x:0 0 0 2024-03-22T07:28:39.388 INFO:tasks.workunit.client.1.smithi195.stdout:5/771: mknod d9/d12/d1d/d36/d7d/dd2/cf6 0 2024-03-22T07:28:39.392 INFO:tasks.workunit.client.0.smithi134.stdout:4/557: creat d2/d15/d35/d37/fc3 x:0 0 0 2024-03-22T07:28:39.392 INFO:tasks.workunit.client.0.smithi134.stdout:4/558: fdatasync d2/d25/d48/d6e/d7b/f8e 0 2024-03-22T07:28:39.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/772: dread d9/d12/d1d/d36/fa6 [0,4194304] 0 2024-03-22T07:28:39.397 INFO:tasks.workunit.client.1.smithi195.stdout:6/635: mkdir d5/d5e/d34/d55/d4b/d5f/de7 0 2024-03-22T07:28:39.397 INFO:tasks.workunit.client.1.smithi195.stdout:6/636: chown d5/d5e/d34/d55/d4b/da2/cce 15 1 2024-03-22T07:28:39.399 INFO:tasks.workunit.client.1.smithi195.stdout:2/717: unlink d2/d3/d7/da/de/f5a 0 2024-03-22T07:28:39.401 INFO:tasks.workunit.client.0.smithi134.stdout:8/629: creat d1/d15/d42/d25/d6f/fca x:0 0 0 2024-03-22T07:28:39.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/718: read d2/d3/f95 [2741389,79497] 0 2024-03-22T07:28:39.410 INFO:tasks.workunit.client.1.smithi195.stdout:7/711: rename d0/d13/d14/d2b/fc5 to d0/d13/d14/d20/d40/d82/db8/ff7 0 2024-03-22T07:28:39.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/603: link d0/d2/d9/d2a/c8d d0/d2/d6/dad/db1/d6a/cc2 0 2024-03-22T07:28:39.412 INFO:tasks.workunit.client.1.smithi195.stdout:1/604: getdents d0/d2/d6/dad/db1/d97/dab 0 2024-03-22T07:28:39.416 INFO:tasks.workunit.client.1.smithi195.stdout:5/773: dwrite d9/da8/fca [0,4194304] 0 2024-03-22T07:28:39.417 INFO:tasks.workunit.client.1.smithi195.stdout:3/712: symlink d3/dbf/lf0 0 2024-03-22T07:28:39.420 INFO:tasks.workunit.client.0.smithi134.stdout:8/630: write d1/d46/f62 [977175,62353] 0 2024-03-22T07:28:39.423 INFO:tasks.workunit.client.1.smithi195.stdout:8/770: rmdir da/de 39 2024-03-22T07:28:39.423 INFO:tasks.workunit.client.1.smithi195.stdout:4/712: truncate d13/d15/f37 2374443 0 2024-03-22T07:28:39.429 INFO:tasks.workunit.client.1.smithi195.stdout:4/713: dread d13/d63/d79/de9/f56 [0,4194304] 0 2024-03-22T07:28:39.430 INFO:tasks.workunit.client.1.smithi195.stdout:6/637: link d5/d5e/d34/d55/d3b/d6e/d3c/fa0 d5/d5e/d34/d55/d3b/dc2/fe8 0 2024-03-22T07:28:39.430 INFO:tasks.workunit.client.1.smithi195.stdout:6/638: truncate d5/d5e/d34/d55/d4b/da2/d1a/fe6 51876 0 2024-03-22T07:28:39.433 INFO:tasks.workunit.client.1.smithi195.stdout:2/719: creat d2/d3/d7/da/d18/fee x:0 0 0 2024-03-22T07:28:39.434 INFO:tasks.workunit.client.1.smithi195.stdout:4/714: dread d13/f1a [0,4194304] 0 2024-03-22T07:28:39.435 INFO:tasks.workunit.client.1.smithi195.stdout:9/862: rename d2/d4/d23/ca6 to d2/d4/d6/d18/d50/d88/c13a 0 2024-03-22T07:28:39.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/712: link d0/d13/d14/d80/fd5 d0/d13/d22/d28/ff8 0 2024-03-22T07:28:39.438 INFO:tasks.workunit.client.1.smithi195.stdout:7/713: write d0/f25 [4647225,101322] 0 2024-03-22T07:28:39.440 INFO:tasks.workunit.client.1.smithi195.stdout:1/605: truncate d0/d2/d6/dad/db1/d97/d39/fa9 299396 0 2024-03-22T07:28:39.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/774: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:39.441 INFO:tasks.workunit.client.1.smithi195.stdout:5/775: stat d9/d73/da1/fab 0 2024-03-22T07:28:39.442 INFO:tasks.workunit.client.0.smithi134.stdout:1/585: creat d5/da/d1b/d27/fd2 x:0 0 0 2024-03-22T07:28:39.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/631: dwrite d1/d15/d42/f28 [0,4194304] 0 2024-03-22T07:28:39.445 INFO:tasks.workunit.client.1.smithi195.stdout:8/771: mkdir da/d17/d32/de8 0 2024-03-22T07:28:39.445 INFO:tasks.workunit.client.1.smithi195.stdout:4/715: dread d13/d63/d79/f53 [0,4194304] 0 2024-03-22T07:28:39.448 INFO:tasks.workunit.client.0.smithi134.stdout:6/396: creat d2/f94 x:0 0 0 2024-03-22T07:28:39.449 INFO:tasks.workunit.client.1.smithi195.stdout:4/716: read d13/d63/d79/f53 [2777027,112300] 0 2024-03-22T07:28:39.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/639: mknod d5/d5e/d34/d55/d4b/da2/ce9 0 2024-03-22T07:28:39.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/640: creat d5/d6d/fea x:0 0 0 2024-03-22T07:28:39.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/641: fdatasync d5/d5e/d34/d55/f7a 0 2024-03-22T07:28:39.451 INFO:tasks.workunit.client.1.smithi195.stdout:6/642: fdatasync d5/d5e/d34/d55/d4b/da2/d1a/f32 0 2024-03-22T07:28:39.454 INFO:tasks.workunit.client.0.smithi134.stdout:0/554: dread dc/d18/f1d [0,4194304] 0 2024-03-22T07:28:39.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/397: dread d2/d1b/d1d/d5e/d6f/d7d/f3a [0,4194304] 0 2024-03-22T07:28:39.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/398: chown d2/l3b 2 1 2024-03-22T07:28:39.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/399: chown d2/d1b/d1d/d5e/d6f/c82 0 1 2024-03-22T07:28:39.456 INFO:tasks.workunit.client.1.smithi195.stdout:8/772: read da/d17/d32/d61/d88/d91/fc8 [3057343,30521] 0 2024-03-22T07:28:39.457 INFO:tasks.workunit.client.1.smithi195.stdout:8/773: fdatasync da/dc/da4/fe1 0 2024-03-22T07:28:39.457 INFO:tasks.workunit.client.1.smithi195.stdout:3/713: rename d3/df/d15/d1d/d5c/d47/d67/d93/da2/cc8 to d3/d18/d89/d8c/d9d/cf1 0 2024-03-22T07:28:39.458 INFO:tasks.workunit.client.0.smithi134.stdout:2/456: symlink d2/d5/d8/l92 0 2024-03-22T07:28:39.459 INFO:tasks.workunit.client.1.smithi195.stdout:5/776: dwrite d9/d2d/d8f/fb6 [0,4194304] 0 2024-03-22T07:28:39.459 INFO:tasks.workunit.client.0.smithi134.stdout:2/457: write d2/d5/d8/f5a [272510,56964] 0 2024-03-22T07:28:39.462 INFO:tasks.workunit.client.1.smithi195.stdout:9/863: unlink d2/d4/f12 0 2024-03-22T07:28:39.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/643: write d5/d5e/d34/d55/f2e [3051491,123492] 0 2024-03-22T07:28:39.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/644: fdatasync d5/d5e/d34/d55/d4b/da2/d4a/f5c 0 2024-03-22T07:28:39.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/714: unlink d0/d13/d22/d28/f85 0 2024-03-22T07:28:39.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/715: chown d0/d13/d14/d20/f78 127 1 2024-03-22T07:28:39.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/716: write d0/d13/d14/d20/d40/d82/da0/f9f [879074,129716] 0 2024-03-22T07:28:39.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/717: stat d0/d13/d14/d29/d35/c5a 0 2024-03-22T07:28:39.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/718: write d0/d13/d14/d20/f4b [387518,68886] 0 2024-03-22T07:28:39.466 INFO:tasks.workunit.client.1.smithi195.stdout:7/719: chown d0/d13/d14/d20/d40/d82/da0/d59/d79 114457671 1 2024-03-22T07:28:39.467 INFO:tasks.workunit.client.0.smithi134.stdout:1/586: unlink d5/da/d61/ccb 0 2024-03-22T07:28:39.469 INFO:tasks.workunit.client.1.smithi195.stdout:4/717: dwrite d13/d63/d3e/f93 [0,4194304] 0 2024-03-22T07:28:39.469 INFO:tasks.workunit.client.1.smithi195.stdout:1/606: creat d0/d2/d6/dad/db1/d97/d39/d64/fc3 x:0 0 0 2024-03-22T07:28:39.472 INFO:tasks.workunit.client.1.smithi195.stdout:3/714: dwrite d3/f3f [4194304,4194304] 0 2024-03-22T07:28:39.478 INFO:tasks.workunit.client.1.smithi195.stdout:8/774: unlink da/dc/l94 0 2024-03-22T07:28:39.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/632: mknod d1/d4/ccb 0 2024-03-22T07:28:39.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/633: read d1/d15/d42/d12/f35 [4176622,67797] 0 2024-03-22T07:28:39.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/634: readlink d1/d15/d42/d12/l60 0 2024-03-22T07:28:39.483 INFO:tasks.workunit.client.0.smithi134.stdout:8/635: creat d1/d15/fcc x:0 0 0 2024-03-22T07:28:39.484 INFO:tasks.workunit.client.1.smithi195.stdout:9/864: dwrite d2/d4/d32/d6d/d78/d79/d97/fed [0,4194304] 0 2024-03-22T07:28:39.484 INFO:tasks.workunit.client.1.smithi195.stdout:9/865: write d2/d4/d32/d6d/d78/d79/f99 [3512189,104775] 0 2024-03-22T07:28:39.485 INFO:tasks.workunit.client.0.smithi134.stdout:5/476: rename d1/d4/d5f to d1/d8/d20/d62/d65/d82/da2 0 2024-03-22T07:28:39.487 INFO:tasks.workunit.client.1.smithi195.stdout:6/645: creat d5/feb x:0 0 0 2024-03-22T07:28:39.488 INFO:tasks.workunit.client.1.smithi195.stdout:0/706: sync 2024-03-22T07:28:39.488 INFO:tasks.workunit.client.0.smithi134.stdout:0/555: chown dc/d18/f8e 146 1 2024-03-22T07:28:39.490 INFO:tasks.workunit.client.0.smithi134.stdout:2/458: fdatasync d2/f1a 0 2024-03-22T07:28:39.492 INFO:tasks.workunit.client.1.smithi195.stdout:2/720: getdents d2/d3/d7/da/d18 0 2024-03-22T07:28:39.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/715: dwrite d3/d18/d89/d76/f85 [0,4194304] 0 2024-03-22T07:28:39.495 INFO:tasks.workunit.client.0.smithi134.stdout:5/477: dread d1/d8/d20/f3e [0,4194304] 0 2024-03-22T07:28:39.495 INFO:tasks.workunit.client.0.smithi134.stdout:5/478: stat d1/d8/d20/d8a/d75/l7d 0 2024-03-22T07:28:39.498 INFO:tasks.workunit.client.1.smithi195.stdout:9/866: dwrite d2/d4/d1d/ddc/fe6 [0,4194304] 0 2024-03-22T07:28:39.501 INFO:tasks.workunit.client.0.smithi134.stdout:2/459: dread d2/d5/d8/f33 [0,4194304] 0 2024-03-22T07:28:39.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/636: creat d1/d46/d75/d8b/db4/fcd x:0 0 0 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/674: rename d1/l4e to d1/d19/d9c/lda 0 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/675: write d1/de/d11/d2b/d31/fa7 [267946,58011] 0 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/676: chown d1/de/d41/c64 1840 1 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/677: chown d1/de/d11/d2b/d31/f54 53861027 1 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/678: fsync d1/de/d41/f49 0 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/679: readlink d1/dae/ld0 0 2024-03-22T07:28:39.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/680: chown d1/de/d11/d48/d52/d46/fc2 463145 1 2024-03-22T07:28:39.508 INFO:tasks.workunit.client.0.smithi134.stdout:7/681: stat d1/d19/f23 0 2024-03-22T07:28:39.508 INFO:tasks.workunit.client.0.smithi134.stdout:7/682: read - d1/de/d11/d2b/fb6 zero size 2024-03-22T07:28:39.508 INFO:tasks.workunit.client.0.smithi134.stdout:7/683: read d1/de/d11/d48/d52/f7 [825556,13021] 0 2024-03-22T07:28:39.508 INFO:tasks.workunit.client.0.smithi134.stdout:7/684: dread - d1/dae/fc7 zero size 2024-03-22T07:28:39.508 INFO:tasks.workunit.client.1.smithi195.stdout:1/607: mknod d0/d2/d6/dad/db1/d6b/d9c/cc4 0 2024-03-22T07:28:39.510 INFO:tasks.workunit.client.0.smithi134.stdout:0/556: link dc/de/f23 dc/de/d55/d65/fa4 0 2024-03-22T07:28:39.510 INFO:tasks.workunit.client.0.smithi134.stdout:0/557: read f5 [2862266,107193] 0 2024-03-22T07:28:39.511 INFO:tasks.workunit.client.1.smithi195.stdout:8/775: truncate da/dc/fa6 230219 0 2024-03-22T07:28:39.513 INFO:tasks.workunit.client.0.smithi134.stdout:1/587: getdents d5/da/d13/d1e/d45 0 2024-03-22T07:28:39.517 INFO:tasks.workunit.client.0.smithi134.stdout:5/479: mknod d1/d8/d83/ca3 0 2024-03-22T07:28:39.517 INFO:tasks.workunit.client.0.smithi134.stdout:5/480: fsync d1/d8/d20/d62/d68/f9e 0 2024-03-22T07:28:39.517 INFO:tasks.workunit.client.0.smithi134.stdout:5/481: write d1/d8/d20/d62/d68/f97 [592364,5822] 0 2024-03-22T07:28:39.523 INFO:tasks.workunit.client.1.smithi195.stdout:4/718: read d13/d63/d79/de9/f2e [4544710,35916] 0 2024-03-22T07:28:39.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/776: dread da/d17/d32/d61/d88/d91/fc8 [0,4194304] 0 2024-03-22T07:28:39.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/777: truncate da/dc/da4/fe1 148636 0 2024-03-22T07:28:39.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/778: chown da/ld2 766369341 1 2024-03-22T07:28:39.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/779: stat da/de/db3/ddd/fc4 0 2024-03-22T07:28:39.525 INFO:tasks.workunit.client.1.smithi195.stdout:8/780: readlink da/d17/l9b 0 2024-03-22T07:28:39.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/637: truncate d1/d15/d57/d79/f9f 3408047 0 2024-03-22T07:28:39.526 INFO:tasks.workunit.client.0.smithi134.stdout:8/638: fsync d1/d15/d42/d76/d8f/dad/db1/f3a 0 2024-03-22T07:28:39.528 INFO:tasks.workunit.client.1.smithi195.stdout:6/646: mkdir d5/d5e/d34/d55/d4b/da2/d82/dec 0 2024-03-22T07:28:39.528 INFO:tasks.workunit.client.1.smithi195.stdout:6/647: creat d5/d5e/d34/d55/d3b/d6e/d97/fed x:0 0 0 2024-03-22T07:28:39.532 INFO:tasks.workunit.client.1.smithi195.stdout:0/707: creat d1/d4/dd/df/d44/d6f/dcb/fd9 x:0 0 0 2024-03-22T07:28:39.534 INFO:tasks.workunit.client.0.smithi134.stdout:7/685: creat d1/de/d11/d48/d52/fdb x:0 0 0 2024-03-22T07:28:39.534 INFO:tasks.workunit.client.0.smithi134.stdout:7/686: stat d1/f3a 0 2024-03-22T07:28:39.534 INFO:tasks.workunit.client.0.smithi134.stdout:7/687: write d1/de/d41/fcb [960174,28389] 0 2024-03-22T07:28:39.536 INFO:tasks.workunit.client.1.smithi195.stdout:6/648: dread d5/d5e/d34/d55/d3b/d6e/d97/f9a [0,4194304] 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.1.smithi195.stdout:2/721: mknod d2/d3/d7/cef 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.1.smithi195.stdout:2/722: creat d2/d3/d7/d19/ff0 x:0 0 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.1.smithi195.stdout:2/723: fdatasync d2/fcd 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.0.smithi134.stdout:5/482: dwrite d1/d8/d20/f50 [0,4194304] 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.0.smithi134.stdout:5/483: chown d1/f7f 7834 1 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.0.smithi134.stdout:1/588: dwrite d5/da/d13/d1e/d62/faf [0,4194304] 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.0.smithi134.stdout:1/589: truncate d5/da/d13/d1e/d67/fa2 73645 0 2024-03-22T07:28:39.538 INFO:tasks.workunit.client.0.smithi134.stdout:1/590: write d5/da/d1b/d27/f80 [536521,49621] 0 2024-03-22T07:28:39.540 INFO:tasks.workunit.client.0.smithi134.stdout:2/460: mknod d2/d5/c93 0 2024-03-22T07:28:39.541 INFO:tasks.workunit.client.1.smithi195.stdout:5/777: truncate d9/d2d/d8f/fb6 2823069 0 2024-03-22T07:28:39.541 INFO:tasks.workunit.client.1.smithi195.stdout:5/778: write d9/f28 [897251,19248] 0 2024-03-22T07:28:39.544 INFO:tasks.workunit.client.0.smithi134.stdout:3/508: sync 2024-03-22T07:28:39.544 INFO:tasks.workunit.client.0.smithi134.stdout:3/509: fdatasync d4/d10/f11 0 2024-03-22T07:28:39.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/639: mkdir d1/dce 0 2024-03-22T07:28:39.551 INFO:tasks.workunit.client.0.smithi134.stdout:2/461: write d2/d5/d22/d52/f4b [3771698,70549] 0 2024-03-22T07:28:39.551 INFO:tasks.workunit.client.0.smithi134.stdout:9/427: rename d3/l7 to d3/d9/df/d12/l96 0 2024-03-22T07:28:39.551 INFO:tasks.workunit.client.0.smithi134.stdout:4/559: rename d2/d2a to d2/d2a/d80/dc4 22 2024-03-22T07:28:39.554 INFO:tasks.workunit.client.0.smithi134.stdout:0/558: dwrite dc/d18/d72/f8b [4194304,4194304] 0 2024-03-22T07:28:39.554 INFO:tasks.workunit.client.0.smithi134.stdout:0/559: write dc/de/d55/f97 [914548,111768] 0 2024-03-22T07:28:39.554 INFO:tasks.workunit.client.0.smithi134.stdout:0/560: stat dc/de/d55/d65/c73 0 2024-03-22T07:28:39.555 INFO:tasks.workunit.client.0.smithi134.stdout:7/688: symlink d1/de/d11/d97/ldc 0 2024-03-22T07:28:39.555 INFO:tasks.workunit.client.0.smithi134.stdout:7/689: write d1/de/d11/d2b/d69/f6c [1300129,97430] 0 2024-03-22T07:28:39.555 INFO:tasks.workunit.client.0.smithi134.stdout:7/690: fsync d1/d40/fa2 0 2024-03-22T07:28:39.555 INFO:tasks.workunit.client.0.smithi134.stdout:7/691: fsync d1/de/d11/d48/d52/f7 0 2024-03-22T07:28:39.561 INFO:tasks.workunit.client.0.smithi134.stdout:9/428: write d3/d9/df/d12/f1d [2300710,74377] 0 2024-03-22T07:28:39.562 INFO:tasks.workunit.client.0.smithi134.stdout:2/462: dread d2/f4c [0,4194304] 0 2024-03-22T07:28:39.562 INFO:tasks.workunit.client.0.smithi134.stdout:2/463: write d2/d5/d22/d52/f76 [789774,38247] 0 2024-03-22T07:28:39.570 INFO:tasks.workunit.client.1.smithi195.stdout:1/608: creat d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 x:0 0 0 2024-03-22T07:28:39.571 INFO:tasks.workunit.client.1.smithi195.stdout:7/720: truncate d0/f25 3504773 0 2024-03-22T07:28:39.575 INFO:tasks.workunit.client.0.smithi134.stdout:3/510: link d4/d10/f40 d4/d8/fa6 0 2024-03-22T07:28:39.580 INFO:tasks.workunit.client.0.smithi134.stdout:9/429: dwrite d3/d9/d37/d6f/d54/f68 [4194304,4194304] 0 2024-03-22T07:28:39.580 INFO:tasks.workunit.client.0.smithi134.stdout:9/430: write d3/d9/d37/d3c/f78 [299077,129741] 0 2024-03-22T07:28:39.580 INFO:tasks.workunit.client.0.smithi134.stdout:4/560: dwrite d2/d2a/d50/f59 [0,4194304] 0 2024-03-22T07:28:39.581 INFO:tasks.workunit.client.0.smithi134.stdout:8/640: link d1/d4/d61/f65 d1/d15/d57/d8c/d9a/fcf 0 2024-03-22T07:28:39.581 INFO:tasks.workunit.client.0.smithi134.stdout:8/641: truncate d1/d15/d57/f89 847410 0 2024-03-22T07:28:39.586 INFO:tasks.workunit.client.0.smithi134.stdout:4/561: dread d2/d1d/f24 [0,4194304] 0 2024-03-22T07:28:39.588 INFO:tasks.workunit.client.0.smithi134.stdout:1/591: rename d5/da/d13/d1e/cb4 to d5/da/d1b/d27/d39/da4/cd3 0 2024-03-22T07:28:39.593 INFO:tasks.workunit.client.1.smithi195.stdout:4/719: mkdir d13/d63/d3e/d5c/d65/df1 0 2024-03-22T07:28:39.595 INFO:tasks.workunit.client.0.smithi134.stdout:7/692: rmdir d1/de/d11/d48/dbc/dc1 0 2024-03-22T07:28:39.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/781: symlink da/le9 0 2024-03-22T07:28:39.597 INFO:tasks.workunit.client.1.smithi195.stdout:8/782: truncate da/d82/fb5 72307 0 2024-03-22T07:28:39.599 INFO:tasks.workunit.client.0.smithi134.stdout:3/511: dwrite d4/d10/f4a [0,4194304] 0 2024-03-22T07:28:39.600 INFO:tasks.workunit.client.0.smithi134.stdout:9/431: dwrite d3/d9/df/d57/d67/f8a [0,4194304] 0 2024-03-22T07:28:39.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/484: getdents d1/d4 0 2024-03-22T07:28:39.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/485: read - d1/d8/d16/f9d zero size 2024-03-22T07:28:39.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/486: chown d1/d8/d20/d62/d65/d82/da2/l87 60878 1 2024-03-22T07:28:39.608 INFO:tasks.workunit.client.1.smithi195.stdout:0/708: truncate d1/d4/dd/f3a 1700050 0 2024-03-22T07:28:39.610 INFO:tasks.workunit.client.0.smithi134.stdout:4/562: symlink d2/d25/d48/d87/lc5 0 2024-03-22T07:28:39.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/649: mkdir d5/d5e/d34/d55/d3b/d6e/d56/dee 0 2024-03-22T07:28:39.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/650: stat d5/d5e/f33 0 2024-03-22T07:28:39.611 INFO:tasks.workunit.client.1.smithi195.stdout:6/651: write d5/d5e/d34/d55/d4b/da2/fb3 [46900,38669] 0 2024-03-22T07:28:39.612 INFO:tasks.workunit.client.0.smithi134.stdout:7/693: dwrite d1/d19/f23 [0,4194304] 0 2024-03-22T07:28:39.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/464: rename d2/d5/d22/d52/d3c/d4f/d6e/l8b to d2/d5/d8/d31/l94 0 2024-03-22T07:28:39.614 INFO:tasks.workunit.client.0.smithi134.stdout:7/694: read d1/de/d11/d2b/d69/f8c [162750,93736] 0 2024-03-22T07:28:39.614 INFO:tasks.workunit.client.0.smithi134.stdout:7/695: write d1/de/d11/f6a [1417084,66376] 0 2024-03-22T07:28:39.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/592: truncate d5/da/d13/d1e/f44 1114509 0 2024-03-22T07:28:39.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/593: write d5/d93/fc9 [370411,27734] 0 2024-03-22T07:28:39.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/594: fdatasync d5/da/d1b/f1c 0 2024-03-22T07:28:39.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/595: fdatasync d5/d1d/d49/f88 0 2024-03-22T07:28:39.615 INFO:tasks.workunit.client.0.smithi134.stdout:1/596: truncate d5/da/d68/da1/fa3 929670 0 2024-03-22T07:28:39.616 INFO:tasks.workunit.client.1.smithi195.stdout:2/724: link d2/d3/dac/dad/fd1 d2/d3/d21/ddd/ff1 0 2024-03-22T07:28:39.617 INFO:tasks.workunit.client.0.smithi134.stdout:0/561: mknod dc/d18/d89/ca5 0 2024-03-22T07:28:39.619 INFO:tasks.workunit.client.1.smithi195.stdout:5/779: symlink d9/d73/da1/lf7 0 2024-03-22T07:28:39.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/780: write d9/d2d/d84/d92/fba [737765,88710] 0 2024-03-22T07:28:39.622 INFO:tasks.workunit.client.1.smithi195.stdout:5/781: fsync d9/d12/f47 0 2024-03-22T07:28:39.623 INFO:tasks.workunit.client.1.smithi195.stdout:3/716: rename d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9/fec to d3/d18/ff2 0 2024-03-22T07:28:39.624 INFO:tasks.workunit.client.1.smithi195.stdout:3/717: write d3/df/f96 [4864799,15418] 0 2024-03-22T07:28:39.626 INFO:tasks.workunit.client.1.smithi195.stdout:5/782: dread d9/f28 [4194304,4194304] 0 2024-03-22T07:28:39.626 INFO:tasks.workunit.client.0.smithi134.stdout:3/512: mknod d4/d22/d3c/ca7 0 2024-03-22T07:28:39.626 INFO:tasks.workunit.client.0.smithi134.stdout:3/513: chown d4/d22/d3c/f73 35 1 2024-03-22T07:28:39.627 INFO:tasks.workunit.client.1.smithi195.stdout:1/609: mknod d0/cc6 0 2024-03-22T07:28:39.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/721: creat d0/d98/dab/ff9 x:0 0 0 2024-03-22T07:28:39.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/722: write d0/d13/d14/d20/d40/d82/da0/d59/d79/ff3 [887051,98633] 0 2024-03-22T07:28:39.632 INFO:tasks.workunit.client.1.smithi195.stdout:7/723: truncate d0/d13/d14/d20/d40/d82/da0/fd9 556189 0 2024-03-22T07:28:39.633 INFO:tasks.workunit.client.1.smithi195.stdout:1/610: write d0/d2/d6/dad/db1/d97/d41/f5a [169688,2229] 0 2024-03-22T07:28:39.635 INFO:tasks.workunit.client.1.smithi195.stdout:4/720: rename d13/d63/d36/d5f/d83/ce8 to d13/d63/d36/d5f/d83/cf2 0 2024-03-22T07:28:39.636 INFO:tasks.workunit.client.0.smithi134.stdout:9/432: mknod d3/d9/d37/d70/c97 0 2024-03-22T07:28:39.636 INFO:tasks.workunit.client.0.smithi134.stdout:9/433: creat d3/d9/d37/d5a/d7f/f98 x:0 0 0 2024-03-22T07:28:39.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/434: truncate d3/d9/df/d57/f7e 1019721 0 2024-03-22T07:28:39.638 INFO:tasks.workunit.client.1.smithi195.stdout:8/783: mkdir da/d17/d32/d61/dea 0 2024-03-22T07:28:39.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.638+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdaa0005860 con 0x7fdab40fc910 2024-03-22T07:28:39.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.639+0000 7fda9bfff700 1 -- 172.21.15.134:0/3067101292 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdaa4020020 con 0x7fdab40fc910 2024-03-22T07:28:39.640 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:28:39.640 INFO:tasks.workunit.client.0.smithi134.stdout:5/487: mkdir d1/d8/d16/da4 0 2024-03-22T07:28:39.641 INFO:tasks.workunit.client.0.smithi134.stdout:5/488: write d1/d8/d20/d62/d68/f97 [500735,110538] 0 2024-03-22T07:28:39.642 INFO:tasks.workunit.client.1.smithi195.stdout:0/709: mknod d1/d4/dd/df/d2b/cda 0 2024-03-22T07:28:39.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.642+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fda9c0388d0 msgr2=0x7fda9c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:39.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.642+0000 7fdab8852700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fda9c0388d0 0x7fda9c03ad80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8004f40 tx=0x7fdaa800b040 comp rx=0 tx=0).stop 2024-03-22T07:28:39.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.642+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 msgr2=0x7fdab4114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:28:39.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.642+0000 7fdab8852700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 0x7fdab4114440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400b3b0 tx=0x7fdaa4009e30 comp rx=0 tx=0).stop 2024-03-22T07:28:39.644 INFO:tasks.workunit.client.1.smithi195.stdout:5/783: dwrite d9/d2d/d8f/fb6 [0,4194304] 0 2024-03-22T07:28:39.644 INFO:tasks.workunit.client.1.smithi195.stdout:5/784: creat d9/d22/dd1/ff8 x:0 0 0 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 shutdown_connections 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdab40fbfc0 0x7fdab4113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fda9c0388d0 0x7fda9c03ad80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 --2- 172.21.15.134:0/3067101292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdab40fc910 0x7fdab4114440 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 >> 172.21.15.134:0/3067101292 conn(0x7fdab40f6a30 msgr2=0x7fdab40f8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 shutdown_connections 2024-03-22T07:28:39.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:28:39.643+0000 7fdab8852700 1 -- 172.21.15.134:0/3067101292 wait complete. 2024-03-22T07:28:39.645 INFO:tasks.workunit.client.0.smithi134.stdout:4/563: mkdir d2/d25/d48/d6e/dc6 0 2024-03-22T07:28:39.646 INFO:tasks.workunit.client.1.smithi195.stdout:6/652: link d5/d16/d45/d53/fa3 d5/d16/d5a/fef 0 2024-03-22T07:28:39.648 INFO:tasks.workunit.client.0.smithi134.stdout:8/642: rename d1/d15/fa6 to d1/d15/d42/d76/fd0 0 2024-03-22T07:28:39.648 INFO:tasks.workunit.client.0.smithi134.stdout:8/643: write d1/d15/d42/d76/fb2 [799620,65001] 0 2024-03-22T07:28:39.648 INFO:tasks.workunit.client.0.smithi134.stdout:8/644: truncate d1/d4/d61/d85/f8d 511263 0 2024-03-22T07:28:39.649 INFO:tasks.workunit.client.1.smithi195.stdout:2/725: creat d2/d1e/ff2 x:0 0 0 2024-03-22T07:28:39.649 INFO:tasks.workunit.client.1.smithi195.stdout:4/721: write d13/f1f [334048,86423] 0 2024-03-22T07:28:39.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/645: write d1/d15/d5b/f81 [89217,37691] 0 2024-03-22T07:28:39.650 INFO:tasks.workunit.client.0.smithi134.stdout:8/646: creat d1/d15/d57/d79/fd1 x:0 0 0 2024-03-22T07:28:39.652 INFO:tasks.workunit.client.0.smithi134.stdout:2/465: symlink d2/d5/d8/d31/l95 0 2024-03-22T07:28:39.653 INFO:tasks.workunit.client.1.smithi195.stdout:2/726: dread d2/d3/d1a/f50 [0,4194304] 0 2024-03-22T07:28:39.658 INFO:tasks.workunit.client.0.smithi134.stdout:7/696: mkdir d1/d19/d9c/db3/ddd 0 2024-03-22T07:28:39.663 INFO:tasks.workunit.client.1.smithi195.stdout:5/785: dwrite d9/d12/d1d/f5e [0,4194304] 0 2024-03-22T07:28:39.666 INFO:tasks.workunit.client.0.smithi134.stdout:1/597: unlink f1 0 2024-03-22T07:28:39.671 INFO:tasks.workunit.client.1.smithi195.stdout:3/718: truncate d3/f14 2487909 0 2024-03-22T07:28:39.673 INFO:tasks.workunit.client.0.smithi134.stdout:9/435: getdents d3/d9/d37 0 2024-03-22T07:28:39.673 INFO:tasks.workunit.client.0.smithi134.stdout:9/436: read d3/d9/d37/d6f/f29 [1553634,28596] 0 2024-03-22T07:28:39.673 INFO:tasks.workunit.client.0.smithi134.stdout:9/437: write d3/d9/d37/d5a/d7f/f88 [1290955,85057] 0 2024-03-22T07:28:39.675 INFO:tasks.workunit.client.1.smithi195.stdout:7/724: link d0/lb d0/d13/d14/d2b/lfa 0 2024-03-22T07:28:39.677 INFO:tasks.workunit.client.0.smithi134.stdout:5/489: mknod d1/d8/d20/d62/d65/d82/da2/ca5 0 2024-03-22T07:28:39.677 INFO:tasks.workunit.client.0.smithi134.stdout:5/490: write d1/d8/d16/f74 [1066669,39122] 0 2024-03-22T07:28:39.677 INFO:tasks.workunit.client.0.smithi134.stdout:5/491: readlink d1/l1d 0 2024-03-22T07:28:39.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/564: creat d2/d2a/d93/fc7 x:0 0 0 2024-03-22T07:28:39.681 INFO:tasks.workunit.client.1.smithi195.stdout:3/719: dread d3/df/d15/d1d/d5c/f2e [0,4194304] 0 2024-03-22T07:28:39.681 INFO:tasks.workunit.client.1.smithi195.stdout:1/611: mknod d0/d2/d9/da4/dc0/cc7 0 2024-03-22T07:28:39.682 INFO:tasks.workunit.client.1.smithi195.stdout:3/720: write d3/df/d15/d1d/d5c/fe5 [515002,66458] 0 2024-03-22T07:28:39.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/612: chown d0/d2/d9/d2a/d6f/l7f 15282 1 2024-03-22T07:28:39.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/613: chown d0/d2/d9/c2c 221 1 2024-03-22T07:28:39.682 INFO:tasks.workunit.client.1.smithi195.stdout:3/721: read d3/df/d15/f1c [256334,76463] 0 2024-03-22T07:28:39.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/614: fsync d0/d2/d9/f6c 0 2024-03-22T07:28:39.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/697: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:39.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/698: dread - d1/de/fd8 zero size 2024-03-22T07:28:39.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/699: fdatasync d1/de/d11/d48/d52/d46/fb1 0 2024-03-22T07:28:39.683 INFO:tasks.workunit.client.0.smithi134.stdout:7/700: fdatasync d1/f3a 0 2024-03-22T07:28:39.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/722: dwrite d13/d63/d79/de9/d7e/d8c/f9f [0,4194304] 0 2024-03-22T07:28:39.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/723: chown lc 58 1 2024-03-22T07:28:39.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/724: chown d13/d15/f25 2895 1 2024-03-22T07:28:39.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/725: readlink d13/d63/d21/l41 0 2024-03-22T07:28:39.687 INFO:tasks.workunit.client.0.smithi134.stdout:5/492: dread d1/d8/d20/d62/f8e [0,4194304] 0 2024-03-22T07:28:39.687 INFO:tasks.workunit.client.0.smithi134.stdout:5/493: write d1/d8/d16/f9d [861813,100479] 0 2024-03-22T07:28:39.687 INFO:tasks.workunit.client.0.smithi134.stdout:5/494: creat d1/fa6 x:0 0 0 2024-03-22T07:28:39.687 INFO:tasks.workunit.client.0.smithi134.stdout:3/514: rename d4/d8/f13 to d4/fa8 0 2024-03-22T07:28:39.688 INFO:tasks.workunit.client.1.smithi195.stdout:8/784: truncate da/de/db3/ddd/fa3 1070999 0 2024-03-22T07:28:39.689 INFO:tasks.workunit.client.0.smithi134.stdout:7/701: dread d1/de/d11/fb2 [0,4194304] 0 2024-03-22T07:28:39.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/710: mknod d1/da2/cdb 0 2024-03-22T07:28:39.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/711: fdatasync d1/d4/dd/f3a 0 2024-03-22T07:28:39.697 INFO:tasks.workunit.client.1.smithi195.stdout:6/653: rename d5/d5e/d34/d55/d4b/da2/dad/lb7 to d5/d5e/d34/d55/d4b/ddc/lf0 0 2024-03-22T07:28:39.698 INFO:tasks.workunit.client.0.smithi134.stdout:3/515: dread d4/d10/f40 [0,4194304] 0 2024-03-22T07:28:39.698 INFO:tasks.workunit.client.1.smithi195.stdout:2/727: truncate d2/d3/d7/d19/f33 4061866 0 2024-03-22T07:28:39.700 INFO:tasks.workunit.client.1.smithi195.stdout:5/786: unlink d9/d12/f9e 0 2024-03-22T07:28:39.701 INFO:tasks.workunit.client.1.smithi195.stdout:9/867: sync 2024-03-22T07:28:39.704 INFO:tasks.workunit.client.1.smithi195.stdout:7/725: getdents d0/d13/d22 0 2024-03-22T07:28:39.709 INFO:tasks.workunit.client.0.smithi134.stdout:3/516: write d4/d22/d29/f67 [3492867,38252] 0 2024-03-22T07:28:39.711 INFO:tasks.workunit.client.1.smithi195.stdout:4/726: mkdir d13/d15/d6b/dd0/df3 0 2024-03-22T07:28:39.715 INFO:tasks.workunit.client.1.smithi195.stdout:2/728: dwrite d2/d3/d21/d4c/fb2 [0,4194304] 0 2024-03-22T07:28:39.715 INFO:tasks.workunit.client.1.smithi195.stdout:7/726: write d0/d13/d14/f8 [7071623,116130] 0 2024-03-22T07:28:39.715 INFO:tasks.workunit.client.1.smithi195.stdout:7/727: readlink d0/d13/d22/d28/lba 0 2024-03-22T07:28:39.720 INFO:tasks.workunit.client.1.smithi195.stdout:8/785: creat da/dc/d71/feb x:0 0 0 2024-03-22T07:28:39.720 INFO:tasks.workunit.client.1.smithi195.stdout:8/786: chown da/d17 973 1 2024-03-22T07:28:39.727 INFO:tasks.workunit.client.1.smithi195.stdout:6/654: symlink d5/d5e/d34/d55/d4b/da2/d82/dec/lf1 0 2024-03-22T07:28:39.728 INFO:tasks.workunit.client.0.smithi134.stdout:2/466: mknod d2/d5/d22/d52/d3c/d60/d7c/c96 0 2024-03-22T07:28:39.729 INFO:tasks.workunit.client.1.smithi195.stdout:5/787: mkdir d9/d22/d7b/d98/df9 0 2024-03-22T07:28:39.730 INFO:tasks.workunit.client.0.smithi134.stdout:1/598: mknod d5/da/d1b/cd4 0 2024-03-22T07:28:39.730 INFO:tasks.workunit.client.0.smithi134.stdout:1/599: stat d5/da/d1b/d27/fab 0 2024-03-22T07:28:39.730 INFO:tasks.workunit.client.0.smithi134.stdout:1/600: fdatasync d5/da/d1b/d27/fd2 0 2024-03-22T07:28:39.732 INFO:tasks.workunit.client.0.smithi134.stdout:0/562: rmdir dc/d18/d72 39 2024-03-22T07:28:39.732 INFO:tasks.workunit.client.0.smithi134.stdout:0/563: write dc/de/f50 [175417,63075] 0 2024-03-22T07:28:39.733 INFO:tasks.workunit.client.0.smithi134.stdout:8/647: dread d1/d15/d42/d12/d20/f70 [4194304,4194304] 0 2024-03-22T07:28:39.733 INFO:tasks.workunit.client.0.smithi134.stdout:9/438: creat d3/d9/d37/d6f/f99 x:0 0 0 2024-03-22T07:28:39.735 INFO:tasks.workunit.client.0.smithi134.stdout:4/565: symlink d2/d15/d35/d37/lc8 0 2024-03-22T07:28:39.735 INFO:tasks.workunit.client.0.smithi134.stdout:4/566: write d2/d2a/d50/fbf [537975,79453] 0 2024-03-22T07:28:39.736 INFO:tasks.workunit.client.1.smithi195.stdout:7/728: mknod d0/d13/d14/d20/d40/d82/da6/dc8/cfb 0 2024-03-22T07:28:39.737 INFO:tasks.workunit.client.1.smithi195.stdout:8/787: mkdir da/d17/d32/d61/d88/dec 0 2024-03-22T07:28:39.739 INFO:tasks.workunit.client.1.smithi195.stdout:0/712: getdents d1/d10/d19/d20 0 2024-03-22T07:28:39.739 INFO:tasks.workunit.client.1.smithi195.stdout:0/713: fdatasync d1/d4/dd/df/d2b/d63/fad 0 2024-03-22T07:28:39.739 INFO:tasks.workunit.client.1.smithi195.stdout:0/714: read - d1/d4/d12/d6c/dbc/fcf zero size 2024-03-22T07:28:39.740 INFO:tasks.workunit.client.0.smithi134.stdout:7/702: mknod d1/de/d41/cde 0 2024-03-22T07:28:39.743 INFO:tasks.workunit.client.1.smithi195.stdout:1/615: rename d0/d2/d9 to d0/d2/d27/d91/dc8 0 2024-03-22T07:28:39.743 INFO:tasks.workunit.client.1.smithi195.stdout:1/616: fdatasync d0/d2/d6/f62 0 2024-03-22T07:28:39.744 INFO:tasks.workunit.client.0.smithi134.stdout:3/517: mkdir d4/d8/d45/da9 0 2024-03-22T07:28:39.745 INFO:tasks.workunit.client.1.smithi195.stdout:6/655: unlink d5/d16/d45/d53/l13 0 2024-03-22T07:28:39.745 INFO:tasks.workunit.client.1.smithi195.stdout:6/656: truncate d5/d5e/d34/d55/d3b/d6e/d97/fb5 780499 0 2024-03-22T07:28:39.746 INFO:tasks.workunit.client.1.smithi195.stdout:6/657: readlink d5/d5e/d34/d55/lb8 0 2024-03-22T07:28:39.746 INFO:tasks.workunit.client.0.smithi134.stdout:2/467: symlink d2/d5/d22/d52/d3c/d4f/l97 0 2024-03-22T07:28:39.747 INFO:tasks.workunit.client.1.smithi195.stdout:8/788: dread da/d82/dc6/d53/f89 [0,4194304] 0 2024-03-22T07:28:39.747 INFO:tasks.workunit.client.1.smithi195.stdout:5/788: mknod d9/d12/d1d/d36/d7d/cfa 0 2024-03-22T07:28:39.748 INFO:tasks.workunit.client.0.smithi134.stdout:1/601: symlink d5/da/d13/d1e/d63/ld5 0 2024-03-22T07:28:39.748 INFO:tasks.workunit.client.0.smithi134.stdout:1/602: creat d5/d1d/d49/fd6 x:0 0 0 2024-03-22T07:28:39.749 INFO:tasks.workunit.client.0.smithi134.stdout:1/603: chown d5/da/d13/d1e/d63/l84 5201807 1 2024-03-22T07:28:39.749 INFO:tasks.workunit.client.0.smithi134.stdout:1/604: chown d5/da/d61/f83 851011035 1 2024-03-22T07:28:39.750 INFO:tasks.workunit.client.1.smithi195.stdout:9/868: rename d2/d4/d32/d6d/d78/d79/d97/fed to d2/d4/d6/d18/f13b 0 2024-03-22T07:28:39.750 INFO:tasks.workunit.client.1.smithi195.stdout:9/869: truncate d2/d4/d32/d6d/d78/d79/f104 1000630 0 2024-03-22T07:28:39.750 INFO:tasks.workunit.client.0.smithi134.stdout:0/564: truncate dc/d18/f70 302679 0 2024-03-22T07:28:39.751 INFO:tasks.workunit.client.1.smithi195.stdout:9/870: dread d2/d4/d32/d6d/d78/d79/f104 [0,4194304] 0 2024-03-22T07:28:39.751 INFO:tasks.workunit.client.0.smithi134.stdout:6/400: sync 2024-03-22T07:28:39.752 INFO:tasks.workunit.client.1.smithi195.stdout:1/617: mkdir d0/d2/d6/dad/db1/d97/d39/d40/dc9 0 2024-03-22T07:28:39.752 INFO:tasks.workunit.client.1.smithi195.stdout:1/618: stat d0/d2/d6/dad/db1/d97/d41/d47/d4a/fbc 0 2024-03-22T07:28:39.754 INFO:tasks.workunit.client.0.smithi134.stdout:8/648: mknod d1/d15/d57/d8c/d9a/cd2 0 2024-03-22T07:28:39.754 INFO:tasks.workunit.client.0.smithi134.stdout:8/649: dread - d1/d15/fcc zero size 2024-03-22T07:28:39.758 INFO:tasks.workunit.client.0.smithi134.stdout:9/439: creat d3/d9/df/d57/d67/d5f/f9a x:0 0 0 2024-03-22T07:28:39.758 INFO:tasks.workunit.client.0.smithi134.stdout:9/440: write d3/d9/df/d12/f1d [1531067,9991] 0 2024-03-22T07:28:39.759 INFO:tasks.workunit.client.1.smithi195.stdout:8/789: mkdir da/d17/d32/d61/ded 0 2024-03-22T07:28:39.759 INFO:tasks.workunit.client.1.smithi195.stdout:5/789: mknod d9/d22/d46/db2/cfb 0 2024-03-22T07:28:39.763 INFO:tasks.workunit.client.0.smithi134.stdout:4/567: unlink d2/d15/d35/c4c 0 2024-03-22T07:28:39.763 INFO:tasks.workunit.client.0.smithi134.stdout:4/568: truncate d2/d25/d48/fa5 697419 0 2024-03-22T07:28:39.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/727: rename d13/d15/d44/l59 to d13/d63/d79/de9/d7e/d85/lf4 0 2024-03-22T07:28:39.769 INFO:tasks.workunit.client.0.smithi134.stdout:5/495: rmdir d1/d8/d20/d62/d68 39 2024-03-22T07:28:39.769 INFO:tasks.workunit.client.0.smithi134.stdout:5/496: chown d1/d8/d20/d62/d68/f7c 1079 1 2024-03-22T07:28:39.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/790: unlink d9/da8/fc6 0 2024-03-22T07:28:39.773 INFO:tasks.workunit.client.1.smithi195.stdout:8/790: dread da/d17/f99 [0,4194304] 0 2024-03-22T07:28:39.773 INFO:tasks.workunit.client.0.smithi134.stdout:7/703: rename d1/d19/d9c/dac to d1/de/d11/d2b/ddf 0 2024-03-22T07:28:39.774 INFO:tasks.workunit.client.0.smithi134.stdout:7/704: write d1/de/d11/d2b/d69/f8c [628729,44094] 0 2024-03-22T07:28:39.775 INFO:tasks.workunit.client.0.smithi134.stdout:3/518: creat d4/d8/d69/faa x:0 0 0 2024-03-22T07:28:39.775 INFO:tasks.workunit.client.0.smithi134.stdout:3/519: write d4/d8/d69/fa2 [871964,26613] 0 2024-03-22T07:28:39.775 INFO:tasks.workunit.client.0.smithi134.stdout:3/520: chown d4/d8/d69/faa 145006 1 2024-03-22T07:28:39.775 INFO:tasks.workunit.client.0.smithi134.stdout:3/521: write d4/d8/d23/f99 [406038,16368] 0 2024-03-22T07:28:39.778 INFO:tasks.workunit.client.1.smithi195.stdout:2/729: rename d2/d3/d7/d19/d22/d26/f2c to d2/d3/d21/ddd/ff3 0 2024-03-22T07:28:39.779 INFO:tasks.workunit.client.0.smithi134.stdout:2/468: write d2/f80 [992212,80856] 0 2024-03-22T07:28:39.780 INFO:tasks.workunit.client.1.smithi195.stdout:4/728: symlink d13/d15/d6b/da6/ded/def/lf5 0 2024-03-22T07:28:39.782 INFO:tasks.workunit.client.1.smithi195.stdout:8/791: creat da/d17/d32/de8/fee x:0 0 0 2024-03-22T07:28:39.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/565: write dc/d18/fa1 [406551,115777] 0 2024-03-22T07:28:39.783 INFO:tasks.workunit.client.1.smithi195.stdout:6/658: dwrite d5/d5e/f84 [0,4194304] 0 2024-03-22T07:28:39.783 INFO:tasks.workunit.client.1.smithi195.stdout:6/659: write d5/d5e/d34/d55/d3b/f50 [1354359,18765] 0 2024-03-22T07:28:39.783 INFO:tasks.workunit.client.1.smithi195.stdout:9/871: dwrite d2/d4/f9f [0,4194304] 0 2024-03-22T07:28:39.784 INFO:tasks.workunit.client.0.smithi134.stdout:6/401: dwrite d2/d1b/f24 [0,4194304] 0 2024-03-22T07:28:39.786 INFO:tasks.workunit.client.1.smithi195.stdout:7/729: rename d0/d13/d22/d57/f84 to d0/d13/d14/d2b/ffc 0 2024-03-22T07:28:39.786 INFO:tasks.workunit.client.1.smithi195.stdout:7/730: read - d0/d13/d14/d80/fd5 zero size 2024-03-22T07:28:39.788 INFO:tasks.workunit.client.0.smithi134.stdout:4/569: mknod d2/d15/cc9 0 2024-03-22T07:28:39.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/570: dread d2/d25/d48/fa5 [0,4194304] 0 2024-03-22T07:28:39.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/571: fsync d2/fa1 0 2024-03-22T07:28:39.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/572: fsync d2/d15/d35/f5d 0 2024-03-22T07:28:39.790 INFO:tasks.workunit.client.0.smithi134.stdout:4/573: write d2/d15/d35/f63 [844532,16796] 0 2024-03-22T07:28:39.790 INFO:tasks.workunit.client.1.smithi195.stdout:4/729: creat d13/d15/d6b/ff6 x:0 0 0 2024-03-22T07:28:39.791 INFO:tasks.workunit.client.0.smithi134.stdout:7/705: dwrite d1/de/d11/d48/d52/f3e [0,4194304] 0 2024-03-22T07:28:39.791 INFO:tasks.workunit.client.0.smithi134.stdout:5/497: creat d1/d8/d20/d62/d65/d82/da2/fa7 x:0 0 0 2024-03-22T07:28:39.792 INFO:tasks.workunit.client.0.smithi134.stdout:5/498: write d1/d4/f1a [705374,77294] 0 2024-03-22T07:28:39.793 INFO:tasks.workunit.client.0.smithi134.stdout:0/566: read dc/d17/f77 [1206433,43515] 0 2024-03-22T07:28:39.793 INFO:tasks.workunit.client.1.smithi195.stdout:8/792: creat da/de/db3/dc7/dd3/fef x:0 0 0 2024-03-22T07:28:39.796 INFO:tasks.workunit.client.0.smithi134.stdout:3/522: dwrite d4/d8/d69/faa [0,4194304] 0 2024-03-22T07:28:39.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/605: rename d5/da/d13/d1e/c33 to d5/da/d13/d1e/d63/d9d/cd7 0 2024-03-22T07:28:39.809 INFO:tasks.workunit.client.0.smithi134.stdout:2/469: write d2/f30 [2924288,3897] 0 2024-03-22T07:28:39.810 INFO:tasks.workunit.client.0.smithi134.stdout:2/470: read d2/d5/d54/f63 [3820,129524] 0 2024-03-22T07:28:39.811 INFO:tasks.workunit.client.1.smithi195.stdout:0/715: rename d1/d4/dd/df/d67/l9c to d1/ldc 0 2024-03-22T07:28:39.812 INFO:tasks.workunit.client.1.smithi195.stdout:0/716: chown d1/d4/dd/df/d44/f50 0 1 2024-03-22T07:28:39.813 INFO:tasks.workunit.client.0.smithi134.stdout:6/402: mknod d2/d1b/d1d/d5e/d84/c95 0 2024-03-22T07:28:39.816 INFO:tasks.workunit.client.0.smithi134.stdout:3/523: dwrite d4/d22/d29/f67 [0,4194304] 0 2024-03-22T07:28:39.820 INFO:tasks.workunit.client.1.smithi195.stdout:4/730: mkdir d13/d63/d7a/de4/df7 0 2024-03-22T07:28:39.824 INFO:tasks.workunit.client.1.smithi195.stdout:8/793: mkdir da/df0 0 2024-03-22T07:28:39.826 INFO:tasks.workunit.client.1.smithi195.stdout:7/731: unlink d0/d13/d14/d2b/ffc 0 2024-03-22T07:28:39.828 INFO:tasks.workunit.client.1.smithi195.stdout:6/660: getdents d5 0 2024-03-22T07:28:39.829 INFO:tasks.workunit.client.1.smithi195.stdout:2/730: write d2/d3/d24/f39 [1276493,90811] 0 2024-03-22T07:28:39.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/574: symlink d2/d25/d74/lca 0 2024-03-22T07:28:39.829 INFO:tasks.workunit.client.0.smithi134.stdout:4/575: dread - d2/d25/d48/fba zero size 2024-03-22T07:28:39.830 INFO:tasks.workunit.client.1.smithi195.stdout:9/872: mknod d2/d4/d6/d18/d50/c13c 0 2024-03-22T07:28:39.830 INFO:tasks.workunit.client.1.smithi195.stdout:9/873: write d2/d4/d1d/d9b/ffc [461689,36036] 0 2024-03-22T07:28:39.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/874: readlink d2/d4/d32/l7d 0 2024-03-22T07:28:39.833 INFO:tasks.workunit.client.0.smithi134.stdout:7/706: creat d1/de/d11/d2b/fe0 x:0 0 0 2024-03-22T07:28:39.836 INFO:tasks.workunit.client.1.smithi195.stdout:0/717: dwrite d1/d4/dd/df/d44/d6f/dae/f86 [0,4194304] 0 2024-03-22T07:28:39.836 INFO:tasks.workunit.client.1.smithi195.stdout:0/718: chown d1/d4/d12/d6c/dbc/d43/f53 120590308 1 2024-03-22T07:28:39.836 INFO:tasks.workunit.client.1.smithi195.stdout:0/719: chown d1/d4/dd/f3a 55896879 1 2024-03-22T07:28:39.837 INFO:tasks.workunit.client.1.smithi195.stdout:0/720: dread - d1/d10/d4d/da6/fb5 zero size 2024-03-22T07:28:39.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/499: mknod d1/d8/d20/d62/d65/d82/da2/ca8 0 2024-03-22T07:28:39.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/524: dwrite d4/d22/d29/d50/f62 [0,4194304] 0 2024-03-22T07:28:39.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/500: creat d1/d8/d16/fa9 x:0 0 0 2024-03-22T07:28:39.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/525: write d4/d8/d23/f99 [1463319,106225] 0 2024-03-22T07:28:39.839 INFO:tasks.workunit.client.0.smithi134.stdout:3/526: chown d4/d8/d69/d6a/c6b 945438 1 2024-03-22T07:28:39.839 INFO:tasks.workunit.client.0.smithi134.stdout:5/501: write d1/d8/d20/d62/f92 [1019680,3447] 0 2024-03-22T07:28:39.840 INFO:tasks.workunit.client.1.smithi195.stdout:4/731: rename d13/d15/f25 to d13/d63/d79/de9/d7e/d8c/db7/ff8 0 2024-03-22T07:28:39.840 INFO:tasks.workunit.client.1.smithi195.stdout:4/732: chown d13/d63/d36/d5f 87817 1 2024-03-22T07:28:39.841 INFO:tasks.workunit.client.0.smithi134.stdout:0/567: truncate dc/f4e 1103173 0 2024-03-22T07:28:39.844 INFO:tasks.workunit.client.1.smithi195.stdout:8/794: truncate da/d17/d32/d61/d88/d91/fc8 1146390 0 2024-03-22T07:28:39.844 INFO:tasks.workunit.client.1.smithi195.stdout:9/875: dwrite d2/d4/d23/d74/fcc [0,4194304] 0 2024-03-22T07:28:39.844 INFO:tasks.workunit.client.1.smithi195.stdout:9/876: write d2/d4/d32/d6d/d78/d79/d97/fcf [973022,103373] 0 2024-03-22T07:28:39.846 INFO:tasks.workunit.client.0.smithi134.stdout:9/441: truncate d3/d9/d37/d5a/d7f/f88 152057 0 2024-03-22T07:28:39.846 INFO:tasks.workunit.client.0.smithi134.stdout:9/442: readlink d3/d9/df/d12/l4b 0 2024-03-22T07:28:39.847 INFO:tasks.workunit.client.1.smithi195.stdout:7/732: mknod d0/d13/d14/d29/d35/d3a/d7e/cfd 0 2024-03-22T07:28:39.850 INFO:tasks.workunit.client.1.smithi195.stdout:6/661: truncate d5/d5e/d34/d55/d3b/d6e/d97/f9a 3752301 0 2024-03-22T07:28:39.852 INFO:tasks.workunit.client.1.smithi195.stdout:9/877: dread d2/d4/d6/db/f48 [0,4194304] 0 2024-03-22T07:28:39.852 INFO:tasks.workunit.client.1.smithi195.stdout:9/878: creat d2/d4/d6/db5/f13d x:0 0 0 2024-03-22T07:28:39.852 INFO:tasks.workunit.client.1.smithi195.stdout:2/731: rmdir d2/d3/d21/d40 39 2024-03-22T07:28:39.865 INFO:tasks.workunit.client.0.smithi134.stdout:3/527: dwrite d4/d8/d45/f51 [0,4194304] 0 2024-03-22T07:28:39.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/721: dwrite d1/d4/dd/df/d6b/f81 [0,4194304] 0 2024-03-22T07:28:39.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/722: readlink d1/ldc 0 2024-03-22T07:28:39.867 INFO:tasks.workunit.client.0.smithi134.stdout:6/403: symlink d2/d3f/d28/l96 0 2024-03-22T07:28:39.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/733: creat d13/d63/d79/de9/d7e/dd6/ff9 x:0 0 0 2024-03-22T07:28:39.870 INFO:tasks.workunit.client.1.smithi195.stdout:4/734: fsync d13/f14 0 2024-03-22T07:28:39.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/795: getdents da/de/db3/ddd/de2 0 2024-03-22T07:28:39.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/796: write da/f4f [1310148,111540] 0 2024-03-22T07:28:39.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/797: getdents da/d17/d32/d61/d88/dec 0 2024-03-22T07:28:39.876 INFO:tasks.workunit.client.1.smithi195.stdout:4/735: dread d13/d63/d36/d5f/d83/fba [0,4194304] 0 2024-03-22T07:28:39.876 INFO:tasks.workunit.client.1.smithi195.stdout:4/736: creat d13/d15/d6b/ffa x:0 0 0 2024-03-22T07:28:39.877 INFO:tasks.workunit.client.1.smithi195.stdout:7/733: symlink d0/d13/d14/d5b/lfe 0 2024-03-22T07:28:39.878 INFO:tasks.workunit.client.0.smithi134.stdout:4/576: truncate d2/d15/f39 2753610 0 2024-03-22T07:28:39.880 INFO:tasks.workunit.client.1.smithi195.stdout:6/662: symlink d5/d6d/lf2 0 2024-03-22T07:28:39.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/723: dwrite d1/d4/d12/d6c/dbc/d43/f53 [4194304,4194304] 0 2024-03-22T07:28:39.883 INFO:tasks.workunit.client.1.smithi195.stdout:0/724: creat d1/d4/dd/d66/fdd x:0 0 0 2024-03-22T07:28:39.885 INFO:tasks.workunit.client.1.smithi195.stdout:9/879: creat d2/d4/d6/dd1/f13e x:0 0 0 2024-03-22T07:28:39.888 INFO:tasks.workunit.client.1.smithi195.stdout:2/732: mknod d2/d3/d7/d19/d22/d26/d3c/cf4 0 2024-03-22T07:28:39.888 INFO:tasks.workunit.client.1.smithi195.stdout:2/733: readlink d2/d3/d7/d19/d22/l38 0 2024-03-22T07:28:39.889 INFO:tasks.workunit.client.0.smithi134.stdout:5/502: creat d1/d8/d20/d62/d65/d95/faa x:0 0 0 2024-03-22T07:28:39.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/722: sync 2024-03-22T07:28:39.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/723: write d3/f48 [996026,17403] 0 2024-03-22T07:28:39.894 INFO:tasks.workunit.client.1.smithi195.stdout:3/724: dread d3/d22/f8a [0,4194304] 0 2024-03-22T07:28:39.894 INFO:tasks.workunit.client.0.smithi134.stdout:0/568: creat dc/d18/d89/fa6 x:0 0 0 2024-03-22T07:28:39.894 INFO:tasks.workunit.client.0.smithi134.stdout:4/577: dwrite d2/d1d/fc2 [0,4194304] 0 2024-03-22T07:28:39.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:39 smithi134 ceph-mon[29057]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:39.894 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:39 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3067101292' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:28:39.895 INFO:tasks.workunit.client.0.smithi134.stdout:9/443: rename d3/d9/d37/d3c/c82 to d3/d9/df/d57/d67/c9b 0 2024-03-22T07:28:39.898 INFO:tasks.workunit.client.1.smithi195.stdout:8/798: rmdir da/d17/d32/d61/dc2 39 2024-03-22T07:28:39.898 INFO:tasks.workunit.client.1.smithi195.stdout:8/799: write da/de/db3/fbc [734817,109873] 0 2024-03-22T07:28:39.898 INFO:tasks.workunit.client.1.smithi195.stdout:8/800: stat da/d17/d32/d61/cba 0 2024-03-22T07:28:39.898 INFO:tasks.workunit.client.1.smithi195.stdout:8/801: chown da/d17/d32/d61/d88/d91/fc8 57505444 1 2024-03-22T07:28:39.901 INFO:tasks.workunit.client.0.smithi134.stdout:3/528: mkdir d4/dab 0 2024-03-22T07:28:39.901 INFO:tasks.workunit.client.1.smithi195.stdout:9/880: dwrite d2/d4/d32/f5f [0,4194304] 0 2024-03-22T07:28:39.901 INFO:tasks.workunit.client.1.smithi195.stdout:9/881: fsync d2/d4/d32/d6d/deb/ff6 0 2024-03-22T07:28:39.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/737: mkdir d13/d63/d79/d68/dfb 0 2024-03-22T07:28:39.902 INFO:tasks.workunit.client.1.smithi195.stdout:4/738: getdents d13/d63/d3e 0 2024-03-22T07:28:39.904 INFO:tasks.workunit.client.1.smithi195.stdout:7/734: symlink d0/d13/d14/d29/d35/lff 0 2024-03-22T07:28:39.907 INFO:tasks.workunit.client.1.smithi195.stdout:6/663: creat d5/d5e/d34/d55/d3b/d6e/ff3 x:0 0 0 2024-03-22T07:28:39.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/725: link d1/d4/d12/c72 d1/d4/dd/df/d6b/cde 0 2024-03-22T07:28:39.914 INFO:tasks.workunit.client.1.smithi195.stdout:0/726: dread - d1/d4/d12/d6c/d7b/fa5 zero size 2024-03-22T07:28:39.915 INFO:tasks.workunit.client.1.smithi195.stdout:0/727: dread d1/d4/d12/d6c/dbc/d47/f60 [0,4194304] 0 2024-03-22T07:28:39.916 INFO:tasks.workunit.client.1.smithi195.stdout:0/728: fdatasync d1/d4/d12/d6c/dbc/d43/f53 0 2024-03-22T07:28:39.916 INFO:tasks.workunit.client.1.smithi195.stdout:0/729: stat d1/d4/dd/df/d44/d6f/dae 0 2024-03-22T07:28:39.916 INFO:tasks.workunit.client.1.smithi195.stdout:2/734: creat d2/d3/d7/d5c/da4/ff5 x:0 0 0 2024-03-22T07:28:39.917 INFO:tasks.workunit.client.1.smithi195.stdout:5/791: sync 2024-03-22T07:28:39.917 INFO:tasks.workunit.client.1.smithi195.stdout:1/619: sync 2024-03-22T07:28:39.917 INFO:tasks.workunit.client.1.smithi195.stdout:5/792: fsync d9/d22/dd1/ff8 0 2024-03-22T07:28:39.919 INFO:tasks.workunit.client.1.smithi195.stdout:0/730: dread d1/d10/d19/d20/fb7 [0,4194304] 0 2024-03-22T07:28:39.919 INFO:tasks.workunit.client.0.smithi134.stdout:6/404: mkdir d2/d3f/d28/d97 0 2024-03-22T07:28:39.919 INFO:tasks.workunit.client.1.smithi195.stdout:8/802: symlink da/df0/lf1 0 2024-03-22T07:28:39.921 INFO:tasks.workunit.client.0.smithi134.stdout:5/503: rmdir d1/d8/d16/da4 0 2024-03-22T07:28:39.922 INFO:tasks.workunit.client.0.smithi134.stdout:0/569: mkdir dc/d17/da7 0 2024-03-22T07:28:39.924 INFO:tasks.workunit.client.1.smithi195.stdout:9/882: dwrite d2/d4/d6/ffd [0,4194304] 0 2024-03-22T07:28:39.924 INFO:tasks.workunit.client.1.smithi195.stdout:9/883: creat d2/d4/d113/f13f x:0 0 0 2024-03-22T07:28:39.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/739: symlink d13/d63/d79/lfc 0 2024-03-22T07:28:39.927 INFO:tasks.workunit.client.1.smithi195.stdout:4/740: readlink d13/d15/d44/l6d 0 2024-03-22T07:28:39.929 INFO:tasks.workunit.client.0.smithi134.stdout:3/529: dwrite d4/d22/d29/d82/f8d [0,4194304] 0 2024-03-22T07:28:39.929 INFO:tasks.workunit.client.0.smithi134.stdout:3/530: write d4/f66 [256355,59534] 0 2024-03-22T07:28:39.929 INFO:tasks.workunit.client.1.smithi195.stdout:7/735: truncate d0/d13/d14/d29/d35/f60 1475239 0 2024-03-22T07:28:39.930 INFO:tasks.workunit.client.0.smithi134.stdout:4/578: mknod d2/d15/d35/ccb 0 2024-03-22T07:28:39.931 INFO:tasks.workunit.client.1.smithi195.stdout:8/803: write da/de/f5b [1722615,94574] 0 2024-03-22T07:28:39.933 INFO:tasks.workunit.client.0.smithi134.stdout:9/444: rename d3/d9/f3a to d3/d9/d37/d3c/d71/d7a/f9c 0 2024-03-22T07:28:39.933 INFO:tasks.workunit.client.0.smithi134.stdout:9/445: write d3/d9/d37/d6f/f99 [796449,50471] 0 2024-03-22T07:28:39.936 INFO:tasks.workunit.client.0.smithi134.stdout:6/405: unlink d2/d1b/d1d/d5e/d6f/d7d/f46 0 2024-03-22T07:28:39.937 INFO:tasks.workunit.client.1.smithi195.stdout:1/620: unlink d0/d2/d27/ca1 0 2024-03-22T07:28:39.937 INFO:tasks.workunit.client.1.smithi195.stdout:8/804: dread da/d17/d32/d61/f73 [0,4194304] 0 2024-03-22T07:28:39.938 INFO:tasks.workunit.client.0.smithi134.stdout:5/504: dwrite d1/d4/f1a [0,4194304] 0 2024-03-22T07:28:39.939 INFO:tasks.workunit.client.0.smithi134.stdout:0/570: unlink dc/de/d55/d60/f8a 0 2024-03-22T07:28:39.940 INFO:tasks.workunit.client.0.smithi134.stdout:5/505: dread d1/d8/d83/f8f [0,4194304] 0 2024-03-22T07:28:39.942 INFO:tasks.workunit.client.1.smithi195.stdout:3/725: getdents d3/d22 0 2024-03-22T07:28:39.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/531: mknod d4/d8/d5c/cac 0 2024-03-22T07:28:39.945 INFO:tasks.workunit.client.0.smithi134.stdout:3/532: write d4/d8/d5c/f85 [206258,28503] 0 2024-03-22T07:28:39.947 INFO:tasks.workunit.client.1.smithi195.stdout:0/731: mknod d1/d4/d12/d6c/cdf 0 2024-03-22T07:28:39.948 INFO:tasks.workunit.client.0.smithi134.stdout:4/579: symlink d2/lcc 0 2024-03-22T07:28:39.958 INFO:tasks.workunit.client.0.smithi134.stdout:2/471: rmdir d2/d5/d22/d52/d3c/d4f/d62 0 2024-03-22T07:28:39.959 INFO:tasks.workunit.client.0.smithi134.stdout:0/571: dwrite dc/de/d55/d60/f7a [0,4194304] 0 2024-03-22T07:28:39.960 INFO:tasks.workunit.client.0.smithi134.stdout:0/572: write dc/de/d55/f56 [4835939,73232] 0 2024-03-22T07:28:39.962 INFO:tasks.workunit.client.0.smithi134.stdout:6/406: creat d2/d1b/d1d/d5e/d6f/f98 x:0 0 0 2024-03-22T07:28:39.962 INFO:tasks.workunit.client.0.smithi134.stdout:6/407: write d2/f1c [6043355,113870] 0 2024-03-22T07:28:39.963 INFO:tasks.workunit.client.1.smithi195.stdout:9/884: getdents d2/d122 0 2024-03-22T07:28:39.965 INFO:tasks.workunit.client.1.smithi195.stdout:4/741: mkdir d13/d63/d79/de9/dfd 0 2024-03-22T07:28:39.965 INFO:tasks.workunit.client.1.smithi195.stdout:4/742: truncate d13/d15/f22 4369252 0 2024-03-22T07:28:39.966 INFO:tasks.workunit.client.0.smithi134.stdout:5/506: unlink d1/d8/d16/c85 0 2024-03-22T07:28:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/736: getdents d0/d13/d14/d29/d35 0 2024-03-22T07:28:39.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/737: write d0/d13/d14/d29/d35/d6d/f99 [531782,7585] 0 2024-03-22T07:28:39.972 INFO:tasks.workunit.client.0.smithi134.stdout:9/446: dwrite d3/d9/f36 [0,4194304] 0 2024-03-22T07:28:39.973 INFO:tasks.workunit.client.1.smithi195.stdout:2/735: mknod d2/cf6 0 2024-03-22T07:28:39.974 INFO:tasks.workunit.client.0.smithi134.stdout:4/580: dwrite d2/d15/d66/f89 [0,4194304] 0 2024-03-22T07:28:39.975 INFO:tasks.workunit.client.0.smithi134.stdout:4/581: dread - d2/d15/d35/fb9 zero size 2024-03-22T07:28:39.975 INFO:tasks.workunit.client.1.smithi195.stdout:1/621: link d0/d2/d6/dad/db1/d6a/la6 d0/d2/d6/dad/db1/d6a/lca 0 2024-03-22T07:28:39.977 INFO:tasks.workunit.client.0.smithi134.stdout:2/472: creat d2/d5/d8/d31/f98 x:0 0 0 2024-03-22T07:28:39.978 INFO:tasks.workunit.client.1.smithi195.stdout:9/885: write d2/d4/d32/fa4 [1356943,9548] 0 2024-03-22T07:28:39.978 INFO:tasks.workunit.client.1.smithi195.stdout:9/886: chown d2/c8e 0 1 2024-03-22T07:28:39.978 INFO:tasks.workunit.client.1.smithi195.stdout:9/887: creat d2/d4/d6/db5/f140 x:0 0 0 2024-03-22T07:28:39.978 INFO:tasks.workunit.client.1.smithi195.stdout:8/805: mknod da/dde/cf2 0 2024-03-22T07:28:39.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/726: creat d3/df/d15/ff3 x:0 0 0 2024-03-22T07:28:39.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/727: fsync d3/df/d15/fd8 0 2024-03-22T07:28:39.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/728: read - d3/dbf/da0/fa1 zero size 2024-03-22T07:28:39.986 INFO:tasks.workunit.client.0.smithi134.stdout:0/573: rename f0 to dc/d18/d89/da0/fa8 0 2024-03-22T07:28:39.986 INFO:tasks.workunit.client.0.smithi134.stdout:0/574: readlink dc/de/d55/l80 0 2024-03-22T07:28:39.986 INFO:tasks.workunit.client.1.smithi195.stdout:0/732: getdents d1/d4/d12/d6c/d89 0 2024-03-22T07:28:39.987 INFO:tasks.workunit.client.1.smithi195.stdout:0/733: stat d1/d4/d12/d6c/dbc/d43/fc0 0 2024-03-22T07:28:39.988 INFO:tasks.workunit.client.0.smithi134.stdout:6/408: mkdir d2/d3f/d99 0 2024-03-22T07:28:39.990 INFO:tasks.workunit.client.0.smithi134.stdout:5/507: link d1/d8/d20/d62/d65/d82/f9b d1/d8/d20/d8a/d75/fab 0 2024-03-22T07:28:39.991 INFO:tasks.workunit.client.1.smithi195.stdout:1/622: read d0/d2/d27/d91/dc8/f6c [4169582,33560] 0 2024-03-22T07:28:39.991 INFO:tasks.workunit.client.1.smithi195.stdout:1/623: write d0/d2/d6/f71 [1644955,17400] 0 2024-03-22T07:28:39.991 INFO:tasks.workunit.client.1.smithi195.stdout:4/743: dwrite f11 [4194304,4194304] 0 2024-03-22T07:28:39.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/447: dwrite d3/d9/d37/d3c/d71/d7a/f9c [0,4194304] 0 2024-03-22T07:28:39.993 INFO:tasks.workunit.client.0.smithi134.stdout:9/448: dread - d3/d9/f94 zero size 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.1.smithi195.stdout:9/888: symlink d2/d4/d23/d74/l141 0 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/736: read d2/d3/fe2 [1821227,23608] 0 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/737: write d2/d3/d21/d60/f85 [47555,48449] 0 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/738: chown d2/d3/d24/fba 1020252 1 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/739: chown d2/d3/d7/da/d1b/d98 0 1 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.1.smithi195.stdout:2/740: chown d2/d3/d21/d60/cbe 87645889 1 2024-03-22T07:28:39.994 INFO:tasks.workunit.client.0.smithi134.stdout:2/473: mkdir d2/d5/d22/d99 0 2024-03-22T07:28:39.995 INFO:tasks.workunit.client.0.smithi134.stdout:2/474: dread - d2/d5/d22/d52/d3c/f89 zero size 2024-03-22T07:28:39.996 INFO:tasks.workunit.client.1.smithi195.stdout:8/806: mkdir da/dde/df3 0 2024-03-22T07:28:40.000 INFO:tasks.workunit.client.1.smithi195.stdout:5/793: rename d9/d22/d46 to d9/d12/d1d/d36/d7d/dd2/dfc 0 2024-03-22T07:28:40.001 INFO:tasks.workunit.client.0.smithi134.stdout:9/449: dread d3/d9/df/d12/f1d [0,4194304] 0 2024-03-22T07:28:40.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/582: rename d2/f97 to d2/d2a/d93/fcd 0 2024-03-22T07:28:40.003 INFO:tasks.workunit.client.1.smithi195.stdout:3/729: creat d3/df/d15/d1d/d5c/d47/d67/ded/ff4 x:0 0 0 2024-03-22T07:28:40.004 INFO:tasks.workunit.client.0.smithi134.stdout:0/575: read dc/d18/f1a [4178384,41979] 0 2024-03-22T07:28:40.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/807: dread da/dc/d71/fc1 [0,4194304] 0 2024-03-22T07:28:40.005 INFO:tasks.workunit.client.1.smithi195.stdout:8/808: readlink da/d82/dc6/lda 0 2024-03-22T07:28:40.005 INFO:tasks.workunit.client.1.smithi195.stdout:7/738: mknod d0/d13/d14/c100 0 2024-03-22T07:28:40.011 INFO:tasks.workunit.client.0.smithi134.stdout:9/450: mkdir d3/d9/d37/d6f/d54/d9d 0 2024-03-22T07:28:40.013 INFO:tasks.workunit.client.1.smithi195.stdout:0/734: dwrite d1/d4/dd/df/d44/d8d/fba [0,4194304] 0 2024-03-22T07:28:40.013 INFO:tasks.workunit.client.0.smithi134.stdout:2/475: dwrite d2/d5/d8/d7e/f82 [0,4194304] 0 2024-03-22T07:28:40.013 INFO:tasks.workunit.client.0.smithi134.stdout:2/476: fdatasync d2/f1a 0 2024-03-22T07:28:40.013 INFO:tasks.workunit.client.0.smithi134.stdout:4/583: creat d2/d15/fce x:0 0 0 2024-03-22T07:28:40.014 INFO:tasks.workunit.client.1.smithi195.stdout:5/794: dread d9/d12/f47 [0,4194304] 0 2024-03-22T07:28:40.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/576: mkdir dc/d17/da9 0 2024-03-22T07:28:40.015 INFO:tasks.workunit.client.0.smithi134.stdout:0/577: readlink dc/l11 0 2024-03-22T07:28:40.017 INFO:tasks.workunit.client.0.smithi134.stdout:6/409: symlink d2/d1b/d1d/d5e/d63/l9a 0 2024-03-22T07:28:40.017 INFO:tasks.workunit.client.0.smithi134.stdout:6/410: write d2/f94 [145010,46492] 0 2024-03-22T07:28:40.020 INFO:tasks.workunit.client.0.smithi134.stdout:5/508: mkdir d1/d8/d20/d62/d65/dac 0 2024-03-22T07:28:40.023 INFO:tasks.workunit.client.0.smithi134.stdout:9/451: creat d3/d9/d37/d5a/f9e x:0 0 0 2024-03-22T07:28:40.023 INFO:tasks.workunit.client.0.smithi134.stdout:9/452: dread - d3/d9/df/d57/d67/d5f/f9a zero size 2024-03-22T07:28:40.024 INFO:tasks.workunit.client.1.smithi195.stdout:9/889: creat d2/d4/d6/db/f142 x:0 0 0 2024-03-22T07:28:40.028 INFO:tasks.workunit.client.1.smithi195.stdout:0/735: dwrite d1/d4/d12/d6c/dbc/d43/f53 [0,4194304] 0 2024-03-22T07:28:40.031 INFO:tasks.workunit.client.1.smithi195.stdout:3/730: getdents d3/df/d15/d1d/d5c/d47/d67/d93/da2 0 2024-03-22T07:28:40.031 INFO:tasks.workunit.client.1.smithi195.stdout:0/736: dread d1/d4/dd/d66/d80/fac [0,4194304] 0 2024-03-22T07:28:40.032 INFO:tasks.workunit.client.1.smithi195.stdout:0/737: chown d1/d4/d12/d6c/dbc/d47/cc1 1704 1 2024-03-22T07:28:40.033 INFO:tasks.workunit.client.0.smithi134.stdout:4/584: mkdir d2/d25/dcf 0 2024-03-22T07:28:40.037 INFO:tasks.workunit.client.1.smithi195.stdout:7/739: unlink d0/d13/d14/d20/d40/d82/daa/fc2 0 2024-03-22T07:28:40.037 INFO:tasks.workunit.client.1.smithi195.stdout:7/740: fdatasync d0/d98/dab/fd4 0 2024-03-22T07:28:40.038 INFO:tasks.workunit.client.0.smithi134.stdout:0/578: creat dc/de/d55/d65/d82/faa x:0 0 0 2024-03-22T07:28:40.039 INFO:tasks.workunit.client.1.smithi195.stdout:0/738: write d1/d4/dd/f13 [1103858,126450] 0 2024-03-22T07:28:40.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/411: creat d2/d1b/d1d/d5e/d63/f9b x:0 0 0 2024-03-22T07:28:40.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/412: fdatasync d2/d3f/f88 0 2024-03-22T07:28:40.043 INFO:tasks.workunit.client.1.smithi195.stdout:3/731: write d3/df/d15/d1d/d5c/f3b [355745,29269] 0 2024-03-22T07:28:40.046 INFO:tasks.workunit.client.0.smithi134.stdout:5/509: mkdir d1/d8/d20/d62/d65/dac/dad 0 2024-03-22T07:28:40.046 INFO:tasks.workunit.client.1.smithi195.stdout:6/664: sync 2024-03-22T07:28:40.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/665: chown d5/d16/d45/d53/d59/d87/f9f 127471896 1 2024-03-22T07:28:40.047 INFO:tasks.workunit.client.1.smithi195.stdout:4/744: rmdir d13/d63/d36/d9e 39 2024-03-22T07:28:40.048 INFO:tasks.workunit.client.1.smithi195.stdout:7/741: dread d0/d13/d14/d29/d35/f37 [4194304,4194304] 0 2024-03-22T07:28:40.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/453: mknod d3/d9/df/d12/c9f 0 2024-03-22T07:28:40.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/454: readlink d3/d9/df/d57/d67/l33 0 2024-03-22T07:28:40.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/455: chown d3/d9/d37/l8f 505468 1 2024-03-22T07:28:40.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/456: fsync d3/d9/d37/d6f/d54/f83 0 2024-03-22T07:28:40.051 INFO:tasks.workunit.client.0.smithi134.stdout:9/457: getdents d3/d9/d37/d6f/d54/d9d 0 2024-03-22T07:28:40.054 INFO:tasks.workunit.client.1.smithi195.stdout:9/890: mkdir d2/d4/d32/d6d/d78/d107/d143 0 2024-03-22T07:28:40.058 INFO:tasks.workunit.client.1.smithi195.stdout:2/741: rename d2/d3/d7/da/de/fd5 to d2/d3/db/ff7 0 2024-03-22T07:28:40.060 INFO:tasks.workunit.client.1.smithi195.stdout:2/742: dread d2/d3/d7/d19/d22/fa9 [0,4194304] 0 2024-03-22T07:28:40.060 INFO:tasks.workunit.client.1.smithi195.stdout:2/743: write d2/d3/d1a/f37 [4010340,39118] 0 2024-03-22T07:28:40.061 INFO:tasks.workunit.client.0.smithi134.stdout:5/510: dread d1/d8/d20/f39 [0,4194304] 0 2024-03-22T07:28:40.061 INFO:tasks.workunit.client.0.smithi134.stdout:5/511: fdatasync d1/f7f 0 2024-03-22T07:28:40.061 INFO:tasks.workunit.client.1.smithi195.stdout:0/739: mkdir d1/d10/d1f/dbf/de0 0 2024-03-22T07:28:40.064 INFO:tasks.workunit.client.1.smithi195.stdout:7/742: dread d0/d98/dab/fd4 [0,4194304] 0 2024-03-22T07:28:40.068 INFO:tasks.workunit.client.1.smithi195.stdout:6/666: dread d5/d5e/d34/d55/d4b/da2/d1a/f54 [0,4194304] 0 2024-03-22T07:28:40.068 INFO:tasks.workunit.client.1.smithi195.stdout:6/667: truncate d5/d5e/d34/d55/d4b/d5f/f60 595036 0 2024-03-22T07:28:40.069 INFO:tasks.workunit.client.0.smithi134.stdout:0/579: creat dc/d18/d89/da0/fab x:0 0 0 2024-03-22T07:28:40.069 INFO:tasks.workunit.client.0.smithi134.stdout:0/580: chown dc/de/d55/d60/f7a 47935525 1 2024-03-22T07:28:40.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/809: rename l6 to da/d17/d32/d61/dc2/lf4 0 2024-03-22T07:28:40.072 INFO:tasks.workunit.client.0.smithi134.stdout:5/512: rename d1/d8/d20/f71 to d1/d8/d20/fae 0 2024-03-22T07:28:40.072 INFO:tasks.workunit.client.0.smithi134.stdout:5/513: creat d1/faf x:0 0 0 2024-03-22T07:28:40.072 INFO:tasks.workunit.client.0.smithi134.stdout:5/514: getdents d1/d8/da1 0 2024-03-22T07:28:40.076 INFO:tasks.workunit.client.0.smithi134.stdout:5/515: mkdir d1/d8/da1/db0 0 2024-03-22T07:28:40.080 INFO:tasks.workunit.client.0.smithi134.stdout:2/477: dwrite d2/f58 [0,4194304] 0 2024-03-22T07:28:40.082 INFO:tasks.workunit.client.0.smithi134.stdout:4/585: dwrite d2/d25/d48/d6e/d7b/f8e [0,4194304] 0 2024-03-22T07:28:40.082 INFO:tasks.workunit.client.0.smithi134.stdout:4/586: read - d2/d1d/f91 zero size 2024-03-22T07:28:40.083 INFO:tasks.workunit.client.0.smithi134.stdout:5/516: rename d1/d8/d16/d4a/l9a to d1/d8/d20/d62/d65/d82/da2/lb1 0 2024-03-22T07:28:40.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/743: rmdir d0/d13/d22/d57/d7b 39 2024-03-22T07:28:40.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/744: write d0/d13/d14/d20/d40/d82/db8/fe3 [468544,7112] 0 2024-03-22T07:28:40.084 INFO:tasks.workunit.client.1.smithi195.stdout:7/745: creat d0/d13/d14/d80/d9c/f101 x:0 0 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/517: read d1/d8/d20/d8a/f51 [179210,123486] 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/518: fsync d1/d8/d20/f50 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/519: write d1/d8/f1b [3915555,19402] 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/520: truncate d1/d8/f21 4358133 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:6/413: dwrite d2/f35 [0,4194304] 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:5/521: chown d1/d8/d20/d62/d65/dac 520 1 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.0.smithi134.stdout:9/458: dwrite d3/d9/d37/f4f [4194304,4194304] 0 2024-03-22T07:28:40.085 INFO:tasks.workunit.client.1.smithi195.stdout:0/740: dread d1/d4/dd/df/d44/d6f/f79 [0,4194304] 0 2024-03-22T07:28:40.086 INFO:tasks.workunit.client.1.smithi195.stdout:3/732: getdents d3/dbf/da0/dd1 0 2024-03-22T07:28:40.089 INFO:tasks.workunit.client.1.smithi195.stdout:6/668: mkdir d5/d5e/dc0/df4 0 2024-03-22T07:28:40.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/478: symlink d2/d5/d22/d52/l9a 0 2024-03-22T07:28:40.093 INFO:tasks.workunit.client.1.smithi195.stdout:5/795: rename d9/d12/d1d/d69/d78/d41/f8d to d9/d12/d1d/d36/d7d/dd2/ffd 0 2024-03-22T07:28:40.094 INFO:tasks.workunit.client.1.smithi195.stdout:2/744: symlink d2/lf8 0 2024-03-22T07:28:40.095 INFO:tasks.workunit.client.0.smithi134.stdout:6/414: dread d2/f43 [4194304,4194304] 0 2024-03-22T07:28:40.095 INFO:tasks.workunit.client.0.smithi134.stdout:6/415: stat d2/l14 0 2024-03-22T07:28:40.099 INFO:tasks.workunit.client.1.smithi195.stdout:7/746: symlink d0/d13/d14/d20/d40/d82/daa/l102 0 2024-03-22T07:28:40.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/522: dread d1/d8/d20/d62/d65/f77 [0,4194304] 0 2024-03-22T07:28:40.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/523: creat d1/fb2 x:0 0 0 2024-03-22T07:28:40.101 INFO:tasks.workunit.client.0.smithi134.stdout:0/581: dwrite dc/f1f [0,4194304] 0 2024-03-22T07:28:40.101 INFO:tasks.workunit.client.0.smithi134.stdout:0/582: stat dc/d18/f1a 0 2024-03-22T07:28:40.101 INFO:tasks.workunit.client.0.smithi134.stdout:0/583: readlink dc/d17/l5d 0 2024-03-22T07:28:40.102 INFO:tasks.workunit.client.1.smithi195.stdout:8/810: dwrite da/d17/d32/f58 [0,4194304] 0 2024-03-22T07:28:40.102 INFO:tasks.workunit.client.1.smithi195.stdout:8/811: getdents da/d17/d32/d61/d88/dec 0 2024-03-22T07:28:40.103 INFO:tasks.workunit.client.1.smithi195.stdout:0/741: link d1/d4/d12/d6c/dbc/d43/l93 d1/d10/d4d/da6/le1 0 2024-03-22T07:28:40.106 INFO:tasks.workunit.client.1.smithi195.stdout:3/733: dwrite d3/df/d15/d1d/d5c/d47/d67/f8d [0,4194304] 0 2024-03-22T07:28:40.107 INFO:tasks.workunit.client.0.smithi134.stdout:2/479: unlink d2/c11 0 2024-03-22T07:28:40.107 INFO:tasks.workunit.client.0.smithi134.stdout:2/480: fdatasync d2/f87 0 2024-03-22T07:28:40.107 INFO:tasks.workunit.client.1.smithi195.stdout:6/669: mkdir d5/d5e/d34/d55/d4b/da2/d1a/df5 0 2024-03-22T07:28:40.108 INFO:tasks.workunit.client.1.smithi195.stdout:6/670: truncate d5/d5e/d34/d55/dab/dbf/fc7 989275 0 2024-03-22T07:28:40.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/745: rename d13/d63/d3e/cb8 to d13/d63/d36/d9e/cfe 0 2024-03-22T07:28:40.111 INFO:tasks.workunit.client.1.smithi195.stdout:8/812: dread da/d17/d32/d61/f72 [0,4194304] 0 2024-03-22T07:28:40.113 INFO:tasks.workunit.client.1.smithi195.stdout:5/796: mknod d9/d2d/cfe 0 2024-03-22T07:28:40.114 INFO:tasks.workunit.client.0.smithi134.stdout:5/524: mknod d1/d8/d20/d62/d68/cb3 0 2024-03-22T07:28:40.115 INFO:tasks.workunit.client.0.smithi134.stdout:4/587: dwrite d2/fa1 [0,4194304] 0 2024-03-22T07:28:40.116 INFO:tasks.workunit.client.0.smithi134.stdout:9/459: dwrite d3/d9/d37/d6f/f5d [0,4194304] 0 2024-03-22T07:28:40.116 INFO:tasks.workunit.client.0.smithi134.stdout:9/460: stat d3/d9/d37/c43 0 2024-03-22T07:28:40.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/745: unlink d2/d3/dac/dad/fd1 0 2024-03-22T07:28:40.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/746: fsync d2/d3/d24/fba 0 2024-03-22T07:28:40.119 INFO:tasks.workunit.client.1.smithi195.stdout:5/797: read d9/d12/d1d/d69/d78/f7e [378827,79397] 0 2024-03-22T07:28:40.119 INFO:tasks.workunit.client.0.smithi134.stdout:6/416: symlink d2/d1b/d1d/d5e/d6f/d7d/l9c 0 2024-03-22T07:28:40.119 INFO:tasks.workunit.client.0.smithi134.stdout:5/525: dread d1/d8/d20/f30 [0,4194304] 0 2024-03-22T07:28:40.121 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:39 smithi195 ceph-mon[36144]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:28:40.121 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:39 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3067101292' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:28:40.121 INFO:tasks.workunit.client.0.smithi134.stdout:5/526: dread d1/d8/d20/d8a/f51 [0,4194304] 0 2024-03-22T07:28:40.123 INFO:tasks.workunit.client.1.smithi195.stdout:0/742: creat d1/d4/dd/df/fe2 x:0 0 0 2024-03-22T07:28:40.125 INFO:tasks.workunit.client.1.smithi195.stdout:2/747: write d2/d3/d7/d19/d22/d26/d99/dbf/fcf [2300294,33741] 0 2024-03-22T07:28:40.125 INFO:tasks.workunit.client.1.smithi195.stdout:2/748: chown d2/d3/d21/d40/f8c 234 1 2024-03-22T07:28:40.127 INFO:tasks.workunit.client.1.smithi195.stdout:1/624: sync 2024-03-22T07:28:40.128 INFO:tasks.workunit.client.1.smithi195.stdout:6/671: dread d5/d5e/d34/d55/d3b/d6e/d97/fb5 [0,4194304] 0 2024-03-22T07:28:40.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/743: read d1/d4/dd/df/f3e [555735,20733] 0 2024-03-22T07:28:40.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/744: write d1/d4/dd/d66/f88 [126702,96587] 0 2024-03-22T07:28:40.131 INFO:tasks.workunit.client.1.smithi195.stdout:3/734: dwrite d3/d18/ff2 [0,4194304] 0 2024-03-22T07:28:40.131 INFO:tasks.workunit.client.1.smithi195.stdout:3/735: creat d3/df/d15/ff5 x:0 0 0 2024-03-22T07:28:40.133 INFO:tasks.workunit.client.1.smithi195.stdout:4/746: dwrite f11 [4194304,4194304] 0 2024-03-22T07:28:40.135 INFO:tasks.workunit.client.0.smithi134.stdout:2/481: dread d2/f3a [0,4194304] 0 2024-03-22T07:28:40.138 INFO:tasks.workunit.client.1.smithi195.stdout:5/798: truncate d9/da8/fd8 2483048 0 2024-03-22T07:28:40.148 INFO:tasks.workunit.client.1.smithi195.stdout:2/749: creat d2/d3/d21/d60/d81/da8/ded/ff9 x:0 0 0 2024-03-22T07:28:40.153 INFO:tasks.workunit.client.0.smithi134.stdout:9/461: mknod d3/d9/d37/d70/ca0 0 2024-03-22T07:28:40.153 INFO:tasks.workunit.client.0.smithi134.stdout:9/462: readlink d3/d9/df/d12/l53 0 2024-03-22T07:28:40.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/745: dwrite d1/d4/d12/d6c/dbc/fcf [0,4194304] 0 2024-03-22T07:28:40.155 INFO:tasks.workunit.client.1.smithi195.stdout:4/747: dwrite d13/d15/f1c [0,4194304] 0 2024-03-22T07:28:40.155 INFO:tasks.workunit.client.1.smithi195.stdout:4/748: chown d13/d63/d79/f4b 9274087 1 2024-03-22T07:28:40.157 INFO:tasks.workunit.client.0.smithi134.stdout:6/417: creat d2/d3f/d28/d6b/f9d x:0 0 0 2024-03-22T07:28:40.159 INFO:tasks.workunit.client.0.smithi134.stdout:5/527: symlink d1/d8/da1/db0/lb4 0 2024-03-22T07:28:40.162 INFO:tasks.workunit.client.0.smithi134.stdout:2/482: unlink d2/d5/d8/d31/f56 0 2024-03-22T07:28:40.163 INFO:tasks.workunit.client.1.smithi195.stdout:3/736: rmdir d3/d18/d89 39 2024-03-22T07:28:40.168 INFO:tasks.workunit.client.1.smithi195.stdout:9/891: rename d2/dad/dff to d2/d4/d6/d18/d50/d144 0 2024-03-22T07:28:40.168 INFO:tasks.workunit.client.0.smithi134.stdout:8/650: sync 2024-03-22T07:28:40.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/463: creat d3/d9/df/d12/d3b/fa1 x:0 0 0 2024-03-22T07:28:40.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/464: chown d3/d9/df/f26 5102533 1 2024-03-22T07:28:40.170 INFO:tasks.workunit.client.0.smithi134.stdout:9/465: readlink d3/d9/df/d12/l53 0 2024-03-22T07:28:40.172 INFO:tasks.workunit.client.0.smithi134.stdout:6/418: dwrite d2/d1b/d1d/d5e/f70 [0,4194304] 0 2024-03-22T07:28:40.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/528: link d1/d8/d16/d4a/l5d d1/d8/d16/d4a/lb5 0 2024-03-22T07:28:40.173 INFO:tasks.workunit.client.1.smithi195.stdout:3/737: write d3/df/d15/d1d/f30 [3540215,13729] 0 2024-03-22T07:28:40.173 INFO:tasks.workunit.client.0.smithi134.stdout:7/707: sync 2024-03-22T07:28:40.174 INFO:tasks.workunit.client.0.smithi134.stdout:1/606: sync 2024-03-22T07:28:40.174 INFO:tasks.workunit.client.0.smithi134.stdout:3/533: sync 2024-03-22T07:28:40.174 INFO:tasks.workunit.client.0.smithi134.stdout:2/483: dread - d2/d5/d8/f88 zero size 2024-03-22T07:28:40.175 INFO:tasks.workunit.client.1.smithi195.stdout:8/813: rmdir da/d17/d32/d61 39 2024-03-22T07:28:40.176 INFO:tasks.workunit.client.0.smithi134.stdout:8/651: rmdir d1/d15/d42/d25 39 2024-03-22T07:28:40.176 INFO:tasks.workunit.client.0.smithi134.stdout:8/652: chown d1/d15/d57/d8c/d9a/da2 122007 1 2024-03-22T07:28:40.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/799: link d9/d12/d1d/d36/d7d/dd2/dfc/db2/cf0 d9/d2d/d84/d92/cff 0 2024-03-22T07:28:40.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/800: chown d9/d12/d1d/d36/d7d/dd2/lec 282462939 1 2024-03-22T07:28:40.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/801: stat d9/d22/c9c 0 2024-03-22T07:28:40.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/802: dread - d9/d2d/d84/fc8 zero size 2024-03-22T07:28:40.178 INFO:tasks.workunit.client.1.smithi195.stdout:5/803: chown d9/d12/d1d/d69/d78/c4a 26774 1 2024-03-22T07:28:40.178 INFO:tasks.workunit.client.1.smithi195.stdout:6/672: write d5/d5e/d34/d55/d3b/d6e/d97/fb5 [1482246,56181] 0 2024-03-22T07:28:40.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/750: truncate d2/d3/d24/f6e 3015268 0 2024-03-22T07:28:40.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/751: chown d2/d3/d7/d19/d22/d26/d3c 567369125 1 2024-03-22T07:28:40.181 INFO:tasks.workunit.client.1.smithi195.stdout:2/752: chown d2/d3/d24/f39 16 1 2024-03-22T07:28:40.184 INFO:tasks.workunit.client.0.smithi134.stdout:6/419: rmdir d2/d1b/d8f 39 2024-03-22T07:28:40.184 INFO:tasks.workunit.client.0.smithi134.stdout:6/420: truncate d2/d3f/f8b 619975 0 2024-03-22T07:28:40.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/708: mkdir d1/dae/de1 0 2024-03-22T07:28:40.186 INFO:tasks.workunit.client.0.smithi134.stdout:7/709: write d1/de/d11/d2b/d31/f8e [4738080,24396] 0 2024-03-22T07:28:40.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/607: getdents d5/da/d1b/d27/dae 0 2024-03-22T07:28:40.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/608: readlink d5/ld 0 2024-03-22T07:28:40.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/609: chown d5/da/d1b/d27/fd2 126 1 2024-03-22T07:28:40.190 INFO:tasks.workunit.client.0.smithi134.stdout:1/610: write d5/da/d13/d1e/d34/f3e [917468,126497] 0 2024-03-22T07:28:40.191 INFO:tasks.workunit.client.0.smithi134.stdout:5/529: dwrite d1/fa6 [0,4194304] 0 2024-03-22T07:28:40.191 INFO:tasks.workunit.client.0.smithi134.stdout:5/530: write d1/d8/d20/d62/d65/d82/da2/f84 [923764,33359] 0 2024-03-22T07:28:40.191 INFO:tasks.workunit.client.0.smithi134.stdout:5/531: write d1/d8/d16/fa9 [821371,84025] 0 2024-03-22T07:28:40.191 INFO:tasks.workunit.client.0.smithi134.stdout:5/532: creat d1/d8/d20/d62/d65/d82/fb6 x:0 0 0 2024-03-22T07:28:40.191 INFO:tasks.workunit.client.1.smithi195.stdout:0/746: rmdir d1/d4/dd/df/d2b/d63 39 2024-03-22T07:28:40.192 INFO:tasks.workunit.client.1.smithi195.stdout:0/747: write d1/d4/dd/df/d44/d8d/fc4 [57178,78422] 0 2024-03-22T07:28:40.193 INFO:tasks.workunit.client.0.smithi134.stdout:3/534: mkdir d4/d22/d29/dad 0 2024-03-22T07:28:40.197 INFO:tasks.workunit.client.0.smithi134.stdout:2/484: rename d2/d5/d22/d52/l9a to d2/d5/d22/d52/d3c/d60/l9b 0 2024-03-22T07:28:40.199 INFO:tasks.workunit.client.0.smithi134.stdout:5/533: dread d1/d8/d16/f40 [0,4194304] 0 2024-03-22T07:28:40.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/653: symlink d1/d15/d42/d12/d20/d69/ld3 0 2024-03-22T07:28:40.200 INFO:tasks.workunit.client.0.smithi134.stdout:8/654: read - d1/d15/d57/d79/fba zero size 2024-03-22T07:28:40.202 INFO:tasks.workunit.client.0.smithi134.stdout:7/710: dwrite d1/de/d41/f49 [0,4194304] 0 2024-03-22T07:28:40.203 INFO:tasks.workunit.client.0.smithi134.stdout:9/466: link d3/f25 d3/d9/df/d12/d3b/fa2 0 2024-03-22T07:28:40.205 INFO:tasks.workunit.client.1.smithi195.stdout:1/625: rename d0/d2/d6/dad/db1/d97/d39/d64/d7a/l90 to d0/d2/d6/dad/db1/d97/d39/d40/lcb 0 2024-03-22T07:28:40.207 INFO:tasks.workunit.client.0.smithi134.stdout:6/421: mknod d2/d1b/d1d/d5e/c9e 0 2024-03-22T07:28:40.209 INFO:tasks.workunit.client.1.smithi195.stdout:9/892: truncate d2/fbe 3304816 0 2024-03-22T07:28:40.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/611: getdents d5/da/d13/d1e/d63/d9d 0 2024-03-22T07:28:40.216 INFO:tasks.workunit.client.0.smithi134.stdout:1/612: readlink d5/l3d 0 2024-03-22T07:28:40.220 INFO:tasks.workunit.client.0.smithi134.stdout:8/655: dwrite d1/d15/d42/d76/fd0 [4194304,4194304] 0 2024-03-22T07:28:40.221 INFO:tasks.workunit.client.1.smithi195.stdout:3/738: truncate d3/df/d15/d1d/d5c/d47/d67/d93/f68 1500943 0 2024-03-22T07:28:40.222 INFO:tasks.workunit.client.0.smithi134.stdout:8/656: dread d1/d15/d42/d12/d20/f3c [0,4194304] 0 2024-03-22T07:28:40.223 INFO:tasks.workunit.client.0.smithi134.stdout:8/657: write d1/d4/f4a [238575,23529] 0 2024-03-22T07:28:40.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/814: symlink da/d17/d32/lf5 0 2024-03-22T07:28:40.224 INFO:tasks.workunit.client.1.smithi195.stdout:8/815: chown da/de/db3/ddd/cdb 26466711 1 2024-03-22T07:28:40.226 INFO:tasks.workunit.client.1.smithi195.stdout:5/804: creat d9/d2d/f100 x:0 0 0 2024-03-22T07:28:40.226 INFO:tasks.workunit.client.1.smithi195.stdout:5/805: chown f3 4 1 2024-03-22T07:28:40.226 INFO:tasks.workunit.client.0.smithi134.stdout:3/535: mknod d4/d22/d29/cae 0 2024-03-22T07:28:40.228 INFO:tasks.workunit.client.1.smithi195.stdout:1/626: dwrite d0/d2/d6/dad/db1/d6b/d9c/fb2 [0,4194304] 0 2024-03-22T07:28:40.230 INFO:tasks.workunit.client.1.smithi195.stdout:7/747: sync 2024-03-22T07:28:40.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/753: creat d2/d3/d7/da/d1b/ffa x:0 0 0 2024-03-22T07:28:40.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/534: creat d1/d8/d20/d62/d65/fb7 x:0 0 0 2024-03-22T07:28:40.232 INFO:tasks.workunit.client.1.smithi195.stdout:0/748: getdents d1/d4 0 2024-03-22T07:28:40.233 INFO:tasks.workunit.client.0.smithi134.stdout:7/711: mkdir d1/d19/d9c/db3/dc4/de2 0 2024-03-22T07:28:40.235 INFO:tasks.workunit.client.1.smithi195.stdout:4/749: rename d13/d63/d79/c3d to d13/d63/d3e/d5c/d65/cff 0 2024-03-22T07:28:40.236 INFO:tasks.workunit.client.0.smithi134.stdout:6/422: creat d2/d3f/d99/f9f x:0 0 0 2024-03-22T07:28:40.237 INFO:tasks.workunit.client.0.smithi134.stdout:1/613: rename d5/da/c3c to d5/da/d13/dac/cd8 0 2024-03-22T07:28:40.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/739: truncate d3/d18/f51 647316 0 2024-03-22T07:28:40.239 INFO:tasks.workunit.client.1.smithi195.stdout:3/740: write d3/df/d15/fd8 [4569105,4828] 0 2024-03-22T07:28:40.239 INFO:tasks.workunit.client.0.smithi134.stdout:8/658: mknod d1/d15/d42/d49/cd4 0 2024-03-22T07:28:40.240 INFO:tasks.workunit.client.0.smithi134.stdout:8/659: rename d1/d15/d42 to d1/d15/d42/d12/dd5 22 2024-03-22T07:28:40.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/741: dread d3/df/d15/fcc [0,4194304] 0 2024-03-22T07:28:40.240 INFO:tasks.workunit.client.1.smithi195.stdout:3/742: chown d3/df/d15/d1d/l41 1062304 1 2024-03-22T07:28:40.241 INFO:tasks.workunit.client.1.smithi195.stdout:8/816: symlink da/d82/dc6/d53/dca/lf6 0 2024-03-22T07:28:40.242 INFO:tasks.workunit.client.0.smithi134.stdout:3/536: symlink d4/d8/d45/laf 0 2024-03-22T07:28:40.243 INFO:tasks.workunit.client.1.smithi195.stdout:7/748: dwrite d0/d13/d14/d29/fe1 [0,4194304] 0 2024-03-22T07:28:40.243 INFO:tasks.workunit.client.1.smithi195.stdout:7/749: fdatasync d0/d13/d14/d29/fe1 0 2024-03-22T07:28:40.244 INFO:tasks.workunit.client.0.smithi134.stdout:7/712: dread d1/de/d11/f16 [4194304,4194304] 0 2024-03-22T07:28:40.248 INFO:tasks.workunit.client.1.smithi195.stdout:5/806: mkdir d9/d12/d1d/d69/d101 0 2024-03-22T07:28:40.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/535: unlink d1/d8/d20/f54 0 2024-03-22T07:28:40.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/536: chown d1/l7e 41618 1 2024-03-22T07:28:40.254 INFO:tasks.workunit.client.0.smithi134.stdout:9/467: unlink d3/f51 0 2024-03-22T07:28:40.259 INFO:tasks.workunit.client.0.smithi134.stdout:6/423: link d2/d1b/d1d/d5e/d84/f79 d2/d1b/d4d/d65/fa0 0 2024-03-22T07:28:40.259 INFO:tasks.workunit.client.0.smithi134.stdout:6/424: write d2/d1b/d1d/f55 [2906312,13876] 0 2024-03-22T07:28:40.259 INFO:tasks.workunit.client.0.smithi134.stdout:6/425: readlink d2/d6e/l78 0 2024-03-22T07:28:40.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/754: creat d2/d3/d21/ffb x:0 0 0 2024-03-22T07:28:40.261 INFO:tasks.workunit.client.0.smithi134.stdout:8/660: dwrite d1/d15/d42/d76/d8f/dad/db1/f3e [0,4194304] 0 2024-03-22T07:28:40.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/614: creat d5/da/d13/d1e/d45/fd9 x:0 0 0 2024-03-22T07:28:40.263 INFO:tasks.workunit.client.0.smithi134.stdout:1/615: fdatasync d5/f20 0 2024-03-22T07:28:40.264 INFO:tasks.workunit.client.0.smithi134.stdout:1/616: chown d5/l3d 24282 1 2024-03-22T07:28:40.266 INFO:tasks.workunit.client.0.smithi134.stdout:7/713: symlink d1/da8/le3 0 2024-03-22T07:28:40.267 INFO:tasks.workunit.client.1.smithi195.stdout:5/807: dwrite d9/d2d/f67 [4194304,4194304] 0 2024-03-22T07:28:40.267 INFO:tasks.workunit.client.1.smithi195.stdout:5/808: fsync d9/d2d/d84/dcf/f6c 0 2024-03-22T07:28:40.267 INFO:tasks.workunit.client.1.smithi195.stdout:6/673: rename d5/d5e/d34/d55/d3b/d6e/d56/f89 to d5/d5e/d34/d55/d3b/d6e/d56/dee/ff6 0 2024-03-22T07:28:40.269 INFO:tasks.workunit.client.1.smithi195.stdout:4/750: mkdir d13/d63/d79/de9/d7e/d8c/db7/d100 0 2024-03-22T07:28:40.270 INFO:tasks.workunit.client.0.smithi134.stdout:2/485: rmdir d2/d5/d8/d31 39 2024-03-22T07:28:40.270 INFO:tasks.workunit.client.0.smithi134.stdout:2/486: readlink d2/d5/d22/d52/d3c/d4f/l74 0 2024-03-22T07:28:40.275 INFO:tasks.workunit.client.1.smithi195.stdout:3/743: getdents d3/df/d15/d1d/d5c/d47/d67 0 2024-03-22T07:28:40.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/751: write d13/d15/f98 [260109,51397] 0 2024-03-22T07:28:40.277 INFO:tasks.workunit.client.1.smithi195.stdout:4/752: chown c1 535948 1 2024-03-22T07:28:40.278 INFO:tasks.workunit.client.1.smithi195.stdout:8/817: truncate da/d17/f99 1092736 0 2024-03-22T07:28:40.278 INFO:tasks.workunit.client.1.smithi195.stdout:8/818: readlink da/dc/l28 0 2024-03-22T07:28:40.280 INFO:tasks.workunit.client.0.smithi134.stdout:5/537: creat d1/d8/d20/d8a/d75/fb8 x:0 0 0 2024-03-22T07:28:40.280 INFO:tasks.workunit.client.0.smithi134.stdout:5/538: fsync d1/d8/d20/d62/f69 0 2024-03-22T07:28:40.280 INFO:tasks.workunit.client.0.smithi134.stdout:5/539: read d1/d8/d20/f30 [388187,69147] 0 2024-03-22T07:28:40.281 INFO:tasks.workunit.client.1.smithi195.stdout:6/674: write d5/d5e/d34/d55/d3b/d6e/d97/fbd [3626796,107341] 0 2024-03-22T07:28:40.282 INFO:tasks.workunit.client.0.smithi134.stdout:9/468: creat d3/fa3 x:0 0 0 2024-03-22T07:28:40.286 INFO:tasks.workunit.client.1.smithi195.stdout:7/750: creat d0/d13/d22/def/f103 x:0 0 0 2024-03-22T07:28:40.291 INFO:tasks.workunit.client.1.smithi195.stdout:2/755: creat d2/d3/dac/ffc x:0 0 0 2024-03-22T07:28:40.291 INFO:tasks.workunit.client.1.smithi195.stdout:2/756: stat d2/d3/d7/da/l3f 0 2024-03-22T07:28:40.295 INFO:tasks.workunit.client.0.smithi134.stdout:7/714: symlink d1/de/d41/d87/d8f/le4 0 2024-03-22T07:28:40.300 INFO:tasks.workunit.client.1.smithi195.stdout:5/809: unlink d9/d7f/fd4 0 2024-03-22T07:28:40.302 INFO:tasks.workunit.client.0.smithi134.stdout:9/469: symlink d3/d9/d37/d3c/d71/la4 0 2024-03-22T07:28:40.304 INFO:tasks.workunit.client.1.smithi195.stdout:7/751: dwrite d0/d13/d14/d5b/f81 [0,4194304] 0 2024-03-22T07:28:40.305 INFO:tasks.workunit.client.1.smithi195.stdout:9/893: rename d2/d4/d6/d18/d50/lef to d2/d4/d32/d6d/deb/l145 0 2024-03-22T07:28:40.305 INFO:tasks.workunit.client.0.smithi134.stdout:2/487: dread d2/d5/d8/d5d/d5f/f6f [0,4194304] 0 2024-03-22T07:28:40.307 INFO:tasks.workunit.client.0.smithi134.stdout:6/426: rename d2/d1b/d1d/d5e/d6f/d7d/c3c to d2/d1b/d1d/d5e/ca1 0 2024-03-22T07:28:40.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/540: rename d1/d8/d20/d62/d65/dac to d1/d8/d20/d62/d65/dac/db9 22 2024-03-22T07:28:40.309 INFO:tasks.workunit.client.1.smithi195.stdout:3/744: symlink d3/df/d15/d1d/lf6 0 2024-03-22T07:28:40.310 INFO:tasks.workunit.client.0.smithi134.stdout:8/661: link d1/d15/d42/c6a d1/d15/d42/cd6 0 2024-03-22T07:28:40.312 INFO:tasks.workunit.client.1.smithi195.stdout:4/753: mkdir d13/d63/d79/de9/d7e/d85/d101 0 2024-03-22T07:28:40.313 INFO:tasks.workunit.client.0.smithi134.stdout:2/488: mknod d2/d5/d22/d52/d3c/d4f/d6e/c9c 0 2024-03-22T07:28:40.313 INFO:tasks.workunit.client.1.smithi195.stdout:3/745: dread d3/df/d15/d1d/d5c/fe5 [0,4194304] 0 2024-03-22T07:28:40.315 INFO:tasks.workunit.client.0.smithi134.stdout:5/541: rename d1/d8/d20/d8a/f78 to d1/d8/d20/d62/d65/dac/fba 0 2024-03-22T07:28:40.316 INFO:tasks.workunit.client.0.smithi134.stdout:8/662: truncate d1/f50 482727 0 2024-03-22T07:28:40.317 INFO:tasks.workunit.client.0.smithi134.stdout:2/489: chown d2/d5/d8/l17 0 1 2024-03-22T07:28:40.317 INFO:tasks.workunit.client.0.smithi134.stdout:2/490: write d2/d5/d22/d52/d3c/f89 [519272,109902] 0 2024-03-22T07:28:40.318 INFO:tasks.workunit.client.1.smithi195.stdout:2/757: mkdir d2/d3/d21/d60/d81/dfd 0 2024-03-22T07:28:40.320 INFO:tasks.workunit.client.0.smithi134.stdout:6/427: link d2/d3f/f32 d2/d1b/d1d/d5e/d63/fa2 0 2024-03-22T07:28:40.320 INFO:tasks.workunit.client.1.smithi195.stdout:3/746: dread f0 [0,4194304] 0 2024-03-22T07:28:40.321 INFO:tasks.workunit.client.1.smithi195.stdout:5/810: symlink d9/d7f/de7/l102 0 2024-03-22T07:28:40.321 INFO:tasks.workunit.client.0.smithi134.stdout:7/715: dwrite d1/de/d11/d48/fc [0,4194304] 0 2024-03-22T07:28:40.321 INFO:tasks.workunit.client.0.smithi134.stdout:7/716: write d1/de/d11/f6a [4210627,37092] 0 2024-03-22T07:28:40.322 INFO:tasks.workunit.client.0.smithi134.stdout:9/470: dwrite d3/d9/d37/d6f/d54/f83 [4194304,4194304] 0 2024-03-22T07:28:40.322 INFO:tasks.workunit.client.0.smithi134.stdout:5/542: creat d1/d8/d20/d62/d65/dac/fbb x:0 0 0 2024-03-22T07:28:40.325 INFO:tasks.workunit.client.0.smithi134.stdout:8/663: creat d1/d15/d5b/fd7 x:0 0 0 2024-03-22T07:28:40.325 INFO:tasks.workunit.client.0.smithi134.stdout:8/664: dread - d1/d15/d42/d12/d20/fc8 zero size 2024-03-22T07:28:40.326 INFO:tasks.workunit.client.0.smithi134.stdout:7/717: dread d1/de/d11/d48/d52/fa4 [0,4194304] 0 2024-03-22T07:28:40.328 INFO:tasks.workunit.client.1.smithi195.stdout:3/747: dread d3/dbf/f97 [0,4194304] 0 2024-03-22T07:28:40.329 INFO:tasks.workunit.client.1.smithi195.stdout:7/752: truncate d0/d13/d14/d20/d40/d82/db8/ff7 36983 0 2024-03-22T07:28:40.335 INFO:tasks.workunit.client.0.smithi134.stdout:5/543: link d1/d8/d20/f30 d1/d8/d20/d62/d65/d82/fbc 0 2024-03-22T07:28:40.338 INFO:tasks.workunit.client.1.smithi195.stdout:8/819: rename da/d82/dc6/f83 to da/de/db3/dc7/ff7 0 2024-03-22T07:28:40.341 INFO:tasks.workunit.client.0.smithi134.stdout:8/665: dwrite d1/d15/d42/d12/d2a/f23 [0,4194304] 0 2024-03-22T07:28:40.341 INFO:tasks.workunit.client.0.smithi134.stdout:8/666: creat d1/fd8 x:0 0 0 2024-03-22T07:28:40.342 INFO:tasks.workunit.client.1.smithi195.stdout:4/754: symlink d13/d63/d36/d5f/d83/l102 0 2024-03-22T07:28:40.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/544: mkdir d1/d8/d16/dbd 0 2024-03-22T07:28:40.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/545: truncate d1/d8/d20/d62/d65/f64 922131 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/546: dread d1/d8/d20/d62/d65/f64 [0,4194304] 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/547: write d1/d8/d20/f70 [5200252,93110] 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/548: dread - d1/d8/d20/d62/d65/dac/fba zero size 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/549: fdatasync d1/d8/f1b 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/550: chown d1/d8/d20/d62/d65/f18 1585 1 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/551: write d1/d8/d16/f59 [846264,698] 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/552: read - d1/f7f zero size 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/553: creat d1/d8/d20/d62/d65/dac/fbe x:0 0 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/554: getdents d1/d8/d20/d62/d68/d9c 0 2024-03-22T07:28:40.344 INFO:tasks.workunit.client.0.smithi134.stdout:5/555: write d1/d8/d20/d62/d65/d82/fb6 [614471,107812] 0 2024-03-22T07:28:40.345 INFO:tasks.workunit.client.1.smithi195.stdout:2/758: link d2/d3/db/db3/feb d2/d3/ffe 0 2024-03-22T07:28:40.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/491: rename d2/d5/d22/d52 to d2/d5/d8/d5d/d5f/d9d 0 2024-03-22T07:28:40.350 INFO:tasks.workunit.client.1.smithi195.stdout:3/748: truncate d3/d18/f26 2579940 0 2024-03-22T07:28:40.350 INFO:tasks.workunit.client.1.smithi195.stdout:3/749: getdents d3/df/d15/d1d/d5c/d47/d67 0 2024-03-22T07:28:40.352 INFO:tasks.workunit.client.1.smithi195.stdout:3/750: read d3/dbf/fdc [503513,77011] 0 2024-03-22T07:28:40.352 INFO:tasks.workunit.client.1.smithi195.stdout:3/751: getdents d3/d18/d89/d76/def 0 2024-03-22T07:28:40.353 INFO:tasks.workunit.client.1.smithi195.stdout:7/753: mknod d0/d98/c104 0 2024-03-22T07:28:40.354 INFO:tasks.workunit.client.1.smithi195.stdout:9/894: rmdir d2/d4/d23 39 2024-03-22T07:28:40.356 INFO:tasks.workunit.client.0.smithi134.stdout:2/492: dread d2/f30 [0,4194304] 0 2024-03-22T07:28:40.358 INFO:tasks.workunit.client.1.smithi195.stdout:6/675: rename d5/d5e/d34/d55/d4b/da2/d4a/f8c to d5/d5e/d34/d55/d4b/da2/dad/de3/ff7 0 2024-03-22T07:28:40.361 INFO:tasks.workunit.client.0.smithi134.stdout:5/556: dwrite d1/d8/f72 [0,4194304] 0 2024-03-22T07:28:40.361 INFO:tasks.workunit.client.0.smithi134.stdout:5/557: write d1/d8/d20/d62/f89 [812225,34072] 0 2024-03-22T07:28:40.361 INFO:tasks.workunit.client.0.smithi134.stdout:5/558: fsync d1/d4/f2b 0 2024-03-22T07:28:40.361 INFO:tasks.workunit.client.1.smithi195.stdout:8/820: mknod da/d17/d32/d78/cf8 0 2024-03-22T07:28:40.363 INFO:tasks.workunit.client.1.smithi195.stdout:7/754: dread d0/d13/d14/d2f/dae/dc3/fc7 [0,4194304] 0 2024-03-22T07:28:40.365 INFO:tasks.workunit.client.1.smithi195.stdout:4/755: truncate f9 1426963 0 2024-03-22T07:28:40.365 INFO:tasks.workunit.client.1.smithi195.stdout:4/756: fdatasync d13/d63/fc3 0 2024-03-22T07:28:40.366 INFO:tasks.workunit.client.1.smithi195.stdout:1/627: sync 2024-03-22T07:28:40.367 INFO:tasks.workunit.client.1.smithi195.stdout:3/752: dwrite d3/fd [0,4194304] 0 2024-03-22T07:28:40.368 INFO:tasks.workunit.client.0.smithi134.stdout:9/471: rename d3/d9/d37/d5a/d7f/f88 to d3/d9/d37/d3c/d71/d7a/fa5 0 2024-03-22T07:28:40.370 INFO:tasks.workunit.client.1.smithi195.stdout:2/759: link d2/d3/d21/d60/d7c/la7 d2/d3/d7/da/lff 0 2024-03-22T07:28:40.370 INFO:tasks.workunit.client.1.smithi195.stdout:2/760: fdatasync d2/d3/d7/da/d1b/d98/fc8 0 2024-03-22T07:28:40.370 INFO:tasks.workunit.client.0.smithi134.stdout:2/493: rmdir d2/d5/d22 39 2024-03-22T07:28:40.372 INFO:tasks.workunit.client.1.smithi195.stdout:9/895: unlink d2/d4/d6/dd1/d112/l11e 0 2024-03-22T07:28:40.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/749: sync 2024-03-22T07:28:40.380 INFO:tasks.workunit.client.0.smithi134.stdout:7/718: rename d1/de/d41/cd6 to d1/de/d11/d48/ce5 0 2024-03-22T07:28:40.380 INFO:tasks.workunit.client.0.smithi134.stdout:7/719: truncate d1/de/d11/f6a 4295374 0 2024-03-22T07:28:40.380 INFO:tasks.workunit.client.0.smithi134.stdout:5/559: dwrite d1/f57 [0,4194304] 0 2024-03-22T07:28:40.381 INFO:tasks.workunit.client.0.smithi134.stdout:5/560: chown d1/d8/d20/d62/d65/d82/fbc 7 1 2024-03-22T07:28:40.381 INFO:tasks.workunit.client.0.smithi134.stdout:5/561: read d1/d4/f2b [2895313,52799] 0 2024-03-22T07:28:40.381 INFO:tasks.workunit.client.1.smithi195.stdout:6/676: mkdir d5/d16/d45/df8 0 2024-03-22T07:28:40.383 INFO:tasks.workunit.client.0.smithi134.stdout:9/472: link d3/d9/d37/d5a/d6b/l93 d3/d9/df/d12/d3b/la6 0 2024-03-22T07:28:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:8/821: creat da/d82/dc6/ff9 x:0 0 0 2024-03-22T07:28:40.384 INFO:tasks.workunit.client.1.smithi195.stdout:8/822: chown da/d82/dc6/d53/d8d/la7 760 1 2024-03-22T07:28:40.386 INFO:tasks.workunit.client.0.smithi134.stdout:2/494: unlink d2/f3e 0 2024-03-22T07:28:40.386 INFO:tasks.workunit.client.0.smithi134.stdout:2/495: truncate d2/f80 1112288 0 2024-03-22T07:28:40.388 INFO:tasks.workunit.client.1.smithi195.stdout:7/755: truncate d0/d13/d14/d20/d40/d82/da0/f9f 269215 0 2024-03-22T07:28:40.389 INFO:tasks.workunit.client.0.smithi134.stdout:5/562: dread d1/d8/f72 [0,4194304] 0 2024-03-22T07:28:40.389 INFO:tasks.workunit.client.0.smithi134.stdout:5/563: write d1/d8/f63 [515234,91417] 0 2024-03-22T07:28:40.389 INFO:tasks.workunit.client.0.smithi134.stdout:5/564: fsync d1/d8/d20/d62/d65/d82/da2/f6d 0 2024-03-22T07:28:40.391 INFO:tasks.workunit.client.1.smithi195.stdout:4/757: mknod d13/d15/d6b/dd0/c103 0 2024-03-22T07:28:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/628: symlink d0/d2/d27/d91/dc8/da4/lcc 0 2024-03-22T07:28:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:1/629: chown d0/d2/d6/dad/db1/d97/d39/d64/d7a/l87 2961 1 2024-03-22T07:28:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/823: write da/d17/d32/f58 [1851877,24903] 0 2024-03-22T07:28:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/824: fsync da/d82/dc6/f93 0 2024-03-22T07:28:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/825: readlink da/de/l52 0 2024-03-22T07:28:40.394 INFO:tasks.workunit.client.1.smithi195.stdout:8/826: write da/de/db3/ddd/fa0 [294824,33850] 0 2024-03-22T07:28:40.399 INFO:tasks.workunit.client.0.smithi134.stdout:8/667: rename d1/d15/d42/d12/d20/d69/lc7 to d1/d15/d42/d76/d8f/dad/ld9 0 2024-03-22T07:28:40.399 INFO:tasks.workunit.client.0.smithi134.stdout:8/668: write d1/d46/f9c [320688,34048] 0 2024-03-22T07:28:40.401 INFO:tasks.workunit.client.1.smithi195.stdout:2/761: mknod d2/d3/d21/d60/d81/da8/ded/c100 0 2024-03-22T07:28:40.401 INFO:tasks.workunit.client.1.smithi195.stdout:2/762: fdatasync d2/d3/d7/d19/d22/d26/fd4 0 2024-03-22T07:28:40.401 INFO:tasks.workunit.client.1.smithi195.stdout:1/630: dread d0/d2/f1b [4194304,4194304] 0 2024-03-22T07:28:40.404 INFO:tasks.workunit.client.1.smithi195.stdout:9/896: creat d2/d4/d32/d102/f146 x:0 0 0 2024-03-22T07:28:40.406 INFO:tasks.workunit.client.1.smithi195.stdout:6/677: truncate d5/d16/f48 73152 0 2024-03-22T07:28:40.406 INFO:tasks.workunit.client.1.smithi195.stdout:6/678: write d5/d5e/d34/d55/d3b/d6e/d97/fed [460227,30651] 0 2024-03-22T07:28:40.406 INFO:tasks.workunit.client.1.smithi195.stdout:6/679: readlink d5/d5e/d34/d55/l19 0 2024-03-22T07:28:40.412 INFO:tasks.workunit.client.1.smithi195.stdout:7/756: truncate d0/d13/f1c 976807 0 2024-03-22T07:28:40.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/680: dread d5/d16/d45/d53/d59/d87/f94 [0,4194304] 0 2024-03-22T07:28:40.413 INFO:tasks.workunit.client.1.smithi195.stdout:6/681: fsync d5/d16/f43 0 2024-03-22T07:28:40.414 INFO:tasks.workunit.client.1.smithi195.stdout:8/827: dwrite da/d82/dc6/d53/f5e [0,4194304] 0 2024-03-22T07:28:40.417 INFO:tasks.workunit.client.1.smithi195.stdout:4/758: rename d13/d63/d79/dcd/la9 to d13/d15/d64/l104 0 2024-03-22T07:28:40.417 INFO:tasks.workunit.client.1.smithi195.stdout:4/759: creat d13/d63/d79/de9/d7e/dd6/f105 x:0 0 0 2024-03-22T07:28:40.418 INFO:tasks.workunit.client.1.smithi195.stdout:9/897: dwrite d2/d4/d32/d6d/f89 [0,4194304] 0 2024-03-22T07:28:40.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/753: getdents d3/df/d15/d1d/d5c 0 2024-03-22T07:28:40.422 INFO:tasks.workunit.client.1.smithi195.stdout:3/754: chown d3/df/d50/lae 4018343 1 2024-03-22T07:28:40.424 INFO:tasks.workunit.client.1.smithi195.stdout:2/763: symlink d2/d3/d21/d60/d81/da8/ded/l101 0 2024-03-22T07:28:40.424 INFO:tasks.workunit.client.1.smithi195.stdout:2/764: creat d2/d3/d21/f102 x:0 0 0 2024-03-22T07:28:40.426 INFO:tasks.workunit.client.1.smithi195.stdout:1/631: rmdir d0/d2/d6 39 2024-03-22T07:28:40.426 INFO:tasks.workunit.client.1.smithi195.stdout:1/632: stat d0/d2/d27/d91/dc8 0 2024-03-22T07:28:40.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/757: creat d0/d13/d14/d5b/f105 x:0 0 0 2024-03-22T07:28:40.428 INFO:tasks.workunit.client.1.smithi195.stdout:7/758: creat d0/d13/d14/d80/f106 x:0 0 0 2024-03-22T07:28:40.433 INFO:tasks.workunit.client.0.smithi134.stdout:9/473: truncate d3/d9/d37/d6f/f99 149432 0 2024-03-22T07:28:40.435 INFO:tasks.workunit.client.0.smithi134.stdout:2/496: write d2/d5/d8/f5a [329852,128887] 0 2024-03-22T07:28:40.435 INFO:tasks.workunit.client.0.smithi134.stdout:2/497: chown d2/f58 807 1 2024-03-22T07:28:40.437 INFO:tasks.workunit.client.1.smithi195.stdout:8/828: creat da/d82/dc6/db4/ffa x:0 0 0 2024-03-22T07:28:40.437 INFO:tasks.workunit.client.1.smithi195.stdout:3/755: dwrite d3/dbf/f97 [0,4194304] 0 2024-03-22T07:28:40.438 INFO:tasks.workunit.client.0.smithi134.stdout:5/565: creat d1/d8/d20/d62/d68/d9c/fbf x:0 0 0 2024-03-22T07:28:40.441 INFO:tasks.workunit.client.0.smithi134.stdout:9/474: dread d3/d9/df/d12/f4c [0,4194304] 0 2024-03-22T07:28:40.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/669: read d1/d15/d42/d12/d20/f86 [584748,4175] 0 2024-03-22T07:28:40.442 INFO:tasks.workunit.client.1.smithi195.stdout:4/760: rename d13/d63/lc4 to d13/d63/d79/de9/dfd/l106 0 2024-03-22T07:28:40.446 INFO:tasks.workunit.client.0.smithi134.stdout:2/498: getdents d2/d5/d8/d31 0 2024-03-22T07:28:40.446 INFO:tasks.workunit.client.0.smithi134.stdout:2/499: readlink d2/d5/l2b 0 2024-03-22T07:28:40.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/566: mkdir d1/d8/d16/dbd/dc0 0 2024-03-22T07:28:40.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/567: truncate d1/d4/f94 709483 0 2024-03-22T07:28:40.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/568: readlink d1/d8/l91 0 2024-03-22T07:28:40.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/569: dread - d1/d8/d20/d62/d65/dac/fbb zero size 2024-03-22T07:28:40.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/570: stat d1/d8/d20/d62/d65/d82/c99 0 2024-03-22T07:28:40.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/584: sync 2024-03-22T07:28:40.451 INFO:tasks.workunit.client.0.smithi134.stdout:8/670: mkdir d1/d15/d42/d76/dda 0 2024-03-22T07:28:40.453 INFO:tasks.workunit.client.1.smithi195.stdout:9/898: symlink d2/d4/d6/dd1/d112/l147 0 2024-03-22T07:28:40.453 INFO:tasks.workunit.client.1.smithi195.stdout:9/899: dread - d2/d4/d32/f12e zero size 2024-03-22T07:28:40.457 INFO:tasks.workunit.client.1.smithi195.stdout:2/765: mknod d2/d3/d21/d60/d81/c103 0 2024-03-22T07:28:40.457 INFO:tasks.workunit.client.1.smithi195.stdout:2/766: fdatasync d2/d3/d7/d19/d22/d26/d99/dbf/fcf 0 2024-03-22T07:28:40.458 INFO:tasks.workunit.client.0.smithi134.stdout:0/585: creat dc/de/d55/d65/fac x:0 0 0 2024-03-22T07:28:40.458 INFO:tasks.workunit.client.0.smithi134.stdout:0/586: chown dc/d17/da9 1151 1 2024-03-22T07:28:40.460 INFO:tasks.workunit.client.1.smithi195.stdout:1/633: unlink d0/d2/d6/dad/db1/f77 0 2024-03-22T07:28:40.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/475: getdents d3/d9/df/d57/d67/d5f 0 2024-03-22T07:28:40.463 INFO:tasks.workunit.client.1.smithi195.stdout:5/811: sync 2024-03-22T07:28:40.465 INFO:tasks.workunit.client.0.smithi134.stdout:8/671: rename d1/d15/d42/d76/d8f/dad/db1 to d1/d15/d42/d25/d6f/ddb 0 2024-03-22T07:28:40.467 INFO:tasks.workunit.client.1.smithi195.stdout:7/759: truncate d0/d13/d14/d2f/fdf 31468 0 2024-03-22T07:28:40.469 INFO:tasks.workunit.client.0.smithi134.stdout:0/587: readlink dc/d18/l30 0 2024-03-22T07:28:40.470 INFO:tasks.workunit.client.1.smithi195.stdout:8/829: mkdir da/d17/d32/d61/dc2/dfb 0 2024-03-22T07:28:40.471 INFO:tasks.workunit.client.0.smithi134.stdout:9/476: fdatasync d3/f14 0 2024-03-22T07:28:40.474 INFO:tasks.workunit.client.0.smithi134.stdout:8/672: unlink d1/d4/c34 0 2024-03-22T07:28:40.474 INFO:tasks.workunit.client.0.smithi134.stdout:8/673: fsync d1/d15/d57/d79/fba 0 2024-03-22T07:28:40.474 INFO:tasks.workunit.client.1.smithi195.stdout:3/756: read d3/f58 [233344,127841] 0 2024-03-22T07:28:40.476 INFO:tasks.workunit.client.0.smithi134.stdout:8/674: link d1/d15/d42/d12/l97 d1/d15/d57/d8c/da4/ldc 0 2024-03-22T07:28:40.480 INFO:tasks.workunit.client.0.smithi134.stdout:9/477: getdents d3/d9/d37/d6f 0 2024-03-22T07:28:40.481 INFO:tasks.workunit.client.1.smithi195.stdout:9/900: creat d2/f148 x:0 0 0 2024-03-22T07:28:40.483 INFO:tasks.workunit.client.0.smithi134.stdout:2/500: dwrite d2/f40 [0,4194304] 0 2024-03-22T07:28:40.483 INFO:tasks.workunit.client.0.smithi134.stdout:2/501: read d2/d5/d8/d5d/d5f/f6f [306420,19131] 0 2024-03-22T07:28:40.484 INFO:tasks.workunit.client.1.smithi195.stdout:7/760: dread d0/d13/d14/d20/f78 [0,4194304] 0 2024-03-22T07:28:40.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/478: symlink d3/d9/la7 0 2024-03-22T07:28:40.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/767: dwrite d2/d3/d7/d5c/f6c [0,4194304] 0 2024-03-22T07:28:40.485 INFO:tasks.workunit.client.0.smithi134.stdout:0/588: dread dc/d18/f1d [4194304,4194304] 0 2024-03-22T07:28:40.487 INFO:tasks.workunit.client.0.smithi134.stdout:8/675: dread d1/d15/d42/d25/d6f/ddb/f52 [0,4194304] 0 2024-03-22T07:28:40.487 INFO:tasks.workunit.client.1.smithi195.stdout:1/634: mknod d0/d2/d27/d91/dc8/dba/ccd 0 2024-03-22T07:28:40.487 INFO:tasks.workunit.client.1.smithi195.stdout:5/812: creat d9/d12/d1d/d69/d101/f103 x:0 0 0 2024-03-22T07:28:40.489 INFO:tasks.workunit.client.0.smithi134.stdout:5/571: write d1/d8/f21 [989479,113309] 0 2024-03-22T07:28:40.492 INFO:tasks.workunit.client.1.smithi195.stdout:3/757: creat d3/dbf/ff7 x:0 0 0 2024-03-22T07:28:40.492 INFO:tasks.workunit.client.1.smithi195.stdout:8/830: dwrite da/d82/dc6/ff9 [0,4194304] 0 2024-03-22T07:28:40.493 INFO:tasks.workunit.client.1.smithi195.stdout:8/831: chown da/dde 18 1 2024-03-22T07:28:40.493 INFO:tasks.workunit.client.0.smithi134.stdout:2/502: mkdir d2/d5/d8/d5d/d5f/d9d/d3c/d4f/d6e/d9e 0 2024-03-22T07:28:40.493 INFO:tasks.workunit.client.0.smithi134.stdout:2/503: write d2/d5/d8/d5d/f90 [534101,689] 0 2024-03-22T07:28:40.495 INFO:tasks.workunit.client.1.smithi195.stdout:7/761: mknod d0/d13/d14/d20/d40/d82/da0/d59/c107 0 2024-03-22T07:28:40.497 INFO:tasks.workunit.client.0.smithi134.stdout:9/479: creat d3/d9/d37/d3c/d71/fa8 x:0 0 0 2024-03-22T07:28:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:2/768: creat d2/d3/db/d82/f104 x:0 0 0 2024-03-22T07:28:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:2/769: chown d2/d3/dac/dad/cb0 1 1 2024-03-22T07:28:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:8/832: dread da/d82/dc6/f54 [0,4194304] 0 2024-03-22T07:28:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:8/833: dread - da/d17/d32/d61/fcb zero size 2024-03-22T07:28:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:9/901: dwrite d2/d4/d6/d18/f44 [0,4194304] 0 2024-03-22T07:28:40.503 INFO:tasks.workunit.client.1.smithi195.stdout:9/902: chown d2/d4/d6/f110 0 1 2024-03-22T07:28:40.504 INFO:tasks.workunit.client.0.smithi134.stdout:8/676: link d1/d4/d38/l56 d1/d15/d42/d9e/dbd/ldd 0 2024-03-22T07:28:40.505 INFO:tasks.workunit.client.0.smithi134.stdout:8/677: chown d1/d46 75 1 2024-03-22T07:28:40.506 INFO:tasks.workunit.client.1.smithi195.stdout:1/635: creat d0/d2/d27/d91/dc8/da4/dc0/fce x:0 0 0 2024-03-22T07:28:40.506 INFO:tasks.workunit.client.1.smithi195.stdout:0/750: sync 2024-03-22T07:28:40.509 INFO:tasks.workunit.client.1.smithi195.stdout:3/758: dwrite d3/dbf/fd6 [0,4194304] 0 2024-03-22T07:28:40.509 INFO:tasks.workunit.client.1.smithi195.stdout:5/813: creat d9/d2d/d84/f104 x:0 0 0 2024-03-22T07:28:40.511 INFO:tasks.workunit.client.0.smithi134.stdout:2/504: symlink d2/d5/d22/l9f 0 2024-03-22T07:28:40.511 INFO:tasks.workunit.client.0.smithi134.stdout:2/505: truncate d2/d5/d8/d5d/d5f/d9d/d3c/d60/f72 649712 0 2024-03-22T07:28:40.511 INFO:tasks.workunit.client.0.smithi134.stdout:2/506: write d2/f1a [756160,117869] 0 2024-03-22T07:28:40.513 INFO:tasks.workunit.client.1.smithi195.stdout:6/682: write d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/fdb [1152624,50928] 0 2024-03-22T07:28:40.513 INFO:tasks.workunit.client.1.smithi195.stdout:6/683: fdatasync d5/d5e/d34/d55/f3e 0 2024-03-22T07:28:40.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/589: symlink dc/d18/d85/lad 0 2024-03-22T07:28:40.515 INFO:tasks.workunit.client.1.smithi195.stdout:3/759: dread f0 [0,4194304] 0 2024-03-22T07:28:40.518 INFO:tasks.workunit.client.0.smithi134.stdout:9/480: dwrite d3/d9/df/d12/f58 [0,4194304] 0 2024-03-22T07:28:40.518 INFO:tasks.workunit.client.0.smithi134.stdout:9/481: creat d3/d9/df/d57/fa9 x:0 0 0 2024-03-22T07:28:40.522 INFO:tasks.workunit.client.1.smithi195.stdout:7/762: unlink d0/d13/d14/f8 0 2024-03-22T07:28:40.525 INFO:tasks.workunit.client.0.smithi134.stdout:5/572: rmdir d1/d8/d20/d62/d65/d95 39 2024-03-22T07:28:40.527 INFO:tasks.workunit.client.1.smithi195.stdout:2/770: mkdir d2/d3/d24/d105 0 2024-03-22T07:28:40.529 INFO:tasks.workunit.client.1.smithi195.stdout:8/834: mknod da/d17/d32/d78/cfc 0 2024-03-22T07:28:40.529 INFO:tasks.workunit.client.1.smithi195.stdout:8/835: chown da/f4f 20 1 2024-03-22T07:28:40.529 INFO:tasks.workunit.client.0.smithi134.stdout:2/507: chown d2/d5/d8/cd 0 1 2024-03-22T07:28:40.534 INFO:tasks.workunit.client.0.smithi134.stdout:5/573: creat d1/d8/da1/fc1 x:0 0 0 2024-03-22T07:28:40.538 INFO:tasks.workunit.client.1.smithi195.stdout:0/751: truncate d1/d4/d12/d6c/dbc/d47/db6/f97 79832 0 2024-03-22T07:28:40.538 INFO:tasks.workunit.client.1.smithi195.stdout:8/836: dread da/dc/d71/f80 [0,4194304] 0 2024-03-22T07:28:40.539 INFO:tasks.workunit.client.1.smithi195.stdout:8/837: fsync da/de/db3/ddd/fc4 0 2024-03-22T07:28:40.539 INFO:tasks.workunit.client.1.smithi195.stdout:8/838: write da/d17/d32/f7e [862431,80784] 0 2024-03-22T07:28:40.539 INFO:tasks.workunit.client.0.smithi134.stdout:5/574: creat d1/d8/d16/dbd/fc2 x:0 0 0 2024-03-22T07:28:40.539 INFO:tasks.workunit.client.0.smithi134.stdout:5/575: write d1/d8/da1/fc1 [446628,57659] 0 2024-03-22T07:28:40.540 INFO:tasks.workunit.client.1.smithi195.stdout:1/636: dwrite d0/d2/d6/f62 [4194304,4194304] 0 2024-03-22T07:28:40.540 INFO:tasks.workunit.client.1.smithi195.stdout:1/637: chown d0/d2/d6/dad/db1/d97/d39/d64/fc3 94 1 2024-03-22T07:28:40.541 INFO:tasks.workunit.client.0.smithi134.stdout:8/678: dwrite d1/f5d [0,4194304] 0 2024-03-22T07:28:40.541 INFO:tasks.workunit.client.0.smithi134.stdout:5/576: read d1/d8/f63 [381797,127260] 0 2024-03-22T07:28:40.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/760: dwrite d3/df/d15/d1d/d5c/fe5 [0,4194304] 0 2024-03-22T07:28:40.543 INFO:tasks.workunit.client.1.smithi195.stdout:5/814: rename d9/d12/d1d/d36/l5c to d9/d12/d1d/d36/d7d/dd2/dfc/l105 0 2024-03-22T07:28:40.545 INFO:tasks.workunit.client.0.smithi134.stdout:9/482: dwrite f0 [0,4194304] 0 2024-03-22T07:28:40.545 INFO:tasks.workunit.client.0.smithi134.stdout:9/483: chown d3/d9/d37/d5a/d7f/d80/f87 276472490 1 2024-03-22T07:28:40.545 INFO:tasks.workunit.client.1.smithi195.stdout:6/684: symlink d5/d16/d45/df8/lf9 0 2024-03-22T07:28:40.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/763: symlink d0/d13/d14/d2f/dae/dc3/l108 0 2024-03-22T07:28:40.548 INFO:tasks.workunit.client.1.smithi195.stdout:7/764: chown d0/d13/d14/d20/d40 2222 1 2024-03-22T07:28:40.548 INFO:tasks.workunit.client.0.smithi134.stdout:2/508: dwrite d2/d5/d8/f88 [0,4194304] 0 2024-03-22T07:28:40.548 INFO:tasks.workunit.client.0.smithi134.stdout:2/509: fsync d2/d5/d8/d5d/d5f/f6f 0 2024-03-22T07:28:40.552 INFO:tasks.workunit.client.1.smithi195.stdout:9/903: rmdir d2/d4/d6/dd1 39 2024-03-22T07:28:40.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/679: write d1/d15/d42/d76/f78 [2715958,98825] 0 2024-03-22T07:28:40.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/680: write d1/d15/d42/d12/f7a [4230880,30366] 0 2024-03-22T07:28:40.552 INFO:tasks.workunit.client.0.smithi134.stdout:8/681: dread - d1/f82 zero size 2024-03-22T07:28:40.555 INFO:tasks.workunit.client.1.smithi195.stdout:8/839: mkdir da/dde/dfd 0 2024-03-22T07:28:40.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/638: creat d0/d2/d6/dad/db1/d97/d39/fcf x:0 0 0 2024-03-22T07:28:40.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/639: truncate d0/d2/d6/dad/db1/d97/d39/fa9 977471 0 2024-03-22T07:28:40.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/640: fdatasync d0/d2/d6/dad/db1/d97/d39/d64/d7a/f57 0 2024-03-22T07:28:40.560 INFO:tasks.workunit.client.1.smithi195.stdout:1/641: chown d0/d2/d6/dad/db1/d97/d39/d64/fc3 1941179 1 2024-03-22T07:28:40.562 INFO:tasks.workunit.client.1.smithi195.stdout:4/761: sync 2024-03-22T07:28:40.567 INFO:tasks.workunit.client.0.smithi134.stdout:5/577: symlink d1/d8/d20/d62/lc3 0 2024-03-22T07:28:40.567 INFO:tasks.workunit.client.1.smithi195.stdout:8/840: dwrite da/f6b [0,4194304] 0 2024-03-22T07:28:40.569 INFO:tasks.workunit.client.1.smithi195.stdout:3/761: symlink d3/df/d15/d1d/d5c/d47/dbb/lf8 0 2024-03-22T07:28:40.572 INFO:tasks.workunit.client.1.smithi195.stdout:4/762: write d13/d15/f22 [3852399,18793] 0 2024-03-22T07:28:40.572 INFO:tasks.workunit.client.1.smithi195.stdout:2/771: rename d2/d3/d7/da/lc6 to d2/d1e/d93/l106 0 2024-03-22T07:28:40.575 INFO:tasks.workunit.client.1.smithi195.stdout:6/685: creat d5/ffa x:0 0 0 2024-03-22T07:28:40.576 INFO:tasks.workunit.client.1.smithi195.stdout:3/762: read d3/dbf/f97 [974967,99142] 0 2024-03-22T07:28:40.577 INFO:tasks.workunit.client.0.smithi134.stdout:2/510: write d2/d5/d8/f1b [1120451,20835] 0 2024-03-22T07:28:40.581 INFO:tasks.workunit.client.0.smithi134.stdout:8/682: rename d1/d15/d42/d76/fd0 to d1/fde 0 2024-03-22T07:28:40.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/578: truncate d1/d8/d20/d62/d68/f97 585517 0 2024-03-22T07:28:40.585 INFO:tasks.workunit.client.0.smithi134.stdout:5/579: truncate d1/d8/d20/d62/d65/d82/f9b 518281 0 2024-03-22T07:28:40.588 INFO:tasks.workunit.client.1.smithi195.stdout:8/841: truncate da/de/f2d 1126020 0 2024-03-22T07:28:40.591 INFO:tasks.workunit.client.0.smithi134.stdout:9/484: rmdir d3/d9/d37/d3c/d71 39 2024-03-22T07:28:40.591 INFO:tasks.workunit.client.0.smithi134.stdout:9/485: fdatasync d3/d9/df/d12/d3b/f42 0 2024-03-22T07:28:40.592 INFO:tasks.workunit.client.0.smithi134.stdout:9/486: getdents d3/d9/d37/d5a/d89 0 2024-03-22T07:28:40.593 INFO:tasks.workunit.client.0.smithi134.stdout:9/487: read d3/d9/d37/f47 [1182292,2961] 0 2024-03-22T07:28:40.593 INFO:tasks.workunit.client.0.smithi134.stdout:9/488: creat d3/d9/d37/d5a/faa x:0 0 0 2024-03-22T07:28:40.593 INFO:tasks.workunit.client.0.smithi134.stdout:9/489: write d3/d9/d37/d6f/f29 [8530356,22044] 0 2024-03-22T07:28:40.594 INFO:tasks.workunit.client.1.smithi195.stdout:4/763: symlink d13/d63/d79/de9/d7e/d85/l107 0 2024-03-22T07:28:40.597 INFO:tasks.workunit.client.0.smithi134.stdout:2/511: mknod d2/d5/d8/d5d/d5f/d9d/ca0 0 2024-03-22T07:28:40.597 INFO:tasks.workunit.client.0.smithi134.stdout:2/512: write d2/d5/d8/d5d/d5f/d9d/f4b [2009737,85792] 0 2024-03-22T07:28:40.601 INFO:tasks.workunit.client.0.smithi134.stdout:8/683: rename d1/d15/d57/d79/cb7 to d1/d15/d5b/cdf 0 2024-03-22T07:28:40.601 INFO:tasks.workunit.client.1.smithi195.stdout:2/772: symlink d2/d3/d7/l107 0 2024-03-22T07:28:40.602 INFO:tasks.workunit.client.1.smithi195.stdout:2/773: chown d2/d3/d7/da 0 1 2024-03-22T07:28:40.603 INFO:tasks.workunit.client.1.smithi195.stdout:6/686: symlink d5/d6d/d95/lfb 0 2024-03-22T07:28:40.603 INFO:tasks.workunit.client.1.smithi195.stdout:6/687: creat d5/d16/d45/d53/d59/d87/ffc x:0 0 0 2024-03-22T07:28:40.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/763: dwrite d3/df/d15/d1d/d5c/f83 [0,4194304] 0 2024-03-22T07:28:40.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/764: dread - d3/df/d50/fcf zero size 2024-03-22T07:28:40.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/765: dread d3/d22/f8a [0,4194304] 0 2024-03-22T07:28:40.606 INFO:tasks.workunit.client.1.smithi195.stdout:3/766: stat d3/d18/ff2 0 2024-03-22T07:28:40.607 INFO:tasks.workunit.client.0.smithi134.stdout:8/684: link d1/d15/d57/d79/l95 d1/le0 0 2024-03-22T07:28:40.607 INFO:tasks.workunit.client.0.smithi134.stdout:9/490: dread d3/d9/df/d12/f2f [0,4194304] 0 2024-03-22T07:28:40.607 INFO:tasks.workunit.client.1.smithi195.stdout:7/765: rmdir d0/d13/d22/d28 39 2024-03-22T07:28:40.610 INFO:tasks.workunit.client.0.smithi134.stdout:8/685: mkdir d1/d15/d42/d76/de1 0 2024-03-22T07:28:40.610 INFO:tasks.workunit.client.0.smithi134.stdout:8/686: chown d1/d15/d42/d25/d6f/ddb/ca8 91466470 1 2024-03-22T07:28:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:4/764: dread d13/d63/d79/de9/d7e/fb6 [0,4194304] 0 2024-03-22T07:28:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:4/765: readlink d13/d63/d79/de9/l30 0 2024-03-22T07:28:40.611 INFO:tasks.workunit.client.1.smithi195.stdout:2/774: write d2/d3/d21/ddd/ff1 [93629,108635] 0 2024-03-22T07:28:40.612 INFO:tasks.workunit.client.0.smithi134.stdout:8/687: creat d1/dce/fe2 x:0 0 0 2024-03-22T07:28:40.612 INFO:tasks.workunit.client.0.smithi134.stdout:8/688: chown d1/d15/d42/cd6 656827 1 2024-03-22T07:28:40.614 INFO:tasks.workunit.client.0.smithi134.stdout:2/513: fdatasync d2/d5/d8/d5d/d5f/d9d/f4b 0 2024-03-22T07:28:40.614 INFO:tasks.workunit.client.0.smithi134.stdout:2/514: dread - d2/d5/d8/d5d/d5f/d9d/d3c/f69 zero size 2024-03-22T07:28:40.616 INFO:tasks.workunit.client.0.smithi134.stdout:8/689: rename d1/d15/d57/d8c/d9a to d1/d15/d7b/d83/de3 0 2024-03-22T07:28:40.616 INFO:tasks.workunit.client.0.smithi134.stdout:8/690: read - d1/d15/d42/fa7 zero size 2024-03-22T07:28:40.616 INFO:tasks.workunit.client.0.smithi134.stdout:9/491: read f0 [1556194,52896] 0 2024-03-22T07:28:40.617 INFO:tasks.workunit.client.0.smithi134.stdout:9/492: chown d3/d9/d37/d70/c97 0 1 2024-03-22T07:28:40.617 INFO:tasks.workunit.client.0.smithi134.stdout:9/493: readlink d3/d9/d37/d5a/d6b/l93 0 2024-03-22T07:28:40.618 INFO:tasks.workunit.client.0.smithi134.stdout:4/588: sync 2024-03-22T07:28:40.618 INFO:tasks.workunit.client.0.smithi134.stdout:4/589: truncate d2/d25/d48/d6e/d7b/f8e 4627665 0 2024-03-22T07:28:40.618 INFO:tasks.workunit.client.0.smithi134.stdout:4/590: creat d2/d2a/d80/fd0 x:0 0 0 2024-03-22T07:28:40.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/580: dwrite d1/d8/d20/d8a/f51 [0,4194304] 0 2024-03-22T07:28:40.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/581: fsync d1/d8/d20/d62/d65/d82/fb6 0 2024-03-22T07:28:40.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/582: write d1/d8/d20/d62/d65/d82/fbc [379518,83551] 0 2024-03-22T07:28:40.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/691: creat d1/d15/d42/d12/d20/fe4 x:0 0 0 2024-03-22T07:28:40.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/692: write d1/d4/f22 [2180674,118144] 0 2024-03-22T07:28:40.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/693: truncate d1/d4/d6e/f73 4539526 0 2024-03-22T07:28:40.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/688: dread d5/d16/d45/d53/d59/d87/fb6 [0,4194304] 0 2024-03-22T07:28:40.622 INFO:tasks.workunit.client.1.smithi195.stdout:8/842: dwrite da/d17/d32/f7e [0,4194304] 0 2024-03-22T07:28:40.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/689: chown d5/d5e/d34/d55/d3b/d6e/d3c/l9e 1702305 1 2024-03-22T07:28:40.622 INFO:tasks.workunit.client.1.smithi195.stdout:6/690: write d5/d5e/d34/d55/d3b/d6e/ff3 [448116,47922] 0 2024-03-22T07:28:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/766: dwrite d13/d63/d79/de9/f88 [0,4194304] 0 2024-03-22T07:28:40.624 INFO:tasks.workunit.client.1.smithi195.stdout:4/767: write d13/d63/d79/d68/fc2 [406666,47661] 0 2024-03-22T07:28:40.624 INFO:tasks.workunit.client.0.smithi134.stdout:9/494: rename d3/d9/d37/d6f/f99 to d3/d9/d37/d5a/d7f/d80/fab 0 2024-03-22T07:28:40.625 INFO:tasks.workunit.client.1.smithi195.stdout:8/843: write da/d17/d32/d61/d88/d91/f9f [1841607,87406] 0 2024-03-22T07:28:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/691: write d5/d16/f43 [1392937,36482] 0 2024-03-22T07:28:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:6/692: write d5/d16/dd8/fe5 [749712,108385] 0 2024-03-22T07:28:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:8/844: write da/dc/f6e [651106,8055] 0 2024-03-22T07:28:40.626 INFO:tasks.workunit.client.1.smithi195.stdout:8/845: chown da/d17/fc5 17237 1 2024-03-22T07:28:40.627 INFO:tasks.workunit.client.1.smithi195.stdout:3/767: mkdir d3/d18/d89/d76/def/df9 0 2024-03-22T07:28:40.628 INFO:tasks.workunit.client.0.smithi134.stdout:4/591: mknod d2/d15/d35/da8/cd1 0 2024-03-22T07:28:40.628 INFO:tasks.workunit.client.0.smithi134.stdout:4/592: readlink d2/d25/l31 0 2024-03-22T07:28:40.629 INFO:tasks.workunit.client.0.smithi134.stdout:4/593: dread - d2/d25/d48/fba zero size 2024-03-22T07:28:40.629 INFO:tasks.workunit.client.1.smithi195.stdout:7/766: mkdir d0/d13/d14/d80/d109 0 2024-03-22T07:28:40.629 INFO:tasks.workunit.client.1.smithi195.stdout:7/767: chown d0/d13/d14/f30 24 1 2024-03-22T07:28:40.631 INFO:tasks.workunit.client.1.smithi195.stdout:4/768: write d13/d63/f18 [3517077,62341] 0 2024-03-22T07:28:40.634 INFO:tasks.workunit.client.0.smithi134.stdout:2/515: dwrite d2/f40 [0,4194304] 0 2024-03-22T07:28:40.635 INFO:tasks.workunit.client.1.smithi195.stdout:2/775: link d2/d3/d7/d19/c7f d2/d3/d21/d60/d81/dfd/c108 0 2024-03-22T07:28:40.637 INFO:tasks.workunit.client.0.smithi134.stdout:9/495: dread d3/d9/d37/d6f/d54/f83 [4194304,4194304] 0 2024-03-22T07:28:40.638 INFO:tasks.workunit.client.1.smithi195.stdout:4/769: dread d13/d63/d79/de9/f2e [0,4194304] 0 2024-03-22T07:28:40.638 INFO:tasks.workunit.client.1.smithi195.stdout:4/770: chown d13/d63/f6a 1240722 1 2024-03-22T07:28:40.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/594: mknod d2/d25/cd2 0 2024-03-22T07:28:40.640 INFO:tasks.workunit.client.0.smithi134.stdout:4/595: write d2/d15/d35/d37/fc3 [744972,76677] 0 2024-03-22T07:28:40.644 INFO:tasks.workunit.client.1.smithi195.stdout:6/693: mknod d5/d5e/d34/d55/d3b/d6e/d56/d8f/cfd 0 2024-03-22T07:28:40.646 INFO:tasks.workunit.client.1.smithi195.stdout:8/846: link da/d82/dc6/c5d da/d82/dc6/db4/cfe 0 2024-03-22T07:28:40.646 INFO:tasks.workunit.client.0.smithi134.stdout:2/516: truncate d2/d5/d8/f42 361777 0 2024-03-22T07:28:40.646 INFO:tasks.workunit.client.0.smithi134.stdout:2/517: fdatasync d2/d5/d8/f88 0 2024-03-22T07:28:40.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/768: mknod d3/dbf/da0/dd1/cfa 0 2024-03-22T07:28:40.648 INFO:tasks.workunit.client.1.smithi195.stdout:3/769: dread - d3/df/d15/d1d/d5c/d47/d67/d80/f8f zero size 2024-03-22T07:28:40.651 INFO:tasks.workunit.client.1.smithi195.stdout:7/768: creat d0/d13/d14/d20/d40/d82/da0/d59/f10a x:0 0 0 2024-03-22T07:28:40.652 INFO:tasks.workunit.client.1.smithi195.stdout:7/769: fsync d0/f91 0 2024-03-22T07:28:40.654 INFO:tasks.workunit.client.1.smithi195.stdout:0/752: rename d1/d4/d12/d6c/dbd to d1/d10/d1f/de3 0 2024-03-22T07:28:40.654 INFO:tasks.workunit.client.1.smithi195.stdout:0/753: stat d1/d4/c23 0 2024-03-22T07:28:40.659 INFO:tasks.workunit.client.1.smithi195.stdout:2/776: link d2/d3/d7/da/d1b/d98/lb9 d2/d3/d21/dca/l109 0 2024-03-22T07:28:40.662 INFO:tasks.workunit.client.1.smithi195.stdout:4/771: truncate d13/d15/faf 151611 0 2024-03-22T07:28:40.662 INFO:tasks.workunit.client.1.smithi195.stdout:4/772: write d13/d63/d36/d9e/faa [2361841,89274] 0 2024-03-22T07:28:40.663 INFO:tasks.workunit.client.1.smithi195.stdout:6/694: unlink d5/d5e/d34/d55/f3e 0 2024-03-22T07:28:40.664 INFO:tasks.workunit.client.1.smithi195.stdout:8/847: mkdir da/d82/dc6/d53/dff 0 2024-03-22T07:28:40.665 INFO:tasks.workunit.client.0.smithi134.stdout:9/496: link d3/d9/d37/d6f/f2e d3/d9/d37/d70/fac 0 2024-03-22T07:28:40.667 INFO:tasks.workunit.client.0.smithi134.stdout:8/694: getdents d1/d46/d75/d8b/db4 0 2024-03-22T07:28:40.667 INFO:tasks.workunit.client.0.smithi134.stdout:8/695: dread - d1/d15/d42/d25/d6f/ddb/fac zero size 2024-03-22T07:28:40.669 INFO:tasks.workunit.client.1.smithi195.stdout:5/815: rename d9/d12/d1d/d36/d7d/dd2/dfc/f85 to d9/d73/dbb/f106 0 2024-03-22T07:28:40.671 INFO:tasks.workunit.client.0.smithi134.stdout:4/596: unlink d2/d15/d35/ccb 0 2024-03-22T07:28:40.671 INFO:tasks.workunit.client.0.smithi134.stdout:4/597: write d2/d2a/d80/f9c [5163579,6434] 0 2024-03-22T07:28:40.671 INFO:tasks.workunit.client.0.smithi134.stdout:4/598: readlink d2/d2a/l45 0 2024-03-22T07:28:40.672 INFO:tasks.workunit.client.1.smithi195.stdout:0/754: truncate d1/d10/d19/d20/f61 1881416 0 2024-03-22T07:28:40.675 INFO:tasks.workunit.client.1.smithi195.stdout:3/770: dwrite d3/dbf/da0/fd3 [0,4194304] 0 2024-03-22T07:28:40.676 INFO:tasks.workunit.client.0.smithi134.stdout:8/696: rename d1/d15/d42/fa7 to d1/d15/d42/d12/d2a/fe5 0 2024-03-22T07:28:40.677 INFO:tasks.workunit.client.1.smithi195.stdout:2/777: symlink d2/d3/d7/da/d1b/d98/l10a 0 2024-03-22T07:28:40.682 INFO:tasks.workunit.client.1.smithi195.stdout:4/773: mkdir d13/d63/d79/de9/d7e/d8c/d108 0 2024-03-22T07:28:40.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/774: dread d13/d63/d79/de9/d7e/d8c/fcf [0,4194304] 0 2024-03-22T07:28:40.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/775: truncate d13/d63/d79/de9/d7e/dd6/ff9 574123 0 2024-03-22T07:28:40.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/776: fdatasync d13/d63/d3e/d5c/f69 0 2024-03-22T07:28:40.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/777: truncate d13/d63/d79/de9/d7e/d8c/dd2/fde 544159 0 2024-03-22T07:28:40.684 INFO:tasks.workunit.client.1.smithi195.stdout:4/778: write d13/d63/d3e/d5c/d65/fd3 [4717059,30555] 0 2024-03-22T07:28:40.685 INFO:tasks.workunit.client.0.smithi134.stdout:9/497: dwrite d3/d9/d37/f47 [0,4194304] 0 2024-03-22T07:28:40.685 INFO:tasks.workunit.client.0.smithi134.stdout:9/498: chown d3/d9/d37/d5a/d6b/l93 629704 1 2024-03-22T07:28:40.687 INFO:tasks.workunit.client.0.smithi134.stdout:8/697: mkdir d1/d15/d7b/d83/de3/da2/de6 0 2024-03-22T07:28:40.688 INFO:tasks.workunit.client.1.smithi195.stdout:9/904: sync 2024-03-22T07:28:40.689 INFO:tasks.workunit.client.1.smithi195.stdout:7/770: rmdir d0/d13/d14/d2f/dae 39 2024-03-22T07:28:40.689 INFO:tasks.workunit.client.1.smithi195.stdout:7/771: read - d0/d13/d14/d80/fd5 zero size 2024-03-22T07:28:40.692 INFO:tasks.workunit.client.1.smithi195.stdout:7/772: dread d0/d13/f1c [0,4194304] 0 2024-03-22T07:28:40.693 INFO:tasks.workunit.client.1.smithi195.stdout:1/642: rename d0/d2/d6/dad/db1/d6a to d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0 0 2024-03-22T07:28:40.694 INFO:tasks.workunit.client.1.smithi195.stdout:4/779: dread d13/f14 [0,4194304] 0 2024-03-22T07:28:40.696 INFO:tasks.workunit.client.1.smithi195.stdout:5/816: mknod d9/d12/d1d/d36/d7d/c107 0 2024-03-22T07:28:40.697 INFO:tasks.workunit.client.1.smithi195.stdout:0/755: dwrite d1/d4/dd/df/d44/d8d/fc8 [0,4194304] 0 2024-03-22T07:28:40.705 INFO:tasks.workunit.client.0.smithi134.stdout:9/499: getdents d3/d9/df/d12 0 2024-03-22T07:28:40.708 INFO:tasks.workunit.client.1.smithi195.stdout:4/780: dwrite d13/d63/d79/f4b [0,4194304] 0 2024-03-22T07:28:40.708 INFO:tasks.workunit.client.1.smithi195.stdout:4/781: readlink d13/d15/d6b/da6/ded/def/lf5 0 2024-03-22T07:28:40.708 INFO:tasks.workunit.client.0.smithi134.stdout:4/599: rename d2/d15/d66 to d2/d25/d48/dd3 0 2024-03-22T07:28:40.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/782: dread d13/d63/d79/de9/d7e/dd6/ff9 [0,4194304] 0 2024-03-22T07:28:40.709 INFO:tasks.workunit.client.1.smithi195.stdout:4/783: write d13/d63/d36/d5f/fb0 [122414,18530] 0 2024-03-22T07:28:40.710 INFO:tasks.workunit.client.0.smithi134.stdout:9/500: mknod d3/d9/cad 0 2024-03-22T07:28:40.712 INFO:tasks.workunit.client.0.smithi134.stdout:4/600: mkdir d2/d1d/dd4 0 2024-03-22T07:28:40.714 INFO:tasks.workunit.client.1.smithi195.stdout:0/756: dwrite d1/d4/dd/df/d44/d6f/dae/f86 [0,4194304] 0 2024-03-22T07:28:40.715 INFO:tasks.workunit.client.0.smithi134.stdout:9/501: dread d3/d9/f62 [0,4194304] 0 2024-03-22T07:28:40.715 INFO:tasks.workunit.client.0.smithi134.stdout:8/698: rename d1/d15/d42/d25/c40 to d1/d15/d7b/d83/de3/da2/ce7 0 2024-03-22T07:28:40.717 INFO:tasks.workunit.client.0.smithi134.stdout:4/601: creat d2/d15/d6f/fd5 x:0 0 0 2024-03-22T07:28:40.717 INFO:tasks.workunit.client.0.smithi134.stdout:4/602: dread - d2/d98/f99 zero size 2024-03-22T07:28:40.719 INFO:tasks.workunit.client.0.smithi134.stdout:9/502: mknod d3/d9/d37/cae 0 2024-03-22T07:28:40.724 INFO:tasks.workunit.client.0.smithi134.stdout:8/699: symlink d1/d15/d42/d76/d8f/dad/dae/le8 0 2024-03-22T07:28:40.726 INFO:tasks.workunit.client.0.smithi134.stdout:1/617: sync 2024-03-22T07:28:40.726 INFO:tasks.workunit.client.0.smithi134.stdout:3/537: sync 2024-03-22T07:28:40.729 INFO:tasks.workunit.client.1.smithi195.stdout:0/757: write d1/d10/d1f/f21 [1330908,115019] 0 2024-03-22T07:28:40.729 INFO:tasks.workunit.client.0.smithi134.stdout:8/700: creat d1/d46/dbf/fe9 x:0 0 0 2024-03-22T07:28:40.730 INFO:tasks.workunit.client.1.smithi195.stdout:6/695: dwrite d5/d5e/d34/d55/d4b/da2/d1a/f54 [0,4194304] 0 2024-03-22T07:28:40.734 INFO:tasks.workunit.client.0.smithi134.stdout:3/538: link d4/d22/f7c d4/d10/fb0 0 2024-03-22T07:28:40.739 INFO:tasks.workunit.client.0.smithi134.stdout:3/539: symlink d4/d8/d45/da9/lb1 0 2024-03-22T07:28:40.740 INFO:tasks.workunit.client.0.smithi134.stdout:9/503: dwrite d3/d9/d37/d3c/d71/d7a/fa5 [0,4194304] 0 2024-03-22T07:28:40.742 INFO:tasks.workunit.client.0.smithi134.stdout:4/603: rename d2/d1d to d2/d2a/d80/dd6 0 2024-03-22T07:28:40.744 INFO:tasks.workunit.client.1.smithi195.stdout:7/773: mknod d0/d13/d14/d29/d35/c10b 0 2024-03-22T07:28:40.745 INFO:tasks.workunit.client.1.smithi195.stdout:7/774: write d0/d13/d14/d80/d9c/fbb [765458,56487] 0 2024-03-22T07:28:40.745 INFO:tasks.workunit.client.1.smithi195.stdout:7/775: stat d0/d13/d14/l7f 0 2024-03-22T07:28:40.750 INFO:tasks.workunit.client.1.smithi195.stdout:8/848: rename da/d82/fb5 to da/d17/d32/f100 0 2024-03-22T07:28:40.753 INFO:tasks.workunit.client.1.smithi195.stdout:1/643: symlink d0/d2/d6/dad/db1/d97/d39/ld1 0 2024-03-22T07:28:40.754 INFO:tasks.workunit.client.0.smithi134.stdout:9/504: fsync d3/f72 0 2024-03-22T07:28:40.755 INFO:tasks.workunit.client.1.smithi195.stdout:5/817: mkdir d9/d73/d108 0 2024-03-22T07:28:40.756 INFO:tasks.workunit.client.0.smithi134.stdout:4/604: mkdir d2/d25/d48/d6e/d7b/dd7 0 2024-03-22T07:28:40.756 INFO:tasks.workunit.client.0.smithi134.stdout:4/605: stat d2/d25/d74/fb6 0 2024-03-22T07:28:40.759 INFO:tasks.workunit.client.0.smithi134.stdout:9/505: mkdir d3/d9/d37/d5a/d7f/daf 0 2024-03-22T07:28:40.759 INFO:tasks.workunit.client.0.smithi134.stdout:9/506: chown d3/d9/d37/d3c/d71/fa8 812 1 2024-03-22T07:28:40.759 INFO:tasks.workunit.client.1.smithi195.stdout:4/784: symlink d13/d63/d79/de9/d7e/l109 0 2024-03-22T07:28:40.761 INFO:tasks.workunit.client.0.smithi134.stdout:4/606: mknod d2/d15/d35/cd8 0 2024-03-22T07:28:40.764 INFO:tasks.workunit.client.1.smithi195.stdout:7/776: mknod d0/d98/dab/dd7/c10c 0 2024-03-22T07:28:40.766 INFO:tasks.workunit.client.1.smithi195.stdout:5/818: symlink d9/d12/d1d/l109 0 2024-03-22T07:28:40.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/785: link d13/f17 d13/d63/d3e/f10a 0 2024-03-22T07:28:40.771 INFO:tasks.workunit.client.1.smithi195.stdout:0/758: rmdir d1/d4/dd/df/d44 39 2024-03-22T07:28:40.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/507: dread d3/d9/df/d12/f58 [0,4194304] 0 2024-03-22T07:28:40.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/508: fdatasync d3/d9/d37/d3c/d71/d7a/f9c 0 2024-03-22T07:28:40.773 INFO:tasks.workunit.client.0.smithi134.stdout:1/618: dwrite d5/da/d13/d1e/d34/f5f [0,4194304] 0 2024-03-22T07:28:40.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/771: rename d3/df/d15/d1d/d5c/d47/d67/le4 to d3/lfb 0 2024-03-22T07:28:40.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/772: creat d3/df/d15/d1d/d5c/d47/d67/ded/ffc x:0 0 0 2024-03-22T07:28:40.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/773: readlink d3/lfb 0 2024-03-22T07:28:40.774 INFO:tasks.workunit.client.1.smithi195.stdout:7/777: dread d0/d13/d14/d29/d35/d6d/f7a [0,4194304] 0 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/696: dwrite d5/d5e/f33 [0,4194304] 0 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/697: dread - d5/d5e/d34/d55/d4b/da2/d4a/fe1 zero size 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/698: chown d5/d16/f48 8 1 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:6/699: write d5/d5e/d34/d55/f2e [1070546,63347] 0 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:8/849: dread da/d17/fc5 [0,4194304] 0 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:8/850: write da/dc/f12 [4619570,109733] 0 2024-03-22T07:28:40.775 INFO:tasks.workunit.client.1.smithi195.stdout:8/851: readlink da/de/db3/dc7/ld8 0 2024-03-22T07:28:40.776 INFO:tasks.workunit.client.0.smithi134.stdout:9/509: rename d3/d9/df/d57/d67/d5f/f85 to d3/d9/d37/d6f/d54/d9d/fb0 0 2024-03-22T07:28:40.776 INFO:tasks.workunit.client.0.smithi134.stdout:8/701: dwrite d1/dce/fe2 [0,4194304] 0 2024-03-22T07:28:40.776 INFO:tasks.workunit.client.0.smithi134.stdout:8/702: write d1/d4/d61/d85/f8d [1374976,56952] 0 2024-03-22T07:28:40.777 INFO:tasks.workunit.client.0.smithi134.stdout:3/540: dwrite d4/d8/d23/f60 [0,4194304] 0 2024-03-22T07:28:40.778 INFO:tasks.workunit.client.0.smithi134.stdout:8/703: write d1/d15/d42/d12/d20/f3c [1370354,128523] 0 2024-03-22T07:28:40.778 INFO:tasks.workunit.client.1.smithi195.stdout:0/759: mknod d1/d4/d12/d6c/dbc/ce4 0 2024-03-22T07:28:40.779 INFO:tasks.workunit.client.0.smithi134.stdout:3/541: dread d4/f66 [0,4194304] 0 2024-03-22T07:28:40.782 INFO:tasks.workunit.client.1.smithi195.stdout:9/905: rename d2/d4/d1d/f22 to d2/d4/d32/d6d/deb/f149 0 2024-03-22T07:28:40.783 INFO:tasks.workunit.client.1.smithi195.stdout:1/644: dwrite d0/d2/d27/d91/dc8/f6c [0,4194304] 0 2024-03-22T07:28:40.786 INFO:tasks.workunit.client.0.smithi134.stdout:1/619: mkdir d5/da/d13/d1e/d62/dda 0 2024-03-22T07:28:40.795 INFO:tasks.workunit.client.0.smithi134.stdout:4/607: dwrite d2/d25/d48/dd3/fb7 [0,4194304] 0 2024-03-22T07:28:40.795 INFO:tasks.workunit.client.0.smithi134.stdout:9/510: write d3/d9/df/d12/f16 [16735,3234] 0 2024-03-22T07:28:40.795 INFO:tasks.workunit.client.1.smithi195.stdout:3/774: creat d3/d18/d89/d70/ffd x:0 0 0 2024-03-22T07:28:40.795 INFO:tasks.workunit.client.1.smithi195.stdout:3/775: chown d3/d18/d89/d8c/d9d/cf1 1205 1 2024-03-22T07:28:40.796 INFO:tasks.workunit.client.1.smithi195.stdout:3/776: write d3/d22/fb3 [192293,120193] 0 2024-03-22T07:28:40.800 INFO:tasks.workunit.client.1.smithi195.stdout:7/778: creat d0/d13/d22/d28/f10d x:0 0 0 2024-03-22T07:28:40.800 INFO:tasks.workunit.client.1.smithi195.stdout:7/779: read d0/d13/d14/d29/d35/d3a/f3e [270733,39593] 0 2024-03-22T07:28:40.800 INFO:tasks.workunit.client.1.smithi195.stdout:7/780: read - d0/d13/d14/d80/f106 zero size 2024-03-22T07:28:40.804 INFO:tasks.workunit.client.0.smithi134.stdout:8/704: mknod d1/d15/d42/d25/cea 0 2024-03-22T07:28:40.809 INFO:tasks.workunit.client.0.smithi134.stdout:4/608: creat d2/d15/d35/d37/dc0/fd9 x:0 0 0 2024-03-22T07:28:40.812 INFO:tasks.workunit.client.1.smithi195.stdout:6/700: dwrite d5/d5e/d34/d55/d3b/d6e/d97/fd0 [0,4194304] 0 2024-03-22T07:28:40.812 INFO:tasks.workunit.client.1.smithi195.stdout:6/701: dread - d5/d5e/d34/d55/d3b/d6e/d3c/fa0 zero size 2024-03-22T07:28:40.812 INFO:tasks.workunit.client.1.smithi195.stdout:6/702: write d5/d16/dd8/fe5 [1787138,128454] 0 2024-03-22T07:28:40.814 INFO:tasks.workunit.client.0.smithi134.stdout:9/511: truncate d3/d9/df/d57/f7e 294144 0 2024-03-22T07:28:40.814 INFO:tasks.workunit.client.0.smithi134.stdout:9/512: dread - d3/d9/df/d12/d3b/fa1 zero size 2024-03-22T07:28:40.817 INFO:tasks.workunit.client.1.smithi195.stdout:8/852: creat da/de/f101 x:0 0 0 2024-03-22T07:28:40.818 INFO:tasks.workunit.client.0.smithi134.stdout:8/705: symlink d1/d15/d7b/leb 0 2024-03-22T07:28:40.820 INFO:tasks.workunit.client.1.smithi195.stdout:0/760: mkdir d1/d4/dd/df/d44/d6f/dcb/de5 0 2024-03-22T07:28:40.820 INFO:tasks.workunit.client.0.smithi134.stdout:9/513: mknod d3/d9/df/d57/d67/d5f/cb1 0 2024-03-22T07:28:40.821 INFO:tasks.workunit.client.0.smithi134.stdout:1/620: dwrite d5/fe [0,4194304] 0 2024-03-22T07:28:40.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/645: dwrite d0/d2/d6/dad/db1/d97/d39/d64/fbe [0,4194304] 0 2024-03-22T07:28:40.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/646: chown d0/d2/d6/dad/db1/d6b/c8c 145008054 1 2024-03-22T07:28:40.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/647: write d0/d2/d6/dad/db1/d97/d39/f65 [667789,10341] 0 2024-03-22T07:28:40.822 INFO:tasks.workunit.client.1.smithi195.stdout:9/906: chown d2/d4/d6/db/d20/d4a/l7e 28672117 1 2024-03-22T07:28:40.822 INFO:tasks.workunit.client.1.smithi195.stdout:3/777: dwrite d3/dbf/fd6 [0,4194304] 0 2024-03-22T07:28:40.823 INFO:tasks.workunit.client.0.smithi134.stdout:3/542: dwrite d4/d22/f7c [0,4194304] 0 2024-03-22T07:28:40.823 INFO:tasks.workunit.client.0.smithi134.stdout:3/543: fdatasync d4/d8/d23/f60 0 2024-03-22T07:28:40.824 INFO:tasks.workunit.client.0.smithi134.stdout:9/514: creat d3/d9/df/fb2 x:0 0 0 2024-03-22T07:28:40.833 INFO:tasks.workunit.client.0.smithi134.stdout:4/609: dwrite d2/d15/d35/d37/dc0/fd9 [0,4194304] 0 2024-03-22T07:28:40.843 INFO:tasks.workunit.client.1.smithi195.stdout:7/781: mkdir d0/d13/d14/d20/d40/d10e 0 2024-03-22T07:28:40.843 INFO:tasks.workunit.client.1.smithi195.stdout:7/782: creat d0/d13/d14/d29/f10f x:0 0 0 2024-03-22T07:28:40.847 INFO:tasks.workunit.client.1.smithi195.stdout:6/703: unlink d5/d6d/f7b 0 2024-03-22T07:28:40.849 INFO:tasks.workunit.client.1.smithi195.stdout:0/761: getdents d1/d4/d12/d6c/dbc/d47 0 2024-03-22T07:28:40.849 INFO:tasks.workunit.client.1.smithi195.stdout:0/762: write d1/d4/dd/d66/d80/f6a [669149,6970] 0 2024-03-22T07:28:40.851 INFO:tasks.workunit.client.0.smithi134.stdout:3/544: rename d4/d22/d29/d82/l9a to d4/d8/d23/lb2 0 2024-03-22T07:28:40.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/778: sync 2024-03-22T07:28:40.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/779: chown d2/d3/d7/da/d18/cd8 2480898 1 2024-03-22T07:28:40.851 INFO:tasks.workunit.client.1.smithi195.stdout:2/780: readlink d2/d3/d7/d19/d22/d26/laf 0 2024-03-22T07:28:40.852 INFO:tasks.workunit.client.1.smithi195.stdout:6/704: read d5/f6 [2469088,31772] 0 2024-03-22T07:28:40.855 INFO:tasks.workunit.client.1.smithi195.stdout:1/648: creat d0/d2/d27/d91/dc8/dba/fd2 x:0 0 0 2024-03-22T07:28:40.859 INFO:tasks.workunit.client.1.smithi195.stdout:3/778: mkdir d3/df/d15/d1d/d5c/d47/d67/d80/d87/dfe 0 2024-03-22T07:28:40.859 INFO:tasks.workunit.client.0.smithi134.stdout:4/610: stat d2/d15/l29 0 2024-03-22T07:28:40.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/545: creat d4/d8/d5c/fb3 x:0 0 0 2024-03-22T07:28:40.864 INFO:tasks.workunit.client.1.smithi195.stdout:0/763: rename d1/d4/dd/d3f/cb2 to d1/d10/d1f/de3/ce6 0 2024-03-22T07:28:40.866 INFO:tasks.workunit.client.1.smithi195.stdout:3/779: dread d3/d18/d89/f90 [0,4194304] 0 2024-03-22T07:28:40.867 INFO:tasks.workunit.client.1.smithi195.stdout:6/705: link d5/d5e/d34/d55/d4b/lb1 d5/d5e/d34/d55/dab/lfe 0 2024-03-22T07:28:40.869 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:40 smithi134 ceph-mon[29057]: pgmap v6: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 118 MiB/s wr, 100 op/s 2024-03-22T07:28:40.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/611: rename d2/d2a/d80/dd6/f72 to d2/d25/dcf/fda 0 2024-03-22T07:28:40.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/612: chown d2/d2a/d80/f94 2025167 1 2024-03-22T07:28:40.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/613: chown d2/d15/d35/d37/la7 1 1 2024-03-22T07:28:40.870 INFO:tasks.workunit.client.1.smithi195.stdout:2/781: read d2/d3/d21/d40/f5d [2799260,49535] 0 2024-03-22T07:28:40.871 INFO:tasks.workunit.client.1.smithi195.stdout:2/782: dread - d2/d3/db/db3/fe5 zero size 2024-03-22T07:28:40.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/614: stat d2/d2a/d93/lbb 0 2024-03-22T07:28:40.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/615: creat d2/d15/fdb x:0 0 0 2024-03-22T07:28:40.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/616: truncate d2/d2a/d80/fd0 498982 0 2024-03-22T07:28:40.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/617: fsync d2/d15/d35/d37/fc3 0 2024-03-22T07:28:40.874 INFO:tasks.workunit.client.1.smithi195.stdout:9/907: rmdir d2/d4/d32 39 2024-03-22T07:28:40.875 INFO:tasks.workunit.client.0.smithi134.stdout:4/618: creat d2/d2a/d80/dd6/fdc x:0 0 0 2024-03-22T07:28:40.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/619: chown d2/d2a/l6c 49 1 2024-03-22T07:28:40.876 INFO:tasks.workunit.client.1.smithi195.stdout:8/853: dwrite da/dc/f6f [0,4194304] 0 2024-03-22T07:28:40.876 INFO:tasks.workunit.client.1.smithi195.stdout:8/854: write da/d17/d32/f58 [4076196,10442] 0 2024-03-22T07:28:40.876 INFO:tasks.workunit.client.0.smithi134.stdout:8/706: dwrite d1/d46/d75/d8b/fb9 [0,4194304] 0 2024-03-22T07:28:40.877 INFO:tasks.workunit.client.0.smithi134.stdout:1/621: dwrite d5/da/d1b/d27/d39/f54 [0,4194304] 0 2024-03-22T07:28:40.878 INFO:tasks.workunit.client.0.smithi134.stdout:9/515: dwrite d3/d9/df/f49 [0,4194304] 0 2024-03-22T07:28:40.880 INFO:tasks.workunit.client.1.smithi195.stdout:1/649: rename d0/d2/d6/dad/db1/d97/d41/d47/d4a/l76 to d0/d2/d6/dad/db1/d97/d39/d64/ld3 0 2024-03-22T07:28:40.882 INFO:tasks.workunit.client.1.smithi195.stdout:7/783: dwrite d0/d98/dab/dd7/ff4 [0,4194304] 0 2024-03-22T07:28:40.883 INFO:tasks.workunit.client.1.smithi195.stdout:7/784: stat d0/d13/d22/d28/lba 0 2024-03-22T07:28:40.883 INFO:tasks.workunit.client.1.smithi195.stdout:6/706: dread d5/d5e/d34/d55/d3b/d6e/d3c/f44 [0,4194304] 0 2024-03-22T07:28:40.883 INFO:tasks.workunit.client.0.smithi134.stdout:4/620: rename d2/d2a/d93/fc7 to d2/d25/d74/fdd 0 2024-03-22T07:28:40.886 INFO:tasks.workunit.client.1.smithi195.stdout:2/783: mkdir d2/d3/d7/da/de/d10b 0 2024-03-22T07:28:40.886 INFO:tasks.workunit.client.1.smithi195.stdout:2/784: chown d2/d3/d21/d60/cbe 2254863 1 2024-03-22T07:28:40.887 INFO:tasks.workunit.client.1.smithi195.stdout:3/780: dwrite d3/df/d15/d1d/f31 [8388608,4194304] 0 2024-03-22T07:28:40.887 INFO:tasks.workunit.client.1.smithi195.stdout:8/855: dread da/d82/dc6/d53/f5e [0,4194304] 0 2024-03-22T07:28:40.887 INFO:tasks.workunit.client.1.smithi195.stdout:8/856: fsync da/de/db3/ddd/fa0 0 2024-03-22T07:28:40.887 INFO:tasks.workunit.client.0.smithi134.stdout:8/707: symlink d1/d15/d42/d76/dda/lec 0 2024-03-22T07:28:40.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/650: dread d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/f6d [0,4194304] 0 2024-03-22T07:28:40.890 INFO:tasks.workunit.client.1.smithi195.stdout:1/651: fdatasync d0/d2/d6/f2f 0 2024-03-22T07:28:40.893 INFO:tasks.workunit.client.0.smithi134.stdout:9/516: dread d3/d9/df/d12/f4c [0,4194304] 0 2024-03-22T07:28:40.901 INFO:tasks.workunit.client.0.smithi134.stdout:1/622: read d5/da/d68/da1/fbd [39847,65972] 0 2024-03-22T07:28:40.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/517: write d3/d9/d37/d6f/d54/d9d/fb0 [1386123,81883] 0 2024-03-22T07:28:40.902 INFO:tasks.workunit.client.0.smithi134.stdout:3/546: dwrite d4/d8/f6e [8388608,4194304] 0 2024-03-22T07:28:40.902 INFO:tasks.workunit.client.0.smithi134.stdout:9/518: fsync d3/d9/df/d57/fa9 0 2024-03-22T07:28:40.904 INFO:tasks.workunit.client.1.smithi195.stdout:9/908: dwrite d2/f82 [0,4194304] 0 2024-03-22T07:28:40.904 INFO:tasks.workunit.client.1.smithi195.stdout:9/909: chown d2/d122 1244243 1 2024-03-22T07:28:40.905 INFO:tasks.workunit.client.0.smithi134.stdout:0/590: sync 2024-03-22T07:28:40.905 INFO:tasks.workunit.client.0.smithi134.stdout:6/428: sync 2024-03-22T07:28:40.905 INFO:tasks.workunit.client.0.smithi134.stdout:5/583: sync 2024-03-22T07:28:40.905 INFO:tasks.workunit.client.0.smithi134.stdout:8/708: write d1/d15/f2c [2749451,86780] 0 2024-03-22T07:28:40.907 INFO:tasks.workunit.client.0.smithi134.stdout:8/709: write d1/d15/d57/f68 [680530,11902] 0 2024-03-22T07:28:40.907 INFO:tasks.workunit.client.0.smithi134.stdout:8/710: creat d1/d4/d61/fed x:0 0 0 2024-03-22T07:28:40.907 INFO:tasks.workunit.client.1.smithi195.stdout:0/764: rmdir d1/d10/d4d/da6 39 2024-03-22T07:28:40.908 INFO:tasks.workunit.client.1.smithi195.stdout:0/765: write d1/d4/d12/d6c/d87/fc7 [1198074,47745] 0 2024-03-22T07:28:40.910 INFO:tasks.workunit.client.0.smithi134.stdout:1/623: mknod d5/d1d/d49/cdb 0 2024-03-22T07:28:40.912 INFO:tasks.workunit.client.1.smithi195.stdout:1/652: dread d0/d2/d6/dad/db1/d97/d41/f5a [0,4194304] 0 2024-03-22T07:28:40.915 INFO:tasks.workunit.client.0.smithi134.stdout:9/519: mkdir d3/d9/df/db3 0 2024-03-22T07:28:40.915 INFO:tasks.workunit.client.0.smithi134.stdout:9/520: creat d3/d9/df/fb4 x:0 0 0 2024-03-22T07:28:40.915 INFO:tasks.workunit.client.0.smithi134.stdout:9/521: chown d3/d9/d37/d3c/d71/l7b 25566180 1 2024-03-22T07:28:40.915 INFO:tasks.workunit.client.0.smithi134.stdout:9/522: write d3/d9/d37/d5a/d7f/d80/f95 [330582,73222] 0 2024-03-22T07:28:40.915 INFO:tasks.workunit.client.0.smithi134.stdout:5/584: write d1/fa6 [1991820,126282] 0 2024-03-22T07:28:40.917 INFO:tasks.workunit.client.0.smithi134.stdout:4/621: rename d2/d15/d35/d37 to d2/d25/d74/dde 0 2024-03-22T07:28:40.917 INFO:tasks.workunit.client.0.smithi134.stdout:2/518: sync 2024-03-22T07:28:40.917 INFO:tasks.workunit.client.0.smithi134.stdout:7/720: sync 2024-03-22T07:28:40.921 INFO:tasks.workunit.client.0.smithi134.stdout:0/591: dread dc/de/d55/f8c [0,4194304] 0 2024-03-22T07:28:40.921 INFO:tasks.workunit.client.0.smithi134.stdout:0/592: chown dc/de/c33 19952 1 2024-03-22T07:28:40.925 INFO:tasks.workunit.client.1.smithi195.stdout:6/707: link d5/d5e/d34/d55/d3b/d6e/d56/d8f/cfd d5/d5e/cff 0 2024-03-22T07:28:40.925 INFO:tasks.workunit.client.0.smithi134.stdout:8/711: mknod d1/d15/d42/d25/d6f/ddb/cee 0 2024-03-22T07:28:40.928 INFO:tasks.workunit.client.0.smithi134.stdout:8/712: write d1/d15/d42/d76/fb2 [169156,101724] 0 2024-03-22T07:28:40.929 INFO:tasks.workunit.client.1.smithi195.stdout:8/857: mkdir da/dde/d102 0 2024-03-22T07:28:40.929 INFO:tasks.workunit.client.1.smithi195.stdout:2/785: dwrite d2/d3/db/db3/feb [0,4194304] 0 2024-03-22T07:28:40.929 INFO:tasks.workunit.client.1.smithi195.stdout:2/786: chown d2/d3/d21/d60/d81/da8/ded/l101 198000627 1 2024-03-22T07:28:40.929 INFO:tasks.workunit.client.1.smithi195.stdout:2/787: chown d2/f4d 232540 1 2024-03-22T07:28:40.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/781: dwrite d3/df/d15/f1c [0,4194304] 0 2024-03-22T07:28:40.930 INFO:tasks.workunit.client.0.smithi134.stdout:1/624: mkdir d5/d1d/dd0/ddc 0 2024-03-22T07:28:40.932 INFO:tasks.workunit.client.0.smithi134.stdout:1/625: dread d5/da/f86 [0,4194304] 0 2024-03-22T07:28:40.934 INFO:tasks.workunit.client.0.smithi134.stdout:7/721: dread d1/d40/f7f [0,4194304] 0 2024-03-22T07:28:40.940 INFO:tasks.workunit.client.1.smithi195.stdout:0/766: creat d1/d4/dd/fe7 x:0 0 0 2024-03-22T07:28:40.941 INFO:tasks.workunit.client.0.smithi134.stdout:7/722: read d1/de/d11/d48/f65 [354492,56174] 0 2024-03-22T07:28:40.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/523: link d3/d9/df/d12/f1d d3/d9/df/d57/d67/fb5 0 2024-03-22T07:28:40.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/524: write d3/d9/d37/d6f/f29 [3793662,14855] 0 2024-03-22T07:28:40.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/525: creat d3/d9/d37/d6f/d54/fb6 x:0 0 0 2024-03-22T07:28:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/653: symlink d0/d2/d27/d91/dc8/d2a/da0/ld4 0 2024-03-22T07:28:40.945 INFO:tasks.workunit.client.1.smithi195.stdout:1/654: chown d0/d2/d27/d91/dc8/d2a/fb0 116 1 2024-03-22T07:28:40.946 INFO:tasks.workunit.client.0.smithi134.stdout:5/585: creat d1/d4/fc4 x:0 0 0 2024-03-22T07:28:40.946 INFO:tasks.workunit.client.0.smithi134.stdout:5/586: truncate d1/d8/d20/d62/d65/f64 1024473 0 2024-03-22T07:28:40.949 INFO:tasks.workunit.client.0.smithi134.stdout:3/547: rename d4/d22/d29/f30 to d4/d10/fb4 0 2024-03-22T07:28:40.953 INFO:tasks.workunit.client.0.smithi134.stdout:4/622: creat d2/d25/d74/dde/fdf x:0 0 0 2024-03-22T07:28:40.953 INFO:tasks.workunit.client.0.smithi134.stdout:4/623: write d2/d2a/d80/fd0 [1018562,83874] 0 2024-03-22T07:28:40.953 INFO:tasks.workunit.client.0.smithi134.stdout:4/624: truncate d2/d25/d48/f57 1009286 0 2024-03-22T07:28:40.954 INFO:tasks.workunit.client.0.smithi134.stdout:4/625: write d2/d98/f99 [20331,97696] 0 2024-03-22T07:28:40.955 INFO:tasks.workunit.client.1.smithi195.stdout:6/708: mkdir d5/d6d/d95/d100 0 2024-03-22T07:28:40.955 INFO:tasks.workunit.client.0.smithi134.stdout:1/626: mkdir d5/d1d/ddd 0 2024-03-22T07:28:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/858: symlink da/d17/d32/d78/l103 0 2024-03-22T07:28:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/819: sync 2024-03-22T07:28:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:4/786: sync 2024-03-22T07:28:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/820: stat d9/d12/d1d/d36/d7d/dd2/dfc/df1 0 2024-03-22T07:28:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:5/821: chown d9/d73 0 1 2024-03-22T07:28:40.958 INFO:tasks.workunit.client.1.smithi195.stdout:2/788: dwrite d2/d3/d7/d5c/da4/ff5 [0,4194304] 0 2024-03-22T07:28:40.959 INFO:tasks.workunit.client.0.smithi134.stdout:7/723: dread d1/de/d41/d87/d8f/f9d [0,4194304] 0 2024-03-22T07:28:40.959 INFO:tasks.workunit.client.0.smithi134.stdout:7/724: chown d1 67 1 2024-03-22T07:28:40.959 INFO:tasks.workunit.client.0.smithi134.stdout:2/519: dwrite d2/d5/d54/f63 [0,4194304] 0 2024-03-22T07:28:40.960 INFO:tasks.workunit.client.0.smithi134.stdout:2/520: fdatasync d2/d5/d54/f63 0 2024-03-22T07:28:40.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/526: mknod d3/d9/d37/d5a/d7f/daf/cb7 0 2024-03-22T07:28:40.963 INFO:tasks.workunit.client.1.smithi195.stdout:3/782: dwrite d3/df/d15/fd8 [4194304,4194304] 0 2024-03-22T07:28:40.964 INFO:tasks.workunit.client.0.smithi134.stdout:8/713: dwrite d1/d15/d42/d12/d20/d41/fa3 [0,4194304] 0 2024-03-22T07:28:40.964 INFO:tasks.workunit.client.0.smithi134.stdout:8/714: truncate d1/d15/d42/d12/d2a/fe5 997416 0 2024-03-22T07:28:40.964 INFO:tasks.workunit.client.0.smithi134.stdout:8/715: dread - d1/d4/d61/fed zero size 2024-03-22T07:28:40.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/429: rename d2/d3f/d28/d6b/f67 to d2/d1b/fa3 0 2024-03-22T07:28:40.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/430: chown d2/d3f/d28 126 1 2024-03-22T07:28:40.968 INFO:tasks.workunit.client.1.smithi195.stdout:0/767: mknod d1/d4/d12/d6c/d7b/ce8 0 2024-03-22T07:28:40.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/626: rmdir d2/d2a/d80/dd6/dd4 0 2024-03-22T07:28:40.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/627: chown d2/d2a/d80/dd6/l20 21744760 1 2024-03-22T07:28:40.970 INFO:tasks.workunit.client.0.smithi134.stdout:4/628: write d2/d2a/d80/dd6/f90 [1668417,3468] 0 2024-03-22T07:28:40.972 INFO:tasks.workunit.client.0.smithi134.stdout:1/627: unlink d5/da/d13/dac/cd8 0 2024-03-22T07:28:40.973 INFO:tasks.workunit.client.1.smithi195.stdout:7/785: rename d0/d13/d14/d2b to d0/d13/d14/d29/da2/d110 0 2024-03-22T07:28:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:8/859: symlink da/df0/l104 0 2024-03-22T07:28:40.974 INFO:tasks.workunit.client.1.smithi195.stdout:6/709: dread d5/d5e/d34/d55/f36 [0,4194304] 0 2024-03-22T07:28:40.975 INFO:tasks.workunit.client.0.smithi134.stdout:5/587: dwrite d1/faf [0,4194304] 0 2024-03-22T07:28:40.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/548: dwrite d4/d8/d23/f3a [4194304,4194304] 0 2024-03-22T07:28:40.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/549: write d4/d8/d69/fa2 [1876540,43387] 0 2024-03-22T07:28:40.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/550: write d4/d8/d5c/fb3 [377991,75997] 0 2024-03-22T07:28:40.976 INFO:tasks.workunit.client.1.smithi195.stdout:4/787: creat d13/d63/d3e/d5c/d65/f10b x:0 0 0 2024-03-22T07:28:40.976 INFO:tasks.workunit.client.0.smithi134.stdout:5/588: read d1/d8/d20/d62/d65/d82/f9b [418559,17574] 0 2024-03-22T07:28:40.977 INFO:tasks.workunit.client.0.smithi134.stdout:8/716: mknod d1/d4/d38/cef 0 2024-03-22T07:28:40.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/710: write d5/d5e/d34/d55/d3b/d6e/d97/f9a [551269,114746] 0 2024-03-22T07:28:40.979 INFO:tasks.workunit.client.1.smithi195.stdout:5/822: link d9/d2d/d84/dcf/fc0 d9/d12/d1d/d36/d7d/f10a 0 2024-03-22T07:28:40.979 INFO:tasks.workunit.client.1.smithi195.stdout:5/823: creat d9/d2d/d58/f10b x:0 0 0 2024-03-22T07:28:40.979 INFO:tasks.workunit.client.0.smithi134.stdout:3/551: fdatasync d4/d8/d5c/fb3 0 2024-03-22T07:28:40.980 INFO:tasks.workunit.client.0.smithi134.stdout:7/725: dwrite d1/de/d11/d48/d52/d46/fb1 [0,4194304] 0 2024-03-22T07:28:40.981 INFO:tasks.workunit.client.0.smithi134.stdout:7/726: write d1/de/d11/d2b/d31/fa7 [1204599,63672] 0 2024-03-22T07:28:40.982 INFO:tasks.workunit.client.0.smithi134.stdout:6/431: symlink d2/d6e/la4 0 2024-03-22T07:28:40.983 INFO:tasks.workunit.client.0.smithi134.stdout:6/432: truncate d2/d3f/d28/d6b/f5b 6620376 0 2024-03-22T07:28:40.983 INFO:tasks.workunit.client.0.smithi134.stdout:6/433: chown d2/d1b/d4d/d65 1374979 1 2024-03-22T07:28:40.983 INFO:tasks.workunit.client.0.smithi134.stdout:6/434: fdatasync d2/d1b/d1d/d5e/f66 0 2024-03-22T07:28:40.988 INFO:tasks.workunit.client.0.smithi134.stdout:4/629: link d2/d2a/d50/c53 d2/d2a/d80/dd6/ce0 0 2024-03-22T07:28:40.990 INFO:tasks.workunit.client.1.smithi195.stdout:2/789: rmdir d2/d3/d7/d19/d22 39 2024-03-22T07:28:40.991 INFO:tasks.workunit.client.0.smithi134.stdout:3/552: write d4/d8/d45/f51 [3315515,122319] 0 2024-03-22T07:28:40.991 INFO:tasks.workunit.client.0.smithi134.stdout:3/553: readlink d4/d22/d29/l47 0 2024-03-22T07:28:40.991 INFO:tasks.workunit.client.0.smithi134.stdout:3/554: dread - d4/d8/fa3 zero size 2024-03-22T07:28:40.992 INFO:tasks.workunit.client.1.smithi195.stdout:5/824: dread d9/d2d/d58/f93 [0,4194304] 0 2024-03-22T07:28:40.993 INFO:tasks.workunit.client.0.smithi134.stdout:1/628: unlink d5/da/d1b/f1f 0 2024-03-22T07:28:40.997 INFO:tasks.workunit.client.1.smithi195.stdout:0/768: symlink d1/d4/dd/df/le9 0 2024-03-22T07:28:41.001 INFO:tasks.workunit.client.0.smithi134.stdout:6/435: dwrite d2/d1b/d1d/d5e/f66 [0,4194304] 0 2024-03-22T07:28:41.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/910: rename d2/d4/d6/db/f6c to d2/d4/d32/d6d/d78/f14a 0 2024-03-22T07:28:41.005 INFO:tasks.workunit.client.1.smithi195.stdout:9/911: chown d2/d4/d6/d18/d50/d88/f10e 27134 1 2024-03-22T07:28:41.007 INFO:tasks.workunit.client.0.smithi134.stdout:8/717: mknod d1/d15/d42/d12/dbb/cf0 0 2024-03-22T07:28:41.007 INFO:tasks.workunit.client.0.smithi134.stdout:8/718: dread - d1/d15/fcc zero size 2024-03-22T07:28:41.009 INFO:tasks.workunit.client.1.smithi195.stdout:5/825: dwrite d9/d12/f3d [0,4194304] 0 2024-03-22T07:28:41.011 INFO:tasks.workunit.client.0.smithi134.stdout:0/593: rename dc/d17/f6d to dc/d18/fae 0 2024-03-22T07:28:41.013 INFO:tasks.workunit.client.1.smithi195.stdout:8/860: truncate da/de/db3/ddd/fa3 702358 0 2024-03-22T07:28:41.013 INFO:tasks.workunit.client.1.smithi195.stdout:8/861: creat da/de/f105 x:0 0 0 2024-03-22T07:28:41.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/788: truncate d13/f34 1577988 0 2024-03-22T07:28:41.016 INFO:tasks.workunit.client.1.smithi195.stdout:4/789: write d13/d63/d36/d5f/d83/fa2 [68433,96650] 0 2024-03-22T07:28:41.021 INFO:tasks.workunit.client.1.smithi195.stdout:0/769: dwrite d1/d4/dd/df/f16 [0,4194304] 0 2024-03-22T07:28:41.022 INFO:tasks.workunit.client.0.smithi134.stdout:6/436: dwrite d2/d3f/d28/f7e [0,4194304] 0 2024-03-22T07:28:41.022 INFO:tasks.workunit.client.1.smithi195.stdout:6/711: link d5/d6d/l8b d5/d5e/d34/d55/d4b/da2/dad/l101 0 2024-03-22T07:28:41.024 INFO:tasks.workunit.client.1.smithi195.stdout:8/862: dread da/dc/f2b [0,4194304] 0 2024-03-22T07:28:41.025 INFO:tasks.workunit.client.0.smithi134.stdout:6/437: dread d2/d3f/d28/d6b/f5b [4194304,4194304] 0 2024-03-22T07:28:41.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/655: rmdir d0/d2/d27/db5 0 2024-03-22T07:28:41.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/656: stat d0/d2/d6/dad/db1/d97/l3c 0 2024-03-22T07:28:41.029 INFO:tasks.workunit.client.0.smithi134.stdout:3/555: symlink d4/d8/d45/da9/lb5 0 2024-03-22T07:28:41.031 INFO:tasks.workunit.client.1.smithi195.stdout:3/783: rename d3/df/c57 to d3/df/d15/d1d/d5c/cff 0 2024-03-22T07:28:41.032 INFO:tasks.workunit.client.1.smithi195.stdout:3/784: fdatasync d3/d18/f51 0 2024-03-22T07:28:41.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/629: truncate d5/da/f2a 2382307 0 2024-03-22T07:28:41.037 INFO:tasks.workunit.client.1.smithi195.stdout:7/786: rmdir d0/d13/d14/d80/d9c 39 2024-03-22T07:28:41.037 INFO:tasks.workunit.client.1.smithi195.stdout:7/787: write d0/d13/f1e [3082933,73412] 0 2024-03-22T07:28:41.044 INFO:tasks.workunit.client.0.smithi134.stdout:2/521: rename d2/d5/d8/d5d/d5f/d9d to d2/d5/d8/d5d/da1 0 2024-03-22T07:28:41.044 INFO:tasks.workunit.client.0.smithi134.stdout:2/522: fdatasync d2/f40 0 2024-03-22T07:28:41.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/594: readlink dc/d18/l7b 0 2024-03-22T07:28:41.045 INFO:tasks.workunit.client.0.smithi134.stdout:0/595: truncate dc/f8d 711350 0 2024-03-22T07:28:41.047 INFO:tasks.workunit.client.0.smithi134.stdout:3/556: dwrite d4/d8/d69/faa [0,4194304] 0 2024-03-22T07:28:41.050 INFO:tasks.workunit.client.0.smithi134.stdout:6/438: mkdir d2/d1b/d4d/da5 0 2024-03-22T07:28:41.054 INFO:tasks.workunit.client.0.smithi134.stdout:7/727: write d1/f33 [1422459,127651] 0 2024-03-22T07:28:41.054 INFO:tasks.workunit.client.0.smithi134.stdout:7/728: chown d1/de/d11/d48/f65 4906597 1 2024-03-22T07:28:41.054 INFO:tasks.workunit.client.0.smithi134.stdout:1/630: link d5/d1d/f76 d5/da/d1b/d27/fde 0 2024-03-22T07:28:41.057 INFO:tasks.workunit.client.0.smithi134.stdout:8/719: getdents d1/d4/d61/d85 0 2024-03-22T07:28:41.062 INFO:tasks.workunit.client.0.smithi134.stdout:9/527: rename d3/d9/df/f90 to d3/d9/df/d57/fb8 0 2024-03-22T07:28:41.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/523: mknod d2/d5/d8/d31/ca2 0 2024-03-22T07:28:41.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/524: chown d2/d5/d8/d5d/da1/d3c/c3d 0 1 2024-03-22T07:28:41.066 INFO:tasks.workunit.client.0.smithi134.stdout:8/720: read d1/d15/d42/d12/f7a [2030076,23471] 0 2024-03-22T07:28:41.070 INFO:tasks.workunit.client.1.smithi195.stdout:8/863: mknod da/dde/dfd/c106 0 2024-03-22T07:28:41.071 INFO:tasks.workunit.client.0.smithi134.stdout:0/596: dwrite dc/d18/f8e [0,4194304] 0 2024-03-22T07:28:41.073 INFO:tasks.workunit.client.1.smithi195.stdout:1/657: mkdir d0/dd5 0 2024-03-22T07:28:41.073 INFO:tasks.workunit.client.1.smithi195.stdout:1/658: truncate d0/d2/d27/d91/dc8/dba/fd2 775829 0 2024-03-22T07:28:41.074 INFO:tasks.workunit.client.0.smithi134.stdout:3/557: link d4/f66 d4/d22/d3c/fb6 0 2024-03-22T07:28:41.074 INFO:tasks.workunit.client.0.smithi134.stdout:3/558: chown d4/d22/f32 7954 1 2024-03-22T07:28:41.076 INFO:tasks.workunit.client.1.smithi195.stdout:2/790: rename d2/d3/d21/ddd/ff1 to d2/d3/d7/da/d4e/f10c 0 2024-03-22T07:28:41.076 INFO:tasks.workunit.client.1.smithi195.stdout:2/791: read - d2/d3/d7/da/d4e/f8d zero size 2024-03-22T07:28:41.077 INFO:tasks.workunit.client.0.smithi134.stdout:6/439: getdents d2/d1b/d1d 0 2024-03-22T07:28:41.079 INFO:tasks.workunit.client.1.smithi195.stdout:3/785: mknod d3/d18/d89/c100 0 2024-03-22T07:28:41.080 INFO:tasks.workunit.client.0.smithi134.stdout:7/729: creat d1/de/d11/d48/daf/fe6 x:0 0 0 2024-03-22T07:28:41.080 INFO:tasks.workunit.client.0.smithi134.stdout:7/730: chown d1/de/d11/d48/d52/l6e 11 1 2024-03-22T07:28:41.083 INFO:tasks.workunit.client.1.smithi195.stdout:9/912: link d2/d4/d6/db/d20/f12c d2/d4/d32/d102/f14b 0 2024-03-22T07:28:41.085 INFO:tasks.workunit.client.0.smithi134.stdout:1/631: unlink d5/da/d13/d1e/d45/fd9 0 2024-03-22T07:28:41.086 INFO:tasks.workunit.client.1.smithi195.stdout:7/788: mknod d0/d13/d22/d28/c111 0 2024-03-22T07:28:41.086 INFO:tasks.workunit.client.1.smithi195.stdout:7/789: read d0/f71 [7361088,27843] 0 2024-03-22T07:28:41.089 INFO:tasks.workunit.client.1.smithi195.stdout:2/792: dwrite d2/d3/db/d82/f104 [0,4194304] 0 2024-03-22T07:28:41.089 INFO:tasks.workunit.client.1.smithi195.stdout:5/826: getdents d9/d2d/d84 0 2024-03-22T07:28:41.089 INFO:tasks.workunit.client.0.smithi134.stdout:7/731: write d1/de/d11/d48/fc [795204,107552] 0 2024-03-22T07:28:41.091 INFO:tasks.workunit.client.0.smithi134.stdout:9/528: creat d3/d9/df/d57/d67/d5f/fb9 x:0 0 0 2024-03-22T07:28:41.093 INFO:tasks.workunit.client.0.smithi134.stdout:8/721: mknod d1/d15/d42/d12/d20/d41/cf1 0 2024-03-22T07:28:41.096 INFO:tasks.workunit.client.1.smithi195.stdout:5/827: dread d9/d12/f3d [0,4194304] 0 2024-03-22T07:28:41.096 INFO:tasks.workunit.client.1.smithi195.stdout:8/864: creat da/d82/dc6/d53/dff/f107 x:0 0 0 2024-03-22T07:28:41.099 INFO:tasks.workunit.client.1.smithi195.stdout:1/659: creat d0/d2/fd6 x:0 0 0 2024-03-22T07:28:41.103 INFO:tasks.workunit.client.1.smithi195.stdout:0/770: rename d1/d4/d12/d6c/d87/fbe to d1/d4/dd/df/d44/fea 0 2024-03-22T07:28:41.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/913: creat d2/d4/d32/d6d/f14c x:0 0 0 2024-03-22T07:28:41.106 INFO:tasks.workunit.client.1.smithi195.stdout:9/914: chown d2/d4/d6/db/fb9 15137 1 2024-03-22T07:28:41.108 INFO:tasks.workunit.client.1.smithi195.stdout:7/790: rmdir d0/d13/d14/d20/d40/d82 39 2024-03-22T07:28:41.114 INFO:tasks.workunit.client.1.smithi195.stdout:5/828: dwrite d9/d2d/d84/d92/fba [0,4194304] 0 2024-03-22T07:28:41.117 INFO:tasks.workunit.client.1.smithi195.stdout:4/790: sync 2024-03-22T07:28:41.121 INFO:tasks.workunit.client.1.smithi195.stdout:2/793: creat d2/d3/d1a/f10d x:0 0 0 2024-03-22T07:28:41.121 INFO:tasks.workunit.client.1.smithi195.stdout:2/794: stat d2/d3/d7/da/de/d10b 0 2024-03-22T07:28:41.121 INFO:tasks.workunit.client.1.smithi195.stdout:2/795: dread - d2/d3/d7/d19/f9d zero size 2024-03-22T07:28:41.123 INFO:tasks.workunit.client.1.smithi195.stdout:8/865: link da/ca2 da/d17/d32/d61/ded/c108 0 2024-03-22T07:28:41.125 INFO:tasks.workunit.client.1.smithi195.stdout:1/660: mkdir d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7 0 2024-03-22T07:28:41.125 INFO:tasks.workunit.client.1.smithi195.stdout:1/661: fdatasync d0/d2/d6/dad/db1/d97/d39/fa9 0 2024-03-22T07:28:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:3/786: rename d3/df/d15/d1d/d5c/d47/d67/lbc to d3/df/d15/d1d/d5c/d47/l101 0 2024-03-22T07:28:41.127 INFO:tasks.workunit.client.1.smithi195.stdout:6/712: sync 2024-03-22T07:28:41.129 INFO:tasks.workunit.client.0.smithi134.stdout:3/559: truncate d4/d8/d23/f99 787068 0 2024-03-22T07:28:41.129 INFO:tasks.workunit.client.1.smithi195.stdout:5/829: dwrite d9/d12/d14/f17 [0,4194304] 0 2024-03-22T07:28:41.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/771: mknod d1/d10/ceb 0 2024-03-22T07:28:41.132 INFO:tasks.workunit.client.1.smithi195.stdout:9/915: mknod d2/d4/d1d/c14d 0 2024-03-22T07:28:41.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/791: creat d0/d13/d14/f112 x:0 0 0 2024-03-22T07:28:41.135 INFO:tasks.workunit.client.1.smithi195.stdout:7/792: readlink d0/d13/d22/d57/d7b/lb5 0 2024-03-22T07:28:41.139 INFO:tasks.workunit.client.0.smithi134.stdout:1/632: mknod d5/da/d1b/d27/cdf 0 2024-03-22T07:28:41.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/560: write d4/d10/d4b/f90 [198637,12455] 0 2024-03-22T07:28:41.139 INFO:tasks.workunit.client.0.smithi134.stdout:3/561: creat d4/d10/d4b/fb7 x:0 0 0 2024-03-22T07:28:41.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/796: symlink d2/d3/d21/d60/d81/l10e 0 2024-03-22T07:28:41.144 INFO:tasks.workunit.client.1.smithi195.stdout:2/797: truncate d2/d3/d7/d19/d22/d26/f4b 4230718 0 2024-03-22T07:28:41.145 INFO:tasks.workunit.client.1.smithi195.stdout:0/772: dwrite d1/d4/f2e [8388608,4194304] 0 2024-03-22T07:28:41.145 INFO:tasks.workunit.client.1.smithi195.stdout:0/773: chown d1/d4/dd/d3f 281 1 2024-03-22T07:28:41.147 INFO:tasks.workunit.client.0.smithi134.stdout:7/732: unlink d1/d19/d32/l76 0 2024-03-22T07:28:41.149 INFO:tasks.workunit.client.1.smithi195.stdout:8/866: link da/d82/dc6/ff9 da/d17/f109 0 2024-03-22T07:28:41.150 INFO:tasks.workunit.client.0.smithi134.stdout:9/529: mknod d3/d9/df/db3/cba 0 2024-03-22T07:28:41.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/662: mkdir d0/d2/d27/d91/dc8/d2a/dd8 0 2024-03-22T07:28:41.153 INFO:tasks.workunit.client.1.smithi195.stdout:8/867: read da/de/db3/ddd/fa3 [450541,21442] 0 2024-03-22T07:28:41.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/597: getdents dc 0 2024-03-22T07:28:41.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/598: chown dc/c69 3300037 1 2024-03-22T07:28:41.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/599: chown dc/d18/d89/da0/fa8 1 1 2024-03-22T07:28:41.156 INFO:tasks.workunit.client.0.smithi134.stdout:0/600: fsync dc/d18/f70 0 2024-03-22T07:28:41.157 INFO:tasks.workunit.client.1.smithi195.stdout:3/787: link d3/d18/d89/d76/f85 d3/df/d15/d1d/d5c/d47/d67/d80/f102 0 2024-03-22T07:28:41.157 INFO:tasks.workunit.client.1.smithi195.stdout:3/788: write d3/df/d15/d1d/f30 [1739068,38354] 0 2024-03-22T07:28:41.158 INFO:tasks.workunit.client.0.smithi134.stdout:1/633: creat d5/d1d/dd0/ddc/fe0 x:0 0 0 2024-03-22T07:28:41.162 INFO:tasks.workunit.client.1.smithi195.stdout:5/830: rename d9/c2f to d9/d73/da1/d5f/c10c 0 2024-03-22T07:28:41.164 INFO:tasks.workunit.client.1.smithi195.stdout:9/916: creat d2/d4/d6/d18/d50/dc9/f14e x:0 0 0 2024-03-22T07:28:41.164 INFO:tasks.workunit.client.1.smithi195.stdout:9/917: write d2/d4/d6/f49 [2218585,110308] 0 2024-03-22T07:28:41.165 INFO:tasks.workunit.client.0.smithi134.stdout:5/589: rename d1/d8/d20/d62/d65/d82 to d1/d8/dc5 0 2024-03-22T07:28:41.166 INFO:tasks.workunit.client.1.smithi195.stdout:1/663: write d0/d2/d27/d91/dc8/da4/fb4 [2638281,129562] 0 2024-03-22T07:28:41.166 INFO:tasks.workunit.client.1.smithi195.stdout:1/664: fsync d0/d2/d27/d91/dc8/d2a/f80 0 2024-03-22T07:28:41.166 INFO:tasks.workunit.client.1.smithi195.stdout:1/665: stat d0/d2/d27/d91/dc8/dba/fd2 0 2024-03-22T07:28:41.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/798: mkdir d2/d3/d21/d60/d10f 0 2024-03-22T07:28:41.167 INFO:tasks.workunit.client.1.smithi195.stdout:3/789: write d3/df/d15/fd8 [3564577,42228] 0 2024-03-22T07:28:41.169 INFO:tasks.workunit.client.1.smithi195.stdout:0/774: link d1/d10/d19/d20/f61 d1/d4/d22/dd8/fec 0 2024-03-22T07:28:41.171 INFO:tasks.workunit.client.0.smithi134.stdout:9/530: mknod d3/d9/d37/d5a/d7f/d80/cbb 0 2024-03-22T07:28:41.172 INFO:tasks.workunit.client.1.smithi195.stdout:8/868: mkdir da/d82/dc6/db4/d10a 0 2024-03-22T07:28:41.172 INFO:tasks.workunit.client.0.smithi134.stdout:7/733: dwrite d1/de/d11/f16 [0,4194304] 0 2024-03-22T07:28:41.173 INFO:tasks.workunit.client.0.smithi134.stdout:8/722: getdents d1/d15/d42/d76 0 2024-03-22T07:28:41.178 INFO:tasks.workunit.client.0.smithi134.stdout:5/590: read d1/d8/d20/f50 [2224639,28962] 0 2024-03-22T07:28:41.178 INFO:tasks.workunit.client.0.smithi134.stdout:5/591: readlink d1/l58 0 2024-03-22T07:28:41.181 INFO:tasks.workunit.client.0.smithi134.stdout:9/531: write d3/d9/df/d12/d3b/fa2 [1087955,105067] 0 2024-03-22T07:28:41.190 INFO:tasks.workunit.client.0.smithi134.stdout:8/723: dwrite d1/d15/d42/d25/d6f/ddb/f52 [0,4194304] 0 2024-03-22T07:28:41.190 INFO:tasks.workunit.client.0.smithi134.stdout:8/724: write d1/d15/d42/d12/f7a [4019602,51051] 0 2024-03-22T07:28:41.190 INFO:tasks.workunit.client.0.smithi134.stdout:8/725: creat d1/ff2 x:0 0 0 2024-03-22T07:28:41.190 INFO:tasks.workunit.client.0.smithi134.stdout:8/726: readlink d1/d15/d42/d25/l33 0 2024-03-22T07:28:41.197 INFO:tasks.workunit.client.0.smithi134.stdout:0/601: symlink dc/d18/d85/laf 0 2024-03-22T07:28:41.197 INFO:tasks.workunit.client.0.smithi134.stdout:0/602: chown dc/de/d55/d65/fac 2 1 2024-03-22T07:28:41.199 INFO:tasks.workunit.client.1.smithi195.stdout:6/713: link d5/d16/l64 d5/d5e/d34/d55/d4b/da2/dad/de3/l102 0 2024-03-22T07:28:41.200 INFO:tasks.workunit.client.0.smithi134.stdout:1/634: mknod d5/da/d13/d1e/ce1 0 2024-03-22T07:28:41.202 INFO:tasks.workunit.client.1.smithi195.stdout:7/793: rename d0/d13/d14/d20/d40/d82/da0/ff5 to d0/d13/d14/d20/d40/d82/db8/f113 0 2024-03-22T07:28:41.204 INFO:tasks.workunit.client.0.smithi134.stdout:4/630: rename d2/d98/cb1 to d2/d25/d74/dde/dc0/ce1 0 2024-03-22T07:28:41.204 INFO:tasks.workunit.client.0.smithi134.stdout:4/631: readlink d2/d25/d74/l8b 0 2024-03-22T07:28:41.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:40 smithi195 ceph-mon[36144]: pgmap v6: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 118 MiB/s wr, 100 op/s 2024-03-22T07:28:41.208 INFO:tasks.workunit.client.1.smithi195.stdout:5/831: creat d9/d12/f10d x:0 0 0 2024-03-22T07:28:41.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/734: link d1/de/d11/d97/c9a d1/de/d41/d87/ce7 0 2024-03-22T07:28:41.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/735: dread - d1/de/fd8 zero size 2024-03-22T07:28:41.209 INFO:tasks.workunit.client.0.smithi134.stdout:7/736: creat d1/de/d11/d48/daf/fe8 x:0 0 0 2024-03-22T07:28:41.210 INFO:tasks.workunit.client.0.smithi134.stdout:8/727: dwrite d1/d15/d42/f28 [4194304,4194304] 0 2024-03-22T07:28:41.211 INFO:tasks.workunit.client.1.smithi195.stdout:9/918: unlink d2/d4/d32/f7c 0 2024-03-22T07:28:41.212 INFO:tasks.workunit.client.0.smithi134.stdout:5/592: symlink d1/d8/d20/lc6 0 2024-03-22T07:28:41.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/666: mknod d0/d2/d6/dad/db1/d97/dab/cd9 0 2024-03-22T07:28:41.213 INFO:tasks.workunit.client.0.smithi134.stdout:9/532: creat d3/d9/d37/d3c/d71/d8e/fbc x:0 0 0 2024-03-22T07:28:41.214 INFO:tasks.workunit.client.1.smithi195.stdout:2/799: link d2/d3/d7/d19/d22/c2e d2/d3/d7/da/de/c110 0 2024-03-22T07:28:41.216 INFO:tasks.workunit.client.1.smithi195.stdout:5/832: write d9/d73/fe1 [1659424,22327] 0 2024-03-22T07:28:41.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/775: symlink d1/d4/dd/df/d44/db4/led 0 2024-03-22T07:28:41.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/776: stat d1/d4/d12/d6c/dbc/d47/db6 0 2024-03-22T07:28:41.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/777: creat d1/d4/d12/d6c/d87/fee x:0 0 0 2024-03-22T07:28:41.217 INFO:tasks.workunit.client.1.smithi195.stdout:0/778: write d1/d4/dd/f13 [3497234,47281] 0 2024-03-22T07:28:41.218 INFO:tasks.workunit.client.0.smithi134.stdout:0/603: symlink dc/de/d55/d65/lb0 0 2024-03-22T07:28:41.219 INFO:tasks.workunit.client.1.smithi195.stdout:8/869: unlink da/de/db3/ddd/caf 0 2024-03-22T07:28:41.219 INFO:tasks.workunit.client.1.smithi195.stdout:8/870: write da/d17/d32/d61/d88/d91/fa8 [1435015,7492] 0 2024-03-22T07:28:41.221 INFO:tasks.workunit.client.0.smithi134.stdout:4/632: creat d2/d25/d48/d6e/d7b/dd7/fe2 x:0 0 0 2024-03-22T07:28:41.225 INFO:tasks.workunit.client.0.smithi134.stdout:8/728: dread d1/d15/d42/f2b [4194304,4194304] 0 2024-03-22T07:28:41.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/794: dwrite d0/d13/d14/d20/d40/d82/da0/d59/f7c [0,4194304] 0 2024-03-22T07:28:41.226 INFO:tasks.workunit.client.1.smithi195.stdout:7/795: creat d0/d13/d14/d20/d40/d82/db8/f114 x:0 0 0 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:1/635: dwrite d5/da/d1b/d27/d60/d72/f7d [0,4194304] 0 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:1/636: chown d5/d1d 322975 1 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:1/637: chown d5/da/d1b/d27/fde 90915655 1 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:1/638: readlink d5/da/d13/l4c 0 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:5/593: read d1/d8/d20/d62/d65/f18 [500702,20859] 0 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:5/594: write d1/d8/d20/d62/d65/f18 [2191268,73908] 0 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:5/595: fsync d1/d8/d20/d62/d65/fb7 0 2024-03-22T07:28:41.227 INFO:tasks.workunit.client.0.smithi134.stdout:7/737: truncate d1/f3a 2346086 0 2024-03-22T07:28:41.228 INFO:tasks.workunit.client.1.smithi195.stdout:6/714: rename d5/d5e/d34/d55/d4b/l90 to d5/d5e/d34/l103 0 2024-03-22T07:28:41.228 INFO:tasks.workunit.client.1.smithi195.stdout:2/800: dwrite d2/d3/d7/d19/fe0 [0,4194304] 0 2024-03-22T07:28:41.233 INFO:tasks.workunit.client.1.smithi195.stdout:9/919: mkdir d2/d4/d6/db/da8/d14f 0 2024-03-22T07:28:41.235 INFO:tasks.workunit.client.1.smithi195.stdout:1/667: link d0/d2/d6/dad/db1/d97/d39/d64/cbb d0/d2/d27/d91/dc8/da4/dc0/cda 0 2024-03-22T07:28:41.236 INFO:tasks.workunit.client.0.smithi134.stdout:0/604: dwrite dc/de/d55/d65/d82/faa [0,4194304] 0 2024-03-22T07:28:41.238 INFO:tasks.workunit.client.1.smithi195.stdout:5/833: symlink d9/d12/l10e 0 2024-03-22T07:28:41.238 INFO:tasks.workunit.client.1.smithi195.stdout:5/834: write d9/d12/f8c [975205,51784] 0 2024-03-22T07:28:41.239 INFO:tasks.workunit.client.0.smithi134.stdout:5/596: write d1/d8/d16/f5a [42371,110962] 0 2024-03-22T07:28:41.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/801: dwrite d2/f4d [4194304,4194304] 0 2024-03-22T07:28:41.247 INFO:tasks.workunit.client.1.smithi195.stdout:0/779: creat d1/d10/d19/d20/fef x:0 0 0 2024-03-22T07:28:41.248 INFO:tasks.workunit.client.1.smithi195.stdout:1/668: dread d0/d2/d27/d91/dc8/f6c [0,4194304] 0 2024-03-22T07:28:41.249 INFO:tasks.workunit.client.0.smithi134.stdout:5/597: dread d1/d8/d16/f5a [0,4194304] 0 2024-03-22T07:28:41.251 INFO:tasks.workunit.client.1.smithi195.stdout:8/871: truncate da/d17/d32/d61/f74 276865 0 2024-03-22T07:28:41.251 INFO:tasks.workunit.client.1.smithi195.stdout:8/872: dread - da/d82/dc6/db4/ffa zero size 2024-03-22T07:28:41.259 INFO:tasks.workunit.client.0.smithi134.stdout:9/533: creat d3/d9/d37/d5a/d7f/daf/fbd x:0 0 0 2024-03-22T07:28:41.262 INFO:tasks.workunit.client.1.smithi195.stdout:7/796: link d0/d13/d14/d20/d40/d82/da0/d59/d79/ff3 d0/d13/d22/f115 0 2024-03-22T07:28:41.263 INFO:tasks.workunit.client.0.smithi134.stdout:4/633: mknod d2/d2a/d80/ce3 0 2024-03-22T07:28:41.264 INFO:tasks.workunit.client.1.smithi195.stdout:6/715: unlink d5/d5e/d34/d55/d4b/da2/dad/l101 0 2024-03-22T07:28:41.265 INFO:tasks.workunit.client.1.smithi195.stdout:6/716: write d5/d5e/d34/d55/d3b/d6e/d3c/f7e [604939,2493] 0 2024-03-22T07:28:41.266 INFO:tasks.workunit.client.1.smithi195.stdout:6/717: chown d5/d5e/d34/d55/d3b/dc2/fe8 847 1 2024-03-22T07:28:41.268 INFO:tasks.workunit.client.0.smithi134.stdout:1/639: symlink d5/d1d/d49/le2 0 2024-03-22T07:28:41.268 INFO:tasks.workunit.client.0.smithi134.stdout:1/640: stat d5/d1d/d49/fd6 0 2024-03-22T07:28:41.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/738: truncate d1/de/d11/d48/d52/f3e 3607784 0 2024-03-22T07:28:41.272 INFO:tasks.workunit.client.0.smithi134.stdout:4/634: dread d2/d15/f30 [0,4194304] 0 2024-03-22T07:28:41.272 INFO:tasks.workunit.client.1.smithi195.stdout:9/920: creat d2/d4/d6/d18/d50/f150 x:0 0 0 2024-03-22T07:28:41.278 INFO:tasks.workunit.client.1.smithi195.stdout:5/835: symlink d9/d2d/d8f/l10f 0 2024-03-22T07:28:41.280 INFO:tasks.workunit.client.0.smithi134.stdout:4/635: write d2/d25/d48/f4b [1782452,53477] 0 2024-03-22T07:28:41.280 INFO:tasks.workunit.client.0.smithi134.stdout:4/636: readlink d2/d15/d35/lad 0 2024-03-22T07:28:41.281 INFO:tasks.workunit.client.0.smithi134.stdout:0/605: mknod dc/de/d55/d65/cb1 0 2024-03-22T07:28:41.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/921: read d2/d4/d6/ffd [3209324,93487] 0 2024-03-22T07:28:41.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/922: write d2/d4/d6/d18/fbf [979152,99386] 0 2024-03-22T07:28:41.281 INFO:tasks.workunit.client.1.smithi195.stdout:9/923: chown f0 7588668 1 2024-03-22T07:28:41.282 INFO:tasks.workunit.client.1.smithi195.stdout:9/924: fdatasync d2/d4/d32/d6d/deb/ff6 0 2024-03-22T07:28:41.282 INFO:tasks.workunit.client.1.smithi195.stdout:9/925: creat d2/d4/d1d/ddc/f151 x:0 0 0 2024-03-22T07:28:41.288 INFO:tasks.workunit.client.1.smithi195.stdout:2/802: rename d2/d3/d24/fba to d2/d3/d7/f111 0 2024-03-22T07:28:41.288 INFO:tasks.workunit.client.1.smithi195.stdout:2/803: stat d2/d3/d7/da/de/lea 0 2024-03-22T07:28:41.289 INFO:tasks.workunit.client.0.smithi134.stdout:5/598: creat d1/d8/d20/d62/d68/fc7 x:0 0 0 2024-03-22T07:28:41.290 INFO:tasks.workunit.client.1.smithi195.stdout:0/780: mkdir d1/d4/d22/df0 0 2024-03-22T07:28:41.291 INFO:tasks.workunit.client.0.smithi134.stdout:9/534: rmdir d3/d9/d37/d3c/d71/d7a 39 2024-03-22T07:28:41.294 INFO:tasks.workunit.client.0.smithi134.stdout:1/641: mkdir d5/d1d/dd0/ddc/de3 0 2024-03-22T07:28:41.297 INFO:tasks.workunit.client.0.smithi134.stdout:7/739: link d1/de/d41/fd7 d1/de/d11/d48/daf/dbf/fe9 0 2024-03-22T07:28:41.299 INFO:tasks.workunit.client.0.smithi134.stdout:4/637: stat d2/d2a/d80/dd6/la6 0 2024-03-22T07:28:41.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/873: mkdir da/dc/d10b 0 2024-03-22T07:28:41.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/874: chown da/d17/l37 33036 1 2024-03-22T07:28:41.300 INFO:tasks.workunit.client.1.smithi195.stdout:8/875: getdents da/dc/d10b 0 2024-03-22T07:28:41.305 INFO:tasks.workunit.client.1.smithi195.stdout:7/797: link d0/d98/cc1 d0/d98/c116 0 2024-03-22T07:28:41.305 INFO:tasks.workunit.client.1.smithi195.stdout:7/798: truncate d0/d13/d22/d28/ff8 402725 0 2024-03-22T07:28:41.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/599: rename d1/d8/d16/d4a/l4c to d1/d4/lc8 0 2024-03-22T07:28:41.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/600: write d1/d8/d20/d62/d65/dac/fbe [732333,45565] 0 2024-03-22T07:28:41.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/601: write d1/d8/da1/fc1 [216708,12805] 0 2024-03-22T07:28:41.309 INFO:tasks.workunit.client.0.smithi134.stdout:9/535: getdents d3/d9/d37/d6f/d54/d9d 0 2024-03-22T07:28:41.313 INFO:tasks.workunit.client.0.smithi134.stdout:1/642: symlink d5/d93/le4 0 2024-03-22T07:28:41.313 INFO:tasks.workunit.client.0.smithi134.stdout:1/643: chown d5/d1d/d2d/c4b 7376 1 2024-03-22T07:28:41.320 INFO:tasks.workunit.client.0.smithi134.stdout:7/740: dwrite d1/de/d11/d2b/d31/f8e [0,4194304] 0 2024-03-22T07:28:41.320 INFO:tasks.workunit.client.0.smithi134.stdout:9/536: dread d3/d9/df/d12/f2a [0,4194304] 0 2024-03-22T07:28:41.320 INFO:tasks.workunit.client.0.smithi134.stdout:9/537: dread - d3/d9/d37/d5a/f9e zero size 2024-03-22T07:28:41.320 INFO:tasks.workunit.client.1.smithi195.stdout:1/669: rename d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/c6e to d0/d2/d6/dad/db1/d97/d39/d40/db3/cdb 0 2024-03-22T07:28:41.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/804: unlink d2/d3/d7/d5c/f6c 0 2024-03-22T07:28:41.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/805: write d2/d3/db/d82/f104 [4438061,5416] 0 2024-03-22T07:28:41.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/806: truncate d2/d3/d21/d60/d81/f84 826748 0 2024-03-22T07:28:41.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/807: truncate d2/d3/d21/d60/d81/d9a/fe7 370705 0 2024-03-22T07:28:41.329 INFO:tasks.workunit.client.1.smithi195.stdout:7/799: mkdir d0/d13/d14/d20/d40/d82/da0/d117 0 2024-03-22T07:28:41.330 INFO:tasks.workunit.client.0.smithi134.stdout:5/602: dwrite d1/d8/f63 [0,4194304] 0 2024-03-22T07:28:41.331 INFO:tasks.workunit.client.0.smithi134.stdout:1/644: mkdir d5/da/d1b/de5 0 2024-03-22T07:28:41.331 INFO:tasks.workunit.client.0.smithi134.stdout:1/645: chown d5/da/f26 1573 1 2024-03-22T07:28:41.331 INFO:tasks.workunit.client.0.smithi134.stdout:1/646: truncate d5/d1d/f75 161453 0 2024-03-22T07:28:41.333 INFO:tasks.workunit.client.1.smithi195.stdout:9/926: mkdir d2/d4/d6/db/d20/d47/dee/d152 0 2024-03-22T07:28:41.334 INFO:tasks.workunit.client.0.smithi134.stdout:9/538: write d3/d9/d37/d6f/d54/f68 [7977588,123976] 0 2024-03-22T07:28:41.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/670: write d0/d2/d27/d91/dc8/f15 [877833,24406] 0 2024-03-22T07:28:41.341 INFO:tasks.workunit.client.0.smithi134.stdout:9/539: dread d3/d9/df/d57/fb8 [0,4194304] 0 2024-03-22T07:28:41.341 INFO:tasks.workunit.client.0.smithi134.stdout:9/540: truncate d3/d9/d37/d3c/f78 498126 0 2024-03-22T07:28:41.345 INFO:tasks.workunit.client.1.smithi195.stdout:7/800: getdents d0/d13/d22/d57/d7b 0 2024-03-22T07:28:41.345 INFO:tasks.workunit.client.1.smithi195.stdout:7/801: fsync d0/d13/d14/d20/d40/d82/db8/f114 0 2024-03-22T07:28:41.345 INFO:tasks.workunit.client.0.smithi134.stdout:0/606: rmdir dc/de/d55/d65 39 2024-03-22T07:28:41.346 INFO:tasks.workunit.client.0.smithi134.stdout:5/603: creat d1/d8/d20/d62/d65/fc9 x:0 0 0 2024-03-22T07:28:41.347 INFO:tasks.workunit.client.1.smithi195.stdout:4/791: sync 2024-03-22T07:28:41.349 INFO:tasks.workunit.client.1.smithi195.stdout:4/792: dread d13/d63/d79/de9/f56 [0,4194304] 0 2024-03-22T07:28:41.349 INFO:tasks.workunit.client.0.smithi134.stdout:1/647: rename d5/da/d13/d1e/d63/d9d/ccf to d5/da/d68/ce6 0 2024-03-22T07:28:41.352 INFO:tasks.workunit.client.1.smithi195.stdout:4/793: dread d13/d63/f18 [0,4194304] 0 2024-03-22T07:28:41.353 INFO:tasks.workunit.client.1.smithi195.stdout:6/718: rename d5/d5e/d34/d55/d4b to d5/d16/d45/df8/d104 0 2024-03-22T07:28:41.355 INFO:tasks.workunit.client.0.smithi134.stdout:7/741: getdents d1/de/d11/d2b 0 2024-03-22T07:28:41.357 INFO:tasks.workunit.client.1.smithi195.stdout:8/876: rmdir da/d17/d32/d61/d88/dec 0 2024-03-22T07:28:41.357 INFO:tasks.workunit.client.1.smithi195.stdout:3/790: sync 2024-03-22T07:28:41.359 INFO:tasks.workunit.client.0.smithi134.stdout:9/541: symlink d3/d9/df/lbe 0 2024-03-22T07:28:41.359 INFO:tasks.workunit.client.0.smithi134.stdout:9/542: creat d3/d9/d37/d6f/d54/fbf x:0 0 0 2024-03-22T07:28:41.363 INFO:tasks.workunit.client.0.smithi134.stdout:5/604: dwrite d1/f57 [0,4194304] 0 2024-03-22T07:28:41.365 INFO:tasks.workunit.client.1.smithi195.stdout:7/802: creat d0/d13/d14/d20/d40/d82/f118 x:0 0 0 2024-03-22T07:28:41.367 INFO:tasks.workunit.client.0.smithi134.stdout:0/607: dread dc/d18/f79 [0,4194304] 0 2024-03-22T07:28:41.371 INFO:tasks.workunit.client.0.smithi134.stdout:5/605: dread d1/d8/d20/d62/f8e [0,4194304] 0 2024-03-22T07:28:41.372 INFO:tasks.workunit.client.0.smithi134.stdout:5/606: write d1/d8/d20/d62/d65/f18 [3632682,91366] 0 2024-03-22T07:28:41.373 INFO:tasks.workunit.client.1.smithi195.stdout:4/794: write d13/d15/f1c [1267049,33652] 0 2024-03-22T07:28:41.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/781: rename d1/d4/d12/d6c/dbc/d43/f4c to d1/d4/dd/df/d2b/d63/ff1 0 2024-03-22T07:28:41.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/782: chown d1/d4/dd/d66/d80/lb9 1 1 2024-03-22T07:28:41.373 INFO:tasks.workunit.client.1.smithi195.stdout:0/783: fsync d1/d4/dd/df/d44/fb0 0 2024-03-22T07:28:41.374 INFO:tasks.workunit.client.1.smithi195.stdout:6/719: truncate d5/d5e/d34/d55/d3b/d6e/d3c/f6c 154319 0 2024-03-22T07:28:41.378 INFO:tasks.workunit.client.0.smithi134.stdout:7/742: rename d1/d19/d32/c9b to d1/de/d11/d48/cea 0 2024-03-22T07:28:41.379 INFO:tasks.workunit.client.1.smithi195.stdout:7/803: symlink d0/d13/d14/d29/d35/d3a/d7e/l119 0 2024-03-22T07:28:41.380 INFO:tasks.workunit.client.1.smithi195.stdout:8/877: dwrite da/de/db3/ddd/fa0 [0,4194304] 0 2024-03-22T07:28:41.381 INFO:tasks.workunit.client.0.smithi134.stdout:9/543: dwrite d3/d9/d37/d6f/d54/fbf [0,4194304] 0 2024-03-22T07:28:41.389 INFO:tasks.workunit.client.0.smithi134.stdout:0/608: symlink dc/d18/d85/lb2 0 2024-03-22T07:28:41.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/795: mknod d13/d63/d79/d68/c10c 0 2024-03-22T07:28:41.392 INFO:tasks.workunit.client.1.smithi195.stdout:4/796: fdatasync d13/d15/f98 0 2024-03-22T07:28:41.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/607: rename d1/d8/d16/f9d to d1/d8/d20/d62/d68/fca 0 2024-03-22T07:28:41.396 INFO:tasks.workunit.client.1.smithi195.stdout:0/784: symlink d1/d4/d12/d6c/dbc/d47/lf2 0 2024-03-22T07:28:41.400 INFO:tasks.workunit.client.1.smithi195.stdout:6/720: creat d5/d16/d45/df8/d104/da2/dad/de3/f105 x:0 0 0 2024-03-22T07:28:41.400 INFO:tasks.workunit.client.1.smithi195.stdout:6/721: chown d5/d16/d45/df8/d104/da2/d1a/fb2 772 1 2024-03-22T07:28:41.402 INFO:tasks.workunit.client.0.smithi134.stdout:7/743: dwrite d1/de/d11/d48/fc [0,4194304] 0 2024-03-22T07:28:41.402 INFO:tasks.workunit.client.0.smithi134.stdout:7/744: write d1/dae/fc7 [316156,13801] 0 2024-03-22T07:28:41.402 INFO:tasks.workunit.client.0.smithi134.stdout:9/544: dwrite d3/d9/df/d12/f2f [0,4194304] 0 2024-03-22T07:28:41.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/804: creat d0/d13/d14/d29/da2/d110/dec/f11a x:0 0 0 2024-03-22T07:28:41.404 INFO:tasks.workunit.client.1.smithi195.stdout:0/785: dread d1/d10/d19/f65 [0,4194304] 0 2024-03-22T07:28:41.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/805: creat d0/d13/d14/d29/d35/d3a/d7e/f11b x:0 0 0 2024-03-22T07:28:41.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/806: dread d0/d13/d14/d80/fd5 [0,4194304] 0 2024-03-22T07:28:41.411 INFO:tasks.workunit.client.1.smithi195.stdout:8/878: mkdir da/dde/dfd/d10c 0 2024-03-22T07:28:41.416 INFO:tasks.workunit.client.0.smithi134.stdout:0/609: dread - dc/d18/f74 zero size 2024-03-22T07:28:41.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/545: dwrite d3/f14 [0,4194304] 0 2024-03-22T07:28:41.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/546: dread - d3/d9/df/fb4 zero size 2024-03-22T07:28:41.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/547: dread - d3/d9/d37/d3c/d71/fa8 zero size 2024-03-22T07:28:41.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/548: read d3/d9/d37/d6f/d54/f68 [6995965,85905] 0 2024-03-22T07:28:41.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/549: readlink d3/d9/df/d57/l77 0 2024-03-22T07:28:41.422 INFO:tasks.workunit.client.0.smithi134.stdout:1/648: rename d5/da/d13/d1e/d67 to d5/da/d13/d1e/de7 0 2024-03-22T07:28:41.423 INFO:tasks.workunit.client.1.smithi195.stdout:8/879: write da/d82/dc6/d53/f89 [2726747,42388] 0 2024-03-22T07:28:41.424 INFO:tasks.workunit.client.1.smithi195.stdout:0/786: truncate d1/d4/f2e 7637731 0 2024-03-22T07:28:41.426 INFO:tasks.workunit.client.0.smithi134.stdout:5/608: symlink d1/d8/d20/d8a/lcb 0 2024-03-22T07:28:41.426 INFO:tasks.workunit.client.0.smithi134.stdout:5/609: stat d1/d4 0 2024-03-22T07:28:41.428 INFO:tasks.workunit.client.0.smithi134.stdout:7/745: symlink d1/de/d11/d2b/d31/leb 0 2024-03-22T07:28:41.430 INFO:tasks.workunit.client.1.smithi195.stdout:7/807: mknod d0/d13/d14/d80/d9c/c11c 0 2024-03-22T07:28:41.430 INFO:tasks.workunit.client.1.smithi195.stdout:7/808: truncate d0/d13/d22/d57/d7b/d8c/f90 4930479 0 2024-03-22T07:28:41.431 INFO:tasks.workunit.client.0.smithi134.stdout:0/610: creat dc/d17/fb3 x:0 0 0 2024-03-22T07:28:41.433 INFO:tasks.workunit.client.0.smithi134.stdout:1/649: mknod d5/da/d1b/d27/d39/da4/ce8 0 2024-03-22T07:28:41.433 INFO:tasks.workunit.client.0.smithi134.stdout:1/650: stat d5/da/d13/d1e/ce1 0 2024-03-22T07:28:41.434 INFO:tasks.workunit.client.0.smithi134.stdout:9/550: dwrite d3/d9/d37/d3c/d71/d7a/f9c [0,4194304] 0 2024-03-22T07:28:41.435 INFO:tasks.workunit.client.0.smithi134.stdout:9/551: dread - d3/d9/df/d12/d3b/f6e zero size 2024-03-22T07:28:41.436 INFO:tasks.workunit.client.1.smithi195.stdout:2/808: rename d2/d3/d1a to d2/d1e/d93/d112 0 2024-03-22T07:28:41.439 INFO:tasks.workunit.client.0.smithi134.stdout:0/611: mknod dc/d17/da9/cb4 0 2024-03-22T07:28:41.439 INFO:tasks.workunit.client.0.smithi134.stdout:0/612: write dc/de/d55/f71 [3026635,89877] 0 2024-03-22T07:28:41.440 INFO:tasks.workunit.client.0.smithi134.stdout:0/613: fdatasync dc/de/d55/f97 0 2024-03-22T07:28:41.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/880: creat da/d17/d32/d78/f10d x:0 0 0 2024-03-22T07:28:41.441 INFO:tasks.workunit.client.1.smithi195.stdout:8/881: write da/d17/d32/f40 [4589267,32857] 0 2024-03-22T07:28:41.442 INFO:tasks.workunit.client.0.smithi134.stdout:1/651: truncate d5/da/d1b/d27/d39/f82 915517 0 2024-03-22T07:28:41.444 INFO:tasks.workunit.client.1.smithi195.stdout:7/809: link d0/d13/d14/f30 d0/d13/f11d 0 2024-03-22T07:28:41.444 INFO:tasks.workunit.client.1.smithi195.stdout:7/810: creat d0/d98/dab/f11e x:0 0 0 2024-03-22T07:28:41.446 INFO:tasks.workunit.client.0.smithi134.stdout:7/746: dwrite d1/f33 [0,4194304] 0 2024-03-22T07:28:41.446 INFO:tasks.workunit.client.0.smithi134.stdout:7/747: stat d1/de/d11/d2b/d31/fa7 0 2024-03-22T07:28:41.449 INFO:tasks.workunit.client.0.smithi134.stdout:5/610: truncate d1/d8/d20/d62/d65/f43 2390387 0 2024-03-22T07:28:41.449 INFO:tasks.workunit.client.1.smithi195.stdout:8/882: read da/d82/dc6/f87 [5516710,66362] 0 2024-03-22T07:28:41.451 INFO:tasks.workunit.client.1.smithi195.stdout:2/809: creat d2/d3/dac/dad/f113 x:0 0 0 2024-03-22T07:28:41.457 INFO:tasks.workunit.client.0.smithi134.stdout:7/748: dread d1/de/d11/d48/f8b [0,4194304] 0 2024-03-22T07:28:41.457 INFO:tasks.workunit.client.0.smithi134.stdout:7/749: chown d1/de/d41 0 1 2024-03-22T07:28:41.460 INFO:tasks.workunit.client.0.smithi134.stdout:5/611: write d1/f57 [3885344,36166] 0 2024-03-22T07:28:41.460 INFO:tasks.workunit.client.0.smithi134.stdout:1/652: symlink d5/da/d13/d1e/d63/d9d/le9 0 2024-03-22T07:28:41.465 INFO:tasks.workunit.client.0.smithi134.stdout:2/525: sync 2024-03-22T07:28:41.465 INFO:tasks.workunit.client.0.smithi134.stdout:6/440: sync 2024-03-22T07:28:41.465 INFO:tasks.workunit.client.0.smithi134.stdout:3/562: sync 2024-03-22T07:28:41.466 INFO:tasks.workunit.client.1.smithi195.stdout:9/927: rename d2/d4/d6/d18/d50/l72 to d2/d4/d6/dd1/l153 0 2024-03-22T07:28:41.466 INFO:tasks.workunit.client.1.smithi195.stdout:8/883: dwrite da/d17/d32/f7e [0,4194304] 0 2024-03-22T07:28:41.470 INFO:tasks.workunit.client.1.smithi195.stdout:2/810: mknod d2/d3/d21/d60/d81/c114 0 2024-03-22T07:28:41.470 INFO:tasks.workunit.client.1.smithi195.stdout:2/811: creat d2/d3/db/db3/f115 x:0 0 0 2024-03-22T07:28:41.471 INFO:tasks.workunit.client.1.smithi195.stdout:5/836: sync 2024-03-22T07:28:41.471 INFO:tasks.workunit.client.1.smithi195.stdout:1/671: sync 2024-03-22T07:28:41.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/791: rename d3/df/d15/d1d/d5c/d47/f66 to d3/df/d15/f103 0 2024-03-22T07:28:41.473 INFO:tasks.workunit.client.1.smithi195.stdout:3/792: creat d3/df/d15/f104 x:0 0 0 2024-03-22T07:28:41.475 INFO:tasks.workunit.client.1.smithi195.stdout:9/928: creat d2/d4/d32/d6d/d78/d79/f154 x:0 0 0 2024-03-22T07:28:41.482 INFO:tasks.workunit.client.1.smithi195.stdout:1/672: link d0/d2/d6/f62 d0/d2/d6/dad/db1/d97/d39/d40/dc9/fdc 0 2024-03-22T07:28:41.484 INFO:tasks.workunit.client.1.smithi195.stdout:2/812: dwrite d2/d3/d21/d40/f9b [0,4194304] 0 2024-03-22T07:28:41.484 INFO:tasks.workunit.client.1.smithi195.stdout:1/673: dread d0/d2/d27/d91/dc8/d2a/fb0 [0,4194304] 0 2024-03-22T07:28:41.484 INFO:tasks.workunit.client.1.smithi195.stdout:4/797: rename d13/d63/d36/d5f/d83/fba to d13/d63/d79/de9/d7e/d85/d101/f10d 0 2024-03-22T07:28:41.486 INFO:tasks.workunit.client.0.smithi134.stdout:0/614: mknod dc/d18/cb5 0 2024-03-22T07:28:41.488 INFO:tasks.workunit.client.1.smithi195.stdout:3/793: symlink d3/df/d15/d1d/d5c/d47/dbb/l105 0 2024-03-22T07:28:41.488 INFO:tasks.workunit.client.1.smithi195.stdout:3/794: creat d3/d18/d89/d76/f106 x:0 0 0 2024-03-22T07:28:41.488 INFO:tasks.workunit.client.0.smithi134.stdout:7/750: symlink d1/de/d11/d48/daf/lec 0 2024-03-22T07:28:41.489 INFO:tasks.workunit.client.1.smithi195.stdout:9/929: mknod d2/d4/d1d/d9b/c155 0 2024-03-22T07:28:41.492 INFO:tasks.workunit.client.0.smithi134.stdout:5/612: mknod d1/d8/da1/db0/ccc 0 2024-03-22T07:28:41.496 INFO:tasks.workunit.client.1.smithi195.stdout:2/813: mkdir d2/d3/d7/d19/d22/d26/d3c/d116 0 2024-03-22T07:28:41.496 INFO:tasks.workunit.client.1.smithi195.stdout:2/814: write d2/d3/fa5 [585318,45427] 0 2024-03-22T07:28:41.499 INFO:tasks.workunit.client.1.smithi195.stdout:1/674: mknod d0/d2/d6/dad/db1/d97/d39/d40/cdd 0 2024-03-22T07:28:41.499 INFO:tasks.workunit.client.1.smithi195.stdout:1/675: readlink d0/d2/d6/dad/db1/d97/d39/d64/d7a/l87 0 2024-03-22T07:28:41.500 INFO:tasks.workunit.client.0.smithi134.stdout:1/653: symlink d5/da/d1b/d27/d60/lea 0 2024-03-22T07:28:41.502 INFO:tasks.workunit.client.1.smithi195.stdout:6/722: rename d5/d16/d5a/l9b to d5/d5e/d34/d55/d3b/d7f/db4/l106 0 2024-03-22T07:28:41.504 INFO:tasks.workunit.client.0.smithi134.stdout:9/552: rename d3/d9/df/d12/d3b to d3/d9/d37/d6f/d54/d9d/dc0 0 2024-03-22T07:28:41.504 INFO:tasks.workunit.client.0.smithi134.stdout:9/553: chown d3/d9/df/d12/f58 15727288 1 2024-03-22T07:28:41.504 INFO:tasks.workunit.client.0.smithi134.stdout:9/554: truncate d3/d9/df/d57/fa9 374040 0 2024-03-22T07:28:41.504 INFO:tasks.workunit.client.1.smithi195.stdout:9/930: dwrite d2/d4/d32/d102/f14b [0,4194304] 0 2024-03-22T07:28:41.508 INFO:tasks.workunit.client.0.smithi134.stdout:6/441: truncate d2/f35 838985 0 2024-03-22T07:28:41.511 INFO:tasks.workunit.client.1.smithi195.stdout:2/815: dread d2/d3/fe2 [0,4194304] 0 2024-03-22T07:28:41.511 INFO:tasks.workunit.client.1.smithi195.stdout:2/816: fsync d2/d3/db/d82/fd0 0 2024-03-22T07:28:41.512 INFO:tasks.workunit.client.1.smithi195.stdout:3/795: rmdir d3/df/d15/d1d/d5c/d47/d67/d93/da2 39 2024-03-22T07:28:41.513 INFO:tasks.workunit.client.0.smithi134.stdout:3/563: mkdir d4/d8/d69/d6a/db8 0 2024-03-22T07:28:41.513 INFO:tasks.workunit.client.0.smithi134.stdout:3/564: write d4/d10/f5d [1044931,34161] 0 2024-03-22T07:28:41.516 INFO:tasks.workunit.client.1.smithi195.stdout:1/676: dwrite d0/d2/d27/d91/dc8/f61 [0,4194304] 0 2024-03-22T07:28:41.516 INFO:tasks.workunit.client.1.smithi195.stdout:1/677: dread - d0/d2/d6/dad/db1/d97/d39/d40/db3/fbf zero size 2024-03-22T07:28:41.517 INFO:tasks.workunit.client.1.smithi195.stdout:0/787: rename d1/d4/dd/df/d44/fb0 to d1/d10/d1f/dbf/ff3 0 2024-03-22T07:28:41.519 INFO:tasks.workunit.client.0.smithi134.stdout:2/526: creat d2/fa3 x:0 0 0 2024-03-22T07:28:41.522 INFO:tasks.workunit.client.1.smithi195.stdout:3/796: dread d3/df/d15/d1d/d5c/d47/d67/d80/f102 [0,4194304] 0 2024-03-22T07:28:41.525 INFO:tasks.workunit.client.1.smithi195.stdout:1/678: link d0/d2/d6/dad/db1/d97/d39/d40/c48 d0/d2/d6/cde 0 2024-03-22T07:28:41.526 INFO:tasks.workunit.client.0.smithi134.stdout:7/751: link d1/de/d11/d48/f8b d1/de/d11/d48/fed 0 2024-03-22T07:28:41.530 INFO:tasks.workunit.client.1.smithi195.stdout:2/817: dread d2/d3/d7/da/de/f35 [0,4194304] 0 2024-03-22T07:28:41.532 INFO:tasks.workunit.client.1.smithi195.stdout:1/679: write d0/d2/d6/f8b [3663823,13685] 0 2024-03-22T07:28:41.534 INFO:tasks.workunit.client.0.smithi134.stdout:1/654: link d5/d1d/d2d/l5e d5/da/d1b/d27/d60/leb 0 2024-03-22T07:28:41.535 INFO:tasks.workunit.client.1.smithi195.stdout:2/818: dread d2/d1e/d93/d112/fbd [0,4194304] 0 2024-03-22T07:28:41.535 INFO:tasks.workunit.client.1.smithi195.stdout:9/931: dwrite d2/d4/d6/db/d20/d4a/f5e [0,4194304] 0 2024-03-22T07:28:41.535 INFO:tasks.workunit.client.1.smithi195.stdout:8/884: rename da/dc/le3 to da/d82/dc6/d53/dca/l10e 0 2024-03-22T07:28:41.536 INFO:tasks.workunit.client.1.smithi195.stdout:0/788: creat d1/d4/d22/dd8/ff4 x:0 0 0 2024-03-22T07:28:41.536 INFO:tasks.workunit.client.0.smithi134.stdout:1/655: dread d5/da/d1b/d27/fab [0,4194304] 0 2024-03-22T07:28:41.536 INFO:tasks.workunit.client.1.smithi195.stdout:6/723: dwrite d5/d5e/d34/d55/f7a [0,4194304] 0 2024-03-22T07:28:41.537 INFO:tasks.workunit.client.0.smithi134.stdout:5/613: rename d1/d8/d20/d62/d65/f53 to d1/fcd 0 2024-03-22T07:28:41.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/442: creat d2/d6e/fa6 x:0 0 0 2024-03-22T07:28:41.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/443: truncate d2/d1b/d1d/d5e/d6f/d7d/f3a 2196859 0 2024-03-22T07:28:41.541 INFO:tasks.workunit.client.1.smithi195.stdout:2/819: unlink d2/d3/db/f88 0 2024-03-22T07:28:41.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/820: write d2/d3/d7/d19/d22/d26/f6f [1984742,125963] 0 2024-03-22T07:28:41.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/821: getdents d2/d3/d21/d4c 0 2024-03-22T07:28:41.542 INFO:tasks.workunit.client.1.smithi195.stdout:2/822: stat d2/d3/d7/d19/d22/d26/fd4 0 2024-03-22T07:28:41.543 INFO:tasks.workunit.client.0.smithi134.stdout:3/565: unlink d4/d8/fa3 0 2024-03-22T07:28:41.543 INFO:tasks.workunit.client.0.smithi134.stdout:3/566: write d4/f76 [1356688,52179] 0 2024-03-22T07:28:41.543 INFO:tasks.workunit.client.0.smithi134.stdout:3/567: dread - d4/f56 zero size 2024-03-22T07:28:41.543 INFO:tasks.workunit.client.0.smithi134.stdout:3/568: write d4/d8/d5c/fb3 [1145708,66397] 0 2024-03-22T07:28:41.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/932: write d2/d4/d1d/ddc/fe6 [1374170,18668] 0 2024-03-22T07:28:41.544 INFO:tasks.workunit.client.1.smithi195.stdout:9/933: dread d2/d4/d6/d18/d50/d88/fdf [0,4194304] 0 2024-03-22T07:28:41.547 INFO:tasks.workunit.client.0.smithi134.stdout:4/638: sync 2024-03-22T07:28:41.548 INFO:tasks.workunit.client.0.smithi134.stdout:4/639: write d2/d15/f11 [5052782,12421] 0 2024-03-22T07:28:41.548 INFO:tasks.workunit.client.0.smithi134.stdout:8/729: sync 2024-03-22T07:28:41.549 INFO:tasks.workunit.client.1.smithi195.stdout:5/837: rename d9/d12/d1d/d36/d7d/dd2/lec to d9/d2d/d84/dcf/l110 0 2024-03-22T07:28:41.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/656: dread d5/da/d13/d1e/d63/f97 [0,4194304] 0 2024-03-22T07:28:41.550 INFO:tasks.workunit.client.0.smithi134.stdout:1/657: fdatasync d5/da/d1b/f30 0 2024-03-22T07:28:41.552 INFO:tasks.workunit.client.0.smithi134.stdout:5/614: write d1/d8/d20/f70 [4095830,105339] 0 2024-03-22T07:28:41.552 INFO:tasks.workunit.client.0.smithi134.stdout:5/615: dread - d1/d8/d20/d62/d65/d95/faa zero size 2024-03-22T07:28:41.552 INFO:tasks.workunit.client.1.smithi195.stdout:3/797: dwrite d3/f91 [0,4194304] 0 2024-03-22T07:28:41.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/680: dwrite d0/d2/d6/f4b [0,4194304] 0 2024-03-22T07:28:41.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/681: chown d0/d2/d6/cd 1254116 1 2024-03-22T07:28:41.553 INFO:tasks.workunit.client.1.smithi195.stdout:1/682: write d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/f88 [4607709,116789] 0 2024-03-22T07:28:41.553 INFO:tasks.workunit.client.0.smithi134.stdout:0/615: mknod dc/d18/cb6 0 2024-03-22T07:28:41.553 INFO:tasks.workunit.client.0.smithi134.stdout:0/616: fdatasync dc/d17/f78 0 2024-03-22T07:28:41.553 INFO:tasks.workunit.client.0.smithi134.stdout:0/617: dread - dc/de/d55/d65/d82/f98 zero size 2024-03-22T07:28:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:8/885: rmdir da/d82/dc6/d53/d8d/dd6 39 2024-03-22T07:28:41.555 INFO:tasks.workunit.client.1.smithi195.stdout:8/886: chown da/d17/fc5 0 1 2024-03-22T07:28:41.556 INFO:tasks.workunit.client.1.smithi195.stdout:8/887: write da/d17/d32/d78/f10d [482640,65229] 0 2024-03-22T07:28:41.557 INFO:tasks.workunit.client.1.smithi195.stdout:3/798: write d3/df/d15/fcc [739431,16013] 0 2024-03-22T07:28:41.557 INFO:tasks.workunit.client.0.smithi134.stdout:9/555: rename d3/d9/df/d57/d67/d5f/l63 to d3/d9/df/d12/lc1 0 2024-03-22T07:28:41.560 INFO:tasks.workunit.client.1.smithi195.stdout:0/789: creat d1/d4/d22/df0/ff5 x:0 0 0 2024-03-22T07:28:41.562 INFO:tasks.workunit.client.0.smithi134.stdout:6/444: link d2/d3f/c37 d2/d1b/d1d/d5e/ca7 0 2024-03-22T07:28:41.563 INFO:tasks.workunit.client.0.smithi134.stdout:8/730: read d1/d15/d42/d76/d8f/dad/dae/fc0 [2002850,2268] 0 2024-03-22T07:28:41.563 INFO:tasks.workunit.client.0.smithi134.stdout:8/731: write d1/d4/d61/fed [50054,28970] 0 2024-03-22T07:28:41.565 INFO:tasks.workunit.client.0.smithi134.stdout:4/640: symlink d2/d25/d74/le4 0 2024-03-22T07:28:41.565 INFO:tasks.workunit.client.0.smithi134.stdout:4/641: truncate d2/d25/d48/d87/fa0 5050191 0 2024-03-22T07:28:41.566 INFO:tasks.workunit.client.0.smithi134.stdout:1/658: write d5/da/d1b/d27/d39/f58 [489311,21683] 0 2024-03-22T07:28:41.566 INFO:tasks.workunit.client.0.smithi134.stdout:1/659: chown d5/da/d1b/d27/d60/lea 6634928 1 2024-03-22T07:28:41.567 INFO:tasks.workunit.client.0.smithi134.stdout:1/660: chown d5/da/d13/d1e/d62/lcd 819219 1 2024-03-22T07:28:41.567 INFO:tasks.workunit.client.0.smithi134.stdout:1/661: read d5/da/d68/f6b [165038,47349] 0 2024-03-22T07:28:41.567 INFO:tasks.workunit.client.0.smithi134.stdout:1/662: dread d5/da/d13/d1e/d9b/f9f [0,4194304] 0 2024-03-22T07:28:41.567 INFO:tasks.workunit.client.0.smithi134.stdout:1/663: stat d5/da/d13/d1e/d62/faf 0 2024-03-22T07:28:41.573 INFO:tasks.workunit.client.0.smithi134.stdout:2/527: rename d2/d5/d8/d5d/da1/d3c/d4f/l74 to d2/d5/d8/d31/la4 0 2024-03-22T07:28:41.574 INFO:tasks.workunit.client.0.smithi134.stdout:6/445: write d2/d1b/f29 [93755,79843] 0 2024-03-22T07:28:41.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/446: fsync d2/f1c 0 2024-03-22T07:28:41.575 INFO:tasks.workunit.client.0.smithi134.stdout:8/732: truncate d1/d15/d42/d25/d6f/ddb/f3a 4038373 0 2024-03-22T07:28:41.576 INFO:tasks.workunit.client.1.smithi195.stdout:6/724: mkdir d5/d16/d45/d53/d107 0 2024-03-22T07:28:41.578 INFO:tasks.workunit.client.0.smithi134.stdout:4/642: mkdir d2/d25/d74/dde/dc0/de5 0 2024-03-22T07:28:41.578 INFO:tasks.workunit.client.0.smithi134.stdout:4/643: chown d2/d15/d6f/fd5 6908 1 2024-03-22T07:28:41.580 INFO:tasks.workunit.client.0.smithi134.stdout:1/664: mknod d5/da/d13/db9/cec 0 2024-03-22T07:28:41.580 INFO:tasks.workunit.client.0.smithi134.stdout:1/665: creat d5/d1d/d49/fed x:0 0 0 2024-03-22T07:28:41.581 INFO:tasks.workunit.client.0.smithi134.stdout:1/666: read d5/da/d1b/d27/d39/f58 [187369,22110] 0 2024-03-22T07:28:41.582 INFO:tasks.workunit.client.0.smithi134.stdout:1/667: write d5/da/d68/da1/fbd [3919892,30930] 0 2024-03-22T07:28:41.583 INFO:tasks.workunit.client.1.smithi195.stdout:4/798: rename d13/d63/d21/l91 to d13/d63/d79/de9/d7e/d8c/db7/d100/l10e 0 2024-03-22T07:28:41.584 INFO:tasks.workunit.client.0.smithi134.stdout:2/528: write d2/d5/d8/d7e/f82 [4829321,84748] 0 2024-03-22T07:28:41.587 INFO:tasks.workunit.client.1.smithi195.stdout:5/838: rename d9/d2d/d84/dcf/cdf to d9/d2d/d84/dcf/c111 0 2024-03-22T07:28:41.589 INFO:tasks.workunit.client.0.smithi134.stdout:6/447: mkdir d2/d1b/d1d/d5e/d6f/da8 0 2024-03-22T07:28:41.591 INFO:tasks.workunit.client.0.smithi134.stdout:8/733: symlink d1/d15/d7b/d83/de3/da2/de6/lf3 0 2024-03-22T07:28:41.595 INFO:tasks.workunit.client.0.smithi134.stdout:5/616: dwrite d1/d8/d20/d62/d65/f64 [0,4194304] 0 2024-03-22T07:28:41.597 INFO:tasks.workunit.client.0.smithi134.stdout:3/569: dwrite d4/d10/d6c/f78 [0,4194304] 0 2024-03-22T07:28:41.597 INFO:tasks.workunit.client.0.smithi134.stdout:3/570: fdatasync d4/d10/d4b/f90 0 2024-03-22T07:28:41.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/888: creat da/d82/f10f x:0 0 0 2024-03-22T07:28:41.598 INFO:tasks.workunit.client.1.smithi195.stdout:3/799: mknod d3/d98/c107 0 2024-03-22T07:28:41.598 INFO:tasks.workunit.client.1.smithi195.stdout:3/800: chown d3/dbf/da0 134589116 1 2024-03-22T07:28:41.598 INFO:tasks.workunit.client.1.smithi195.stdout:8/889: truncate da/d17/d32/de8/fee 903286 0 2024-03-22T07:28:41.598 INFO:tasks.workunit.client.1.smithi195.stdout:3/801: chown d3/df/d15/d1d/d5c/d47/dbb/lf8 8056 1 2024-03-22T07:28:41.598 INFO:tasks.workunit.client.0.smithi134.stdout:1/668: symlink d5/da/d13/db9/lee 0 2024-03-22T07:28:41.599 INFO:tasks.workunit.client.1.smithi195.stdout:0/790: symlink d1/d4/dd/lf6 0 2024-03-22T07:28:41.599 INFO:tasks.workunit.client.1.smithi195.stdout:1/683: dwrite d0/d2/d27/d91/dc8/f81 [0,4194304] 0 2024-03-22T07:28:41.600 INFO:tasks.workunit.client.1.smithi195.stdout:1/684: chown d0/d2/d6/dad/db1/d97/d41/d47/l51 64039 1 2024-03-22T07:28:41.600 INFO:tasks.workunit.client.0.smithi134.stdout:4/644: dwrite d2/d98/f99 [0,4194304] 0 2024-03-22T07:28:41.600 INFO:tasks.workunit.client.0.smithi134.stdout:4/645: readlink d2/d2a/d50/l8d 0 2024-03-22T07:28:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/802: dread d3/d22/fb3 [0,4194304] 0 2024-03-22T07:28:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/803: write d3/d18/d89/d76/f106 [123393,65702] 0 2024-03-22T07:28:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/804: chown d3/df/d15/d1d 572 1 2024-03-22T07:28:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/805: truncate d3/fe7 563810 0 2024-03-22T07:28:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/806: dread - d3/d18/d89/d76/fee zero size 2024-03-22T07:28:41.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/807: readlink d3/dbf/lc4 0 2024-03-22T07:28:41.603 INFO:tasks.workunit.client.1.smithi195.stdout:2/823: rename d2/d3/d21/d4c/l86 to d2/d3/d21/d60/d81/l117 0 2024-03-22T07:28:41.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/571: dread d4/d8/d5c/fb3 [0,4194304] 0 2024-03-22T07:28:41.603 INFO:tasks.workunit.client.0.smithi134.stdout:3/572: fdatasync d4/fa8 0 2024-03-22T07:28:41.610 INFO:tasks.workunit.client.0.smithi134.stdout:8/734: creat d1/d15/d42/d12/d20/ff4 x:0 0 0 2024-03-22T07:28:41.611 INFO:tasks.workunit.client.0.smithi134.stdout:1/669: dread d5/d1d/d49/f5c [0,4194304] 0 2024-03-22T07:28:41.613 INFO:tasks.workunit.client.1.smithi195.stdout:4/799: unlink d13/d15/d6b/dd0/c103 0 2024-03-22T07:28:41.614 INFO:tasks.workunit.client.0.smithi134.stdout:6/448: dwrite d2/d1b/fa3 [0,4194304] 0 2024-03-22T07:28:41.614 INFO:tasks.workunit.client.1.smithi195.stdout:5/839: dwrite d9/da8/fca [0,4194304] 0 2024-03-22T07:28:41.617 INFO:tasks.workunit.client.1.smithi195.stdout:4/800: dread d13/d63/d36/d5f/fb0 [0,4194304] 0 2024-03-22T07:28:41.617 INFO:tasks.workunit.client.1.smithi195.stdout:8/890: symlink da/d17/d32/d61/dc2/l110 0 2024-03-22T07:28:41.619 INFO:tasks.workunit.client.0.smithi134.stdout:5/617: dwrite d1/fb2 [0,4194304] 0 2024-03-22T07:28:41.623 INFO:tasks.workunit.client.1.smithi195.stdout:0/791: creat d1/d4/ff7 x:0 0 0 2024-03-22T07:28:41.628 INFO:tasks.workunit.client.1.smithi195.stdout:5/840: dread d9/d12/d14/f17 [0,4194304] 0 2024-03-22T07:28:41.635 INFO:tasks.workunit.client.1.smithi195.stdout:3/808: creat d3/dbf/da0/dd1/f108 x:0 0 0 2024-03-22T07:28:41.638 INFO:tasks.workunit.client.1.smithi195.stdout:6/725: rename d5/d16/d5a/faa to d5/d16/d45/d53/f108 0 2024-03-22T07:28:41.639 INFO:tasks.workunit.client.1.smithi195.stdout:6/726: fsync d5/d16/d5a/fef 0 2024-03-22T07:28:41.639 INFO:tasks.workunit.client.0.smithi134.stdout:5/618: dwrite d1/d8/dc5/fb6 [0,4194304] 0 2024-03-22T07:28:41.642 INFO:tasks.workunit.client.1.smithi195.stdout:3/809: dread d3/fab [0,4194304] 0 2024-03-22T07:28:41.644 INFO:tasks.workunit.client.1.smithi195.stdout:4/801: rename d13/d63/d3e/d5c/d65/fd3 to d13/d63/d3e/d5c/d65/f10f 0 2024-03-22T07:28:41.644 INFO:tasks.workunit.client.0.smithi134.stdout:5/619: dread d1/d8/d20/d62/d65/f18 [0,4194304] 0 2024-03-22T07:28:41.646 INFO:tasks.workunit.client.0.smithi134.stdout:4/646: truncate d2/d2a/d80/f9c 1377115 0 2024-03-22T07:28:41.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/792: creat d1/d4/d12/d6c/d89/ff8 x:0 0 0 2024-03-22T07:28:41.649 INFO:tasks.workunit.client.1.smithi195.stdout:0/793: readlink d1/d4/d83/l8c 0 2024-03-22T07:28:41.651 INFO:tasks.workunit.client.0.smithi134.stdout:3/573: unlink d4/d22/d29/c83 0 2024-03-22T07:28:41.652 INFO:tasks.workunit.client.1.smithi195.stdout:7/811: sync 2024-03-22T07:28:41.654 INFO:tasks.workunit.client.1.smithi195.stdout:4/802: dread d13/d63/d36/fc5 [0,4194304] 0 2024-03-22T07:28:41.662 INFO:tasks.workunit.client.1.smithi195.stdout:3/810: dwrite d3/f3f [0,4194304] 0 2024-03-22T07:28:41.666 INFO:tasks.workunit.client.1.smithi195.stdout:0/794: dwrite d1/d4/dd/df/d44/fd7 [0,4194304] 0 2024-03-22T07:28:41.668 INFO:tasks.workunit.client.1.smithi195.stdout:4/803: dread d13/d15/f6f [0,4194304] 0 2024-03-22T07:28:41.671 INFO:tasks.workunit.client.1.smithi195.stdout:3/811: dread d3/fd [0,4194304] 0 2024-03-22T07:28:41.671 INFO:tasks.workunit.client.1.smithi195.stdout:3/812: chown d3/d18/d89/d70/db5/lbe 927094 1 2024-03-22T07:28:41.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/841: creat d9/d73/da1/f112 x:0 0 0 2024-03-22T07:28:41.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/842: stat d9/d12/f1f 0 2024-03-22T07:28:41.673 INFO:tasks.workunit.client.1.smithi195.stdout:5/843: chown d9/d12/d1d/d69/d78/fb1 14 1 2024-03-22T07:28:41.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/804: dread d13/d63/f6a [0,4194304] 0 2024-03-22T07:28:41.678 INFO:tasks.workunit.client.1.smithi195.stdout:4/805: chown c8 1 1 2024-03-22T07:28:41.682 INFO:tasks.workunit.client.0.smithi134.stdout:8/735: getdents d1/d15/d7b/d83/de3/da2/de6 0 2024-03-22T07:28:41.684 INFO:tasks.workunit.client.1.smithi195.stdout:1/685: rename d0/d2/d6/dad/db1/d97/d39/d40/dc9/fdc to d0/d2/d6/dad/db1/d6b/d9c/fdf 0 2024-03-22T07:28:41.684 INFO:tasks.workunit.client.1.smithi195.stdout:1/686: readlink d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/l82 0 2024-03-22T07:28:41.684 INFO:tasks.workunit.client.1.smithi195.stdout:5/844: dread d9/ff [0,4194304] 0 2024-03-22T07:28:41.684 INFO:tasks.workunit.client.1.smithi195.stdout:5/845: creat d9/d2d/d84/dcf/f113 x:0 0 0 2024-03-22T07:28:41.685 INFO:tasks.workunit.client.0.smithi134.stdout:5/620: mkdir d1/d8/d16/d4a/dce 0 2024-03-22T07:28:41.685 INFO:tasks.workunit.client.0.smithi134.stdout:5/621: chown d1/f57 677 1 2024-03-22T07:28:41.686 INFO:tasks.workunit.client.1.smithi195.stdout:4/806: dread f9 [0,4194304] 0 2024-03-22T07:28:41.687 INFO:tasks.workunit.client.1.smithi195.stdout:7/812: unlink d0/d13/d14/d20/cc0 0 2024-03-22T07:28:41.687 INFO:tasks.workunit.client.1.smithi195.stdout:7/813: chown d0/d13/d14/d20/d40/d82/da0/d59/d79/fb0 9 1 2024-03-22T07:28:41.687 INFO:tasks.workunit.client.1.smithi195.stdout:7/814: dread - d0/f91 zero size 2024-03-22T07:28:41.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/647: mknod d2/d15/ce6 0 2024-03-22T07:28:41.688 INFO:tasks.workunit.client.0.smithi134.stdout:4/648: readlink d2/d25/d48/dd3/l9e 0 2024-03-22T07:28:41.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/795: dwrite d1/d4/dd/f51 [0,4194304] 0 2024-03-22T07:28:41.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/796: fdatasync d1/d10/d1f/de3/fc5 0 2024-03-22T07:28:41.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/797: dread - d1/d4/d12/d6c/d87/fee zero size 2024-03-22T07:28:41.690 INFO:tasks.workunit.client.1.smithi195.stdout:0/798: write d1/d4/d12/d6c/dbc/d47/f60 [1180557,118138] 0 2024-03-22T07:28:41.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/449: rename d2/d1b/d1d/d5e/d6f/d7d/l44 to d2/d1b/d1d/d5e/d6f/da8/la9 0 2024-03-22T07:28:41.692 INFO:tasks.workunit.client.0.smithi134.stdout:6/450: chown d2/f4b 856 1 2024-03-22T07:28:41.699 INFO:tasks.workunit.client.0.smithi134.stdout:5/622: symlink d1/d8/d16/dbd/lcf 0 2024-03-22T07:28:41.703 INFO:tasks.workunit.client.1.smithi195.stdout:1/687: rmdir d0/d2/d27/d91 39 2024-03-22T07:28:41.704 INFO:tasks.workunit.client.1.smithi195.stdout:1/688: write d0/d2/d6/f4b [4495650,3360] 0 2024-03-22T07:28:41.709 INFO:tasks.workunit.client.0.smithi134.stdout:6/451: mkdir d2/d1b/daa 0 2024-03-22T07:28:41.710 INFO:tasks.workunit.client.1.smithi195.stdout:7/815: dread d0/ff [0,4194304] 0 2024-03-22T07:28:41.710 INFO:tasks.workunit.client.1.smithi195.stdout:5/846: dwrite d9/d22/d7b/fdb [0,4194304] 0 2024-03-22T07:28:41.713 INFO:tasks.workunit.client.1.smithi195.stdout:4/807: mknod d13/d63/d7a/ddf/c110 0 2024-03-22T07:28:41.713 INFO:tasks.workunit.client.1.smithi195.stdout:4/808: chown d13/d63/d79/de9/d7e/fb6 4132 1 2024-03-22T07:28:41.713 INFO:tasks.workunit.client.1.smithi195.stdout:4/809: fsync d13/d63/d3e/d5c/d65/f10b 0 2024-03-22T07:28:41.713 INFO:tasks.workunit.client.0.smithi134.stdout:6/452: dread d2/f17 [0,4194304] 0 2024-03-22T07:28:41.716 INFO:tasks.workunit.client.0.smithi134.stdout:8/736: rmdir d1/d46 39 2024-03-22T07:28:41.719 INFO:tasks.workunit.client.1.smithi195.stdout:0/799: creat d1/d4/dd/df/d67/ff9 x:0 0 0 2024-03-22T07:28:41.719 INFO:tasks.workunit.client.1.smithi195.stdout:0/800: write d1/d4/dd/d66/f88 [474088,2051] 0 2024-03-22T07:28:41.722 INFO:tasks.workunit.client.0.smithi134.stdout:4/649: rmdir d2/d25/d48/d6e/d7b/dd7 39 2024-03-22T07:28:41.722 INFO:tasks.workunit.client.0.smithi134.stdout:4/650: chown d2/d25/d74/dde/d76/cb5 287607990 1 2024-03-22T07:28:41.722 INFO:tasks.workunit.client.0.smithi134.stdout:4/651: chown d2/d25/c3b 1977 1 2024-03-22T07:28:41.724 INFO:tasks.workunit.client.0.smithi134.stdout:6/453: mkdir d2/d3f/d99/dab 0 2024-03-22T07:28:41.725 INFO:tasks.workunit.client.0.smithi134.stdout:6/454: write d2/d1b/f24 [4512761,56849] 0 2024-03-22T07:28:41.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/737: dread d1/d15/d7b/d83/de3/fcf [0,4194304] 0 2024-03-22T07:28:41.725 INFO:tasks.workunit.client.0.smithi134.stdout:8/738: dread - d1/d46/dbf/fe9 zero size 2024-03-22T07:28:41.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/689: creat d0/d2/d6/dad/db1/d6b/fe0 x:0 0 0 2024-03-22T07:28:41.727 INFO:tasks.workunit.client.1.smithi195.stdout:5/847: dwrite d9/d2d/f40 [0,4194304] 0 2024-03-22T07:28:41.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/690: creat d0/d2/d27/d91/dc8/da4/dc0/fe1 x:0 0 0 2024-03-22T07:28:41.727 INFO:tasks.workunit.client.1.smithi195.stdout:1/691: chown d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/f6d 570287 1 2024-03-22T07:28:41.729 INFO:tasks.workunit.client.0.smithi134.stdout:6/455: write d2/d3f/d28/d6b/f5b [5714434,97242] 0 2024-03-22T07:28:41.729 INFO:tasks.workunit.client.0.smithi134.stdout:8/739: dread d1/d15/d42/d12/d20/f3c [0,4194304] 0 2024-03-22T07:28:41.729 INFO:tasks.workunit.client.0.smithi134.stdout:8/740: chown d1/d15/d57/d8c/da4/ldc 0 1 2024-03-22T07:28:41.730 INFO:tasks.workunit.client.0.smithi134.stdout:6/456: write d2/f4b [4264546,108632] 0 2024-03-22T07:28:41.736 INFO:tasks.workunit.client.1.smithi195.stdout:4/810: stat d13/d63/d36/l67 0 2024-03-22T07:28:41.740 INFO:tasks.workunit.client.1.smithi195.stdout:0/801: mkdir d1/d4/dd/df/d44/d6f/dcb/dfa 0 2024-03-22T07:28:41.744 INFO:tasks.workunit.client.1.smithi195.stdout:2/824: rename d2/d3/d21/d60/d81/da8/ded to d2/d3/d7/d19/d22/d26/d99/d118 0 2024-03-22T07:28:41.744 INFO:tasks.workunit.client.1.smithi195.stdout:2/825: dread - d2/d3/db/d82/f8a zero size 2024-03-22T07:28:41.744 INFO:tasks.workunit.client.1.smithi195.stdout:2/826: truncate d2/d1e/d93/d112/f50 1906885 0 2024-03-22T07:28:41.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/623: rmdir d1/d8/d20 39 2024-03-22T07:28:41.750 INFO:tasks.workunit.client.0.smithi134.stdout:4/652: truncate f1 2580892 0 2024-03-22T07:28:41.750 INFO:tasks.workunit.client.0.smithi134.stdout:4/653: fdatasync d2/f62 0 2024-03-22T07:28:41.756 INFO:tasks.workunit.client.1.smithi195.stdout:5/848: unlink d9/f25 0 2024-03-22T07:28:41.756 INFO:tasks.workunit.client.1.smithi195.stdout:5/849: fsync d9/f45 0 2024-03-22T07:28:41.763 INFO:tasks.workunit.client.0.smithi134.stdout:8/741: truncate d1/d4/f54 192402 0 2024-03-22T07:28:41.766 INFO:tasks.workunit.client.0.smithi134.stdout:6/457: dwrite d2/d1b/f24 [4194304,4194304] 0 2024-03-22T07:28:41.768 INFO:tasks.workunit.client.0.smithi134.stdout:5/624: mknod d1/d8/d20/d62/d65/dac/cd0 0 2024-03-22T07:28:41.768 INFO:tasks.workunit.client.1.smithi195.stdout:9/934: sync 2024-03-22T07:28:41.769 INFO:tasks.workunit.client.1.smithi195.stdout:4/811: unlink d13/d63/c5b 0 2024-03-22T07:28:41.771 INFO:tasks.workunit.client.0.smithi134.stdout:6/458: dread d2/d1b/d4d/f74 [0,4194304] 0 2024-03-22T07:28:41.771 INFO:tasks.workunit.client.0.smithi134.stdout:6/459: truncate d2/d1b/f29 4774896 0 2024-03-22T07:28:41.771 INFO:tasks.workunit.client.0.smithi134.stdout:6/460: fdatasync d2/d3f/d28/d6b/f8e 0 2024-03-22T07:28:41.771 INFO:tasks.workunit.client.0.smithi134.stdout:4/654: creat d2/d25/fe7 x:0 0 0 2024-03-22T07:28:41.780 INFO:tasks.workunit.client.1.smithi195.stdout:0/802: mknod d1/d4/dd/df/d44/d6f/dcb/de5/cfb 0 2024-03-22T07:28:41.784 INFO:tasks.workunit.client.1.smithi195.stdout:8/891: rename da/d82/dc6/d53/dca to da/de/db3/ddd/de2/d111 0 2024-03-22T07:28:41.785 INFO:tasks.workunit.client.0.smithi134.stdout:8/742: symlink d1/d15/d42/d25/d6f/lf5 0 2024-03-22T07:28:41.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/827: symlink d2/d3/d21/d60/d81/dfd/l119 0 2024-03-22T07:28:41.788 INFO:tasks.workunit.client.1.smithi195.stdout:2/828: write d2/d3/d21/f14 [1682299,7335] 0 2024-03-22T07:28:41.789 INFO:tasks.workunit.client.1.smithi195.stdout:8/892: write da/dc/f7b [3121037,7837] 0 2024-03-22T07:28:41.792 INFO:tasks.workunit.client.1.smithi195.stdout:5/850: creat d9/d12/d1d/d36/d7d/dd2/dfc/df1/f114 x:0 0 0 2024-03-22T07:28:41.792 INFO:tasks.workunit.client.1.smithi195.stdout:5/851: chown d9/d12/d1d/d69/d101 174 1 2024-03-22T07:28:41.792 INFO:tasks.workunit.client.1.smithi195.stdout:5/852: readlink d9/d22/d7b/d98/da0/lb8 0 2024-03-22T07:28:41.793 INFO:tasks.workunit.client.0.smithi134.stdout:5/625: dwrite d1/d8/f21 [0,4194304] 0 2024-03-22T07:28:41.793 INFO:tasks.workunit.client.0.smithi134.stdout:5/626: dread - d1/f7f zero size 2024-03-22T07:28:41.794 INFO:tasks.workunit.client.0.smithi134.stdout:6/461: dwrite d2/d1b/f24 [4194304,4194304] 0 2024-03-22T07:28:41.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/935: creat d2/d4/d6/db/da8/d14f/f156 x:0 0 0 2024-03-22T07:28:41.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/936: readlink d2/d4/d6/db/d20/d4a/da2/lc8 0 2024-03-22T07:28:41.801 INFO:tasks.workunit.client.1.smithi195.stdout:9/937: write d2/d4/d6/db5/f128 [38221,114948] 0 2024-03-22T07:28:41.808 INFO:tasks.workunit.client.1.smithi195.stdout:6/727: rename d5/d5e/d34/d55/d3b/d6e/d56/c6b to d5/d16/d45/d53/d107/c109 0 2024-03-22T07:28:41.808 INFO:tasks.workunit.client.1.smithi195.stdout:6/728: chown d5/d5e/d34/d55/l19 4874156 1 2024-03-22T07:28:41.811 INFO:tasks.workunit.client.0.smithi134.stdout:4/655: symlink d2/d25/d48/d6e/d7b/le8 0 2024-03-22T07:28:41.815 INFO:tasks.workunit.client.1.smithi195.stdout:2/829: link d2/d3/d24/f6b d2/d3/d21/d60/d81/dfd/f11a 0 2024-03-22T07:28:41.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/743: getdents d1/d46 0 2024-03-22T07:28:41.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/744: stat d1/d46/c58 0 2024-03-22T07:28:41.817 INFO:tasks.workunit.client.0.smithi134.stdout:8/745: creat d1/d4/d61/ff6 x:0 0 0 2024-03-22T07:28:41.820 INFO:tasks.workunit.client.0.smithi134.stdout:5/627: creat d1/d8/d20/d8a/d75/fd1 x:0 0 0 2024-03-22T07:28:41.820 INFO:tasks.workunit.client.0.smithi134.stdout:5/628: chown d1/d8/d20/d8a/d75 14 1 2024-03-22T07:28:41.821 INFO:tasks.workunit.client.1.smithi195.stdout:8/893: creat da/de/db3/ddd/f112 x:0 0 0 2024-03-22T07:28:41.823 INFO:tasks.workunit.client.0.smithi134.stdout:6/462: link d2/f35 d2/d3f/d28/fac 0 2024-03-22T07:28:41.825 INFO:tasks.workunit.client.1.smithi195.stdout:5/853: mknod d9/d12/d1d/d36/d7d/dd2/c115 0 2024-03-22T07:28:41.828 INFO:tasks.workunit.client.0.smithi134.stdout:8/746: write d1/f2e [1465384,64203] 0 2024-03-22T07:28:41.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/830: dread d2/d3/f79 [4194304,4194304] 0 2024-03-22T07:28:41.828 INFO:tasks.workunit.client.1.smithi195.stdout:2/831: write d2/d3/d7/da/d4e/f10c [650996,57820] 0 2024-03-22T07:28:41.829 INFO:tasks.workunit.client.1.smithi195.stdout:9/938: unlink d2/d4/d32/c101 0 2024-03-22T07:28:41.835 INFO:tasks.workunit.client.1.smithi195.stdout:1/692: rename d0/d2/d6/dad/db1/d97/d39/ld1 to d0/d2/d6/dad/db1/d97/d39/d40/dc9/le2 0 2024-03-22T07:28:41.837 INFO:tasks.workunit.client.1.smithi195.stdout:6/729: mkdir d5/d10a 0 2024-03-22T07:28:41.843 INFO:tasks.workunit.client.1.smithi195.stdout:2/832: link d2/d3/d21/d40/f9b d2/d3/d21/d60/f11b 0 2024-03-22T07:28:41.843 INFO:tasks.workunit.client.1.smithi195.stdout:2/833: write d2/d3/d7/d19/ff0 [338342,4603] 0 2024-03-22T07:28:41.845 INFO:tasks.workunit.client.0.smithi134.stdout:5/629: unlink d1/d8/d20/d8a/f51 0 2024-03-22T07:28:41.845 INFO:tasks.workunit.client.0.smithi134.stdout:5/630: read - d1/d8/d20/d62/d65/dac/fbb zero size 2024-03-22T07:28:41.845 INFO:tasks.workunit.client.1.smithi195.stdout:9/939: rmdir d2/d122 39 2024-03-22T07:28:41.848 INFO:tasks.workunit.client.0.smithi134.stdout:6/463: rename d2/d3f/l89 to d2/d1b/d1d/d5e/d84/lad 0 2024-03-22T07:28:41.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/812: rename d13/d63/d79/de9/d7e/d8c/db7/cca to d13/d63/d7a/ddf/c111 0 2024-03-22T07:28:41.851 INFO:tasks.workunit.client.1.smithi195.stdout:4/813: write d13/d15/f1c [4208698,25845] 0 2024-03-22T07:28:41.852 INFO:tasks.workunit.client.1.smithi195.stdout:9/940: dread d2/d4/d1d/fb3 [0,4194304] 0 2024-03-22T07:28:41.853 INFO:tasks.workunit.client.1.smithi195.stdout:9/941: write d2/d4/d6/db5/fbb [382815,72393] 0 2024-03-22T07:28:41.854 INFO:tasks.workunit.client.1.smithi195.stdout:1/693: creat d0/d2/d6/dad/db1/fe3 x:0 0 0 2024-03-22T07:28:41.855 INFO:tasks.workunit.client.0.smithi134.stdout:8/747: mkdir d1/d15/d42/d76/dda/df7 0 2024-03-22T07:28:41.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/730: creat d5/d16/d45/df8/f10b x:0 0 0 2024-03-22T07:28:41.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/731: fsync d5/d5e/d34/d55/d3b/d7f/fca 0 2024-03-22T07:28:41.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/732: readlink d5/d16/d45/df8/lf9 0 2024-03-22T07:28:41.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/733: stat d5/d16/d45/df8/d104/da2/d1a/df5 0 2024-03-22T07:28:41.857 INFO:tasks.workunit.client.1.smithi195.stdout:6/734: truncate d5/d5e/d34/d55/fb9 328154 0 2024-03-22T07:28:41.861 INFO:tasks.workunit.client.0.smithi134.stdout:5/631: symlink d1/d8/d20/d62/d68/ld2 0 2024-03-22T07:28:41.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/803: rename d1/d4/dd/df/f16 to d1/d4/dd/df/d6b/ffc 0 2024-03-22T07:28:41.865 INFO:tasks.workunit.client.1.smithi195.stdout:0/804: write d1/d4/d12/d6c/dbc/d47/db6/f97 [262556,100264] 0 2024-03-22T07:28:41.867 INFO:tasks.workunit.client.0.smithi134.stdout:8/748: getdents d1/d15/d57 0 2024-03-22T07:28:41.867 INFO:tasks.workunit.client.0.smithi134.stdout:8/749: chown d1/d4/f54 42637 1 2024-03-22T07:28:41.867 INFO:tasks.workunit.client.0.smithi134.stdout:8/750: dread - d1/d15/d42/d76/fc5 zero size 2024-03-22T07:28:41.869 INFO:tasks.workunit.client.0.smithi134.stdout:6/464: getdents d2/d1b/d1d/d5e 0 2024-03-22T07:28:41.871 INFO:tasks.workunit.client.1.smithi195.stdout:4/814: link d13/d63/d3e/d5c/d65/f10b d13/d15/d64/f112 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/694: mknod d0/d2/d27/d91/dc8/d2a/d6f/ce4 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/695: creat d0/d2/fe5 x:0 0 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/696: creat d0/d2/d27/d91/dc8/da4/dc0/fe6 x:0 0 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/697: fdatasync d0/d2/fe5 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/698: write d0/d2/d27/d91/dc8/da4/dc0/fce [271692,33427] 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/699: read d0/d2/d27/d91/dc8/dba/fd2 [234213,118637] 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/700: write d0/d2/d6/dad/db1/fe3 [824861,111772] 0 2024-03-22T07:28:41.875 INFO:tasks.workunit.client.1.smithi195.stdout:1/701: fsync d0/d2/d27/d91/dc8/f6c 0 2024-03-22T07:28:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/702: chown d0/d2/d27/d91/dc8/da4/dc0/cda 0 1 2024-03-22T07:28:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/703: write d0/d2/d27/d91/dc8/da4/dc0/fc1 [2475769,124795] 0 2024-03-22T07:28:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:1/704: creat d0/d2/d6/dad/db1/d6b/d9c/fe7 x:0 0 0 2024-03-22T07:28:41.876 INFO:tasks.workunit.client.1.smithi195.stdout:6/735: truncate d5/d5e/d34/d55/dab/dbf/fc7 909032 0 2024-03-22T07:28:41.876 INFO:tasks.workunit.client.0.smithi134.stdout:6/465: link d2/l11 d2/d3f/d99/dab/lae 0 2024-03-22T07:28:41.876 INFO:tasks.workunit.client.0.smithi134.stdout:8/751: dread d1/d15/d42/d12/d20/d41/f45 [0,4194304] 0 2024-03-22T07:28:41.877 INFO:tasks.workunit.client.1.smithi195.stdout:6/736: dread d5/d5e/d34/d55/d3b/d6e/ff3 [0,4194304] 0 2024-03-22T07:28:41.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/894: rename da/dc/d71/fb6 to da/d82/dc6/d53/dff/f113 0 2024-03-22T07:28:41.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/895: fdatasync da/dc/fa6 0 2024-03-22T07:28:41.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/896: dread - da/d17/d32/d61/fcb zero size 2024-03-22T07:28:41.880 INFO:tasks.workunit.client.1.smithi195.stdout:8/897: truncate da/d82/dc6/ff9 4232502 0 2024-03-22T07:28:41.882 INFO:tasks.workunit.client.1.smithi195.stdout:0/805: mkdir d1/d4/dd/d66/d80/dfd 0 2024-03-22T07:28:41.887 INFO:tasks.workunit.client.1.smithi195.stdout:4/815: truncate d13/d63/f6a 816670 0 2024-03-22T07:28:41.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/942: truncate d2/d4/d6/db/d20/f31 1078160 0 2024-03-22T07:28:41.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/943: creat d2/f157 x:0 0 0 2024-03-22T07:28:41.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/944: chown d2/d4/d6/db5/fbb 2859375 1 2024-03-22T07:28:41.891 INFO:tasks.workunit.client.1.smithi195.stdout:9/945: fsync d2/d4/d6/db/f129 0 2024-03-22T07:28:41.891 INFO:tasks.workunit.client.0.smithi134.stdout:7/752: sync 2024-03-22T07:28:41.891 INFO:tasks.workunit.client.0.smithi134.stdout:2/529: sync 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.0.smithi134.stdout:2/530: read d2/d5/d8/d31/f5b [1188097,112075] 0 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/670: sync 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/671: chown d5/d1d/dd0 568 1 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/672: fdatasync d5/f9 0 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.0.smithi134.stdout:1/673: write d5/d1d/d2d/fc6 [296698,56854] 0 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.0.smithi134.stdout:0/618: sync 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/946: dread d2/d4/d1d/d9b/ffc [0,4194304] 0 2024-03-22T07:28:41.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/947: chown d2/d4/d6/d18/fbf 1 1 2024-03-22T07:28:41.898 INFO:tasks.workunit.client.1.smithi195.stdout:7/816: sync 2024-03-22T07:28:41.898 INFO:tasks.workunit.client.1.smithi195.stdout:3/813: sync 2024-03-22T07:28:41.898 INFO:tasks.workunit.client.1.smithi195.stdout:3/814: write d3/d18/fcd [745701,15750] 0 2024-03-22T07:28:41.898 INFO:tasks.workunit.client.1.smithi195.stdout:7/817: write d0/d13/d14/d29/d35/d3a/d7e/f11b [336384,118848] 0 2024-03-22T07:28:41.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/753: symlink d1/da8/lee 0 2024-03-22T07:28:41.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/705: symlink d0/d2/d27/d91/dc8/d2a/d6f/le8 0 2024-03-22T07:28:41.900 INFO:tasks.workunit.client.1.smithi195.stdout:1/706: stat d0/d2/d27/d91/dc8/d2a/dd8 0 2024-03-22T07:28:41.901 INFO:tasks.workunit.client.0.smithi134.stdout:9/556: sync 2024-03-22T07:28:41.901 INFO:tasks.workunit.client.0.smithi134.stdout:9/557: dread - d3/d9/d37/d3c/d71/d8e/fbc zero size 2024-03-22T07:28:41.901 INFO:tasks.workunit.client.0.smithi134.stdout:9/558: truncate d3/d9/d37/d5a/d7f/f98 17604 0 2024-03-22T07:28:41.902 INFO:tasks.workunit.client.0.smithi134.stdout:2/531: dread - d2/f49 zero size 2024-03-22T07:28:41.904 INFO:tasks.workunit.client.0.smithi134.stdout:6/466: dwrite d2/d1b/d4d/f74 [0,4194304] 0 2024-03-22T07:28:41.906 INFO:tasks.workunit.client.1.smithi195.stdout:6/737: creat d5/d5e/d34/d55/d3b/dc2/f10c x:0 0 0 2024-03-22T07:28:41.910 INFO:tasks.workunit.client.0.smithi134.stdout:7/754: dread d1/f17 [4194304,4194304] 0 2024-03-22T07:28:41.913 INFO:tasks.workunit.client.1.smithi195.stdout:5/854: rename d9/d12/l86 to d9/d22/d7b/d98/dbe/l116 0 2024-03-22T07:28:41.913 INFO:tasks.workunit.client.0.smithi134.stdout:8/752: dwrite d1/f2e [0,4194304] 0 2024-03-22T07:28:41.917 INFO:tasks.workunit.client.0.smithi134.stdout:0/619: dwrite dc/d18/f1d [0,4194304] 0 2024-03-22T07:28:41.917 INFO:tasks.workunit.client.0.smithi134.stdout:2/532: truncate d2/d5/d8/f2f 8982804 0 2024-03-22T07:28:41.918 INFO:tasks.workunit.client.0.smithi134.stdout:9/559: mkdir d3/d9/d37/d3c/d71/dc2 0 2024-03-22T07:28:41.918 INFO:tasks.workunit.client.0.smithi134.stdout:1/674: read d5/da/f2a [1099853,125556] 0 2024-03-22T07:28:41.919 INFO:tasks.workunit.client.0.smithi134.stdout:1/675: creat d5/da/d1b/d27/fef x:0 0 0 2024-03-22T07:28:41.920 INFO:tasks.workunit.client.1.smithi195.stdout:0/806: symlink d1/d4/d12/d6c/dbc/d43/lfe 0 2024-03-22T07:28:41.925 INFO:tasks.workunit.client.1.smithi195.stdout:4/816: mknod d13/d63/d79/de9/d7e/d8c/d108/c113 0 2024-03-22T07:28:41.927 INFO:tasks.workunit.client.0.smithi134.stdout:7/755: creat d1/dae/fef x:0 0 0 2024-03-22T07:28:41.927 INFO:tasks.workunit.client.0.smithi134.stdout:7/756: readlink d1/de/d11/l79 0 2024-03-22T07:28:41.927 INFO:tasks.workunit.client.0.smithi134.stdout:3/574: sync 2024-03-22T07:28:41.927 INFO:tasks.workunit.client.0.smithi134.stdout:3/575: stat d4/f1e 0 2024-03-22T07:28:41.927 INFO:tasks.workunit.client.0.smithi134.stdout:0/620: dread dc/f29 [0,4194304] 0 2024-03-22T07:28:41.928 INFO:tasks.workunit.client.0.smithi134.stdout:6/467: dwrite d2/d3f/f61 [0,4194304] 0 2024-03-22T07:28:41.935 INFO:tasks.workunit.client.0.smithi134.stdout:8/753: mknod d1/d15/d42/d76/dda/cf8 0 2024-03-22T07:28:41.935 INFO:tasks.workunit.client.0.smithi134.stdout:8/754: fdatasync d1/d15/d42/d76/fc5 0 2024-03-22T07:28:41.938 INFO:tasks.workunit.client.0.smithi134.stdout:9/560: symlink d3/d9/d37/d3c/d71/d8e/lc3 0 2024-03-22T07:28:41.938 INFO:tasks.workunit.client.0.smithi134.stdout:2/533: dwrite d2/d5/d8/d5d/da1/d3c/f47 [0,4194304] 0 2024-03-22T07:28:41.939 INFO:tasks.workunit.client.1.smithi195.stdout:1/707: dwrite d0/d2/d6/dad/db1/d97/d39/fa9 [0,4194304] 0 2024-03-22T07:28:41.939 INFO:tasks.workunit.client.1.smithi195.stdout:1/708: dread - d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 zero size 2024-03-22T07:28:41.941 INFO:tasks.workunit.client.1.smithi195.stdout:3/815: symlink d3/df/d15/d1d/d5c/d47/l109 0 2024-03-22T07:28:41.941 INFO:tasks.workunit.client.1.smithi195.stdout:3/816: truncate d3/df/d15/ff3 27768 0 2024-03-22T07:28:41.941 INFO:tasks.workunit.client.1.smithi195.stdout:3/817: stat d3/dbf/da0/fa1 0 2024-03-22T07:28:41.943 INFO:tasks.workunit.client.0.smithi134.stdout:9/561: write d3/d9/df/d57/fb8 [3510719,108714] 0 2024-03-22T07:28:41.944 INFO:tasks.workunit.client.1.smithi195.stdout:7/818: creat d0/d13/d14/d2f/dae/f11f x:0 0 0 2024-03-22T07:28:41.946 INFO:tasks.workunit.client.0.smithi134.stdout:1/676: creat d5/d1d/dd0/ff0 x:0 0 0 2024-03-22T07:28:41.946 INFO:tasks.workunit.client.0.smithi134.stdout:1/677: creat d5/da/d13/d1e/d45/ff1 x:0 0 0 2024-03-22T07:28:41.947 INFO:tasks.workunit.client.0.smithi134.stdout:7/757: symlink d1/d19/d9c/db3/ddd/lf0 0 2024-03-22T07:28:41.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/819: write d0/d13/d14/d29/fe1 [3662673,121938] 0 2024-03-22T07:28:41.951 INFO:tasks.workunit.client.0.smithi134.stdout:3/576: mkdir d4/d8/d7f/d9c/db9 0 2024-03-22T07:28:41.952 INFO:tasks.workunit.client.0.smithi134.stdout:3/577: readlink d4/d22/d3c/l7d 0 2024-03-22T07:28:41.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/562: dread d3/d9/df/d12/f4c [0,4194304] 0 2024-03-22T07:28:41.952 INFO:tasks.workunit.client.0.smithi134.stdout:3/578: dread d4/d22/d3c/f8a [0,4194304] 0 2024-03-22T07:28:41.953 INFO:tasks.workunit.client.0.smithi134.stdout:4/656: dwrite d2/d25/d48/d87/fa0 [4194304,4194304] 0 2024-03-22T07:28:41.953 INFO:tasks.workunit.client.0.smithi134.stdout:4/657: stat d2/l92 0 2024-03-22T07:28:41.954 INFO:tasks.workunit.client.0.smithi134.stdout:0/621: dwrite dc/d18/fa1 [0,4194304] 0 2024-03-22T07:28:41.954 INFO:tasks.workunit.client.0.smithi134.stdout:0/622: chown dc/d17/fb3 54994355 1 2024-03-22T07:28:41.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/834: write d2/d3/d24/f6e [863352,96353] 0 2024-03-22T07:28:41.955 INFO:tasks.workunit.client.1.smithi195.stdout:2/835: write d2/f34 [5158318,73706] 0 2024-03-22T07:28:41.961 INFO:tasks.workunit.client.0.smithi134.stdout:6/468: rename d2/d1b/d4d/f54 to d2/d1b/d1d/d5e/d84/faf 0 2024-03-22T07:28:41.961 INFO:tasks.workunit.client.0.smithi134.stdout:6/469: chown d2/d1b/f24 47344113 1 2024-03-22T07:28:41.965 INFO:tasks.workunit.client.0.smithi134.stdout:8/755: symlink d1/d15/d42/d49/lf9 0 2024-03-22T07:28:41.970 INFO:tasks.workunit.client.0.smithi134.stdout:6/470: write d2/d1b/f24 [710919,73773] 0 2024-03-22T07:28:41.970 INFO:tasks.workunit.client.0.smithi134.stdout:6/471: write d2/d1b/d1d/d5e/f8d [365431,80002] 0 2024-03-22T07:28:41.973 INFO:tasks.workunit.client.0.smithi134.stdout:2/534: creat d2/d5/d8/d5d/d5f/fa5 x:0 0 0 2024-03-22T07:28:41.973 INFO:tasks.workunit.client.0.smithi134.stdout:2/535: stat d2/f87 0 2024-03-22T07:28:41.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/738: rename d5/d5e/dc0/df4 to d5/d6d/d95/d100/d10d 0 2024-03-22T07:28:41.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/739: write d5/d5e/d34/d55/d3b/d6e/d97/fbd [930274,16955] 0 2024-03-22T07:28:41.980 INFO:tasks.workunit.client.1.smithi195.stdout:6/740: dread d5/d16/d45/df8/d104/da2/d1a/f71 [0,4194304] 0 2024-03-22T07:28:41.981 INFO:tasks.workunit.client.1.smithi195.stdout:5/855: creat d9/d12/d1d/d69/f117 x:0 0 0 2024-03-22T07:28:41.983 INFO:tasks.workunit.client.1.smithi195.stdout:8/898: getdents da/de/db3/dc7/dd3 0 2024-03-22T07:28:41.983 INFO:tasks.workunit.client.0.smithi134.stdout:7/758: mkdir d1/de/d11/d48/daf/df1 0 2024-03-22T07:28:41.984 INFO:tasks.workunit.client.0.smithi134.stdout:8/756: dwrite d1/d15/d42/d12/f7a [0,4194304] 0 2024-03-22T07:28:41.985 INFO:tasks.workunit.client.1.smithi195.stdout:5/856: read d9/d12/f3d [3367429,45959] 0 2024-03-22T07:28:41.985 INFO:tasks.workunit.client.1.smithi195.stdout:5/857: write d9/d12/d1d/d36/f49 [1603983,13999] 0 2024-03-22T07:28:41.987 INFO:tasks.workunit.client.0.smithi134.stdout:6/472: dread d2/d1b/d1d/d5e/f8d [0,4194304] 0 2024-03-22T07:28:41.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/807: rmdir d1/d10 39 2024-03-22T07:28:41.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/808: creat d1/d10/d19/d20/fff x:0 0 0 2024-03-22T07:28:41.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/809: getdents d1/d4/dd/df/d44/d8d/dd2 0 2024-03-22T07:28:41.988 INFO:tasks.workunit.client.1.smithi195.stdout:0/810: dread - d1/d4/dd/d3f/fd6 zero size 2024-03-22T07:28:41.988 INFO:tasks.workunit.client.0.smithi134.stdout:9/563: symlink d3/d9/d37/d6f/d54/d9d/lc4 0 2024-03-22T07:28:41.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/579: truncate d4/d8/f19 3067343 0 2024-03-22T07:28:41.990 INFO:tasks.workunit.client.0.smithi134.stdout:3/580: chown d4/d8/d23/f70 8907 1 2024-03-22T07:28:41.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/817: mkdir d13/d63/d79/de9/d7e/d85/d101/d114 0 2024-03-22T07:28:41.992 INFO:tasks.workunit.client.1.smithi195.stdout:4/818: write d13/d63/d79/de9/f2e [2671251,8740] 0 2024-03-22T07:28:41.994 INFO:tasks.workunit.client.0.smithi134.stdout:4/658: truncate d2/d25/d74/dde/dc0/fd9 45342 0 2024-03-22T07:28:41.994 INFO:tasks.workunit.client.0.smithi134.stdout:4/659: creat d2/d25/fe9 x:0 0 0 2024-03-22T07:28:41.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/709: link d0/d2/d27/d91/dc8/c9a d0/d2/d27/d91/dc8/d2a/ce9 0 2024-03-22T07:28:41.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/710: chown d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/cc2 74913 1 2024-03-22T07:28:41.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/711: creat d0/d2/d6/dad/db1/d97/d39/d64/fea x:0 0 0 2024-03-22T07:28:41.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/818: mkdir d3/d18/d89/d76/d10a 0 2024-03-22T07:28:41.999 INFO:tasks.workunit.client.1.smithi195.stdout:3/819: fsync d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea 0 2024-03-22T07:28:42.001 INFO:tasks.workunit.client.1.smithi195.stdout:0/811: dread d1/d4/d12/d6c/dbc/d47/f84 [0,4194304] 0 2024-03-22T07:28:42.002 INFO:tasks.workunit.client.1.smithi195.stdout:0/812: fsync d1/d4/dd/d66/d80/fac 0 2024-03-22T07:28:42.003 INFO:tasks.workunit.client.1.smithi195.stdout:6/741: dwrite d5/d16/d45/df8/d104/da2/d1a/f4d [0,4194304] 0 2024-03-22T07:28:42.004 INFO:tasks.workunit.client.1.smithi195.stdout:7/820: unlink d0/d13/d14/d5b/ldb 0 2024-03-22T07:28:42.008 INFO:tasks.workunit.client.1.smithi195.stdout:2/836: symlink d2/d3/d7/da/l11c 0 2024-03-22T07:28:42.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/837: write d2/d3/d7/d19/d22/d26/f4b [4203737,39329] 0 2024-03-22T07:28:42.009 INFO:tasks.workunit.client.1.smithi195.stdout:2/838: write d2/d3/db/d82/f8a [165203,10648] 0 2024-03-22T07:28:42.019 INFO:tasks.workunit.client.1.smithi195.stdout:1/712: dwrite d0/d2/d27/d91/dc8/d2a/f86 [0,4194304] 0 2024-03-22T07:28:42.020 INFO:tasks.workunit.client.1.smithi195.stdout:1/713: fdatasync d0/d2/f1b 0 2024-03-22T07:28:42.022 INFO:tasks.workunit.client.1.smithi195.stdout:3/820: dwrite d3/f29 [4194304,4194304] 0 2024-03-22T07:28:42.022 INFO:tasks.workunit.client.0.smithi134.stdout:3/581: dwrite d4/d8/f12 [4194304,4194304] 0 2024-03-22T07:28:42.022 INFO:tasks.workunit.client.0.smithi134.stdout:3/582: fsync d4/d10/f36 0 2024-03-22T07:28:42.025 INFO:tasks.workunit.client.0.smithi134.stdout:0/623: dwrite dc/d18/f44 [0,4194304] 0 2024-03-22T07:28:42.026 INFO:tasks.workunit.client.1.smithi195.stdout:8/899: creat da/d17/d32/d61/dc2/f114 x:0 0 0 2024-03-22T07:28:42.030 INFO:tasks.workunit.client.1.smithi195.stdout:5/858: creat d9/d7f/de7/f118 x:0 0 0 2024-03-22T07:28:42.030 INFO:tasks.workunit.client.1.smithi195.stdout:5/859: chown d9/f6f 18550 1 2024-03-22T07:28:42.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/678: getdents d5/da/d68/da1 0 2024-03-22T07:28:42.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/679: creat d5/d1d/d49/ff2 x:0 0 0 2024-03-22T07:28:42.033 INFO:tasks.workunit.client.0.smithi134.stdout:1/680: dread - d5/d1d/dd0/ddc/fe0 zero size 2024-03-22T07:28:42.034 INFO:tasks.workunit.client.1.smithi195.stdout:4/819: rename d13/d63/d79/de9/d7e/d8c/f9f to d13/d63/d79/de9/f115 0 2024-03-22T07:28:42.039 INFO:tasks.workunit.client.1.smithi195.stdout:5/860: dread d9/d2d/f67 [0,4194304] 0 2024-03-22T07:28:42.040 INFO:tasks.workunit.client.1.smithi195.stdout:0/813: mkdir d1/d10/d4d/da6/d100 0 2024-03-22T07:28:42.042 INFO:tasks.workunit.client.0.smithi134.stdout:8/757: mkdir d1/d15/d5b/dfa 0 2024-03-22T07:28:42.042 INFO:tasks.workunit.client.0.smithi134.stdout:8/758: write d1/d15/fcc [288360,120345] 0 2024-03-22T07:28:42.047 INFO:tasks.workunit.client.0.smithi134.stdout:9/564: unlink d3/d9/df/d12/c9f 0 2024-03-22T07:28:42.049 INFO:tasks.workunit.client.1.smithi195.stdout:6/742: mknod d5/d16/d45/df8/d104/da2/d1a/df5/c10e 0 2024-03-22T07:28:42.049 INFO:tasks.workunit.client.1.smithi195.stdout:6/743: write d5/ffa [703402,15231] 0 2024-03-22T07:28:42.052 INFO:tasks.workunit.client.1.smithi195.stdout:7/821: unlink d0/d13/d22/d57/d7b/d8c/lee 0 2024-03-22T07:28:42.054 INFO:tasks.workunit.client.0.smithi134.stdout:4/660: link d2/d15/fdb d2/d25/d48/d6e/fea 0 2024-03-22T07:28:42.058 INFO:tasks.workunit.client.0.smithi134.stdout:3/583: symlink d4/d8/d45/lba 0 2024-03-22T07:28:42.062 INFO:tasks.workunit.client.0.smithi134.stdout:3/584: dread f3 [0,4194304] 0 2024-03-22T07:28:42.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/821: rmdir d3 39 2024-03-22T07:28:42.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/822: truncate d3/df/d15/d1d/d5c/f6f 259784 0 2024-03-22T07:28:42.064 INFO:tasks.workunit.client.1.smithi195.stdout:3/823: fdatasync d3/fe7 0 2024-03-22T07:28:42.065 INFO:tasks.workunit.client.1.smithi195.stdout:3/824: write d3/d18/d89/d70/f71 [409229,125321] 0 2024-03-22T07:28:42.066 INFO:tasks.workunit.client.0.smithi134.stdout:0/624: mkdir dc/de/d55/d65/d82/db7 0 2024-03-22T07:28:42.071 INFO:tasks.workunit.client.1.smithi195.stdout:7/822: dwrite d0/d13/d14/f112 [0,4194304] 0 2024-03-22T07:28:42.071 INFO:tasks.workunit.client.1.smithi195.stdout:7/823: write d0/d13/d14/d20/d40/d82/da0/f9f [558791,103094] 0 2024-03-22T07:28:42.071 INFO:tasks.workunit.client.1.smithi195.stdout:7/824: truncate d0/d13/d14/d80/f106 310909 0 2024-03-22T07:28:42.071 INFO:tasks.workunit.client.0.smithi134.stdout:8/759: rename d1/fc4 to d1/d15/d42/d25/d6f/ffb 0 2024-03-22T07:28:42.073 INFO:tasks.workunit.client.0.smithi134.stdout:6/473: truncate d2/d1b/d4d/f74 1104527 0 2024-03-22T07:28:42.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/565: mkdir d3/d9/d37/d5a/dc5 0 2024-03-22T07:28:42.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/566: readlink d3/d9/d37/d6f/d54/d9d/dc0/l74 0 2024-03-22T07:28:42.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/567: fdatasync d3/d9/df/d12/f1d 0 2024-03-22T07:28:42.076 INFO:tasks.workunit.client.0.smithi134.stdout:9/568: fdatasync d3/d9/df/d12/f4c 0 2024-03-22T07:28:42.077 INFO:tasks.workunit.client.0.smithi134.stdout:4/661: mkdir d2/d2a/d93/deb 0 2024-03-22T07:28:42.080 INFO:tasks.workunit.client.0.smithi134.stdout:3/585: mknod d4/dab/cbb 0 2024-03-22T07:28:42.082 INFO:tasks.workunit.client.0.smithi134.stdout:8/760: getdents d1/d15/d42/d9e/dbd 0 2024-03-22T07:28:42.082 INFO:tasks.workunit.client.0.smithi134.stdout:8/761: truncate d1/f4b 5143493 0 2024-03-22T07:28:42.082 INFO:tasks.workunit.client.0.smithi134.stdout:6/474: dread d2/d1b/d1d/d5e/d84/f79 [4194304,4194304] 0 2024-03-22T07:28:42.085 INFO:tasks.workunit.client.0.smithi134.stdout:0/625: rename dc/d18/d72 to dc/de/d55/d65/db8 0 2024-03-22T07:28:42.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/569: link d3/d9/df/f7d d3/d9/d37/d3c/fc6 0 2024-03-22T07:28:42.088 INFO:tasks.workunit.client.0.smithi134.stdout:9/570: write d3/d9/d37/d3c/d71/d7a/fa5 [4852070,46607] 0 2024-03-22T07:28:42.092 INFO:tasks.workunit.client.0.smithi134.stdout:8/762: dread d1/dce/fe2 [0,4194304] 0 2024-03-22T07:28:42.095 INFO:tasks.workunit.client.0.smithi134.stdout:4/662: dwrite d2/d15/d35/fb9 [0,4194304] 0 2024-03-22T07:28:42.099 INFO:tasks.workunit.client.0.smithi134.stdout:0/626: link dc/d18/fa1 dc/d18/d85/fb9 0 2024-03-22T07:28:42.103 INFO:tasks.workunit.client.0.smithi134.stdout:6/475: dwrite d2/d1b/d1d/d5e/f8d [0,4194304] 0 2024-03-22T07:28:42.104 INFO:tasks.workunit.client.0.smithi134.stdout:8/763: mkdir d1/d15/d42/d76/d8f/dad/dfc 0 2024-03-22T07:28:42.104 INFO:tasks.workunit.client.0.smithi134.stdout:8/764: creat d1/ffd x:0 0 0 2024-03-22T07:28:42.105 INFO:tasks.workunit.client.1.smithi195.stdout:8/900: creat da/d82/dc6/db4/d10a/f115 x:0 0 0 2024-03-22T07:28:42.105 INFO:tasks.workunit.client.1.smithi195.stdout:8/901: fsync da/d82/dc6/d53/dff/f113 0 2024-03-22T07:28:42.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/476: dread d2/d3f/d28/fac [0,4194304] 0 2024-03-22T07:28:42.108 INFO:tasks.workunit.client.0.smithi134.stdout:6/477: truncate d2/d3f/d28/f7e 4505094 0 2024-03-22T07:28:42.108 INFO:tasks.workunit.client.1.smithi195.stdout:4/820: creat d13/d63/d79/dcd/f116 x:0 0 0 2024-03-22T07:28:42.108 INFO:tasks.workunit.client.1.smithi195.stdout:4/821: write d13/d15/faf [864773,33059] 0 2024-03-22T07:28:42.110 INFO:tasks.workunit.client.1.smithi195.stdout:5/861: mknod d9/d22/dd1/c119 0 2024-03-22T07:28:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:0/814: truncate d1/d4/dd/d66/d80/f6a 1349606 0 2024-03-22T07:28:42.114 INFO:tasks.workunit.client.1.smithi195.stdout:4/822: dread d13/d63/d3e/f97 [0,4194304] 0 2024-03-22T07:28:42.115 INFO:tasks.workunit.client.0.smithi134.stdout:4/663: mkdir d2/d15/d35/da8/dec 0 2024-03-22T07:28:42.118 INFO:tasks.workunit.client.0.smithi134.stdout:0/627: chown dc/d18/l4c 14 1 2024-03-22T07:28:42.120 INFO:tasks.workunit.client.0.smithi134.stdout:4/664: dread d2/d15/f39 [0,4194304] 0 2024-03-22T07:28:42.121 INFO:tasks.workunit.client.1.smithi195.stdout:2/839: rename d2/d3/db/c62 to d2/d3/db/c11d 0 2024-03-22T07:28:42.124 INFO:tasks.workunit.client.1.smithi195.stdout:1/714: rmdir d0/d2/d6/dad/db1/d6b 39 2024-03-22T07:28:42.125 INFO:tasks.workunit.client.1.smithi195.stdout:1/715: truncate d0/d2/fe5 542408 0 2024-03-22T07:28:42.128 INFO:tasks.workunit.client.0.smithi134.stdout:8/765: creat d1/d15/d7b/ffe x:0 0 0 2024-03-22T07:28:42.129 INFO:tasks.workunit.client.0.smithi134.stdout:8/766: chown d1/d15/d42/d76/dda 4472916 1 2024-03-22T07:28:42.135 INFO:tasks.workunit.client.0.smithi134.stdout:6/478: mkdir d2/d3f/d28/db0 0 2024-03-22T07:28:42.136 INFO:tasks.workunit.client.0.smithi134.stdout:0/628: rename dc/de/d55/d60/c9b to dc/de/cba 0 2024-03-22T07:28:42.136 INFO:tasks.workunit.client.0.smithi134.stdout:0/629: read - dc/de/f84 zero size 2024-03-22T07:28:42.137 INFO:tasks.workunit.client.0.smithi134.stdout:4/665: mknod d2/d25/d74/dde/ced 0 2024-03-22T07:28:42.137 INFO:tasks.workunit.client.0.smithi134.stdout:4/666: chown d2/d25/d74/dde/dc0/ce1 80190353 1 2024-03-22T07:28:42.140 INFO:tasks.workunit.client.1.smithi195.stdout:6/744: truncate d5/d5e/d34/d55/fb9 1136025 0 2024-03-22T07:28:42.146 INFO:tasks.workunit.client.0.smithi134.stdout:6/479: stat d2/l11 0 2024-03-22T07:28:42.150 INFO:tasks.workunit.client.0.smithi134.stdout:0/630: write dc/d18/d85/fb9 [2080331,106325] 0 2024-03-22T07:28:42.151 INFO:tasks.workunit.client.1.smithi195.stdout:8/902: unlink da/de/cf 0 2024-03-22T07:28:42.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/862: creat d9/d12/d1d/d36/d7d/dd2/f11a x:0 0 0 2024-03-22T07:28:42.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/863: creat d9/d22/dd1/f11b x:0 0 0 2024-03-22T07:28:42.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/864: creat d9/d2d/d84/dcf/f11c x:0 0 0 2024-03-22T07:28:42.152 INFO:tasks.workunit.client.1.smithi195.stdout:5/865: readlink d9/d22/d7b/d98/lef 0 2024-03-22T07:28:42.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/825: dread d0/d13/d22/d57/d7b/d8c/f90 [0,4194304] 0 2024-03-22T07:28:42.153 INFO:tasks.workunit.client.0.smithi134.stdout:8/767: dwrite d1/d4/f4a [0,4194304] 0 2024-03-22T07:28:42.153 INFO:tasks.workunit.client.0.smithi134.stdout:8/768: write d1/d15/fcc [1099111,18113] 0 2024-03-22T07:28:42.153 INFO:tasks.workunit.client.0.smithi134.stdout:8/769: fsync d1/d15/d57/d79/fba 0 2024-03-22T07:28:42.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/815: creat d1/d4/dd/df/d44/d8d/dd2/f101 x:0 0 0 2024-03-22T07:28:42.156 INFO:tasks.workunit.client.0.smithi134.stdout:6/480: mknod d2/d3f/d28/d6b/cb1 0 2024-03-22T07:28:42.158 INFO:tasks.workunit.client.1.smithi195.stdout:2/840: mknod d2/d3/d21/d4c/c11e 0 2024-03-22T07:28:42.159 INFO:tasks.workunit.client.0.smithi134.stdout:3/586: dwrite d4/d10/d6c/fa5 [0,4194304] 0 2024-03-22T07:28:42.159 INFO:tasks.workunit.client.0.smithi134.stdout:3/587: creat d4/d8/d23/fbc x:0 0 0 2024-03-22T07:28:42.161 INFO:tasks.workunit.client.1.smithi195.stdout:1/716: unlink d0/d2/d6/f8b 0 2024-03-22T07:28:42.161 INFO:tasks.workunit.client.1.smithi195.stdout:1/717: truncate d0/d2/d6/dad/db1/d97/d39/fcf 192115 0 2024-03-22T07:28:42.162 INFO:tasks.workunit.client.1.smithi195.stdout:1/718: fdatasync d0/d2/fd6 0 2024-03-22T07:28:42.168 INFO:tasks.workunit.client.0.smithi134.stdout:0/631: symlink dc/d17/lbb 0 2024-03-22T07:28:42.174 INFO:tasks.workunit.client.0.smithi134.stdout:8/770: rename d1/fd8 to d1/d15/d42/d76/d8f/fff 0 2024-03-22T07:28:42.175 INFO:tasks.workunit.client.0.smithi134.stdout:8/771: truncate d1/d15/d5b/f81 1637822 0 2024-03-22T07:28:42.175 INFO:tasks.workunit.client.1.smithi195.stdout:8/903: mkdir da/de/db3/dc7/d116 0 2024-03-22T07:28:42.178 INFO:tasks.workunit.client.0.smithi134.stdout:6/481: unlink d2/c4c 0 2024-03-22T07:28:42.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/825: write d3/f58 [857698,75899] 0 2024-03-22T07:28:42.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/826: creat d3/dbf/da0/dd1/f10b x:0 0 0 2024-03-22T07:28:42.178 INFO:tasks.workunit.client.1.smithi195.stdout:3/827: write d3/df/d15/d1d/d5c/d47/d67/d80/f102 [4512396,65158] 0 2024-03-22T07:28:42.182 INFO:tasks.workunit.client.0.smithi134.stdout:3/588: mknod d4/d8/d23/cbd 0 2024-03-22T07:28:42.184 INFO:tasks.workunit.client.1.smithi195.stdout:5/866: creat d9/d22/d7b/d98/da0/f11d x:0 0 0 2024-03-22T07:28:42.184 INFO:tasks.workunit.client.1.smithi195.stdout:5/867: write d9/d22/dd1/fe8 [164189,115429] 0 2024-03-22T07:28:42.185 INFO:tasks.workunit.client.1.smithi195.stdout:5/868: read - d9/d2d/d84/dcf/f11c zero size 2024-03-22T07:28:42.189 INFO:tasks.workunit.client.0.smithi134.stdout:8/772: rename d1/d15/d5b/fd7 to d1/d15/d42/d76/d8f/dad/f100 0 2024-03-22T07:28:42.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/826: creat d0/d13/d14/d20/d40/d82/da6/dc8/f120 x:0 0 0 2024-03-22T07:28:42.192 INFO:tasks.workunit.client.0.smithi134.stdout:6/482: getdents d2/d3f 0 2024-03-22T07:28:42.193 INFO:tasks.workunit.client.1.smithi195.stdout:2/841: rename d2/d3/db/db3/fdf to d2/d3/d7/da/d18/f11f 0 2024-03-22T07:28:42.195 INFO:tasks.workunit.client.0.smithi134.stdout:3/589: dread d4/d10/f40 [4194304,4194304] 0 2024-03-22T07:28:42.196 INFO:tasks.workunit.client.0.smithi134.stdout:6/483: truncate d2/d1b/d4d/d65/fa0 516410 0 2024-03-22T07:28:42.200 INFO:tasks.workunit.client.1.smithi195.stdout:5/869: symlink d9/d22/d7b/d98/dbe/l11e 0 2024-03-22T07:28:42.200 INFO:tasks.workunit.client.1.smithi195.stdout:5/870: truncate d9/ff 4232312 0 2024-03-22T07:28:42.202 INFO:tasks.workunit.client.1.smithi195.stdout:7/827: creat d0/d13/d14/d20/f121 x:0 0 0 2024-03-22T07:28:42.202 INFO:tasks.workunit.client.1.smithi195.stdout:7/828: fdatasync d0/d13/d14/d29/d35/fa8 0 2024-03-22T07:28:42.202 INFO:tasks.workunit.client.1.smithi195.stdout:9/948: sync 2024-03-22T07:28:42.203 INFO:tasks.workunit.client.1.smithi195.stdout:9/949: creat d2/d4/d113/f158 x:0 0 0 2024-03-22T07:28:42.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/590: read d4/d22/d29/f67 [1987369,69418] 0 2024-03-22T07:28:42.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/591: fsync d4/f2b 0 2024-03-22T07:28:42.203 INFO:tasks.workunit.client.0.smithi134.stdout:3/592: truncate d4/f56 199007 0 2024-03-22T07:28:42.205 INFO:tasks.workunit.client.1.smithi195.stdout:8/904: rmdir da/de/db3/ddd 39 2024-03-22T07:28:42.207 INFO:tasks.workunit.client.1.smithi195.stdout:5/871: unlink d9/c89 0 2024-03-22T07:28:42.209 INFO:tasks.workunit.client.0.smithi134.stdout:6/484: write d2/d3f/f61 [545628,76736] 0 2024-03-22T07:28:42.209 INFO:tasks.workunit.client.0.smithi134.stdout:0/632: dwrite dc/d18/d89/fa6 [0,4194304] 0 2024-03-22T07:28:42.210 INFO:tasks.workunit.client.0.smithi134.stdout:0/633: readlink dc/d18/d85/laf 0 2024-03-22T07:28:42.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/828: dwrite d3/f91 [0,4194304] 0 2024-03-22T07:28:42.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/829: write d3/df/d15/d1d/d5c/d47/d67/d80/f8f [1027559,84621] 0 2024-03-22T07:28:42.210 INFO:tasks.workunit.client.1.smithi195.stdout:3/830: dread - d3/df/d50/fcf zero size 2024-03-22T07:28:42.210 INFO:tasks.workunit.client.1.smithi195.stdout:9/950: mknod d2/d4/d6/dd1/d112/c159 0 2024-03-22T07:28:42.211 INFO:tasks.workunit.client.0.smithi134.stdout:5/632: sync 2024-03-22T07:28:42.212 INFO:tasks.workunit.client.1.smithi195.stdout:5/872: mkdir d9/d12/d1d/d69/d11f 0 2024-03-22T07:28:42.212 INFO:tasks.workunit.client.1.smithi195.stdout:5/873: chown d9/d12/d1d/d69/d78/d41/leb 0 1 2024-03-22T07:28:42.212 INFO:tasks.workunit.client.1.smithi195.stdout:5/874: dread - d9/d22/d7b/fe9 zero size 2024-03-22T07:28:42.214 INFO:tasks.workunit.client.1.smithi195.stdout:3/831: read d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea [599090,123869] 0 2024-03-22T07:28:42.214 INFO:tasks.workunit.client.1.smithi195.stdout:3/832: stat d3/df/d15/d1d/d5c/d47/d67/d80/c7b 0 2024-03-22T07:28:42.215 INFO:tasks.workunit.client.1.smithi195.stdout:7/829: rename d0/d13/d14/d29/da2 to d0/d13/d14/d80/d9c/d122 0 2024-03-22T07:28:42.215 INFO:tasks.workunit.client.1.smithi195.stdout:7/830: creat d0/d13/d14/d2f/dae/f123 x:0 0 0 2024-03-22T07:28:42.222 INFO:tasks.workunit.client.1.smithi195.stdout:8/905: rename da/dc/fa6 to da/d17/d32/d61/f117 0 2024-03-22T07:28:42.223 INFO:tasks.workunit.client.1.smithi195.stdout:8/906: write da/de/f101 [773550,88022] 0 2024-03-22T07:28:42.229 INFO:tasks.workunit.client.1.smithi195.stdout:7/831: rmdir d0/d98/dab/dd7 39 2024-03-22T07:28:42.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/833: rmdir d3/df/d15/d1d/d5c/d47/d67/d80/db8/dc0 0 2024-03-22T07:28:42.232 INFO:tasks.workunit.client.1.smithi195.stdout:3/834: getdents d3/d18/d89/d76/def/df9 0 2024-03-22T07:28:42.234 INFO:tasks.workunit.client.1.smithi195.stdout:3/835: link d3/fd d3/dbf/f10c 0 2024-03-22T07:28:42.234 INFO:tasks.workunit.client.1.smithi195.stdout:3/836: getdents d3/d22 0 2024-03-22T07:28:42.238 INFO:tasks.workunit.client.1.smithi195.stdout:8/907: dwrite da/d17/d32/d61/d88/dc9/fe0 [0,4194304] 0 2024-03-22T07:28:42.241 INFO:tasks.workunit.client.1.smithi195.stdout:8/908: rename da/de/db3/ddd/f112 to da/de/db3/dc7/d116/f118 0 2024-03-22T07:28:42.242 INFO:tasks.workunit.client.1.smithi195.stdout:8/909: write da/dc/f6e [498438,73900] 0 2024-03-22T07:28:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/719: dwrite d0/d2/d6/dad/db1/d97/d39/d64/fc3 [0,4194304] 0 2024-03-22T07:28:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/720: chown d0/d2/d6/f2f 26554 1 2024-03-22T07:28:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/721: dread - d0/d2/fd6 zero size 2024-03-22T07:28:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:1/722: write d0/d2/d27/d91/dc8/da4/dc0/fe6 [1033349,123979] 0 2024-03-22T07:28:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:8/910: symlink da/de/db3/dc7/dd3/l119 0 2024-03-22T07:28:42.243 INFO:tasks.workunit.client.1.smithi195.stdout:8/911: read - da/d17/d32/d61/dc2/f114 zero size 2024-03-22T07:28:42.249 INFO:tasks.workunit.client.1.smithi195.stdout:1/723: creat d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7/feb x:0 0 0 2024-03-22T07:28:42.250 INFO:tasks.workunit.client.1.smithi195.stdout:3/837: write d3/fd [2510610,92550] 0 2024-03-22T07:28:42.250 INFO:tasks.workunit.client.1.smithi195.stdout:3/838: stat d3/fab 0 2024-03-22T07:28:42.252 INFO:tasks.workunit.client.1.smithi195.stdout:8/912: mknod da/de/c11a 0 2024-03-22T07:28:42.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/745: dwrite d5/d16/d5a/fef [0,4194304] 0 2024-03-22T07:28:42.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/746: dread - d5/d5e/d34/d55/d3b/d7f/fd4 zero size 2024-03-22T07:28:42.252 INFO:tasks.workunit.client.1.smithi195.stdout:6/747: fdatasync d5/d16/d45/df8/d104/da2/d1a/fb2 0 2024-03-22T07:28:42.254 INFO:tasks.workunit.client.1.smithi195.stdout:1/724: mknod d0/d2/d6/dad/db1/d97/d39/cec 0 2024-03-22T07:28:42.254 INFO:tasks.workunit.client.1.smithi195.stdout:1/725: readlink d0/d2/l8a 0 2024-03-22T07:28:42.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/726: creat d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7/fed x:0 0 0 2024-03-22T07:28:42.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/727: chown d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/f6d 9 1 2024-03-22T07:28:42.255 INFO:tasks.workunit.client.1.smithi195.stdout:1/728: dread - d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 zero size 2024-03-22T07:28:42.255 INFO:tasks.workunit.client.0.smithi134.stdout:5/633: dwrite d1/d8/d16/f74 [0,4194304] 0 2024-03-22T07:28:42.258 INFO:tasks.workunit.client.1.smithi195.stdout:8/913: creat da/de/db3/ddd/de2/f11b x:0 0 0 2024-03-22T07:28:42.258 INFO:tasks.workunit.client.1.smithi195.stdout:8/914: chown da/d17/l9d 10089208 1 2024-03-22T07:28:42.262 INFO:tasks.workunit.client.1.smithi195.stdout:6/748: symlink d5/d16/d45/df8/l10f 0 2024-03-22T07:28:42.262 INFO:tasks.workunit.client.1.smithi195.stdout:6/749: write d5/d16/d45/df8/d104/da2/d1a/fe2 [901021,115300] 0 2024-03-22T07:28:42.262 INFO:tasks.workunit.client.1.smithi195.stdout:3/839: write d3/df/d15/d1d/d5c/f72 [9001,21043] 0 2024-03-22T07:28:42.263 INFO:tasks.workunit.client.1.smithi195.stdout:3/840: truncate d3/df/d15/d1d/d5c/d47/d67/ded/ff4 249861 0 2024-03-22T07:28:42.265 INFO:tasks.workunit.client.0.smithi134.stdout:5/634: dread d1/d8/d20/d62/d65/f67 [0,4194304] 0 2024-03-22T07:28:42.268 INFO:tasks.workunit.client.1.smithi195.stdout:9/951: dwrite d2/d4/d6/db5/df2/ff5 [0,4194304] 0 2024-03-22T07:28:42.269 INFO:tasks.workunit.client.0.smithi134.stdout:5/635: creat d1/d8/d20/d62/fd3 x:0 0 0 2024-03-22T07:28:42.270 INFO:tasks.workunit.client.0.smithi134.stdout:5/636: fsync d1/d8/d20/d62/d65/f18 0 2024-03-22T07:28:42.270 INFO:tasks.workunit.client.1.smithi195.stdout:0/816: dwrite d1/d4/d22/df0/ff5 [0,4194304] 0 2024-03-22T07:28:42.272 INFO:tasks.workunit.client.0.smithi134.stdout:0/634: write dc/d18/d89/da0/fa8 [3981267,35911] 0 2024-03-22T07:28:42.272 INFO:tasks.workunit.client.0.smithi134.stdout:8/773: dwrite d1/d15/d5b/f6d [0,4194304] 0 2024-03-22T07:28:42.272 INFO:tasks.workunit.client.0.smithi134.stdout:0/635: write dc/de/d55/d65/d82/faa [5085088,39564] 0 2024-03-22T07:28:42.272 INFO:tasks.workunit.client.0.smithi134.stdout:8/774: write d1/d15/d57/f89 [321623,57948] 0 2024-03-22T07:28:42.272 INFO:tasks.workunit.client.0.smithi134.stdout:8/775: read - d1/d15/d42/d76/fc5 zero size 2024-03-22T07:28:42.273 INFO:tasks.workunit.client.1.smithi195.stdout:5/875: dwrite d9/d2d/d84/dcf/f75 [0,4194304] 0 2024-03-22T07:28:42.274 INFO:tasks.workunit.client.1.smithi195.stdout:2/842: dwrite d2/d3/d21/d60/d81/d9a/f9c [4194304,4194304] 0 2024-03-22T07:28:42.275 INFO:tasks.workunit.client.0.smithi134.stdout:5/637: getdents d1/d8/d83 0 2024-03-22T07:28:42.275 INFO:tasks.workunit.client.0.smithi134.stdout:3/593: dwrite d4/d8/d23/f55 [0,4194304] 0 2024-03-22T07:28:42.276 INFO:tasks.workunit.client.0.smithi134.stdout:3/594: chown d4/d10/d4b/l64 143 1 2024-03-22T07:28:42.276 INFO:tasks.workunit.client.0.smithi134.stdout:3/595: chown d4/d8/d7f/d9c/db9 6747 1 2024-03-22T07:28:42.276 INFO:tasks.workunit.client.0.smithi134.stdout:3/596: write d4/d8/f19 [1860422,51278] 0 2024-03-22T07:28:42.279 INFO:tasks.workunit.client.1.smithi195.stdout:9/952: dread d2/d4/d6/db5/df2/ff5 [0,4194304] 0 2024-03-22T07:28:42.279 INFO:tasks.workunit.client.1.smithi195.stdout:9/953: chown d2/d4/d6/d18/d50/f150 2361094 1 2024-03-22T07:28:42.280 INFO:tasks.workunit.client.1.smithi195.stdout:1/729: dwrite d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7/fed [0,4194304] 0 2024-03-22T07:28:42.282 INFO:tasks.workunit.client.0.smithi134.stdout:8/776: symlink d1/d46/d75/d8b/l101 0 2024-03-22T07:28:42.283 INFO:tasks.workunit.client.0.smithi134.stdout:0/636: dread dc/d18/d89/fa6 [0,4194304] 0 2024-03-22T07:28:42.284 INFO:tasks.workunit.client.1.smithi195.stdout:8/915: creat da/d17/d32/d61/d88/f11c x:0 0 0 2024-03-22T07:28:42.285 INFO:tasks.workunit.client.1.smithi195.stdout:8/916: chown da/d17/d32/d61/dc2/dc3 3068 1 2024-03-22T07:28:42.286 INFO:tasks.workunit.client.0.smithi134.stdout:5/638: unlink d1/c32 0 2024-03-22T07:28:42.289 INFO:tasks.workunit.client.1.smithi195.stdout:6/750: rename d5/d16/d5b/c5d to d5/d5e/d34/d55/d3b/d6e/d56/c110 0 2024-03-22T07:28:42.289 INFO:tasks.workunit.client.1.smithi195.stdout:6/751: write d5/f1e [2943882,84524] 0 2024-03-22T07:28:42.289 INFO:tasks.workunit.client.1.smithi195.stdout:6/752: fdatasync d5/d5e/d34/d55/d3b/d6e/d3c/f6c 0 2024-03-22T07:28:42.291 INFO:tasks.workunit.client.1.smithi195.stdout:3/841: symlink d3/df/d50/l10d 0 2024-03-22T07:28:42.292 INFO:tasks.workunit.client.0.smithi134.stdout:8/777: mkdir d1/d46/d75/d8b/db4/d102 0 2024-03-22T07:28:42.292 INFO:tasks.workunit.client.0.smithi134.stdout:8/778: truncate d1/d15/d57/d79/fba 333248 0 2024-03-22T07:28:42.293 INFO:tasks.workunit.client.0.smithi134.stdout:0/637: creat dc/de/d55/d65/d82/fbc x:0 0 0 2024-03-22T07:28:42.296 INFO:tasks.workunit.client.0.smithi134.stdout:8/779: rename d1/d15/d5b/cdf to d1/dce/c103 0 2024-03-22T07:28:42.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/638: dread dc/d18/fa1 [0,4194304] 0 2024-03-22T07:28:42.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/639: write dc/d18/f70 [1055042,75187] 0 2024-03-22T07:28:42.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/640: chown dc/f4e 23 1 2024-03-22T07:28:42.301 INFO:tasks.workunit.client.0.smithi134.stdout:0/641: chown dc/d18/d89/l9f 403 1 2024-03-22T07:28:42.301 INFO:tasks.workunit.client.0.smithi134.stdout:8/780: mknod d1/d15/d7b/d83/de3/da2/c104 0 2024-03-22T07:28:42.301 INFO:tasks.workunit.client.1.smithi195.stdout:0/817: link d1/da2/cdb d1/d4/d22/df0/c102 0 2024-03-22T07:28:42.302 INFO:tasks.workunit.client.0.smithi134.stdout:0/642: rmdir dc/de/d55/d65 39 2024-03-22T07:28:42.303 INFO:tasks.workunit.client.0.smithi134.stdout:8/781: mknod d1/d15/d42/d76/dda/df7/c105 0 2024-03-22T07:28:42.304 INFO:tasks.workunit.client.0.smithi134.stdout:8/782: read - d1/d15/d42/d76/d8f/dad/dae/fbc zero size 2024-03-22T07:28:42.306 INFO:tasks.workunit.client.0.smithi134.stdout:8/783: mkdir d1/d4/d38/d106 0 2024-03-22T07:28:42.306 INFO:tasks.workunit.client.0.smithi134.stdout:8/784: dread - d1/d15/d42/d12/fc6 zero size 2024-03-22T07:28:42.307 INFO:tasks.workunit.client.0.smithi134.stdout:8/785: truncate d1/d15/f19 1704746 0 2024-03-22T07:28:42.310 INFO:tasks.workunit.client.1.smithi195.stdout:9/954: mknod d2/d4/d6/db/da8/d14f/c15a 0 2024-03-22T07:28:42.311 INFO:tasks.workunit.client.0.smithi134.stdout:8/786: mknod d1/d15/d42/c107 0 2024-03-22T07:28:42.311 INFO:tasks.workunit.client.0.smithi134.stdout:0/643: dread dc/f57 [0,4194304] 0 2024-03-22T07:28:42.312 INFO:tasks.workunit.client.0.smithi134.stdout:0/644: stat dc/de/d55/f71 0 2024-03-22T07:28:42.312 INFO:tasks.workunit.client.0.smithi134.stdout:0/645: fsync dc/de/d55/d65/d82/f98 0 2024-03-22T07:28:42.312 INFO:tasks.workunit.client.0.smithi134.stdout:0/646: read - dc/de/d55/d65/db8/f83 zero size 2024-03-22T07:28:42.313 INFO:tasks.workunit.client.0.smithi134.stdout:8/787: creat d1/d46/d75/d8b/db4/d102/f108 x:0 0 0 2024-03-22T07:28:42.314 INFO:tasks.workunit.client.0.smithi134.stdout:5/639: dwrite d1/d8/dc5/f9b [0,4194304] 0 2024-03-22T07:28:42.314 INFO:tasks.workunit.client.0.smithi134.stdout:3/597: dwrite d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:42.316 INFO:tasks.workunit.client.1.smithi195.stdout:1/730: creat d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/fee x:0 0 0 2024-03-22T07:28:42.317 INFO:tasks.workunit.client.0.smithi134.stdout:0/647: chown dc/d18/f5e 22 1 2024-03-22T07:28:42.317 INFO:tasks.workunit.client.0.smithi134.stdout:0/648: chown dc/l58 844 1 2024-03-22T07:28:42.324 INFO:tasks.workunit.client.0.smithi134.stdout:3/598: dread f0 [0,4194304] 0 2024-03-22T07:28:42.326 INFO:tasks.workunit.client.1.smithi195.stdout:8/917: mkdir da/d17/d32/d61/dc2/d11d 0 2024-03-22T07:28:42.326 INFO:tasks.workunit.client.1.smithi195.stdout:8/918: readlink da/d17/l9b 0 2024-03-22T07:28:42.326 INFO:tasks.workunit.client.1.smithi195.stdout:8/919: truncate da/d82/dc6/d53/f5e 4991568 0 2024-03-22T07:28:42.331 INFO:tasks.workunit.client.1.smithi195.stdout:6/753: creat d5/d16/d45/df8/d104/f111 x:0 0 0 2024-03-22T07:28:42.331 INFO:tasks.workunit.client.1.smithi195.stdout:9/955: dwrite d2/ffb [0,4194304] 0 2024-03-22T07:28:42.337 INFO:tasks.workunit.client.1.smithi195.stdout:3/842: mknod d3/df/d15/d1d/d5c/d47/d67/d80/d87/dfe/c10e 0 2024-03-22T07:28:42.338 INFO:tasks.workunit.client.1.smithi195.stdout:6/754: write d5/d5e/d34/d55/d3b/d6e/d97/fd0 [1146442,126748] 0 2024-03-22T07:28:42.341 INFO:tasks.workunit.client.1.smithi195.stdout:0/818: creat d1/d10/d4d/f103 x:0 0 0 2024-03-22T07:28:42.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/956: dread d2/d4/f38 [0,4194304] 0 2024-03-22T07:28:42.341 INFO:tasks.workunit.client.1.smithi195.stdout:9/957: dread - d2/d4/d6/d18/d50/f150 zero size 2024-03-22T07:28:42.344 INFO:tasks.workunit.client.1.smithi195.stdout:2/843: link d2/d3/d7/da/l11c d2/d3/d21/ddd/l120 0 2024-03-22T07:28:42.349 INFO:tasks.workunit.client.1.smithi195.stdout:1/731: mknod d0/d2/d6/dad/db1/d97/d39/d40/dc9/cef 0 2024-03-22T07:28:42.350 INFO:tasks.workunit.client.1.smithi195.stdout:1/732: write d0/d2/d27/d91/dc8/d2a/fb0 [605970,29072] 0 2024-03-22T07:28:42.351 INFO:tasks.workunit.client.0.smithi134.stdout:0/649: link dc/de/d55/l80 dc/d17/da9/lbd 0 2024-03-22T07:28:42.354 INFO:tasks.workunit.client.1.smithi195.stdout:8/920: dwrite da/f35 [0,4194304] 0 2024-03-22T07:28:42.355 INFO:tasks.workunit.client.1.smithi195.stdout:8/921: chown da/dc/da4 2559 1 2024-03-22T07:28:42.355 INFO:tasks.workunit.client.1.smithi195.stdout:8/922: write da/de/db3/dc7/ff7 [2071093,96731] 0 2024-03-22T07:28:42.356 INFO:tasks.workunit.client.1.smithi195.stdout:2/844: read d2/d3/ffe [2878201,41025] 0 2024-03-22T07:28:42.357 INFO:tasks.workunit.client.0.smithi134.stdout:5/640: dread d1/d8/d20/d62/d65/f43 [0,4194304] 0 2024-03-22T07:28:42.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/843: rmdir d3/df/d15/d1d/d5c/d47/dbb 39 2024-03-22T07:28:42.358 INFO:tasks.workunit.client.1.smithi195.stdout:3/844: chown d3/df/d15/d1d/d5c/c9e 1 1 2024-03-22T07:28:42.360 INFO:tasks.workunit.client.0.smithi134.stdout:0/650: mkdir dc/de/d55/d65/dbe 0 2024-03-22T07:28:42.361 INFO:tasks.workunit.client.1.smithi195.stdout:6/755: getdents d5/d5e/d34/d55/d3b/d7f/db4 0 2024-03-22T07:28:42.361 INFO:tasks.workunit.client.1.smithi195.stdout:6/756: stat d5/d16/cc4 0 2024-03-22T07:28:42.362 INFO:tasks.workunit.client.0.smithi134.stdout:3/599: getdents d4/d8/d45 0 2024-03-22T07:28:42.364 INFO:tasks.workunit.client.1.smithi195.stdout:0/819: unlink d1/d10/d19/d20/fb7 0 2024-03-22T07:28:42.364 INFO:tasks.workunit.client.1.smithi195.stdout:0/820: truncate d1/d4/dd/d66/f9a 716203 0 2024-03-22T07:28:42.366 INFO:tasks.workunit.client.1.smithi195.stdout:9/958: symlink d2/d4/d6/db5/de3/l15b 0 2024-03-22T07:28:42.367 INFO:tasks.workunit.client.0.smithi134.stdout:5/641: truncate d1/d8/d83/f8f 583815 0 2024-03-22T07:28:42.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/876: truncate d9/ff 1605412 0 2024-03-22T07:28:42.369 INFO:tasks.workunit.client.1.smithi195.stdout:5/877: write d9/d73/fe1 [160475,80137] 0 2024-03-22T07:28:42.370 INFO:tasks.workunit.client.0.smithi134.stdout:0/651: symlink dc/de/d55/d65/d82/db7/lbf 0 2024-03-22T07:28:42.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/733: mknod d0/d2/d6/dad/db1/d6b/cf0 0 2024-03-22T07:28:42.372 INFO:tasks.workunit.client.1.smithi195.stdout:1/734: chown d0/d2/d6/dad/db1/d97/d39/l9e 69003 1 2024-03-22T07:28:42.373 INFO:tasks.workunit.client.0.smithi134.stdout:3/600: rename d4/d8/f6e to d4/d10/fbe 0 2024-03-22T07:28:42.373 INFO:tasks.workunit.client.0.smithi134.stdout:3/601: readlink d4/d22/d3c/l92 0 2024-03-22T07:28:42.377 INFO:tasks.workunit.client.0.smithi134.stdout:5/642: rmdir d1/d90 0 2024-03-22T07:28:42.377 INFO:tasks.workunit.client.0.smithi134.stdout:2/536: sync 2024-03-22T07:28:42.378 INFO:tasks.workunit.client.1.smithi195.stdout:8/923: unlink da/dde/dfd/c106 0 2024-03-22T07:28:42.378 INFO:tasks.workunit.client.1.smithi195.stdout:8/924: getdents da/dde/d102 0 2024-03-22T07:28:42.379 INFO:tasks.workunit.client.1.smithi195.stdout:0/821: read d1/d4/dd/df/d44/d6f/f71 [7229115,63632] 0 2024-03-22T07:28:42.381 INFO:tasks.workunit.client.0.smithi134.stdout:0/652: rename dc/d17/f48 to dc/de/d55/d65/dbe/fc0 0 2024-03-22T07:28:42.383 INFO:tasks.workunit.client.1.smithi195.stdout:2/845: mkdir d2/d3/d7/d19/d22/d26/d3c/d116/d121 0 2024-03-22T07:28:42.386 INFO:tasks.workunit.client.1.smithi195.stdout:3/845: getdents d3/df/d15/d1d 0 2024-03-22T07:28:42.387 INFO:tasks.workunit.client.1.smithi195.stdout:3/846: write d3/d18/d89/d76/fee [190072,70712] 0 2024-03-22T07:28:42.390 INFO:tasks.workunit.client.0.smithi134.stdout:0/653: mkdir dc/de/d55/d65/dc1 0 2024-03-22T07:28:42.393 INFO:tasks.workunit.client.1.smithi195.stdout:9/959: creat d2/d4/d1d/f15c x:0 0 0 2024-03-22T07:28:42.395 INFO:tasks.workunit.client.1.smithi195.stdout:5/878: dwrite d9/da8/fed [0,4194304] 0 2024-03-22T07:28:42.396 INFO:tasks.workunit.client.0.smithi134.stdout:2/537: rename d2/f1c to d2/d5/d22/d99/fa6 0 2024-03-22T07:28:42.402 INFO:tasks.workunit.client.1.smithi195.stdout:8/925: mkdir da/d17/d32/d61/dc2/dfb/d11e 0 2024-03-22T07:28:42.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/822: mkdir d1/d10/d1f/dbf/d104 0 2024-03-22T07:28:42.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/823: write d1/d10/d1f/f9d [326998,128494] 0 2024-03-22T07:28:42.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/824: fdatasync d1/d4/d12/d6c/dbc/d47/db6/f97 0 2024-03-22T07:28:42.405 INFO:tasks.workunit.client.1.smithi195.stdout:0/825: chown d1/d4/d12 0 1 2024-03-22T07:28:42.407 INFO:tasks.workunit.client.1.smithi195.stdout:7/832: sync 2024-03-22T07:28:42.407 INFO:tasks.workunit.client.1.smithi195.stdout:4/823: sync 2024-03-22T07:28:42.410 INFO:tasks.workunit.client.0.smithi134.stdout:3/602: dwrite d4/d22/d29/d50/f62 [0,4194304] 0 2024-03-22T07:28:42.410 INFO:tasks.workunit.client.0.smithi134.stdout:3/603: creat d4/d22/d3c/fbf x:0 0 0 2024-03-22T07:28:42.410 INFO:tasks.workunit.client.0.smithi134.stdout:3/604: chown d4/d22/f20 0 1 2024-03-22T07:28:42.411 INFO:tasks.workunit.client.1.smithi195.stdout:1/735: dwrite d0/d2/d27/d91/dc8/da4/dc0/fc1 [0,4194304] 0 2024-03-22T07:28:42.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/879: unlink d9/d12/d1d/d69/d78/l42 0 2024-03-22T07:28:42.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/880: read d9/d12/f3d [250332,88690] 0 2024-03-22T07:28:42.413 INFO:tasks.workunit.client.1.smithi195.stdout:5/881: chown d9/d73/le2 6769 1 2024-03-22T07:28:42.414 INFO:tasks.workunit.client.1.smithi195.stdout:3/847: dwrite d3/f58 [0,4194304] 0 2024-03-22T07:28:42.416 INFO:tasks.workunit.client.1.smithi195.stdout:8/926: unlink da/dc/f2b 0 2024-03-22T07:28:42.419 INFO:tasks.workunit.client.0.smithi134.stdout:2/538: dread d2/d5/d8/d5d/da1/d3c/d60/f91 [0,4194304] 0 2024-03-22T07:28:42.421 INFO:tasks.workunit.client.0.smithi134.stdout:0/654: write dc/d18/f5a [1849177,85765] 0 2024-03-22T07:28:42.422 INFO:tasks.workunit.client.1.smithi195.stdout:0/826: dwrite d1/d4/dd/df/fe2 [0,4194304] 0 2024-03-22T07:28:42.424 INFO:tasks.workunit.client.1.smithi195.stdout:2/846: mkdir d2/d122 0 2024-03-22T07:28:42.427 INFO:tasks.workunit.client.1.smithi195.stdout:4/824: link d13/d63/d3e/d5c/cd8 d13/d63/d79/de9/dfd/c117 0 2024-03-22T07:28:42.427 INFO:tasks.workunit.client.1.smithi195.stdout:4/825: truncate d13/d15/faf 1111130 0 2024-03-22T07:28:42.430 INFO:tasks.workunit.client.1.smithi195.stdout:5/882: write d9/d12/f1f [464047,110251] 0 2024-03-22T07:28:42.430 INFO:tasks.workunit.client.1.smithi195.stdout:5/883: chown d9/fb 25 1 2024-03-22T07:28:42.431 INFO:tasks.workunit.client.0.smithi134.stdout:0/655: dread dc/d18/f2e [0,4194304] 0 2024-03-22T07:28:42.431 INFO:tasks.workunit.client.1.smithi195.stdout:7/833: mknod d0/d13/d14/d20/d40/d82/da6/c124 0 2024-03-22T07:28:42.432 INFO:tasks.workunit.client.0.smithi134.stdout:2/539: getdents d2/d5/d22/d99 0 2024-03-22T07:28:42.432 INFO:tasks.workunit.client.0.smithi134.stdout:2/540: write d2/d5/d22/f5e [1653675,110220] 0 2024-03-22T07:28:42.436 INFO:tasks.workunit.client.0.smithi134.stdout:0/656: creat dc/de/d55/d65/fc2 x:0 0 0 2024-03-22T07:28:42.436 INFO:tasks.workunit.client.0.smithi134.stdout:0/657: creat dc/d18/d89/da0/fc3 x:0 0 0 2024-03-22T07:28:42.439 INFO:tasks.workunit.client.0.smithi134.stdout:3/605: dwrite d4/d10/d4b/f65 [0,4194304] 0 2024-03-22T07:28:42.439 INFO:tasks.workunit.client.0.smithi134.stdout:2/541: creat d2/d5/d8/d5d/da1/d3c/d60/fa7 x:0 0 0 2024-03-22T07:28:42.444 INFO:tasks.workunit.client.0.smithi134.stdout:0/658: rename dc/c52 to dc/de/cc4 0 2024-03-22T07:28:42.444 INFO:tasks.workunit.client.0.smithi134.stdout:0/659: chown dc/f8d 19016 1 2024-03-22T07:28:42.445 INFO:tasks.workunit.client.1.smithi195.stdout:6/757: dwrite d5/d16/d45/df8/d104/f4f [0,4194304] 0 2024-03-22T07:28:42.445 INFO:tasks.workunit.client.1.smithi195.stdout:8/927: dwrite da/de/f5b [4194304,4194304] 0 2024-03-22T07:28:42.450 INFO:tasks.workunit.client.1.smithi195.stdout:3/848: mknod d3/df/d15/d1d/d5c/d47/d67/d80/c10f 0 2024-03-22T07:28:42.455 INFO:tasks.workunit.client.0.smithi134.stdout:3/606: write d4/d22/d29/d82/f8d [3290014,14661] 0 2024-03-22T07:28:42.455 INFO:tasks.workunit.client.0.smithi134.stdout:3/607: write d4/d8/d5c/f7a [450593,17336] 0 2024-03-22T07:28:42.460 INFO:tasks.workunit.client.1.smithi195.stdout:2/847: getdents d2/d3 0 2024-03-22T07:28:42.460 INFO:tasks.workunit.client.1.smithi195.stdout:2/848: fdatasync d2/fc4 0 2024-03-22T07:28:42.463 INFO:tasks.workunit.client.1.smithi195.stdout:4/826: rename d13/d15/f1c to d13/d15/d6b/da6/f118 0 2024-03-22T07:28:42.463 INFO:tasks.workunit.client.1.smithi195.stdout:4/827: truncate d13/d15/d6b/da6/f118 4543356 0 2024-03-22T07:28:42.464 INFO:tasks.workunit.client.0.smithi134.stdout:3/608: symlink d4/d22/d29/dad/lc0 0 2024-03-22T07:28:42.464 INFO:tasks.workunit.client.0.smithi134.stdout:3/609: creat d4/d22/d29/d82/fc1 x:0 0 0 2024-03-22T07:28:42.465 INFO:tasks.workunit.client.1.smithi195.stdout:8/928: dwrite da/dc/d71/fc1 [0,4194304] 0 2024-03-22T07:28:42.466 INFO:tasks.workunit.client.0.smithi134.stdout:0/660: dwrite dc/de/f23 [0,4194304] 0 2024-03-22T07:28:42.466 INFO:tasks.workunit.client.0.smithi134.stdout:0/661: readlink dc/d17/lbb 0 2024-03-22T07:28:42.469 INFO:tasks.workunit.client.1.smithi195.stdout:5/884: getdents d9/d12/d1d/d36 0 2024-03-22T07:28:42.471 INFO:tasks.workunit.client.0.smithi134.stdout:3/610: read d4/f48 [140953,3900] 0 2024-03-22T07:28:42.472 INFO:tasks.workunit.client.0.smithi134.stdout:3/611: chown d4/d22/d29 9909 1 2024-03-22T07:28:42.472 INFO:tasks.workunit.client.0.smithi134.stdout:3/612: chown d4/d22/d3c/l41 594182 1 2024-03-22T07:28:42.472 INFO:tasks.workunit.client.1.smithi195.stdout:7/834: rename d0/d13/d14/d20/d40/d82/da0/le5 to d0/d13/d14/d20/d40/d82/da0/l125 0 2024-03-22T07:28:42.473 INFO:tasks.workunit.client.0.smithi134.stdout:0/662: mknod dc/de/d55/cc5 0 2024-03-22T07:28:42.473 INFO:tasks.workunit.client.0.smithi134.stdout:0/663: creat dc/de/d55/d65/fc6 x:0 0 0 2024-03-22T07:28:42.474 INFO:tasks.workunit.client.0.smithi134.stdout:0/664: chown dc/de/d55/f63 3960400 1 2024-03-22T07:28:42.474 INFO:tasks.workunit.client.0.smithi134.stdout:0/665: rename dc to dc/de/d55/dc7 22 2024-03-22T07:28:42.474 INFO:tasks.workunit.client.0.smithi134.stdout:0/666: creat dc/d18/d89/fc8 x:0 0 0 2024-03-22T07:28:42.475 INFO:tasks.workunit.client.1.smithi195.stdout:1/736: getdents d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7 0 2024-03-22T07:28:42.475 INFO:tasks.workunit.client.1.smithi195.stdout:1/737: write d0/d2/d27/d91/dc8/d2a/f86 [5101224,42479] 0 2024-03-22T07:28:42.476 INFO:tasks.workunit.client.0.smithi134.stdout:3/613: symlink d4/d8/d7f/d9c/lc2 0 2024-03-22T07:28:42.476 INFO:tasks.workunit.client.1.smithi195.stdout:5/885: dread d9/d7f/f81 [0,4194304] 0 2024-03-22T07:28:42.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/886: dread - d9/d22/dd1/ff8 zero size 2024-03-22T07:28:42.477 INFO:tasks.workunit.client.1.smithi195.stdout:5/887: chown d9/d12/d1d/d36/fa6 37 1 2024-03-22T07:28:42.478 INFO:tasks.workunit.client.0.smithi134.stdout:0/667: write dc/f29 [3830800,82898] 0 2024-03-22T07:28:42.482 INFO:tasks.workunit.client.1.smithi195.stdout:6/758: mkdir d5/d5e/d34/d55/d3b/d6e/d97/d112 0 2024-03-22T07:28:42.483 INFO:tasks.workunit.client.0.smithi134.stdout:3/614: rmdir d4/dab 39 2024-03-22T07:28:42.483 INFO:tasks.workunit.client.0.smithi134.stdout:3/615: chown d4/d22/d29/d50/f7b 165 1 2024-03-22T07:28:42.485 INFO:tasks.workunit.client.0.smithi134.stdout:0/668: rmdir dc 39 2024-03-22T07:28:42.487 INFO:tasks.workunit.client.1.smithi195.stdout:2/849: mknod d2/d3/d7/d19/d22/d26/d3c/c123 0 2024-03-22T07:28:42.489 INFO:tasks.workunit.client.1.smithi195.stdout:4/828: unlink d13/d63/d79/c80 0 2024-03-22T07:28:42.491 INFO:tasks.workunit.client.0.smithi134.stdout:0/669: mkdir dc/de/dc9 0 2024-03-22T07:28:42.493 INFO:tasks.workunit.client.0.smithi134.stdout:7/759: sync 2024-03-22T07:28:42.493 INFO:tasks.workunit.client.0.smithi134.stdout:7/760: write d1/de/f98 [3010181,124134] 0 2024-03-22T07:28:42.494 INFO:tasks.workunit.client.1.smithi195.stdout:8/929: mknod da/d82/dc6/d53/c11f 0 2024-03-22T07:28:42.494 INFO:tasks.workunit.client.0.smithi134.stdout:2/542: write d2/f3b [6868508,76079] 0 2024-03-22T07:28:42.495 INFO:tasks.workunit.client.0.smithi134.stdout:2/543: fsync d2/d5/d22/f5e 0 2024-03-22T07:28:42.496 INFO:tasks.workunit.client.0.smithi134.stdout:2/544: write d2/d5/d8/f1b [790085,118412] 0 2024-03-22T07:28:42.496 INFO:tasks.workunit.client.0.smithi134.stdout:2/545: write d2/d5/d8/d5d/da1/d3c/f89 [1616388,102233] 0 2024-03-22T07:28:42.497 INFO:tasks.workunit.client.1.smithi195.stdout:7/835: mknod d0/d13/d22/c126 0 2024-03-22T07:28:42.497 INFO:tasks.workunit.client.1.smithi195.stdout:7/836: chown d0/d13/d14/d2f/dae/f11f 287 1 2024-03-22T07:28:42.499 INFO:tasks.workunit.client.0.smithi134.stdout:0/670: creat dc/d17/da7/fca x:0 0 0 2024-03-22T07:28:42.499 INFO:tasks.workunit.client.0.smithi134.stdout:0/671: dread - dc/de/d55/d65/db8/f83 zero size 2024-03-22T07:28:42.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/761: symlink d1/de/d11/d2b/d31/d85/lf2 0 2024-03-22T07:28:42.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/762: stat d1/de/d11/d2b/d31/d85/lf2 0 2024-03-22T07:28:42.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/763: read - d1/de/f59 zero size 2024-03-22T07:28:42.502 INFO:tasks.workunit.client.0.smithi134.stdout:7/764: write d1/de/d11/d2b/d31/fa7 [1537262,16882] 0 2024-03-22T07:28:42.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/738: symlink d0/d2/d6/dad/db1/d97/d39/d40/db3/lf1 0 2024-03-22T07:28:42.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/739: chown d0/d2/d6/dad/db1/d97/c92 6 1 2024-03-22T07:28:42.503 INFO:tasks.workunit.client.1.smithi195.stdout:1/740: chown d0/d2/d27/d91/dc8/c2c 48580104 1 2024-03-22T07:28:42.503 INFO:tasks.workunit.client.0.smithi134.stdout:2/546: mknod d2/d5/d54/ca8 0 2024-03-22T07:28:42.504 INFO:tasks.workunit.client.1.smithi195.stdout:5/888: mknod d9/d12/de4/c120 0 2024-03-22T07:28:42.504 INFO:tasks.workunit.client.1.smithi195.stdout:5/889: readlink d9/d12/d1d/laf 0 2024-03-22T07:28:42.506 INFO:tasks.workunit.client.1.smithi195.stdout:6/759: rename d5/d16/d45/d53/fa3 to d5/d5e/dc0/f113 0 2024-03-22T07:28:42.507 INFO:tasks.workunit.client.0.smithi134.stdout:7/765: creat d1/de/d11/d48/dbc/ff3 x:0 0 0 2024-03-22T07:28:42.511 INFO:tasks.workunit.client.1.smithi195.stdout:2/850: dwrite d2/d3/d24/f6b [0,4194304] 0 2024-03-22T07:28:42.512 INFO:tasks.workunit.client.1.smithi195.stdout:5/890: write d9/ff [1208856,101224] 0 2024-03-22T07:28:42.517 INFO:tasks.workunit.client.0.smithi134.stdout:2/547: write d2/f4c [327474,77609] 0 2024-03-22T07:28:42.517 INFO:tasks.workunit.client.0.smithi134.stdout:2/548: readlink d2/d5/d8/d31/l43 0 2024-03-22T07:28:42.517 INFO:tasks.workunit.client.0.smithi134.stdout:2/549: dread - d2/d5/d8/d31/f81 zero size 2024-03-22T07:28:42.518 INFO:tasks.workunit.client.0.smithi134.stdout:2/550: fdatasync d2/fa3 0 2024-03-22T07:28:42.518 INFO:tasks.workunit.client.1.smithi195.stdout:4/829: symlink d13/d63/d79/de9/d7e/d8c/l119 0 2024-03-22T07:28:42.518 INFO:tasks.workunit.client.1.smithi195.stdout:8/930: creat da/d82/dc6/d53/d8d/dd6/de6/f120 x:0 0 0 2024-03-22T07:28:42.518 INFO:tasks.workunit.client.1.smithi195.stdout:8/931: truncate da/d17/f109 4768965 0 2024-03-22T07:28:42.520 INFO:tasks.workunit.client.1.smithi195.stdout:7/837: creat d0/d13/d14/d20/d40/d82/da6/f127 x:0 0 0 2024-03-22T07:28:42.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/838: chown d0/d13/d14/d20/d40/d82/da6/dc8/cfb 675 1 2024-03-22T07:28:42.521 INFO:tasks.workunit.client.1.smithi195.stdout:7/839: dread - d0/d98/dab/ff9 zero size 2024-03-22T07:28:42.521 INFO:tasks.workunit.client.0.smithi134.stdout:7/766: dread d1/de/f5a [0,4194304] 0 2024-03-22T07:28:42.523 INFO:tasks.workunit.client.0.smithi134.stdout:2/551: creat d2/d5/fa9 x:0 0 0 2024-03-22T07:28:42.528 INFO:tasks.workunit.client.1.smithi195.stdout:2/851: dread d2/d3/d7/da/f72 [0,4194304] 0 2024-03-22T07:28:42.529 INFO:tasks.workunit.client.0.smithi134.stdout:7/767: getdents d1/dae 0 2024-03-22T07:28:42.529 INFO:tasks.workunit.client.0.smithi134.stdout:7/768: creat d1/de/d11/d48/dbc/ff4 x:0 0 0 2024-03-22T07:28:42.531 INFO:tasks.workunit.client.1.smithi195.stdout:4/830: getdents d13/d63/d3e/d5c 0 2024-03-22T07:28:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:8/932: link da/d82/dc6/d53/f5e da/d17/d32/d61/d88/f121 0 2024-03-22T07:28:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:8/933: fsync da/d82/f9a 0 2024-03-22T07:28:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:8/934: truncate da/de/db3/ddd/fa3 1314026 0 2024-03-22T07:28:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:8/935: chown da/de/db3/ddd/de2/d111/l10e 28450 1 2024-03-22T07:28:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:1/741: dwrite d0/d2/d6/dad/db1/d97/d39/d64/fbe [4194304,4194304] 0 2024-03-22T07:28:42.536 INFO:tasks.workunit.client.1.smithi195.stdout:1/742: readlink d0/d2/d27/l67 0 2024-03-22T07:28:42.537 INFO:tasks.workunit.client.1.smithi195.stdout:7/840: unlink d0/d13/d14/c72 0 2024-03-22T07:28:42.544 INFO:tasks.workunit.client.1.smithi195.stdout:2/852: symlink d2/d3/d21/d60/d81/da8/l124 0 2024-03-22T07:28:42.544 INFO:tasks.workunit.client.1.smithi195.stdout:2/853: dread - d2/d3/d21/d40/fa0 zero size 2024-03-22T07:28:42.544 INFO:tasks.workunit.client.1.smithi195.stdout:2/854: stat d2/d3/d21/d60/d81/dfd/l119 0 2024-03-22T07:28:42.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/891: getdents d9/d12/d1d/d36/d7d/dd2 0 2024-03-22T07:28:42.544 INFO:tasks.workunit.client.1.smithi195.stdout:5/892: creat d9/d73/da1/f121 x:0 0 0 2024-03-22T07:28:42.545 INFO:tasks.workunit.client.0.smithi134.stdout:0/672: write dc/f4e [1078391,42734] 0 2024-03-22T07:28:42.545 INFO:tasks.workunit.client.1.smithi195.stdout:4/831: mknod d13/d63/d7a/ddf/c11a 0 2024-03-22T07:28:42.547 INFO:tasks.workunit.client.1.smithi195.stdout:8/936: creat da/dc/f122 x:0 0 0 2024-03-22T07:28:42.547 INFO:tasks.workunit.client.1.smithi195.stdout:8/937: creat da/d17/f123 x:0 0 0 2024-03-22T07:28:42.547 INFO:tasks.workunit.client.1.smithi195.stdout:8/938: truncate da/de/db3/ddd/fc4 996780 0 2024-03-22T07:28:42.547 INFO:tasks.workunit.client.1.smithi195.stdout:8/939: write da/de/f5b [47012,102851] 0 2024-03-22T07:28:42.548 INFO:tasks.workunit.client.1.smithi195.stdout:8/940: write da/d17/d32/d61/d88/f11c [494250,52811] 0 2024-03-22T07:28:42.548 INFO:tasks.workunit.client.1.smithi195.stdout:8/941: stat da/d17/d32/d61/d88/f121 0 2024-03-22T07:28:42.548 INFO:tasks.workunit.client.0.smithi134.stdout:0/673: truncate dc/d18/f26 4689377 0 2024-03-22T07:28:42.549 INFO:tasks.workunit.client.1.smithi195.stdout:5/893: dread d9/f29 [0,4194304] 0 2024-03-22T07:28:42.549 INFO:tasks.workunit.client.1.smithi195.stdout:7/841: mknod d0/d98/dab/dd7/c128 0 2024-03-22T07:28:42.550 INFO:tasks.workunit.client.1.smithi195.stdout:2/855: creat d2/d1e/d93/d112/f125 x:0 0 0 2024-03-22T07:28:42.551 INFO:tasks.workunit.client.1.smithi195.stdout:4/832: rmdir d13/d15 39 2024-03-22T07:28:42.553 INFO:tasks.workunit.client.1.smithi195.stdout:8/942: mkdir da/d82/dc6/d53/d124 0 2024-03-22T07:28:42.554 INFO:tasks.workunit.client.1.smithi195.stdout:8/943: creat da/d17/d32/d61/d88/f125 x:0 0 0 2024-03-22T07:28:42.554 INFO:tasks.workunit.client.1.smithi195.stdout:5/894: rename d9/d22/d7b/l8e to d9/d12/d1d/d69/d11f/l122 0 2024-03-22T07:28:42.555 INFO:tasks.workunit.client.1.smithi195.stdout:2/856: unlink d2/d3/d21/d4c/cb6 0 2024-03-22T07:28:42.558 INFO:tasks.workunit.client.1.smithi195.stdout:4/833: unlink d13/d15/f6f 0 2024-03-22T07:28:42.560 INFO:tasks.workunit.client.0.smithi134.stdout:2/552: dwrite d2/d5/d8/d5d/f90 [0,4194304] 0 2024-03-22T07:28:42.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/842: symlink d0/d13/d14/l129 0 2024-03-22T07:28:42.561 INFO:tasks.workunit.client.1.smithi195.stdout:7/843: truncate d0/d13/d14/d20/d40/d82/f118 29146 0 2024-03-22T07:28:42.562 INFO:tasks.workunit.client.0.smithi134.stdout:7/769: dwrite d1/de/d41/fcb [0,4194304] 0 2024-03-22T07:28:42.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/844: truncate d0/d13/d14/d20/d40/d82/da0/d59/d79/fb0 1067003 0 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:7/845: chown d0/d13/d14/d80/d9c/c11c 1 1 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/760: dwrite d5/d5e/d34/d55/d3b/d6e/d56/f77 [0,4194304] 0 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/761: fdatasync d5/d16/d45/d53/d59/d87/fcf 0 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/762: chown d5/d5e/d34/d55/d3b/d6e/d3c/fa0 25766 1 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:1/743: dwrite d0/d2/d27/d91/dc8/d2a/f86 [0,4194304] 0 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:5/895: stat d9/d12/d1d/d69/d78/d41/lbc 0 2024-03-22T07:28:42.563 INFO:tasks.workunit.client.1.smithi195.stdout:5/896: write d9/d73/fe1 [2263735,75788] 0 2024-03-22T07:28:42.568 INFO:tasks.workunit.client.1.smithi195.stdout:2/857: stat d2/d3/d21/ddd/l120 0 2024-03-22T07:28:42.569 INFO:tasks.workunit.client.1.smithi195.stdout:2/858: readlink d2/d3/d21/d60/d81/dfd/l119 0 2024-03-22T07:28:42.569 INFO:tasks.workunit.client.1.smithi195.stdout:2/859: read d2/d3/d21/d60/d81/d9a/f7b [3200679,29763] 0 2024-03-22T07:28:42.569 INFO:tasks.workunit.client.1.smithi195.stdout:2/860: write d2/d3/d24/f9f [532182,3743] 0 2024-03-22T07:28:42.570 INFO:tasks.workunit.client.0.smithi134.stdout:2/553: creat d2/d5/d8/d31/faa x:0 0 0 2024-03-22T07:28:42.572 INFO:tasks.workunit.client.1.smithi195.stdout:7/846: unlink d0/d13/d14/d80/d9c/d122/d110/lfa 0 2024-03-22T07:28:42.577 INFO:tasks.workunit.client.1.smithi195.stdout:6/763: creat d5/d16/d45/df8/d104/da2/d82/ddf/f114 x:0 0 0 2024-03-22T07:28:42.580 INFO:tasks.workunit.client.1.smithi195.stdout:5/897: dwrite d9/da8/fca [4194304,4194304] 0 2024-03-22T07:28:42.580 INFO:tasks.workunit.client.1.smithi195.stdout:5/898: readlink d9/d12/l10e 0 2024-03-22T07:28:42.580 INFO:tasks.workunit.client.1.smithi195.stdout:5/899: creat d9/d12/d1d/d69/f123 x:0 0 0 2024-03-22T07:28:42.580 INFO:tasks.workunit.client.1.smithi195.stdout:5/900: creat d9/d73/da1/d5f/f124 x:0 0 0 2024-03-22T07:28:42.581 INFO:tasks.workunit.client.1.smithi195.stdout:4/834: dwrite d13/d63/d3e/f42 [0,4194304] 0 2024-03-22T07:28:42.585 INFO:tasks.workunit.client.1.smithi195.stdout:1/744: mkdir d0/d2/d6/dad/df2 0 2024-03-22T07:28:42.585 INFO:tasks.workunit.client.1.smithi195.stdout:1/745: creat d0/d2/ff3 x:0 0 0 2024-03-22T07:28:42.587 INFO:tasks.workunit.client.0.smithi134.stdout:0/674: dread dc/de/d55/f9a [4194304,4194304] 0 2024-03-22T07:28:42.590 INFO:tasks.workunit.client.0.smithi134.stdout:0/675: dread dc/d18/f70 [0,4194304] 0 2024-03-22T07:28:42.593 INFO:tasks.workunit.client.1.smithi195.stdout:5/901: dread d9/d2d/f72 [0,4194304] 0 2024-03-22T07:28:42.594 INFO:tasks.workunit.client.1.smithi195.stdout:5/902: fdatasync d9/d2d/d84/dcf/fe3 0 2024-03-22T07:28:42.595 INFO:tasks.workunit.client.1.smithi195.stdout:6/764: dwrite f4 [0,4194304] 0 2024-03-22T07:28:42.596 INFO:tasks.workunit.client.1.smithi195.stdout:6/765: stat d5/d16/d45/d53/d59/l88 0 2024-03-22T07:28:42.605 INFO:tasks.workunit.client.0.smithi134.stdout:0/676: dwrite dc/de/d55/d65/d82/f98 [0,4194304] 0 2024-03-22T07:28:42.608 INFO:tasks.workunit.client.0.smithi134.stdout:7/770: unlink d1/de/d11/d2b/d31/f54 0 2024-03-22T07:28:42.615 INFO:tasks.workunit.client.0.smithi134.stdout:0/677: write dc/de/f23 [4190332,59686] 0 2024-03-22T07:28:42.615 INFO:tasks.workunit.client.0.smithi134.stdout:0/678: stat dc/d17/da9/cb4 0 2024-03-22T07:28:42.616 INFO:tasks.workunit.client.0.smithi134.stdout:7/771: link d1/d19/d32/f4d d1/da8/ff5 0 2024-03-22T07:28:42.616 INFO:tasks.workunit.client.0.smithi134.stdout:7/772: write d1/de/f98 [1978017,23074] 0 2024-03-22T07:28:42.616 INFO:tasks.workunit.client.0.smithi134.stdout:7/773: fsync d1/da8/fb7 0 2024-03-22T07:28:42.619 INFO:tasks.workunit.client.0.smithi134.stdout:2/554: rename d2/f40 to d2/d5/d8/d5d/d5f/fab 0 2024-03-22T07:28:42.623 INFO:tasks.workunit.client.0.smithi134.stdout:0/679: symlink dc/d17/lcb 0 2024-03-22T07:28:42.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/774: mknod d1/de/d11/d97/cf6 0 2024-03-22T07:28:42.626 INFO:tasks.workunit.client.0.smithi134.stdout:7/775: write d1/de/d11/d48/d52/d46/fd1 [749413,69363] 0 2024-03-22T07:28:42.627 INFO:tasks.workunit.client.0.smithi134.stdout:7/776: read - d1/de/fca zero size 2024-03-22T07:28:42.631 INFO:tasks.workunit.client.0.smithi134.stdout:1/681: sync 2024-03-22T07:28:42.634 INFO:tasks.workunit.client.0.smithi134.stdout:0/680: creat dc/de/dc9/fcc x:0 0 0 2024-03-22T07:28:42.636 INFO:tasks.workunit.client.0.smithi134.stdout:7/777: mkdir d1/d19/d9c/db3/dc4/df7 0 2024-03-22T07:28:42.636 INFO:tasks.workunit.client.0.smithi134.stdout:7/778: write d1/f3a [2173978,47045] 0 2024-03-22T07:28:42.637 INFO:tasks.workunit.client.0.smithi134.stdout:1/682: rmdir d5/da/d1b/d27/d39 39 2024-03-22T07:28:42.637 INFO:tasks.workunit.client.0.smithi134.stdout:1/683: write d5/d1d/d49/f52 [4683411,108471] 0 2024-03-22T07:28:42.638 INFO:tasks.workunit.client.0.smithi134.stdout:1/684: write d5/da/f26 [1093291,17391] 0 2024-03-22T07:28:42.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/681: symlink dc/d17/da7/lcd 0 2024-03-22T07:28:42.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/682: dread - dc/de/dc9/fcc zero size 2024-03-22T07:28:42.640 INFO:tasks.workunit.client.0.smithi134.stdout:0/683: fsync dc/d17/f41 0 2024-03-22T07:28:42.641 INFO:tasks.workunit.client.0.smithi134.stdout:7/779: symlink d1/de/d11/d48/daf/df1/lf8 0 2024-03-22T07:28:42.642 INFO:tasks.workunit.client.0.smithi134.stdout:2/555: dwrite d2/f80 [0,4194304] 0 2024-03-22T07:28:42.642 INFO:tasks.workunit.client.0.smithi134.stdout:2/556: dread - d2/d5/d8/d5d/da1/d3c/f6c zero size 2024-03-22T07:28:42.642 INFO:tasks.workunit.client.0.smithi134.stdout:2/557: write d2/d5/d8/d5d/da1/f4b [875557,25521] 0 2024-03-22T07:28:42.644 INFO:tasks.workunit.client.1.smithi195.stdout:1/746: symlink d0/d2/d6/dad/lf4 0 2024-03-22T07:28:42.644 INFO:tasks.workunit.client.1.smithi195.stdout:1/747: write d0/d2/d6/dad/db1/d97/d39/d64/d7a/f9b [948264,10314] 0 2024-03-22T07:28:42.647 INFO:tasks.workunit.client.1.smithi195.stdout:8/944: rename da/d82/dc6/d53/d8d/dd6/de6 to da/d17/d32/d78/d126 0 2024-03-22T07:28:42.647 INFO:tasks.workunit.client.1.smithi195.stdout:8/945: stat da/df0 0 2024-03-22T07:28:42.649 INFO:tasks.workunit.client.0.smithi134.stdout:1/685: creat d5/da/d68/ff3 x:0 0 0 2024-03-22T07:28:42.651 INFO:tasks.workunit.client.1.smithi195.stdout:5/903: mkdir d9/d73/d125 0 2024-03-22T07:28:42.653 INFO:tasks.workunit.client.0.smithi134.stdout:0/684: mknod dc/de/d55/d65/dc1/cce 0 2024-03-22T07:28:42.658 INFO:tasks.workunit.client.1.smithi195.stdout:6/766: symlink d5/d5e/d34/d55/dcb/l115 0 2024-03-22T07:28:42.678 INFO:tasks.workunit.client.0.smithi134.stdout:2/558: creat d2/d5/d8/d5d/fac x:0 0 0 2024-03-22T07:28:42.681 INFO:tasks.workunit.client.0.smithi134.stdout:2/559: chown d2/l67 7036 1 2024-03-22T07:28:42.683 INFO:tasks.workunit.client.1.smithi195.stdout:2/861: rename d2/d3/db/c10 to d2/d3/d7/da/c126 0 2024-03-22T07:28:42.684 INFO:tasks.workunit.client.0.smithi134.stdout:2/560: creat d2/d5/fad x:0 0 0 2024-03-22T07:28:42.685 INFO:tasks.workunit.client.1.smithi195.stdout:4/835: rename d13/d63/d79/de9/d7e/d85/fa7 to d13/d63/d79/d68/f11b 0 2024-03-22T07:28:42.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/748: dwrite d0/d2/d6/dad/db1/d97/d41/f5a [0,4194304] 0 2024-03-22T07:28:42.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/749: fsync d0/d2/d6/f84 0 2024-03-22T07:28:42.686 INFO:tasks.workunit.client.1.smithi195.stdout:1/750: chown d0/d2/d6/dad/db1/d97/d39/d64/fbe 1 1 2024-03-22T07:28:42.686 INFO:tasks.workunit.client.0.smithi134.stdout:2/561: creat d2/d5/d8/d5d/da1/d3c/d4f/d6e/fae x:0 0 0 2024-03-22T07:28:42.686 INFO:tasks.workunit.client.0.smithi134.stdout:2/562: truncate d2/d5/d8/d5d/da1/d3c/f69 974779 0 2024-03-22T07:28:42.687 INFO:tasks.workunit.client.1.smithi195.stdout:4/836: truncate d13/d63/d79/d68/fc2 157218 0 2024-03-22T07:28:42.688 INFO:tasks.workunit.client.0.smithi134.stdout:7/780: dwrite d1/de/fca [0,4194304] 0 2024-03-22T07:28:42.688 INFO:tasks.workunit.client.0.smithi134.stdout:7/781: write d1/de/d11/d48/d52/d46/fc2 [371133,83908] 0 2024-03-22T07:28:42.690 INFO:tasks.workunit.client.1.smithi195.stdout:2/862: write d2/d3/d21/d40/f9b [1186415,108759] 0 2024-03-22T07:28:42.692 INFO:tasks.workunit.client.0.smithi134.stdout:7/782: symlink d1/de/d11/d48/lf9 0 2024-03-22T07:28:42.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/863: mkdir d2/d3/d21/d4c/d127 0 2024-03-22T07:28:42.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/864: write d2/d3/d21/f14 [5049094,41923] 0 2024-03-22T07:28:42.694 INFO:tasks.workunit.client.1.smithi195.stdout:2/865: creat d2/d1e/d93/d112/f128 x:0 0 0 2024-03-22T07:28:42.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/783: symlink d1/de/d41/d87/d8f/lfa 0 2024-03-22T07:28:42.695 INFO:tasks.workunit.client.0.smithi134.stdout:7/784: fdatasync d1/de/d11/d48/d52/d46/fd1 0 2024-03-22T07:28:42.699 INFO:tasks.workunit.client.0.smithi134.stdout:7/785: dread d1/da8/ff5 [0,4194304] 0 2024-03-22T07:28:42.699 INFO:tasks.workunit.client.0.smithi134.stdout:7/786: write d1/de/f5a [3454244,93491] 0 2024-03-22T07:28:42.700 INFO:tasks.workunit.client.1.smithi195.stdout:4/837: dread d13/d15/d6b/da6/f118 [0,4194304] 0 2024-03-22T07:28:42.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/787: unlink d1/de/d11/d2b/d31/fa7 0 2024-03-22T07:28:42.701 INFO:tasks.workunit.client.0.smithi134.stdout:7/788: dread - d1/de/d11/d48/d52/fdb zero size 2024-03-22T07:28:42.701 INFO:tasks.workunit.client.1.smithi195.stdout:2/866: read d2/d3/f31 [2263736,49710] 0 2024-03-22T07:28:42.708 INFO:tasks.workunit.client.0.smithi134.stdout:7/789: dread d1/de/d11/d48/f6b [0,4194304] 0 2024-03-22T07:28:42.710 INFO:tasks.workunit.client.0.smithi134.stdout:7/790: creat d1/d19/d9c/db3/dc4/ffb x:0 0 0 2024-03-22T07:28:42.710 INFO:tasks.workunit.client.0.smithi134.stdout:7/791: truncate d1/de/d41/f5d 1152456 0 2024-03-22T07:28:42.710 INFO:tasks.workunit.client.0.smithi134.stdout:7/792: write d1/de/d11/d97/fbd [414980,95402] 0 2024-03-22T07:28:42.710 INFO:tasks.workunit.client.0.smithi134.stdout:7/793: truncate d1/de/f98 3966013 0 2024-03-22T07:28:42.711 INFO:tasks.workunit.client.0.smithi134.stdout:7/794: mkdir d1/de/d8d/dfc 0 2024-03-22T07:28:42.712 INFO:tasks.workunit.client.0.smithi134.stdout:7/795: symlink d1/de/d11/d48/d52/lfd 0 2024-03-22T07:28:42.712 INFO:tasks.workunit.client.0.smithi134.stdout:7/796: getdents d1/d19/d9c/db3/dc4/df7 0 2024-03-22T07:28:42.712 INFO:tasks.workunit.client.0.smithi134.stdout:7/797: mknod d1/de/d11/d48/daf/cfe 0 2024-03-22T07:28:42.713 INFO:tasks.workunit.client.0.smithi134.stdout:7/798: mknod d1/de/d11/d2b/d31/d85/cff 0 2024-03-22T07:28:42.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/799: write d1/de/d11/d48/f3c [3284149,110787] 0 2024-03-22T07:28:42.724 INFO:tasks.workunit.client.0.smithi134.stdout:7/800: dread - d1/dae/fef zero size 2024-03-22T07:28:42.725 INFO:tasks.workunit.client.0.smithi134.stdout:7/801: write d1/de/d11/d48/f8b [4784453,47418] 0 2024-03-22T07:28:42.740 INFO:tasks.workunit.client.1.smithi195.stdout:1/751: dread d0/d2/d6/dad/db1/d97/d39/d64/d7a/f9b [0,4194304] 0 2024-03-22T07:28:42.741 INFO:tasks.workunit.client.1.smithi195.stdout:1/752: write d0/d2/d27/d91/dc8/f15 [1455094,15725] 0 2024-03-22T07:28:42.742 INFO:tasks.workunit.client.1.smithi195.stdout:1/753: getdents d0/d2/d6/dad/db1/d97/d39/d40/db3 0 2024-03-22T07:28:42.746 INFO:tasks.workunit.client.1.smithi195.stdout:1/754: rename d0/d2/fe5 to d0/d2/d27/d91/dc8/d2a/da0/ff5 0 2024-03-22T07:28:42.746 INFO:tasks.workunit.client.1.smithi195.stdout:1/755: rename d0/d2/d6/l75 to d0/d2/d27/d91/dc8/d2a/d6f/lf6 0 2024-03-22T07:28:42.746 INFO:tasks.workunit.client.1.smithi195.stdout:6/767: dwrite d5/d16/dd8/fe5 [0,4194304] 0 2024-03-22T07:28:42.747 INFO:tasks.workunit.client.0.smithi134.stdout:0/685: dwrite dc/d18/d89/da0/fa8 [0,4194304] 0 2024-03-22T07:28:42.747 INFO:tasks.workunit.client.1.smithi195.stdout:5/904: dwrite f5 [0,4194304] 0 2024-03-22T07:28:42.748 INFO:tasks.workunit.client.0.smithi134.stdout:2/563: dwrite d2/d5/d8/d5d/da1/d3c/f47 [4194304,4194304] 0 2024-03-22T07:28:42.748 INFO:tasks.workunit.client.0.smithi134.stdout:2/564: write d2/d5/d8/d5d/f90 [5022274,123639] 0 2024-03-22T07:28:42.749 INFO:tasks.workunit.client.1.smithi195.stdout:2/867: dwrite d2/d3/d7/d19/d22/d26/d3c/f9e [0,4194304] 0 2024-03-22T07:28:42.749 INFO:tasks.workunit.client.1.smithi195.stdout:2/868: fdatasync d2/d3/db/db3/fe5 0 2024-03-22T07:28:42.749 INFO:tasks.workunit.client.0.smithi134.stdout:7/802: dwrite d1/de/d11/d2b/d31/fcd [0,4194304] 0 2024-03-22T07:28:42.750 INFO:tasks.workunit.client.0.smithi134.stdout:0/686: link dc/de/d55/d65/db8/f8b dc/de/dc9/fcf 0 2024-03-22T07:28:42.755 INFO:tasks.workunit.client.1.smithi195.stdout:6/768: write d5/d16/d45/d53/f108 [2522854,49239] 0 2024-03-22T07:28:42.757 INFO:tasks.workunit.client.0.smithi134.stdout:2/565: creat d2/d5/d8/d5d/da1/d3c/d4f/faf x:0 0 0 2024-03-22T07:28:42.757 INFO:tasks.workunit.client.0.smithi134.stdout:2/566: fdatasync d2/d5/d8/f88 0 2024-03-22T07:28:42.759 INFO:tasks.workunit.client.1.smithi195.stdout:1/756: dwrite d0/d2/d6/f71 [0,4194304] 0 2024-03-22T07:28:42.762 INFO:tasks.workunit.client.1.smithi195.stdout:5/905: write d9/da8/fed [2601572,122065] 0 2024-03-22T07:28:42.768 INFO:tasks.workunit.client.1.smithi195.stdout:9/960: sync 2024-03-22T07:28:42.768 INFO:tasks.workunit.client.1.smithi195.stdout:0/827: sync 2024-03-22T07:28:42.769 INFO:tasks.workunit.client.1.smithi195.stdout:9/961: chown d2/d4/d32/l130 31106919 1 2024-03-22T07:28:42.769 INFO:tasks.workunit.client.0.smithi134.stdout:9/571: sync 2024-03-22T07:28:42.769 INFO:tasks.workunit.client.0.smithi134.stdout:9/572: dread - d3/d9/d37/d6f/d54/d9d/dc0/f6e zero size 2024-03-22T07:28:42.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/869: link d2/d3/d7/d19/d22/d26/d99/ca2 d2/d3/d7/d19/d22/d26/c129 0 2024-03-22T07:28:42.772 INFO:tasks.workunit.client.1.smithi195.stdout:2/870: write d2/d3/d21/d40/f9b [4480227,99282] 0 2024-03-22T07:28:42.773 INFO:tasks.workunit.client.1.smithi195.stdout:7/847: sync 2024-03-22T07:28:42.773 INFO:tasks.workunit.client.1.smithi195.stdout:3/849: sync 2024-03-22T07:28:42.774 INFO:tasks.workunit.client.0.smithi134.stdout:9/573: creat d3/d9/df/d57/d67/fc7 x:0 0 0 2024-03-22T07:28:42.774 INFO:tasks.workunit.client.0.smithi134.stdout:9/574: write d3/d9/d37/d6f/f5b [168065,109746] 0 2024-03-22T07:28:42.776 INFO:tasks.workunit.client.1.smithi195.stdout:6/769: unlink d5/d5e/d34/d55/dab/lfe 0 2024-03-22T07:28:42.777 INFO:tasks.workunit.client.1.smithi195.stdout:1/757: symlink d0/d2/d6/dad/db1/d97/d39/d64/lf7 0 2024-03-22T07:28:42.780 INFO:tasks.workunit.client.1.smithi195.stdout:0/828: mknod d1/d4/d12/d6c/dbc/d43/c105 0 2024-03-22T07:28:42.781 INFO:tasks.workunit.client.0.smithi134.stdout:2/567: getdents d2/d5 0 2024-03-22T07:28:42.782 INFO:tasks.workunit.client.1.smithi195.stdout:4/838: getdents d13/d63/d79/d68 0 2024-03-22T07:28:42.784 INFO:tasks.workunit.client.0.smithi134.stdout:2/568: symlink d2/d5/d8/d5d/da1/d3c/lb0 0 2024-03-22T07:28:42.786 INFO:tasks.workunit.client.1.smithi195.stdout:2/871: creat d2/f12a x:0 0 0 2024-03-22T07:28:42.786 INFO:tasks.workunit.client.1.smithi195.stdout:2/872: chown d2/f34 86438908 1 2024-03-22T07:28:42.786 INFO:tasks.workunit.client.1.smithi195.stdout:2/873: write d2/d3/d21/d60/f85 [405207,106668] 0 2024-03-22T07:28:42.787 INFO:tasks.workunit.client.0.smithi134.stdout:0/687: dwrite dc/de/d55/d65/fa4 [0,4194304] 0 2024-03-22T07:28:42.787 INFO:tasks.workunit.client.0.smithi134.stdout:7/803: dwrite d1/de/f5a [4194304,4194304] 0 2024-03-22T07:28:42.788 INFO:tasks.workunit.client.0.smithi134.stdout:2/569: symlink d2/d5/d22/d99/lb1 0 2024-03-22T07:28:42.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/850: creat d3/df/d15/d1d/d5c/d47/f110 x:0 0 0 2024-03-22T07:28:42.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/851: chown d3/dbf/lc4 145277945 1 2024-03-22T07:28:42.790 INFO:tasks.workunit.client.1.smithi195.stdout:3/852: stat d3/df/d15/d1d/d5c/cba 0 2024-03-22T07:28:42.791 INFO:tasks.workunit.client.1.smithi195.stdout:4/839: dread d13/d63/d36/fd5 [0,4194304] 0 2024-03-22T07:28:42.791 INFO:tasks.workunit.client.1.smithi195.stdout:5/906: dwrite d9/d2d/f3b [0,4194304] 0 2024-03-22T07:28:42.792 INFO:tasks.workunit.client.0.smithi134.stdout:0/688: mkdir dc/de/dc9/dd0 0 2024-03-22T07:28:42.792 INFO:tasks.workunit.client.0.smithi134.stdout:0/689: write dc/de/d55/f63 [507123,772] 0 2024-03-22T07:28:42.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/770: symlink d5/d16/d45/d53/d59/l116 0 2024-03-22T07:28:42.792 INFO:tasks.workunit.client.1.smithi195.stdout:6/771: truncate d5/d16/d45/df8/d104/da2/d1a/fe2 1884571 0 2024-03-22T07:28:42.796 INFO:tasks.workunit.client.1.smithi195.stdout:1/758: mkdir d0/d2/d6/dad/df2/df8 0 2024-03-22T07:28:42.800 INFO:tasks.workunit.client.1.smithi195.stdout:0/829: creat d1/d4/d83/f106 x:0 0 0 2024-03-22T07:28:42.800 INFO:tasks.workunit.client.1.smithi195.stdout:0/830: readlink d1/d4/dd/lb3 0 2024-03-22T07:28:42.800 INFO:tasks.workunit.client.1.smithi195.stdout:3/853: write d3/df/f96 [2958416,30197] 0 2024-03-22T07:28:42.802 INFO:tasks.workunit.client.1.smithi195.stdout:9/962: getdents d2/d4/d6/db5 0 2024-03-22T07:28:42.803 INFO:tasks.workunit.client.1.smithi195.stdout:0/831: dread d1/d4/d12/d6c/dbc/d47/db6/f97 [0,4194304] 0 2024-03-22T07:28:42.803 INFO:tasks.workunit.client.1.smithi195.stdout:0/832: read d1/d10/d1f/f2c [2522359,120555] 0 2024-03-22T07:28:42.804 INFO:tasks.workunit.client.1.smithi195.stdout:0/833: truncate d1/d10/d4d/da6/fb5 266001 0 2024-03-22T07:28:42.805 INFO:tasks.workunit.client.1.smithi195.stdout:2/874: creat d2/d3/d7/d19/d22/d26/d99/f12b x:0 0 0 2024-03-22T07:28:42.807 INFO:tasks.workunit.client.1.smithi195.stdout:7/848: symlink d0/d13/d14/d20/d40/d82/db8/l12a 0 2024-03-22T07:28:42.807 INFO:tasks.workunit.client.1.smithi195.stdout:7/849: chown d0/d13/c38 15934 1 2024-03-22T07:28:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:0/834: read d1/d4/d22/df0/ff5 [3006410,49775] 0 2024-03-22T07:28:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:4/840: dwrite d13/d63/d36/f50 [0,4194304] 0 2024-03-22T07:28:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:5/907: dwrite d9/d22/d7b/d98/fc7 [0,4194304] 0 2024-03-22T07:28:42.815 INFO:tasks.workunit.client.1.smithi195.stdout:6/772: dwrite d5/d5e/d34/d55/d3b/dc2/f10c [0,4194304] 0 2024-03-22T07:28:42.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/759: creat d0/d2/d27/d91/dc8/da4/ff9 x:0 0 0 2024-03-22T07:28:42.826 INFO:tasks.workunit.client.1.smithi195.stdout:3/854: stat d3/df/d15/d1d/l41 0 2024-03-22T07:28:42.828 INFO:tasks.workunit.client.1.smithi195.stdout:3/855: dread d3/d18/d89/f6d [0,4194304] 0 2024-03-22T07:28:42.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/963: truncate d2/d4/d6/d18/f2b 860406 0 2024-03-22T07:28:42.831 INFO:tasks.workunit.client.1.smithi195.stdout:9/964: dread - d2/d4/d6/d18/d50/fe0 zero size 2024-03-22T07:28:42.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/835: dwrite d1/d4/dd/df/d2b/d63/fad [0,4194304] 0 2024-03-22T07:28:42.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/836: getdents d1/d10/d1f/dbf/de0 0 2024-03-22T07:28:42.832 INFO:tasks.workunit.client.1.smithi195.stdout:0/837: chown d1/d4/d12/l4e 20002220 1 2024-03-22T07:28:42.833 INFO:tasks.workunit.client.1.smithi195.stdout:2/875: rmdir d2/d3/d21/d4c/d127 0 2024-03-22T07:28:42.835 INFO:tasks.workunit.client.1.smithi195.stdout:5/908: dwrite d9/f29 [0,4194304] 0 2024-03-22T07:28:42.836 INFO:tasks.workunit.client.0.smithi134.stdout:7/804: mkdir d1/de/d11/d48/dbc/d100 0 2024-03-22T07:28:42.836 INFO:tasks.workunit.client.1.smithi195.stdout:7/850: symlink d0/d98/dab/dd7/l12b 0 2024-03-22T07:28:42.838 INFO:tasks.workunit.client.0.smithi134.stdout:2/570: unlink d2/d5/d8/d5d/da1/f4d 0 2024-03-22T07:28:42.839 INFO:tasks.workunit.client.1.smithi195.stdout:3/856: write d3/df/d15/d1d/d5c/f44 [1337675,62752] 0 2024-03-22T07:28:42.839 INFO:tasks.workunit.client.1.smithi195.stdout:3/857: write d3/d18/f26 [2242200,67241] 0 2024-03-22T07:28:42.840 INFO:tasks.workunit.client.1.smithi195.stdout:4/841: unlink d13/d63/d7a/ddf/c111 0 2024-03-22T07:28:42.844 INFO:tasks.workunit.client.0.smithi134.stdout:7/805: write d1/de/d11/f55 [215179,58017] 0 2024-03-22T07:28:42.846 INFO:tasks.workunit.client.0.smithi134.stdout:2/571: mknod d2/d5/d8/d5d/da1/d3c/d60/d7c/cb2 0 2024-03-22T07:28:42.846 INFO:tasks.workunit.client.0.smithi134.stdout:2/572: creat d2/d5/d8/d5d/da1/d3c/d60/fb3 x:0 0 0 2024-03-22T07:28:42.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/760: dwrite d0/d2/d6/dad/db1/d6b/d9c/fe7 [0,4194304] 0 2024-03-22T07:28:42.846 INFO:tasks.workunit.client.1.smithi195.stdout:3/858: dread d3/dbf/fd6 [0,4194304] 0 2024-03-22T07:28:42.851 INFO:tasks.workunit.client.1.smithi195.stdout:6/773: mknod d5/c117 0 2024-03-22T07:28:42.851 INFO:tasks.workunit.client.1.smithi195.stdout:6/774: write d5/d16/d45/df8/d104/da2/dad/de3/ff7 [659257,797] 0 2024-03-22T07:28:42.855 INFO:tasks.workunit.client.0.smithi134.stdout:2/573: write d2/d5/d8/d5d/d5f/fab [821967,34802] 0 2024-03-22T07:28:42.855 INFO:tasks.workunit.client.0.smithi134.stdout:2/574: chown d2/d5/d8/d7e/f82 174375365 1 2024-03-22T07:28:42.855 INFO:tasks.workunit.client.0.smithi134.stdout:2/575: write d2/d5/d22/f5e [2703717,21083] 0 2024-03-22T07:28:42.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/965: unlink d2/d4/d6/db/f2c 0 2024-03-22T07:28:42.859 INFO:tasks.workunit.client.1.smithi195.stdout:0/838: mkdir d1/d4/d22/d107 0 2024-03-22T07:28:42.861 INFO:tasks.workunit.client.1.smithi195.stdout:1/761: dwrite d0/d2/d6/f2f [0,4194304] 0 2024-03-22T07:28:42.862 INFO:tasks.workunit.client.0.smithi134.stdout:2/576: unlink d2/d5/d8/f1b 0 2024-03-22T07:28:42.862 INFO:tasks.workunit.client.0.smithi134.stdout:2/577: write d2/d5/d8/d31/f5b [2992028,32903] 0 2024-03-22T07:28:42.863 INFO:tasks.workunit.client.1.smithi195.stdout:2/876: mkdir d2/d3/d7/d5c/d8e/d12c 0 2024-03-22T07:28:42.864 INFO:tasks.workunit.client.1.smithi195.stdout:5/909: unlink d9/d12/d1d/d36/d7d/dd2/cf6 0 2024-03-22T07:28:42.864 INFO:tasks.workunit.client.1.smithi195.stdout:5/910: write d9/d73/da1/f121 [424930,117096] 0 2024-03-22T07:28:42.865 INFO:tasks.workunit.client.0.smithi134.stdout:6/485: sync 2024-03-22T07:28:42.865 INFO:tasks.workunit.client.0.smithi134.stdout:8/788: sync 2024-03-22T07:28:42.865 INFO:tasks.workunit.client.0.smithi134.stdout:4/667: sync 2024-03-22T07:28:42.865 INFO:tasks.workunit.client.0.smithi134.stdout:5/643: sync 2024-03-22T07:28:42.865 INFO:tasks.workunit.client.0.smithi134.stdout:2/578: mknod d2/d5/d8/d7e/d83/cb4 0 2024-03-22T07:28:42.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/579: chown d2/d5/d8/d5d/da1/d3c/d4f/l61 9614 1 2024-03-22T07:28:42.866 INFO:tasks.workunit.client.0.smithi134.stdout:2/580: truncate d2/d5/d8/f5a 848115 0 2024-03-22T07:28:42.866 INFO:tasks.workunit.client.1.smithi195.stdout:7/851: chown d0/d13/d14/d20/le2 1 1 2024-03-22T07:28:42.867 INFO:tasks.workunit.client.0.smithi134.stdout:7/806: dwrite d1/de/d41/f5d [0,4194304] 0 2024-03-22T07:28:42.867 INFO:tasks.workunit.client.0.smithi134.stdout:7/807: creat d1/de/d11/d97/f101 x:0 0 0 2024-03-22T07:28:42.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/946: sync 2024-03-22T07:28:42.867 INFO:tasks.workunit.client.1.smithi195.stdout:8/947: readlink da/df0/l104 0 2024-03-22T07:28:42.867 INFO:tasks.workunit.client.0.smithi134.stdout:5/644: mknod d1/d8/d83/cd4 0 2024-03-22T07:28:42.868 INFO:tasks.workunit.client.0.smithi134.stdout:5/645: chown d1/d8/l91 316975181 1 2024-03-22T07:28:42.868 INFO:tasks.workunit.client.0.smithi134.stdout:3/616: sync 2024-03-22T07:28:42.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/668: mknod d2/d25/d74/dde/d76/cee 0 2024-03-22T07:28:42.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/669: readlink d2/d2a/l6c 0 2024-03-22T07:28:42.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/911: dread d9/f31 [0,4194304] 0 2024-03-22T07:28:42.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/912: read - d9/d12/d1d/d69/d101/f103 zero size 2024-03-22T07:28:42.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/913: fsync d9/d12/d1d/d36/f49 0 2024-03-22T07:28:42.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/914: chown d9/d12 19386 1 2024-03-22T07:28:42.874 INFO:tasks.workunit.client.1.smithi195.stdout:5/915: fsync d9/d22/dd1/f11b 0 2024-03-22T07:28:42.875 INFO:tasks.workunit.client.0.smithi134.stdout:6/486: symlink d2/d1b/d1d/d5e/d6f/da8/lb2 0 2024-03-22T07:28:42.876 INFO:tasks.workunit.client.1.smithi195.stdout:4/842: creat d13/d63/d79/de9/d7e/d8c/f11c x:0 0 0 2024-03-22T07:28:42.877 INFO:tasks.workunit.client.0.smithi134.stdout:3/617: write d4/d10/d6c/fa5 [1402405,19410] 0 2024-03-22T07:28:42.882 INFO:tasks.workunit.client.0.smithi134.stdout:4/670: write d2/d25/d74/dde/d76/fb0 [2258988,89175] 0 2024-03-22T07:28:42.882 INFO:tasks.workunit.client.0.smithi134.stdout:3/618: dread d4/d8/d23/f3b [0,4194304] 0 2024-03-22T07:28:42.885 INFO:tasks.workunit.client.0.smithi134.stdout:8/789: dwrite d1/d15/f27 [4194304,4194304] 0 2024-03-22T07:28:42.886 INFO:tasks.workunit.client.1.smithi195.stdout:3/859: symlink d3/df/d15/d1d/d5c/d47/d67/d80/l111 0 2024-03-22T07:28:42.889 INFO:tasks.workunit.client.0.smithi134.stdout:7/808: symlink d1/dae/de1/l102 0 2024-03-22T07:28:42.889 INFO:tasks.workunit.client.0.smithi134.stdout:2/581: dread d2/d5/d8/f33 [0,4194304] 0 2024-03-22T07:28:42.890 INFO:tasks.workunit.client.0.smithi134.stdout:5/646: rmdir d1/d8 39 2024-03-22T07:28:42.892 INFO:tasks.workunit.client.1.smithi195.stdout:5/916: dread d9/d2d/d84/dcf/fc0 [0,4194304] 0 2024-03-22T07:28:42.892 INFO:tasks.workunit.client.1.smithi195.stdout:9/966: creat d2/d4/d23/d74/f15d x:0 0 0 2024-03-22T07:28:42.895 INFO:tasks.workunit.client.1.smithi195.stdout:0/839: symlink d1/d10/d19/l108 0 2024-03-22T07:28:42.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/671: mkdir d2/d15/d35/da8/dec/def 0 2024-03-22T07:28:42.898 INFO:tasks.workunit.client.0.smithi134.stdout:4/672: chown d2/lcc 105205102 1 2024-03-22T07:28:42.899 INFO:tasks.workunit.client.1.smithi195.stdout:1/762: mkdir d0/d2/d27/d91/dc8/da4/dc0/dfa 0 2024-03-22T07:28:42.901 INFO:tasks.workunit.client.0.smithi134.stdout:7/809: link d1/de/c78 d1/de/d11/c103 0 2024-03-22T07:28:42.901 INFO:tasks.workunit.client.0.smithi134.stdout:7/810: creat d1/d40/f104 x:0 0 0 2024-03-22T07:28:42.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/877: stat d2/d3/db/c36 0 2024-03-22T07:28:42.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/878: stat d2/d3/d7/d19/f9d 0 2024-03-22T07:28:42.902 INFO:tasks.workunit.client.1.smithi195.stdout:2/879: fsync d2/d3/d7/da/f72 0 2024-03-22T07:28:42.904 INFO:tasks.workunit.client.0.smithi134.stdout:7/811: dread d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:42.904 INFO:tasks.workunit.client.0.smithi134.stdout:7/812: read - d1/de/fa1 zero size 2024-03-22T07:28:42.905 INFO:tasks.workunit.client.0.smithi134.stdout:2/582: link d2/d5/d54/f63 d2/d5/d8/d5d/fb5 0 2024-03-22T07:28:42.905 INFO:tasks.workunit.client.0.smithi134.stdout:3/619: dwrite d4/d22/d29/d82/f8e [0,4194304] 0 2024-03-22T07:28:42.905 INFO:tasks.workunit.client.0.smithi134.stdout:3/620: stat d4/f94 0 2024-03-22T07:28:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/840: read d1/d4/dd/df/d44/d6f/dae/f86 [2142666,61614] 0 2024-03-22T07:28:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:0/841: write d1/d4/dd/d66/d80/f6a [1452502,16313] 0 2024-03-22T07:28:42.910 INFO:tasks.workunit.client.1.smithi195.stdout:8/948: creat da/d82/dc6/d53/f127 x:0 0 0 2024-03-22T07:28:42.911 INFO:tasks.workunit.client.0.smithi134.stdout:7/813: dread d1/de/d11/d48/d52/f3e [0,4194304] 0 2024-03-22T07:28:42.911 INFO:tasks.workunit.client.0.smithi134.stdout:7/814: readlink d1/da8/lee 0 2024-03-22T07:28:42.912 INFO:tasks.workunit.client.0.smithi134.stdout:5/647: truncate d1/d8/d20/f70 4071467 0 2024-03-22T07:28:42.912 INFO:tasks.workunit.client.1.smithi195.stdout:8/949: dread da/d82/dc6/d53/f8f [0,4194304] 0 2024-03-22T07:28:42.913 INFO:tasks.workunit.client.1.smithi195.stdout:8/950: creat da/d82/dc6/db4/f128 x:0 0 0 2024-03-22T07:28:42.915 INFO:tasks.workunit.client.0.smithi134.stdout:8/790: dwrite d1/d15/d42/d76/d8f/dad/dae/fc0 [0,4194304] 0 2024-03-22T07:28:42.915 INFO:tasks.workunit.client.0.smithi134.stdout:6/487: mknod d2/d1b/d1d/d5e/d6f/d7d/cb3 0 2024-03-22T07:28:42.917 INFO:tasks.workunit.client.0.smithi134.stdout:4/673: unlink d2/d2a/d80/dd6/l20 0 2024-03-22T07:28:42.917 INFO:tasks.workunit.client.0.smithi134.stdout:4/674: fsync d2/d25/d48/d6e/f82 0 2024-03-22T07:28:42.918 INFO:tasks.workunit.client.1.smithi195.stdout:8/951: dread da/d17/d32/d61/d88/f121 [0,4194304] 0 2024-03-22T07:28:42.919 INFO:tasks.workunit.client.1.smithi195.stdout:8/952: getdents da/dde/d102 0 2024-03-22T07:28:42.919 INFO:tasks.workunit.client.1.smithi195.stdout:4/843: symlink d13/d63/d36/l11d 0 2024-03-22T07:28:42.920 INFO:tasks.workunit.client.1.smithi195.stdout:4/844: fdatasync d13/d63/d3e/f97 0 2024-03-22T07:28:42.920 INFO:tasks.workunit.client.0.smithi134.stdout:2/583: creat d2/d5/fb6 x:0 0 0 2024-03-22T07:28:42.920 INFO:tasks.workunit.client.0.smithi134.stdout:2/584: chown d2/d5/l86 707088083 1 2024-03-22T07:28:42.921 INFO:tasks.workunit.client.0.smithi134.stdout:2/585: stat d2/f58 0 2024-03-22T07:28:42.925 INFO:tasks.workunit.client.0.smithi134.stdout:3/621: mknod d4/d22/d29/dad/cc3 0 2024-03-22T07:28:42.928 INFO:tasks.workunit.client.0.smithi134.stdout:7/815: mknod d1/d19/d9c/db3/dc4/df7/c105 0 2024-03-22T07:28:42.929 INFO:tasks.workunit.client.1.smithi195.stdout:3/860: mknod d3/dbf/da0/c112 0 2024-03-22T07:28:42.932 INFO:tasks.workunit.client.0.smithi134.stdout:5/648: unlink d1/d8/d16/d4a/l5d 0 2024-03-22T07:28:42.932 INFO:tasks.workunit.client.0.smithi134.stdout:5/649: chown d1/l7e 5285599 1 2024-03-22T07:28:42.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/791: symlink d1/d15/d42/d76/d8f/dad/dfc/l109 0 2024-03-22T07:28:42.934 INFO:tasks.workunit.client.0.smithi134.stdout:8/792: chown d1/d15/d57/d79/fd1 225811 1 2024-03-22T07:28:42.938 INFO:tasks.workunit.client.0.smithi134.stdout:6/488: link d2/d3f/d28/d6b/f5b d2/fb4 0 2024-03-22T07:28:42.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/775: rmdir d5/d6d 39 2024-03-22T07:28:42.943 INFO:tasks.workunit.client.1.smithi195.stdout:5/917: link d9/d12/d1d/d69/d78/d41/fbd d9/d2d/f126 0 2024-03-22T07:28:42.943 INFO:tasks.workunit.client.1.smithi195.stdout:5/918: chown d9/d22/c79 234067236 1 2024-03-22T07:28:42.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/622: dwrite d4/d22/d3c/f98 [0,4194304] 0 2024-03-22T07:28:42.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/623: write d4/d8/d5c/fb3 [1440120,10228] 0 2024-03-22T07:28:42.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/861: dwrite d3/d22/f8a [0,4194304] 0 2024-03-22T07:28:42.946 INFO:tasks.workunit.client.1.smithi195.stdout:3/862: creat d3/dbf/f113 x:0 0 0 2024-03-22T07:28:42.947 INFO:tasks.workunit.client.1.smithi195.stdout:1/763: link d0/d2/d6/dad/db1/d97/d39/d40/c48 d0/d2/d6/dad/db1/cfb 0 2024-03-22T07:28:42.950 INFO:tasks.workunit.client.1.smithi195.stdout:2/880: unlink d2/d3/d21/d60/d81/da8/l124 0 2024-03-22T07:28:42.950 INFO:tasks.workunit.client.1.smithi195.stdout:2/881: write d2/d3/d7/da/d4e/fb1 [4287218,41167] 0 2024-03-22T07:28:42.954 INFO:tasks.workunit.client.1.smithi195.stdout:0/842: unlink d1/d4/d12/d6c/d89/ff8 0 2024-03-22T07:28:42.957 INFO:tasks.workunit.client.0.smithi134.stdout:4/675: symlink d2/d2a/d80/dd6/lf0 0 2024-03-22T07:28:42.957 INFO:tasks.workunit.client.0.smithi134.stdout:4/676: chown d2/d15/f39 341703 1 2024-03-22T07:28:42.957 INFO:tasks.workunit.client.0.smithi134.stdout:4/677: readlink d2/d25/l31 0 2024-03-22T07:28:42.958 INFO:tasks.workunit.client.1.smithi195.stdout:8/953: mknod da/d17/d32/d61/dea/c129 0 2024-03-22T07:28:42.959 INFO:tasks.workunit.client.0.smithi134.stdout:2/586: mknod d2/d5/d8/d5d/da1/d3c/cb7 0 2024-03-22T07:28:42.963 INFO:tasks.workunit.client.0.smithi134.stdout:5/650: creat d1/d8/dc5/fd5 x:0 0 0 2024-03-22T07:28:42.965 INFO:tasks.workunit.client.0.smithi134.stdout:8/793: symlink d1/d46/d75/d8b/db4/d102/l10a 0 2024-03-22T07:28:42.965 INFO:tasks.workunit.client.0.smithi134.stdout:8/794: dread - d1/f82 zero size 2024-03-22T07:28:42.967 INFO:tasks.workunit.client.1.smithi195.stdout:8/954: read da/d17/d32/d61/d88/dc9/fe0 [2184563,66803] 0 2024-03-22T07:28:42.967 INFO:tasks.workunit.client.1.smithi195.stdout:6/776: mknod d5/d6d/c118 0 2024-03-22T07:28:42.967 INFO:tasks.workunit.client.0.smithi134.stdout:6/489: creat d2/d3f/d28/d97/fb5 x:0 0 0 2024-03-22T07:28:42.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/919: truncate d9/d73/dbb/f106 18050 0 2024-03-22T07:28:42.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/920: read d9/f11 [3800381,12259] 0 2024-03-22T07:28:42.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/921: creat d9/d22/d7b/d98/da0/f127 x:0 0 0 2024-03-22T07:28:42.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/922: readlink d9/d22/d7b/d98/da0/lb8 0 2024-03-22T07:28:42.974 INFO:tasks.workunit.client.1.smithi195.stdout:5/923: dread - d9/d2d/d58/fb0 zero size 2024-03-22T07:28:42.976 INFO:tasks.workunit.client.1.smithi195.stdout:9/967: truncate d2/d4/d6/db/d20/f31 88166 0 2024-03-22T07:28:42.976 INFO:tasks.workunit.client.1.smithi195.stdout:9/968: fdatasync d2/d4/d32/d6d/deb/f149 0 2024-03-22T07:28:42.977 INFO:tasks.workunit.client.0.smithi134.stdout:3/624: creat d4/d8/d7f/d9c/db9/fc4 x:0 0 0 2024-03-22T07:28:42.982 INFO:tasks.workunit.client.0.smithi134.stdout:5/651: mkdir d1/d8/dc5/dd6 0 2024-03-22T07:28:42.983 INFO:tasks.workunit.client.0.smithi134.stdout:8/795: mkdir d1/d46/d75/d10b 0 2024-03-22T07:28:42.984 INFO:tasks.workunit.client.0.smithi134.stdout:8/796: truncate d1/d15/d42/d49/f5f 1702967 0 2024-03-22T07:28:42.984 INFO:tasks.workunit.client.1.smithi195.stdout:6/777: dwrite d5/d16/dd8/fe5 [0,4194304] 0 2024-03-22T07:28:42.986 INFO:tasks.workunit.client.1.smithi195.stdout:3/863: link d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea d3/df/d50/f114 0 2024-03-22T07:28:42.987 INFO:tasks.workunit.client.0.smithi134.stdout:2/587: dwrite d2/d5/d8/d5d/da1/d3c/d4f/faf [0,4194304] 0 2024-03-22T07:28:42.987 INFO:tasks.workunit.client.0.smithi134.stdout:6/490: dwrite d2/d1b/d4d/f74 [0,4194304] 0 2024-03-22T07:28:42.989 INFO:tasks.workunit.client.1.smithi195.stdout:9/969: dread d2/d4/d23/f69 [0,4194304] 0 2024-03-22T07:28:42.989 INFO:tasks.workunit.client.1.smithi195.stdout:9/970: truncate d2/d4/f109 425368 0 2024-03-22T07:28:42.991 INFO:tasks.workunit.client.1.smithi195.stdout:1/764: creat d0/d2/d6/dad/ffc x:0 0 0 2024-03-22T07:28:42.994 INFO:tasks.workunit.client.0.smithi134.stdout:3/625: creat d4/fc5 x:0 0 0 2024-03-22T07:28:42.995 INFO:tasks.workunit.client.1.smithi195.stdout:2/882: mknod d2/d3/d7/d5c/d8e/d12c/c12d 0 2024-03-22T07:28:42.998 INFO:tasks.workunit.client.1.smithi195.stdout:9/971: dread d2/d4/d6/db/d20/d4a/f96 [0,4194304] 0 2024-03-22T07:28:42.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/843: mknod d1/d4/dd/df/d2b/d63/c109 0 2024-03-22T07:28:42.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/844: dread - d1/d4/d12/d6c/d87/fee zero size 2024-03-22T07:28:42.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/845: write d1/d4/d12/d6c/dbc/d47/f60 [1828419,43956] 0 2024-03-22T07:28:42.999 INFO:tasks.workunit.client.1.smithi195.stdout:0/846: creat d1/d4/d12/d6c/d7b/f10a x:0 0 0 2024-03-22T07:28:43.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/845: getdents d13/d63/d7a 0 2024-03-22T07:28:43.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/846: chown d13/d63/d36/fc5 37 1 2024-03-22T07:28:43.003 INFO:tasks.workunit.client.1.smithi195.stdout:4/847: write d13/f90 [628971,53263] 0 2024-03-22T07:28:43.007 INFO:tasks.workunit.client.1.smithi195.stdout:8/955: symlink da/d17/d32/de8/l12a 0 2024-03-22T07:28:43.009 INFO:tasks.workunit.client.0.smithi134.stdout:2/588: creat d2/d5/d8/d5d/da1/fb8 x:0 0 0 2024-03-22T07:28:43.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/491: symlink d2/d1b/daa/lb6 0 2024-03-22T07:28:43.013 INFO:tasks.workunit.client.1.smithi195.stdout:5/924: symlink d9/d22/d7b/d98/l128 0 2024-03-22T07:28:43.017 INFO:tasks.workunit.client.0.smithi134.stdout:3/626: symlink d4/d22/d29/d50/lc6 0 2024-03-22T07:28:43.017 INFO:tasks.workunit.client.0.smithi134.stdout:3/627: chown d4/d22/f32 1 1 2024-03-22T07:28:43.017 INFO:tasks.workunit.client.0.smithi134.stdout:3/628: chown d4/d8/c8c 204711162 1 2024-03-22T07:28:43.017 INFO:tasks.workunit.client.0.smithi134.stdout:3/629: write d4/d22/d3c/f8a [477025,19530] 0 2024-03-22T07:28:43.018 INFO:tasks.workunit.client.0.smithi134.stdout:5/652: creat d1/d8/d20/d62/d68/fd7 x:0 0 0 2024-03-22T07:28:43.024 INFO:tasks.workunit.client.0.smithi134.stdout:6/492: dread d2/d1b/f2f [0,4194304] 0 2024-03-22T07:28:43.025 INFO:tasks.workunit.client.0.smithi134.stdout:3/630: dread d4/d8/d5c/fb3 [0,4194304] 0 2024-03-22T07:28:43.025 INFO:tasks.workunit.client.0.smithi134.stdout:3/631: write d4/d10/f35 [4711462,99197] 0 2024-03-22T07:28:43.026 INFO:tasks.workunit.client.0.smithi134.stdout:6/493: rename d2/d1b/d4d/d65/l93 to d2/d1b/d8f/lb7 0 2024-03-22T07:28:43.027 INFO:tasks.workunit.client.1.smithi195.stdout:3/864: dwrite d3/d18/d89/f90 [4194304,4194304] 0 2024-03-22T07:28:43.028 INFO:tasks.workunit.client.1.smithi195.stdout:9/972: creat d2/d4/d32/d6d/deb/f15e x:0 0 0 2024-03-22T07:28:43.030 INFO:tasks.workunit.client.0.smithi134.stdout:6/494: creat d2/d3f/fb8 x:0 0 0 2024-03-22T07:28:43.031 INFO:tasks.workunit.client.1.smithi195.stdout:4/848: mkdir d13/d63/d3e/d5c/d65/d11e 0 2024-03-22T07:28:43.032 INFO:tasks.workunit.client.0.smithi134.stdout:5/653: dread d1/d8/d20/f39 [0,4194304] 0 2024-03-22T07:28:43.034 INFO:tasks.workunit.client.0.smithi134.stdout:6/495: mknod d2/d1b/d1d/d5e/d6f/da8/cb9 0 2024-03-22T07:28:43.034 INFO:tasks.workunit.client.1.smithi195.stdout:5/925: mknod d9/d2d/d84/d92/c129 0 2024-03-22T07:28:43.034 INFO:tasks.workunit.client.1.smithi195.stdout:5/926: creat d9/d12/d1d/d69/d78/d41/f12a x:0 0 0 2024-03-22T07:28:43.034 INFO:tasks.workunit.client.1.smithi195.stdout:5/927: fsync d9/d2d/d58/f10b 0 2024-03-22T07:28:43.035 INFO:tasks.workunit.client.1.smithi195.stdout:1/765: dwrite d0/f26 [4194304,4194304] 0 2024-03-22T07:28:43.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/589: dwrite d2/d5/d8/d5d/da1/d3c/f6c [0,4194304] 0 2024-03-22T07:28:43.035 INFO:tasks.workunit.client.0.smithi134.stdout:2/590: fsync d2/d5/f79 0 2024-03-22T07:28:43.036 INFO:tasks.workunit.client.1.smithi195.stdout:8/956: dwrite da/de/f2d [0,4194304] 0 2024-03-22T07:28:43.036 INFO:tasks.workunit.client.0.smithi134.stdout:3/632: dread d4/d8/fa [0,4194304] 0 2024-03-22T07:28:43.036 INFO:tasks.workunit.client.0.smithi134.stdout:8/797: dwrite d1/d15/d42/d12/d20/fc8 [0,4194304] 0 2024-03-22T07:28:43.038 INFO:tasks.workunit.client.1.smithi195.stdout:2/883: unlink d2/d3/d21/ddd/le1 0 2024-03-22T07:28:43.040 INFO:tasks.workunit.client.1.smithi195.stdout:2/884: dread d2/d3/d21/d40/f8c [0,4194304] 0 2024-03-22T07:28:43.040 INFO:tasks.workunit.client.0.smithi134.stdout:6/496: rename d2/d1b/d1d/d5e/c71 to d2/d1b/d8f/cba 0 2024-03-22T07:28:43.046 INFO:tasks.workunit.client.1.smithi195.stdout:9/973: creat d2/d4/d32/d6d/d78/d79/d97/f15f x:0 0 0 2024-03-22T07:28:43.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:42 smithi134 ceph-mon[29057]: pgmap v7: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 210 MiB/s rd, 238 MiB/s wr, 347 op/s 2024-03-22T07:28:43.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/497: dread d2/d1b/d1d/d5e/d84/f79 [0,4194304] 0 2024-03-22T07:28:43.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/498: readlink d2/d1b/daa/lb6 0 2024-03-22T07:28:43.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/499: creat d2/d3f/fbb x:0 0 0 2024-03-22T07:28:43.047 INFO:tasks.workunit.client.0.smithi134.stdout:6/500: chown d2/d1b/d4d/d65 1 1 2024-03-22T07:28:43.048 INFO:tasks.workunit.client.0.smithi134.stdout:3/633: dread d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:43.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/591: mkdir d2/d5/d8/d5d/da1/d3c/d60/db9 0 2024-03-22T07:28:43.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/592: truncate d2/d5/d8/d5d/d5f/f6f 1579699 0 2024-03-22T07:28:43.054 INFO:tasks.workunit.client.1.smithi195.stdout:4/849: dwrite d13/d63/d79/de9/f28 [0,4194304] 0 2024-03-22T07:28:43.054 INFO:tasks.workunit.client.1.smithi195.stdout:4/850: write d13/d15/d64/fdd [862188,26397] 0 2024-03-22T07:28:43.054 INFO:tasks.workunit.client.1.smithi195.stdout:4/851: creat d13/d63/d36/d5f/d83/f11f x:0 0 0 2024-03-22T07:28:43.058 INFO:tasks.workunit.client.0.smithi134.stdout:8/798: unlink d1/d15/d42/d25/d6f/ffb 0 2024-03-22T07:28:43.058 INFO:tasks.workunit.client.0.smithi134.stdout:8/799: readlink d1/d15/d42/d76/d8f/dad/dae/lbe 0 2024-03-22T07:28:43.058 INFO:tasks.workunit.client.0.smithi134.stdout:8/800: chown d1/d15/d57/d79 1221 1 2024-03-22T07:28:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:9/974: dwrite d2/d4/d32/d6d/f14c [0,4194304] 0 2024-03-22T07:28:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:9/975: fdatasync d2/d4/d32/d6d/deb/f15e 0 2024-03-22T07:28:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:9/976: write d2/d4/d32/d6d/d78/ffa [4321428,49961] 0 2024-03-22T07:28:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:9/977: write d2/d4/d32/d6d/deb/f11f [561644,62514] 0 2024-03-22T07:28:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:9/978: write d2/d4/d1d/ddc/f151 [987350,100429] 0 2024-03-22T07:28:43.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/766: dwrite d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/fee [0,4194304] 0 2024-03-22T07:28:43.063 INFO:tasks.workunit.client.1.smithi195.stdout:2/885: symlink d2/d3/d21/d60/d10f/l12e 0 2024-03-22T07:28:43.069 INFO:tasks.workunit.client.1.smithi195.stdout:4/852: dwrite d13/d63/d79/de9/d7e/d8c/fcf [4194304,4194304] 0 2024-03-22T07:28:43.070 INFO:tasks.workunit.client.0.smithi134.stdout:3/634: creat d4/d8/d69/d6a/fc7 x:0 0 0 2024-03-22T07:28:43.070 INFO:tasks.workunit.client.0.smithi134.stdout:3/635: creat d4/d22/d3c/fc8 x:0 0 0 2024-03-22T07:28:43.073 INFO:tasks.workunit.client.0.smithi134.stdout:2/593: unlink d2/d5/fad 0 2024-03-22T07:28:43.075 INFO:tasks.workunit.client.1.smithi195.stdout:9/979: dwrite d2/d4/d6/db5/de3/f117 [0,4194304] 0 2024-03-22T07:28:43.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/801: creat d1/d46/f10c x:0 0 0 2024-03-22T07:28:43.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/802: creat d1/d46/d75/d8b/db4/d102/f10d x:0 0 0 2024-03-22T07:28:43.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/803: chown d1/le0 13679 1 2024-03-22T07:28:43.076 INFO:tasks.workunit.client.0.smithi134.stdout:8/804: fdatasync d1/f24 0 2024-03-22T07:28:43.077 INFO:tasks.workunit.client.1.smithi195.stdout:5/928: rmdir d9/d12/d1d/d36/d7d/dd2 39 2024-03-22T07:28:43.090 INFO:tasks.workunit.client.1.smithi195.stdout:1/767: mknod d0/d2/d6/dad/df2/cfd 0 2024-03-22T07:28:43.093 INFO:tasks.workunit.client.1.smithi195.stdout:2/886: unlink d2/d3/d21/d60/d81/c114 0 2024-03-22T07:28:43.093 INFO:tasks.workunit.client.1.smithi195.stdout:2/887: chown d2/d3/d21/d4c 5383798 1 2024-03-22T07:28:43.093 INFO:tasks.workunit.client.1.smithi195.stdout:2/888: chown d2/d3/db/fc7 2695 1 2024-03-22T07:28:43.095 INFO:tasks.workunit.client.1.smithi195.stdout:5/929: dwrite f5 [4194304,4194304] 0 2024-03-22T07:28:43.095 INFO:tasks.workunit.client.1.smithi195.stdout:4/853: link d13/d63/d36/l67 d13/d63/d3e/l120 0 2024-03-22T07:28:43.098 INFO:tasks.workunit.client.1.smithi195.stdout:3/865: rename d3/dbf to d3/d98/d115 0 2024-03-22T07:28:43.100 INFO:tasks.workunit.client.0.smithi134.stdout:6/501: rmdir d2 39 2024-03-22T07:28:43.101 INFO:tasks.workunit.client.0.smithi134.stdout:6/502: write d2/d3f/d28/d6b/f9d [320083,65020] 0 2024-03-22T07:28:43.102 INFO:tasks.workunit.client.1.smithi195.stdout:3/866: dread d3/d98/d115/fd6 [0,4194304] 0 2024-03-22T07:28:43.105 INFO:tasks.workunit.client.0.smithi134.stdout:3/636: symlink d4/d10/d4b/lc9 0 2024-03-22T07:28:43.107 INFO:tasks.workunit.client.0.smithi134.stdout:2/594: mkdir d2/d5/d8/d7e/dba 0 2024-03-22T07:28:43.110 INFO:tasks.workunit.client.0.smithi134.stdout:8/805: getdents d1/d15/d42/d76/dda 0 2024-03-22T07:28:43.113 INFO:tasks.workunit.client.0.smithi134.stdout:6/503: truncate d2/d1b/f24 8364982 0 2024-03-22T07:28:43.113 INFO:tasks.workunit.client.0.smithi134.stdout:6/504: chown d2/l18 32273931 1 2024-03-22T07:28:43.114 INFO:tasks.workunit.client.1.smithi195.stdout:9/980: creat d2/d4/d6/dd1/f160 x:0 0 0 2024-03-22T07:28:43.116 INFO:tasks.workunit.client.1.smithi195.stdout:1/768: symlink d0/d2/d6/dad/db1/d6b/lfe 0 2024-03-22T07:28:43.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/889: creat d2/d3/d7/d19/d22/f12f x:0 0 0 2024-03-22T07:28:43.117 INFO:tasks.workunit.client.1.smithi195.stdout:2/890: chown d2/l1c 11 1 2024-03-22T07:28:43.118 INFO:tasks.workunit.client.0.smithi134.stdout:8/806: dread d1/f50 [0,4194304] 0 2024-03-22T07:28:43.120 INFO:tasks.workunit.client.0.smithi134.stdout:6/505: mknod d2/d3f/d28/d97/cbc 0 2024-03-22T07:28:43.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/595: symlink d2/d5/d8/lbb 0 2024-03-22T07:28:43.121 INFO:tasks.workunit.client.1.smithi195.stdout:5/930: mknod d9/d2d/d58/c12b 0 2024-03-22T07:28:43.121 INFO:tasks.workunit.client.1.smithi195.stdout:5/931: chown d9/d73/fe1 30943710 1 2024-03-22T07:28:43.123 INFO:tasks.workunit.client.1.smithi195.stdout:3/867: dwrite d3/df/d15/d1d/f7e [0,4194304] 0 2024-03-22T07:28:43.123 INFO:tasks.workunit.client.1.smithi195.stdout:4/854: mkdir d13/d63/d3e/d121 0 2024-03-22T07:28:43.128 INFO:tasks.workunit.client.1.smithi195.stdout:8/957: rename da/d82/dc6/c7f to da/d17/d32/d78/d126/c12b 0 2024-03-22T07:28:43.130 INFO:tasks.workunit.client.0.smithi134.stdout:3/637: dwrite d4/d10/f11 [0,4194304] 0 2024-03-22T07:28:43.130 INFO:tasks.workunit.client.0.smithi134.stdout:3/638: fdatasync d4/d8/d69/faa 0 2024-03-22T07:28:43.132 INFO:tasks.workunit.client.0.smithi134.stdout:6/506: creat d2/d1b/d4d/fbd x:0 0 0 2024-03-22T07:28:43.133 INFO:tasks.workunit.client.1.smithi195.stdout:3/868: dread d3/df/f7f [0,4194304] 0 2024-03-22T07:28:43.134 INFO:tasks.workunit.client.1.smithi195.stdout:3/869: chown d3/df/d15/ff5 67 1 2024-03-22T07:28:43.134 INFO:tasks.workunit.client.1.smithi195.stdout:1/769: truncate d0/d2/d6/dad/db1/d97/d41/d47/f49 2327056 0 2024-03-22T07:28:43.136 INFO:tasks.workunit.client.0.smithi134.stdout:2/596: mkdir d2/d5/d22/dbc 0 2024-03-22T07:28:43.136 INFO:tasks.workunit.client.0.smithi134.stdout:2/597: creat d2/d5/d8/d5d/fbd x:0 0 0 2024-03-22T07:28:43.138 INFO:tasks.workunit.client.0.smithi134.stdout:2/598: read d2/d5/d8/d5d/da1/d3c/f69 [616272,78239] 0 2024-03-22T07:28:43.138 INFO:tasks.workunit.client.0.smithi134.stdout:2/599: write d2/d5/d8/d5d/f66 [1464455,128562] 0 2024-03-22T07:28:43.138 INFO:tasks.workunit.client.1.smithi195.stdout:5/932: mkdir d9/d22/d12c 0 2024-03-22T07:28:43.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/639: creat d4/dab/fca x:0 0 0 2024-03-22T07:28:43.143 INFO:tasks.workunit.client.0.smithi134.stdout:3/640: fdatasync d4/d10/f36 0 2024-03-22T07:28:43.145 INFO:tasks.workunit.client.0.smithi134.stdout:6/507: creat d2/d1b/fbe x:0 0 0 2024-03-22T07:28:43.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/508: dread d2/f17 [0,4194304] 0 2024-03-22T07:28:43.149 INFO:tasks.workunit.client.0.smithi134.stdout:2/600: mkdir d2/d5/d22/dbe 0 2024-03-22T07:28:43.149 INFO:tasks.workunit.client.0.smithi134.stdout:2/601: truncate d2/d5/d8/d5d/fbd 834801 0 2024-03-22T07:28:43.151 INFO:tasks.workunit.client.0.smithi134.stdout:3/641: rename d4/d22/c9f to d4/d8/d69/d6a/db8/ccb 0 2024-03-22T07:28:43.151 INFO:tasks.workunit.client.0.smithi134.stdout:3/642: read - d4/d22/d3c/fbf zero size 2024-03-22T07:28:43.151 INFO:tasks.workunit.client.0.smithi134.stdout:3/643: write d4/d22/f3e [1683038,122261] 0 2024-03-22T07:28:43.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/770: creat d0/d2/d6/dad/df2/fff x:0 0 0 2024-03-22T07:28:43.152 INFO:tasks.workunit.client.1.smithi195.stdout:1/771: chown d0/d2/d6/dad/db1/d97/d41/d47/c4f 63 1 2024-03-22T07:28:43.153 INFO:tasks.workunit.client.1.smithi195.stdout:7/852: sync 2024-03-22T07:28:43.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/778: sync 2024-03-22T07:28:43.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/779: chown d5/d16/d45/df8/f10b 3462 1 2024-03-22T07:28:43.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/780: fsync d5/d5e/d34/d55/f2e 0 2024-03-22T07:28:43.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/781: read d5/d5e/d34/d55/d3b/d6e/d97/fbd [133336,53117] 0 2024-03-22T07:28:43.153 INFO:tasks.workunit.client.1.smithi195.stdout:6/782: fdatasync d5/d5e/d34/d55/d3b/d7f/fcc 0 2024-03-22T07:28:43.154 INFO:tasks.workunit.client.0.smithi134.stdout:6/509: unlink d2/d1b/daa/lb6 0 2024-03-22T07:28:43.154 INFO:tasks.workunit.client.0.smithi134.stdout:6/510: readlink d2/d1b/l4a 0 2024-03-22T07:28:43.154 INFO:tasks.workunit.client.1.smithi195.stdout:0/847: sync 2024-03-22T07:28:43.155 INFO:tasks.workunit.client.1.smithi195.stdout:9/981: rename d2/d4/d32/d6d/d78/d79/d97/lb6 to d2/d4/l161 0 2024-03-22T07:28:43.155 INFO:tasks.workunit.client.1.smithi195.stdout:4/855: dwrite d13/d63/d36/fc5 [0,4194304] 0 2024-03-22T07:28:43.156 INFO:tasks.workunit.client.1.smithi195.stdout:8/958: dwrite da/d17/d32/f100 [0,4194304] 0 2024-03-22T07:28:43.156 INFO:tasks.workunit.client.1.smithi195.stdout:5/933: dwrite f5 [4194304,4194304] 0 2024-03-22T07:28:43.156 INFO:tasks.workunit.client.1.smithi195.stdout:2/891: dwrite d2/d3/d7/d19/d22/d26/f6f [0,4194304] 0 2024-03-22T07:28:43.158 INFO:tasks.workunit.client.1.smithi195.stdout:1/772: mknod d0/d2/d6/dad/db1/d97/d41/c100 0 2024-03-22T07:28:43.161 INFO:tasks.workunit.client.1.smithi195.stdout:0/848: mkdir d1/d10b 0 2024-03-22T07:28:43.161 INFO:tasks.workunit.client.0.smithi134.stdout:1/686: sync 2024-03-22T07:28:43.164 INFO:tasks.workunit.client.1.smithi195.stdout:9/982: rename d2/d4/d6/db/d20/d4a/c10a to d2/d4/d6/d18/d50/d144/c162 0 2024-03-22T07:28:43.164 INFO:tasks.workunit.client.1.smithi195.stdout:5/934: dread d9/d2d/f72 [4194304,4194304] 0 2024-03-22T07:28:43.167 INFO:tasks.workunit.client.0.smithi134.stdout:3/644: unlink d4/d8/d69/fa2 0 2024-03-22T07:28:43.167 INFO:tasks.workunit.client.1.smithi195.stdout:6/783: dread d5/d5e/f84 [0,4194304] 0 2024-03-22T07:28:43.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/856: truncate d13/f3a 2725780 0 2024-03-22T07:28:43.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/857: chown d13/d63/d36/d9e/ca4 1808 1 2024-03-22T07:28:43.170 INFO:tasks.workunit.client.1.smithi195.stdout:4/858: write d13/d63/d79/de9/d7e/d8c/dd2/fde [1538698,130828] 0 2024-03-22T07:28:43.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/645: dread d4/d22/d3c/f8a [0,4194304] 0 2024-03-22T07:28:43.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/646: write d4/d22/d3c/f8a [1316081,21308] 0 2024-03-22T07:28:43.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/511: rmdir d2 39 2024-03-22T07:28:43.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/512: readlink d2/d3f/d99/dab/lae 0 2024-03-22T07:28:43.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/513: write d2/d1b/d4d/d65/fa0 [1211290,96969] 0 2024-03-22T07:28:43.171 INFO:tasks.workunit.client.0.smithi134.stdout:6/514: truncate d2/d1b/d4d/f90 5059704 0 2024-03-22T07:28:43.176 INFO:tasks.workunit.client.0.smithi134.stdout:2/602: mknod d2/d5/d8/d5d/d5f/d75/cbf 0 2024-03-22T07:28:43.177 INFO:tasks.workunit.client.1.smithi195.stdout:7/853: dwrite d0/d13/d22/d57/d7b/d8c/f92 [8388608,4194304] 0 2024-03-22T07:28:43.179 INFO:tasks.workunit.client.0.smithi134.stdout:1/687: rename d5/da/d13/d1e/d34/c41 to d5/d1d/d49/cf4 0 2024-03-22T07:28:43.180 INFO:tasks.workunit.client.1.smithi195.stdout:8/959: creat da/de/db3/f12c x:0 0 0 2024-03-22T07:28:43.181 INFO:tasks.workunit.client.1.smithi195.stdout:7/854: dread d0/d13/d14/d20/d40/d82/da0/d59/d79/ff3 [0,4194304] 0 2024-03-22T07:28:43.181 INFO:tasks.workunit.client.1.smithi195.stdout:7/855: dread - d0/d13/d14/d5b/f105 zero size 2024-03-22T07:28:43.181 INFO:tasks.workunit.client.0.smithi134.stdout:3/647: truncate d4/d8/d5c/f7a 91514 0 2024-03-22T07:28:43.187 INFO:tasks.workunit.client.1.smithi195.stdout:5/935: dwrite d9/d22/dd1/ff8 [0,4194304] 0 2024-03-22T07:28:43.188 INFO:tasks.workunit.client.0.smithi134.stdout:8/807: dwrite d1/f4b [4194304,4194304] 0 2024-03-22T07:28:43.188 INFO:tasks.workunit.client.1.smithi195.stdout:8/960: dread da/d82/dc6/f87 [0,4194304] 0 2024-03-22T07:28:43.189 INFO:tasks.workunit.client.0.smithi134.stdout:2/603: fsync d2/f28 0 2024-03-22T07:28:43.191 INFO:tasks.workunit.client.1.smithi195.stdout:2/892: truncate d2/d3/db/ff7 4636103 0 2024-03-22T07:28:43.194 INFO:tasks.workunit.client.0.smithi134.stdout:3/648: write d4/d8/f49 [466141,114849] 0 2024-03-22T07:28:43.195 INFO:tasks.workunit.client.1.smithi195.stdout:0/849: getdents d1/d4/dd/df/d44/d6f/dcb 0 2024-03-22T07:28:43.196 INFO:tasks.workunit.client.1.smithi195.stdout:7/856: dwrite d0/d13/d14/d80/d9c/d122/d110/f9b [0,4194304] 0 2024-03-22T07:28:43.198 INFO:tasks.workunit.client.1.smithi195.stdout:1/773: rename d0/d2/d27/c31 to d0/d2/d6/dad/db1/d97/dab/c101 0 2024-03-22T07:28:43.201 INFO:tasks.workunit.client.1.smithi195.stdout:9/983: mkdir d2/d4/d6/db/d20/d47/dee/d163 0 2024-03-22T07:28:43.201 INFO:tasks.workunit.client.0.smithi134.stdout:6/515: dwrite d2/d1b/d1d/d5e/d63/f64 [0,4194304] 0 2024-03-22T07:28:43.203 INFO:tasks.workunit.client.0.smithi134.stdout:8/808: link d1/d15/f5 d1/d15/d42/d76/dda/f10e 0 2024-03-22T07:28:43.203 INFO:tasks.workunit.client.0.smithi134.stdout:8/809: truncate d1/d15/d42/d76/fc5 429545 0 2024-03-22T07:28:43.204 INFO:tasks.workunit.client.0.smithi134.stdout:8/810: truncate d1/d15/d42/d25/d6f/ddb/f52 4367931 0 2024-03-22T07:28:43.204 INFO:tasks.workunit.client.1.smithi195.stdout:6/784: creat d5/d16/d45/f119 x:0 0 0 2024-03-22T07:28:43.205 INFO:tasks.workunit.client.1.smithi195.stdout:6/785: chown d5/d5e/d34/d55/f2e 2 1 2024-03-22T07:28:43.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:42 smithi195 ceph-mon[36144]: pgmap v7: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 210 MiB/s rd, 238 MiB/s wr, 347 op/s 2024-03-22T07:28:43.206 INFO:tasks.workunit.client.0.smithi134.stdout:2/604: mknod d2/d5/d22/d99/cc0 0 2024-03-22T07:28:43.206 INFO:tasks.workunit.client.0.smithi134.stdout:2/605: readlink d2/d5/d8/d31/la4 0 2024-03-22T07:28:43.206 INFO:tasks.workunit.client.0.smithi134.stdout:2/606: creat d2/d5/d8/d5d/fc1 x:0 0 0 2024-03-22T07:28:43.212 INFO:tasks.workunit.client.1.smithi195.stdout:0/850: dwrite d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:43.212 INFO:tasks.workunit.client.0.smithi134.stdout:1/688: symlink d5/da/d1b/d27/d60/d72/lf5 0 2024-03-22T07:28:43.212 INFO:tasks.workunit.client.0.smithi134.stdout:1/689: fdatasync d5/da/d1b/d27/d39/f54 0 2024-03-22T07:28:43.214 INFO:tasks.workunit.client.1.smithi195.stdout:4/859: creat d13/d63/d79/de9/d7e/d8c/dd2/f122 x:0 0 0 2024-03-22T07:28:43.215 INFO:tasks.workunit.client.0.smithi134.stdout:3/649: mkdir d4/d10/d4b/dcc 0 2024-03-22T07:28:43.216 INFO:tasks.workunit.client.1.smithi195.stdout:0/851: dread d1/d10/d1f/f2f [0,4194304] 0 2024-03-22T07:28:43.216 INFO:tasks.workunit.client.1.smithi195.stdout:0/852: write d1/d4/dd/f59 [6422225,117447] 0 2024-03-22T07:28:43.218 INFO:tasks.workunit.client.0.smithi134.stdout:6/516: dwrite d2/d1b/d1d/d5e/d63/f64 [0,4194304] 0 2024-03-22T07:28:43.220 INFO:tasks.workunit.client.1.smithi195.stdout:5/936: unlink f8 0 2024-03-22T07:28:43.224 INFO:tasks.workunit.client.1.smithi195.stdout:2/893: creat d2/d3/d24/f130 x:0 0 0 2024-03-22T07:28:43.230 INFO:tasks.workunit.client.1.smithi195.stdout:7/857: unlink d0/d13/d14/d29/d35/d3a/c6f 0 2024-03-22T07:28:43.230 INFO:tasks.workunit.client.1.smithi195.stdout:7/858: write d0/d13/d14/d29/f10f [341454,36842] 0 2024-03-22T07:28:43.233 INFO:tasks.workunit.client.1.smithi195.stdout:1/774: unlink d0/d2/d27/d91/dc8/d2a/f86 0 2024-03-22T07:28:43.237 INFO:tasks.workunit.client.0.smithi134.stdout:8/811: creat d1/d15/d42/d9e/dbd/f10f x:0 0 0 2024-03-22T07:28:43.240 INFO:tasks.workunit.client.1.smithi195.stdout:6/786: unlink d5/d16/l64 0 2024-03-22T07:28:43.245 INFO:tasks.workunit.client.0.smithi134.stdout:1/690: mkdir d5/d1d/dd0/ddc/de3/df6 0 2024-03-22T07:28:43.245 INFO:tasks.workunit.client.1.smithi195.stdout:0/853: dwrite d1/d4/d12/d6c/dbc/fcf [0,4194304] 0 2024-03-22T07:28:43.246 INFO:tasks.workunit.client.1.smithi195.stdout:0/854: chown d1/d4/d22/f96 8 1 2024-03-22T07:28:43.249 INFO:tasks.workunit.client.0.smithi134.stdout:3/650: dwrite d4/f1e [0,4194304] 0 2024-03-22T07:28:43.250 INFO:tasks.workunit.client.1.smithi195.stdout:5/937: symlink d9/d22/d7b/d98/df9/l12d 0 2024-03-22T07:28:43.253 INFO:tasks.workunit.client.1.smithi195.stdout:2/894: dwrite d2/d3/d24/f6e [0,4194304] 0 2024-03-22T07:28:43.253 INFO:tasks.workunit.client.1.smithi195.stdout:7/859: creat d0/d13/d14/d80/d9c/d122/d110/dec/f12c x:0 0 0 2024-03-22T07:28:43.253 INFO:tasks.workunit.client.1.smithi195.stdout:7/860: write d0/d13/d22/f23 [979342,62492] 0 2024-03-22T07:28:43.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/855: symlink d1/d4/dd/df/d44/d6f/dae/l10c 0 2024-03-22T07:28:43.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/856: dread - d1/d4/dd/d66/fdd zero size 2024-03-22T07:28:43.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/857: fsync d1/d4/dd/df/d44/d8d/dd2/f101 0 2024-03-22T07:28:43.257 INFO:tasks.workunit.client.1.smithi195.stdout:0/858: chown d1/da2 67888 1 2024-03-22T07:28:43.258 INFO:tasks.workunit.client.1.smithi195.stdout:4/860: rmdir d13/d15/d6b/dd0 39 2024-03-22T07:28:43.259 INFO:tasks.workunit.client.1.smithi195.stdout:5/938: symlink d9/d12/de4/l12e 0 2024-03-22T07:28:43.260 INFO:tasks.workunit.client.1.smithi195.stdout:5/939: chown d9/d12/d1d/d36/d7d/dd2/dfc/db2/cf0 154065759 1 2024-03-22T07:28:43.262 INFO:tasks.workunit.client.1.smithi195.stdout:1/775: dwrite d0/d2/d6/dad/db1/d97/d39/d40/f43 [0,4194304] 0 2024-03-22T07:28:43.263 INFO:tasks.workunit.client.0.smithi134.stdout:6/517: rmdir d2/d1b/d1d/d5e 39 2024-03-22T07:28:43.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/861: mkdir d0/d13/d14/d29/d35/de7/d12d 0 2024-03-22T07:28:43.263 INFO:tasks.workunit.client.1.smithi195.stdout:7/862: readlink d0/d13/d22/d28/lb4 0 2024-03-22T07:28:43.266 INFO:tasks.workunit.client.1.smithi195.stdout:5/940: truncate d9/f29 1675270 0 2024-03-22T07:28:43.266 INFO:tasks.workunit.client.1.smithi195.stdout:5/941: creat d9/d7f/f12f x:0 0 0 2024-03-22T07:28:43.268 INFO:tasks.workunit.client.1.smithi195.stdout:2/895: write d2/d3/d7/d19/d22/d26/f4b [70030,56884] 0 2024-03-22T07:28:43.268 INFO:tasks.workunit.client.0.smithi134.stdout:6/518: mknod d2/d1b/d1d/d5e/cbf 0 2024-03-22T07:28:43.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/859: dread d1/d10/d1f/f2c [0,4194304] 0 2024-03-22T07:28:43.269 INFO:tasks.workunit.client.1.smithi195.stdout:0/860: chown d1/d4/dd/df 236 1 2024-03-22T07:28:43.271 INFO:tasks.workunit.client.0.smithi134.stdout:3/651: rmdir d4/d22/d3c 39 2024-03-22T07:28:43.271 INFO:tasks.workunit.client.1.smithi195.stdout:6/787: dwrite d5/d16/d45/df8/d104/da2/d1a/f32 [0,4194304] 0 2024-03-22T07:28:43.271 INFO:tasks.workunit.client.0.smithi134.stdout:1/691: dwrite d5/f23 [4194304,4194304] 0 2024-03-22T07:28:43.272 INFO:tasks.workunit.client.0.smithi134.stdout:1/692: write d5/da/d1b/f5d [1795344,96697] 0 2024-03-22T07:28:43.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/863: truncate d0/ff 2077563 0 2024-03-22T07:28:43.272 INFO:tasks.workunit.client.1.smithi195.stdout:7/864: readlink d0/d98/dab/dd7/l12b 0 2024-03-22T07:28:43.273 INFO:tasks.workunit.client.1.smithi195.stdout:4/861: dwrite d13/d63/d79/d68/f11b [0,4194304] 0 2024-03-22T07:28:43.274 INFO:tasks.workunit.client.0.smithi134.stdout:8/812: dwrite d1/d15/d57/d8c/faa [0,4194304] 0 2024-03-22T07:28:43.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/519: creat d2/d1b/d1d/d5e/fc0 x:0 0 0 2024-03-22T07:28:43.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/520: fdatasync d2/d1b/d1d/d5e/d63/fa2 0 2024-03-22T07:28:43.278 INFO:tasks.workunit.client.0.smithi134.stdout:8/813: dread d1/d15/d42/d12/d20/f3c [0,4194304] 0 2024-03-22T07:28:43.278 INFO:tasks.workunit.client.0.smithi134.stdout:8/814: write d1/d15/d42/d76/d8f/dad/dae/fbc [690794,38165] 0 2024-03-22T07:28:43.279 INFO:tasks.workunit.client.0.smithi134.stdout:3/652: mkdir d4/d10/dcd 0 2024-03-22T07:28:43.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/862: dread d13/d15/faf [0,4194304] 0 2024-03-22T07:28:43.279 INFO:tasks.workunit.client.1.smithi195.stdout:4/863: write d13/d63/d79/de9/d7e/f8e [679130,27153] 0 2024-03-22T07:28:43.281 INFO:tasks.workunit.client.1.smithi195.stdout:5/942: rename d9/d22/d7b/d98/dbe/l11e to d9/d12/d1d/d69/d101/l130 0 2024-03-22T07:28:43.282 INFO:tasks.workunit.client.1.smithi195.stdout:5/943: write d9/d2d/f67 [2856000,105897] 0 2024-03-22T07:28:43.282 INFO:tasks.workunit.client.0.smithi134.stdout:3/653: dread d4/f76 [0,4194304] 0 2024-03-22T07:28:43.282 INFO:tasks.workunit.client.0.smithi134.stdout:3/654: truncate d4/f66 716810 0 2024-03-22T07:28:43.285 INFO:tasks.workunit.client.1.smithi195.stdout:2/896: mknod d2/d3/d24/c131 0 2024-03-22T07:28:43.288 INFO:tasks.workunit.client.1.smithi195.stdout:0/861: mkdir d1/d4/d22/d107/d10d 0 2024-03-22T07:28:43.289 INFO:tasks.workunit.client.0.smithi134.stdout:6/521: mkdir d2/d1b/daa/dc1 0 2024-03-22T07:28:43.291 INFO:tasks.workunit.client.1.smithi195.stdout:1/776: dwrite d0/d2/d27/d91/dc8/da4/ff9 [0,4194304] 0 2024-03-22T07:28:43.291 INFO:tasks.workunit.client.0.smithi134.stdout:9/575: sync 2024-03-22T07:28:43.291 INFO:tasks.workunit.client.0.smithi134.stdout:9/576: chown d3/d9/df/fb2 11902 1 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:7/816: sync 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:0/690: sync 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:7/817: fsync d1/de/d11/d2b/d69/f8c 0 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:0/691: read - dc/de/d55/d65/d82/fbc zero size 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:7/818: dread - d1/de/d11/d48/dbc/ff3 zero size 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:7/819: stat d1/de/d11/d48/fed 0 2024-03-22T07:28:43.292 INFO:tasks.workunit.client.0.smithi134.stdout:1/693: dwrite d5/da/d13/d1e/d45/f7f [8388608,4194304] 0 2024-03-22T07:28:43.293 INFO:tasks.workunit.client.0.smithi134.stdout:8/815: truncate d1/d15/d42/d76/fb2 26514 0 2024-03-22T07:28:43.294 INFO:tasks.workunit.client.0.smithi134.stdout:8/816: write d1/d4/f54 [5034284,67095] 0 2024-03-22T07:28:43.295 INFO:tasks.workunit.client.0.smithi134.stdout:7/820: dread d1/dae/fc7 [0,4194304] 0 2024-03-22T07:28:43.295 INFO:tasks.workunit.client.0.smithi134.stdout:7/821: write d1/de/d11/f55 [1923328,102512] 0 2024-03-22T07:28:43.296 INFO:tasks.workunit.client.0.smithi134.stdout:6/522: creat d2/d1b/d1d/d5e/d6f/da8/fc2 x:0 0 0 2024-03-22T07:28:43.297 INFO:tasks.workunit.client.1.smithi195.stdout:0/862: dread d1/d4/dd/df/d44/f50 [0,4194304] 0 2024-03-22T07:28:43.298 INFO:tasks.workunit.client.1.smithi195.stdout:6/788: creat d5/d16/d45/df8/d104/da2/d82/ddf/f11a x:0 0 0 2024-03-22T07:28:43.298 INFO:tasks.workunit.client.1.smithi195.stdout:6/789: readlink d5/d16/d45/df8/d104/da2/d1a/le0 0 2024-03-22T07:28:43.299 INFO:tasks.workunit.client.0.smithi134.stdout:0/692: creat dc/de/dc9/dd0/fd1 x:0 0 0 2024-03-22T07:28:43.302 INFO:tasks.workunit.client.1.smithi195.stdout:7/865: link d0/d13/d14/d20/d40/c49 d0/d13/d14/d20/d40/c12e 0 2024-03-22T07:28:43.305 INFO:tasks.workunit.client.0.smithi134.stdout:3/655: dwrite d4/fa8 [0,4194304] 0 2024-03-22T07:28:43.307 INFO:tasks.workunit.client.1.smithi195.stdout:7/866: dread d0/d13/d14/d2f/f86 [0,4194304] 0 2024-03-22T07:28:43.308 INFO:tasks.workunit.client.0.smithi134.stdout:9/577: read d3/d9/df/d57/d67/f8a [6050443,100970] 0 2024-03-22T07:28:43.309 INFO:tasks.workunit.client.0.smithi134.stdout:9/578: fdatasync d3/d9/f62 0 2024-03-22T07:28:43.309 INFO:tasks.workunit.client.0.smithi134.stdout:9/579: creat d3/d9/df/fc8 x:0 0 0 2024-03-22T07:28:43.309 INFO:tasks.workunit.client.0.smithi134.stdout:8/817: dread d1/d15/d42/d12/d20/f70 [4194304,4194304] 0 2024-03-22T07:28:43.312 INFO:tasks.workunit.client.0.smithi134.stdout:7/822: write d1/f4 [1360002,84440] 0 2024-03-22T07:28:43.312 INFO:tasks.workunit.client.0.smithi134.stdout:7/823: chown d1/de/d41/c50 592914932 1 2024-03-22T07:28:43.312 INFO:tasks.workunit.client.0.smithi134.stdout:6/523: creat d2/d6e/fc3 x:0 0 0 2024-03-22T07:28:43.314 INFO:tasks.workunit.client.1.smithi195.stdout:4/864: symlink d13/d15/d6b/dd0/l123 0 2024-03-22T07:28:43.317 INFO:tasks.workunit.client.0.smithi134.stdout:0/693: link dc/d17/f7f dc/de/d55/d65/fd2 0 2024-03-22T07:28:43.317 INFO:tasks.workunit.client.0.smithi134.stdout:0/694: chown dc/de/d55/d65/f67 7 1 2024-03-22T07:28:43.319 INFO:tasks.workunit.client.1.smithi195.stdout:0/863: dwrite d1/d4/d12/d6c/dbc/d43/f62 [0,4194304] 0 2024-03-22T07:28:43.320 INFO:tasks.workunit.client.1.smithi195.stdout:5/944: link d9/d12/de4/l12e d9/da8/l131 0 2024-03-22T07:28:43.322 INFO:tasks.workunit.client.1.smithi195.stdout:2/897: unlink d2/d3/d7/d19/d22/d26/c80 0 2024-03-22T07:28:43.325 INFO:tasks.workunit.client.1.smithi195.stdout:0/864: dread d1/d4/d12/d6c/d87/fc7 [0,4194304] 0 2024-03-22T07:28:43.325 INFO:tasks.workunit.client.1.smithi195.stdout:0/865: write d1/d4/dd/df/d44/d6f/f91 [1201316,38715] 0 2024-03-22T07:28:43.330 INFO:tasks.workunit.client.0.smithi134.stdout:3/656: mkdir d4/d22/dce 0 2024-03-22T07:28:43.331 INFO:tasks.workunit.client.0.smithi134.stdout:7/824: dwrite d1/de/d11/d48/f6b [0,4194304] 0 2024-03-22T07:28:43.333 INFO:tasks.workunit.client.0.smithi134.stdout:9/580: dwrite d3/d9/df/d12/f58 [4194304,4194304] 0 2024-03-22T07:28:43.333 INFO:tasks.workunit.client.0.smithi134.stdout:8/818: dwrite d1/d15/d42/d12/d20/f86 [0,4194304] 0 2024-03-22T07:28:43.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/777: getdents d0/d2/d6/dad/db1/d97/dab 0 2024-03-22T07:28:43.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/778: chown d0/d2/d6/f2f 875 1 2024-03-22T07:28:43.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/779: creat d0/d2/d27/d91/dc8/da4/dc0/f102 x:0 0 0 2024-03-22T07:28:43.335 INFO:tasks.workunit.client.1.smithi195.stdout:1/780: write d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7/feb [431982,33577] 0 2024-03-22T07:28:43.338 INFO:tasks.workunit.client.0.smithi134.stdout:0/695: truncate dc/d18/f5a 3444429 0 2024-03-22T07:28:43.340 INFO:tasks.workunit.client.0.smithi134.stdout:7/825: write d1/f33 [3592554,85660] 0 2024-03-22T07:28:43.346 INFO:tasks.workunit.client.0.smithi134.stdout:9/581: truncate d3/d9/df/d12/f2a 713025 0 2024-03-22T07:28:43.346 INFO:tasks.workunit.client.0.smithi134.stdout:9/582: truncate d3/d9/f62 1407021 0 2024-03-22T07:28:43.357 INFO:tasks.workunit.client.0.smithi134.stdout:1/694: dwrite d5/da/f2a [0,4194304] 0 2024-03-22T07:28:43.361 INFO:tasks.workunit.client.1.smithi195.stdout:7/867: link d0/d13/d14/d20/d40/c51 d0/d13/d14/d20/d40/c12f 0 2024-03-22T07:28:43.363 INFO:tasks.workunit.client.1.smithi195.stdout:4/865: mknod d13/d63/d3e/d121/c124 0 2024-03-22T07:28:43.368 INFO:tasks.workunit.client.1.smithi195.stdout:5/945: symlink d9/d2d/d84/dcf/l132 0 2024-03-22T07:28:43.370 INFO:tasks.workunit.client.1.smithi195.stdout:2/898: mknod d2/d3/d21/d60/d81/c132 0 2024-03-22T07:28:43.372 INFO:tasks.workunit.client.1.smithi195.stdout:0/866: rmdir d1/d4/d22 39 2024-03-22T07:28:43.376 INFO:tasks.workunit.client.0.smithi134.stdout:8/819: mkdir d1/d46/d110 0 2024-03-22T07:28:43.376 INFO:tasks.workunit.client.0.smithi134.stdout:8/820: chown d1/d15/f27 8 1 2024-03-22T07:28:43.376 INFO:tasks.workunit.client.1.smithi195.stdout:1/781: truncate d0/d2/d6/dad/db1/d97/d39/f68 2963012 0 2024-03-22T07:28:43.378 INFO:tasks.workunit.client.0.smithi134.stdout:6/524: getdents d2/d1b 0 2024-03-22T07:28:43.378 INFO:tasks.workunit.client.0.smithi134.stdout:6/525: read d2/d3f/f8b [346917,92886] 0 2024-03-22T07:28:43.379 INFO:tasks.workunit.client.0.smithi134.stdout:6/526: fsync d2/f43 0 2024-03-22T07:28:43.379 INFO:tasks.workunit.client.1.smithi195.stdout:4/866: creat d13/d63/d79/de9/d7e/d85/f125 x:0 0 0 2024-03-22T07:28:43.380 INFO:tasks.workunit.client.1.smithi195.stdout:7/868: dwrite d0/ff [0,4194304] 0 2024-03-22T07:28:43.381 INFO:tasks.workunit.client.1.smithi195.stdout:7/869: truncate d0/d13/d14/d2f/dae/f11f 465775 0 2024-03-22T07:28:43.381 INFO:tasks.workunit.client.1.smithi195.stdout:7/870: readlink d0/d13/d14/d20/d40/d82/da0/d59/l62 0 2024-03-22T07:28:43.381 INFO:tasks.workunit.client.0.smithi134.stdout:0/696: mkdir dc/de/d55/d65/dd3 0 2024-03-22T07:28:43.381 INFO:tasks.workunit.client.1.smithi195.stdout:4/867: dread d13/d63/d79/de9/f56 [0,4194304] 0 2024-03-22T07:28:43.382 INFO:tasks.workunit.client.0.smithi134.stdout:0/697: read dc/d17/f2b [824094,115982] 0 2024-03-22T07:28:43.382 INFO:tasks.workunit.client.0.smithi134.stdout:0/698: creat dc/d18/d89/fd4 x:0 0 0 2024-03-22T07:28:43.382 INFO:tasks.workunit.client.1.smithi195.stdout:5/946: symlink d9/d12/d1d/d36/d7d/l133 0 2024-03-22T07:28:43.385 INFO:tasks.workunit.client.1.smithi195.stdout:2/899: symlink d2/d3/db/d82/l133 0 2024-03-22T07:28:43.385 INFO:tasks.workunit.client.1.smithi195.stdout:5/947: write d9/f29 [383521,82516] 0 2024-03-22T07:28:43.387 INFO:tasks.workunit.client.0.smithi134.stdout:8/821: dread d1/d4/f22 [0,4194304] 0 2024-03-22T07:28:43.388 INFO:tasks.workunit.client.0.smithi134.stdout:7/826: creat d1/d19/f106 x:0 0 0 2024-03-22T07:28:43.388 INFO:tasks.workunit.client.0.smithi134.stdout:7/827: stat d1/de/f5a 0 2024-03-22T07:28:43.390 INFO:tasks.workunit.client.1.smithi195.stdout:0/867: mkdir d1/d4/d12/d6c/d7b/d10e 0 2024-03-22T07:28:43.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/583: creat d3/d9/d37/d3c/d71/dc2/fc9 x:0 0 0 2024-03-22T07:28:43.396 INFO:tasks.workunit.client.0.smithi134.stdout:1/695: mknod d5/d1d/d49/cf7 0 2024-03-22T07:28:43.398 INFO:tasks.workunit.client.1.smithi195.stdout:1/782: mknod d0/d2/d6/dad/db1/d97/d39/d64/d7a/c103 0 2024-03-22T07:28:43.400 INFO:tasks.workunit.client.0.smithi134.stdout:6/527: creat d2/d3f/d28/fc4 x:0 0 0 2024-03-22T07:28:43.400 INFO:tasks.workunit.client.0.smithi134.stdout:6/528: stat d2/d3f/d28/f7e 0 2024-03-22T07:28:43.400 INFO:tasks.workunit.client.1.smithi195.stdout:7/871: rename d0/lb to d0/d13/d22/def/l130 0 2024-03-22T07:28:43.402 INFO:tasks.workunit.client.1.smithi195.stdout:4/868: symlink d13/d63/d3e/d121/l126 0 2024-03-22T07:28:43.405 INFO:tasks.workunit.client.1.smithi195.stdout:5/948: mknod d9/d12/d1d/d36/d7d/c134 0 2024-03-22T07:28:43.405 INFO:tasks.workunit.client.1.smithi195.stdout:5/949: chown d9/d22/d7b/d98/df9/l12d 759156 1 2024-03-22T07:28:43.407 INFO:tasks.workunit.client.0.smithi134.stdout:7/828: link d1/de/d11/l24 d1/de/d41/l107 0 2024-03-22T07:28:43.408 INFO:tasks.workunit.client.1.smithi195.stdout:0/868: link d1/d4/d12/d6c/dbc/fcf d1/d10/d4d/f10f 0 2024-03-22T07:28:43.409 INFO:tasks.workunit.client.1.smithi195.stdout:0/869: creat d1/d4/dd/df/f110 x:0 0 0 2024-03-22T07:28:43.409 INFO:tasks.workunit.client.1.smithi195.stdout:4/869: write d13/d63/d79/de9/f28 [3044096,10086] 0 2024-03-22T07:28:43.409 INFO:tasks.workunit.client.0.smithi134.stdout:0/699: dwrite dc/d18/f1a [4194304,4194304] 0 2024-03-22T07:28:43.409 INFO:tasks.workunit.client.1.smithi195.stdout:2/900: dwrite d2/d3/ffe [0,4194304] 0 2024-03-22T07:28:43.412 INFO:tasks.workunit.client.0.smithi134.stdout:1/696: unlink d5/da/d68/cc3 0 2024-03-22T07:28:43.413 INFO:tasks.workunit.client.0.smithi134.stdout:6/529: rename d2/d1b/d1d/d5e/cbf to d2/d1b/d4d/cc5 0 2024-03-22T07:28:43.414 INFO:tasks.workunit.client.1.smithi195.stdout:5/950: symlink d9/d2d/d84/dcf/l135 0 2024-03-22T07:28:43.415 INFO:tasks.workunit.client.0.smithi134.stdout:8/822: symlink d1/d15/d42/d12/d20/l111 0 2024-03-22T07:28:43.418 INFO:tasks.workunit.client.0.smithi134.stdout:7/829: creat d1/dae/f108 x:0 0 0 2024-03-22T07:28:43.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/870: dwrite d1/d4/dd/df/d44/f50 [0,4194304] 0 2024-03-22T07:28:43.421 INFO:tasks.workunit.client.1.smithi195.stdout:0/871: write d1/d4/f2e [7795905,57702] 0 2024-03-22T07:28:43.422 INFO:tasks.workunit.client.1.smithi195.stdout:4/870: unlink d13/d63/d3e/f42 0 2024-03-22T07:28:43.423 INFO:tasks.workunit.client.0.smithi134.stdout:0/700: creat dc/de/d55/d65/d82/db7/fd5 x:0 0 0 2024-03-22T07:28:43.426 INFO:tasks.workunit.client.0.smithi134.stdout:9/584: getdents d3/d9/df/d12 0 2024-03-22T07:28:43.431 INFO:tasks.workunit.client.0.smithi134.stdout:1/697: mkdir d5/da/df8 0 2024-03-22T07:28:43.431 INFO:tasks.workunit.client.0.smithi134.stdout:1/698: write d5/d1d/dd0/ddc/fe0 [744428,71804] 0 2024-03-22T07:28:43.436 INFO:tasks.workunit.client.0.smithi134.stdout:6/530: mkdir d2/d1b/d1d/d5e/d6f/da8/dc6 0 2024-03-22T07:28:43.436 INFO:tasks.workunit.client.0.smithi134.stdout:6/531: fdatasync d2/d3f/d28/fc4 0 2024-03-22T07:28:43.437 INFO:tasks.workunit.client.0.smithi134.stdout:0/701: dread dc/d18/f44 [0,4194304] 0 2024-03-22T07:28:43.437 INFO:tasks.workunit.client.0.smithi134.stdout:8/823: truncate d1/d15/d42/f28 4927977 0 2024-03-22T07:28:43.438 INFO:tasks.workunit.client.0.smithi134.stdout:8/824: chown d1/d4/c66 1023 1 2024-03-22T07:28:43.439 INFO:tasks.workunit.client.1.smithi195.stdout:0/872: dread d1/d4/dd/d66/d80/f95 [0,4194304] 0 2024-03-22T07:28:43.443 INFO:tasks.workunit.client.0.smithi134.stdout:7/830: rmdir d1/de/d8d/dfc 0 2024-03-22T07:28:43.445 INFO:tasks.workunit.client.0.smithi134.stdout:9/585: dwrite d3/d9/d37/d3c/fc6 [4194304,4194304] 0 2024-03-22T07:28:43.445 INFO:tasks.workunit.client.0.smithi134.stdout:9/586: dread - d3/d9/d37/d3c/d71/d8e/fbc zero size 2024-03-22T07:28:43.445 INFO:tasks.workunit.client.0.smithi134.stdout:9/587: stat d3/d9/df/d57/d67/d5f/cb1 0 2024-03-22T07:28:43.445 INFO:tasks.workunit.client.0.smithi134.stdout:9/588: creat d3/d9/d37/d5a/d7f/daf/fca x:0 0 0 2024-03-22T07:28:43.448 INFO:tasks.workunit.client.0.smithi134.stdout:5/654: sync 2024-03-22T07:28:43.448 INFO:tasks.workunit.client.0.smithi134.stdout:4/678: sync 2024-03-22T07:28:43.448 INFO:tasks.workunit.client.0.smithi134.stdout:4/679: read - d2/d25/d74/f75 zero size 2024-03-22T07:28:43.448 INFO:tasks.workunit.client.0.smithi134.stdout:4/680: chown d2/d2a/d50/c53 15444 1 2024-03-22T07:28:43.449 INFO:tasks.workunit.client.1.smithi195.stdout:2/901: mknod d2/d3/db/db3/c134 0 2024-03-22T07:28:43.449 INFO:tasks.workunit.client.0.smithi134.stdout:2/607: sync 2024-03-22T07:28:43.451 INFO:tasks.workunit.client.1.smithi195.stdout:7/872: link d0/d13/d14/d5b/f81 d0/d13/d14/d20/f131 0 2024-03-22T07:28:43.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/873: creat d1/d10/d4d/da6/f111 x:0 0 0 2024-03-22T07:28:43.457 INFO:tasks.workunit.client.1.smithi195.stdout:0/874: chown d1/d4/dd/df/d44/db4/ld3 454 1 2024-03-22T07:28:43.459 INFO:tasks.workunit.client.1.smithi195.stdout:2/902: creat d2/d3/d21/d60/d81/f135 x:0 0 0 2024-03-22T07:28:43.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/589: mkdir d3/d9/d37/d3c/dcb 0 2024-03-22T07:28:43.463 INFO:tasks.workunit.client.1.smithi195.stdout:5/951: getdents d9/d73/da1/d5f 0 2024-03-22T07:28:43.463 INFO:tasks.workunit.client.1.smithi195.stdout:5/952: fsync d9/d73/dbb/f106 0 2024-03-22T07:28:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/871: mknod d13/d63/d79/dcd/c127 0 2024-03-22T07:28:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/872: write d13/d63/f18 [5226170,120828] 0 2024-03-22T07:28:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/873: chown d13/d63/d36/fd5 12137166 1 2024-03-22T07:28:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/874: chown d13/d63/d79/de9/d7e/d85/d101/f10d 19 1 2024-03-22T07:28:43.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/875: chown d13/d15/d44/fe3 16986872 1 2024-03-22T07:28:43.466 INFO:tasks.workunit.client.0.smithi134.stdout:4/681: creat d2/d25/d48/d6e/d7b/dd7/ff1 x:0 0 0 2024-03-22T07:28:43.466 INFO:tasks.workunit.client.0.smithi134.stdout:4/682: fdatasync d2/d25/f3e 0 2024-03-22T07:28:43.467 INFO:tasks.workunit.client.1.smithi195.stdout:0/875: mknod d1/d10/d19/d20/c112 0 2024-03-22T07:28:43.467 INFO:tasks.workunit.client.1.smithi195.stdout:0/876: chown d1/d4/d12/f54 2 1 2024-03-22T07:28:43.468 INFO:tasks.workunit.client.0.smithi134.stdout:2/608: creat d2/d5/d8/d5d/d5f/d75/fc2 x:0 0 0 2024-03-22T07:28:43.468 INFO:tasks.workunit.client.0.smithi134.stdout:2/609: write d2/d5/d8/d5d/da1/d3c/d60/f72 [1640392,81781] 0 2024-03-22T07:28:43.470 INFO:tasks.workunit.client.0.smithi134.stdout:0/702: link dc/de/d55/d65/d82/db7/fd5 dc/de/d55/d65/dc1/fd6 0 2024-03-22T07:28:43.475 INFO:tasks.workunit.client.0.smithi134.stdout:4/683: symlink d2/d25/dcf/lf2 0 2024-03-22T07:28:43.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/655: mknod d1/d8/d20/d62/cd8 0 2024-03-22T07:28:43.476 INFO:tasks.workunit.client.0.smithi134.stdout:5/656: readlink d1/d8/dc5/da2/lb1 0 2024-03-22T07:28:43.476 INFO:tasks.workunit.client.1.smithi195.stdout:2/903: unlink d2/d3/d24/l4a 0 2024-03-22T07:28:43.476 INFO:tasks.workunit.client.1.smithi195.stdout:7/873: getdents d0/d13/d14/d29/d35/d6d 0 2024-03-22T07:28:43.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/953: truncate d9/d2d/f65 876495 0 2024-03-22T07:28:43.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/954: chown d9/l34 17520816 1 2024-03-22T07:28:43.480 INFO:tasks.workunit.client.0.smithi134.stdout:4/684: unlink d2/d15/d35/lad 0 2024-03-22T07:28:43.482 INFO:tasks.workunit.client.1.smithi195.stdout:2/904: creat d2/d3/d7/d19/d22/d26/f136 x:0 0 0 2024-03-22T07:28:43.484 INFO:tasks.workunit.client.0.smithi134.stdout:0/703: dread dc/f57 [0,4194304] 0 2024-03-22T07:28:43.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/825: dwrite d1/d46/dbf/fe9 [0,4194304] 0 2024-03-22T07:28:43.484 INFO:tasks.workunit.client.0.smithi134.stdout:8/826: write d1/d15/d57/d79/fd1 [1035479,113871] 0 2024-03-22T07:28:43.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/590: dwrite d3/d9/d37/d6f/f2e [0,4194304] 0 2024-03-22T07:28:43.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/591: creat d3/d9/df/d57/d67/fcc x:0 0 0 2024-03-22T07:28:43.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/592: truncate d3/d9/df/f61 93339 0 2024-03-22T07:28:43.485 INFO:tasks.workunit.client.0.smithi134.stdout:4/685: symlink d2/lf3 0 2024-03-22T07:28:43.486 INFO:tasks.workunit.client.0.smithi134.stdout:8/827: dread d1/d15/d42/d76/dda/f10e [0,4194304] 0 2024-03-22T07:28:43.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/657: read d1/fcd [164438,71688] 0 2024-03-22T07:28:43.492 INFO:tasks.workunit.client.1.smithi195.stdout:5/955: creat d9/d22/d7b/d98/df9/f136 x:0 0 0 2024-03-22T07:28:43.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/699: dwrite d5/da/d1b/d27/d39/f58 [0,4194304] 0 2024-03-22T07:28:43.493 INFO:tasks.workunit.client.1.smithi195.stdout:3/870: sync 2024-03-22T07:28:43.493 INFO:tasks.workunit.client.1.smithi195.stdout:3/871: chown d3/df/d15/d1d/d5c/d47/d67/d80/f102 18248 1 2024-03-22T07:28:43.493 INFO:tasks.workunit.client.1.smithi195.stdout:3/872: chown d3/d18/ccb 5300 1 2024-03-22T07:28:43.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/873: creat d3/df/d50/f116 x:0 0 0 2024-03-22T07:28:43.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/874: readlink d3/df/d15/d1d/d5c/d47/d67/d93/la8 0 2024-03-22T07:28:43.494 INFO:tasks.workunit.client.1.smithi195.stdout:3/875: chown d3/df/d15/d1d/d5c/d47/d67/d80/f102 346034 1 2024-03-22T07:28:43.495 INFO:tasks.workunit.client.1.smithi195.stdout:2/905: mknod d2/d3/d7/da/de/d10b/c137 0 2024-03-22T07:28:43.495 INFO:tasks.workunit.client.1.smithi195.stdout:2/906: truncate d2/d1e/d93/d112/f128 6837 0 2024-03-22T07:28:43.495 INFO:tasks.workunit.client.1.smithi195.stdout:2/907: chown d2/d3/d7/da/cde 155908328 1 2024-03-22T07:28:43.496 INFO:tasks.workunit.client.0.smithi134.stdout:9/593: dread d3/d9/df/f7d [0,4194304] 0 2024-03-22T07:28:43.497 INFO:tasks.workunit.client.1.smithi195.stdout:7/874: mknod d0/d13/d14/c132 0 2024-03-22T07:28:43.499 INFO:tasks.workunit.client.0.smithi134.stdout:8/828: write d1/d46/dbf/fe9 [2157349,36180] 0 2024-03-22T07:28:43.500 INFO:tasks.workunit.client.0.smithi134.stdout:7/831: dwrite d1/de/d11/d97/fbd [0,4194304] 0 2024-03-22T07:28:43.500 INFO:tasks.workunit.client.0.smithi134.stdout:7/832: write d1/de/d11/d48/dbc/ff4 [775283,90710] 0 2024-03-22T07:28:43.500 INFO:tasks.workunit.client.0.smithi134.stdout:7/833: fdatasync d1/de/d11/d48/daf/fe6 0 2024-03-22T07:28:43.500 INFO:tasks.workunit.client.1.smithi195.stdout:4/876: dwrite d13/d63/d79/de9/f88 [4194304,4194304] 0 2024-03-22T07:28:43.500 INFO:tasks.workunit.client.1.smithi195.stdout:0/877: dwrite d1/d10/d1f/f2c [0,4194304] 0 2024-03-22T07:28:43.501 INFO:tasks.workunit.client.1.smithi195.stdout:0/878: readlink d1/d10/d19/d20/l5e 0 2024-03-22T07:28:43.501 INFO:tasks.workunit.client.1.smithi195.stdout:5/956: mkdir d9/d73/da1/d137 0 2024-03-22T07:28:43.503 INFO:tasks.workunit.client.0.smithi134.stdout:4/686: creat d2/d25/d74/dde/d76/d9a/ff4 x:0 0 0 2024-03-22T07:28:43.511 INFO:tasks.workunit.client.1.smithi195.stdout:3/876: mkdir d3/d18/d89/d70/db5/d117 0 2024-03-22T07:28:43.513 INFO:tasks.workunit.client.1.smithi195.stdout:3/877: dread d3/d18/d89/d76/f106 [0,4194304] 0 2024-03-22T07:28:43.513 INFO:tasks.workunit.client.1.smithi195.stdout:3/878: chown d3/d18/d89/d8c/d9d/cf1 98188 1 2024-03-22T07:28:43.513 INFO:tasks.workunit.client.1.smithi195.stdout:3/879: fdatasync d3/df/d15/d1d/d5c/f46 0 2024-03-22T07:28:43.513 INFO:tasks.workunit.client.0.smithi134.stdout:0/704: rmdir dc/d17/da7 39 2024-03-22T07:28:43.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/705: dread dc/d18/f79 [0,4194304] 0 2024-03-22T07:28:43.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/706: creat dc/d17/fd7 x:0 0 0 2024-03-22T07:28:43.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/707: read dc/de/d55/d65/db8/f7c [36724,113569] 0 2024-03-22T07:28:43.515 INFO:tasks.workunit.client.0.smithi134.stdout:0/708: creat dc/d18/d89/da0/fd8 x:0 0 0 2024-03-22T07:28:43.518 INFO:tasks.workunit.client.1.smithi195.stdout:7/875: rename d0/d13/d22/d57/d7b/d8c/cc9 to d0/d13/d14/d20/d40/d82/c133 0 2024-03-22T07:28:43.518 INFO:tasks.workunit.client.1.smithi195.stdout:7/876: fsync d0/d13/d22/d57/d7b/d8c/f92 0 2024-03-22T07:28:43.518 INFO:tasks.workunit.client.1.smithi195.stdout:9/984: sync 2024-03-22T07:28:43.518 INFO:tasks.workunit.client.1.smithi195.stdout:8/961: sync 2024-03-22T07:28:43.518 INFO:tasks.workunit.client.1.smithi195.stdout:9/985: truncate d2/d4/d1d/d9b/ffc 1013733 0 2024-03-22T07:28:43.522 INFO:tasks.workunit.client.0.smithi134.stdout:1/700: rename d5/d1d/d49/le2 to d5/d1d/dd0/ddc/lf9 0 2024-03-22T07:28:43.522 INFO:tasks.workunit.client.0.smithi134.stdout:1/701: fdatasync d5/da/d13/d1e/d34/f5f 0 2024-03-22T07:28:43.522 INFO:tasks.workunit.client.1.smithi195.stdout:4/877: truncate d13/d63/d79/de9/f70 2014121 0 2024-03-22T07:28:43.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/594: truncate f0 1347127 0 2024-03-22T07:28:43.526 INFO:tasks.workunit.client.0.smithi134.stdout:9/595: readlink d3/d9/d37/d3c/d71/l8b 0 2024-03-22T07:28:43.527 INFO:tasks.workunit.client.0.smithi134.stdout:8/829: dwrite d1/d46/f62 [0,4194304] 0 2024-03-22T07:28:43.528 INFO:tasks.workunit.client.1.smithi195.stdout:5/957: dwrite d9/d73/da1/fab [0,4194304] 0 2024-03-22T07:28:43.533 INFO:tasks.workunit.client.1.smithi195.stdout:0/879: dwrite d1/d4/dd/d66/d80/f6a [0,4194304] 0 2024-03-22T07:28:43.533 INFO:tasks.workunit.client.0.smithi134.stdout:7/834: mknod d1/de/d11/d48/c109 0 2024-03-22T07:28:43.536 INFO:tasks.workunit.client.0.smithi134.stdout:4/687: unlink d2/d2a/c58 0 2024-03-22T07:28:43.538 INFO:tasks.workunit.client.1.smithi195.stdout:2/908: symlink d2/d3/d21/d40/l138 0 2024-03-22T07:28:43.539 INFO:tasks.workunit.client.1.smithi195.stdout:0/880: dread d1/d10/d1f/f2c [0,4194304] 0 2024-03-22T07:28:43.541 INFO:tasks.workunit.client.0.smithi134.stdout:8/830: dread d1/f77 [0,4194304] 0 2024-03-22T07:28:43.541 INFO:tasks.workunit.client.1.smithi195.stdout:3/880: rename d3/df/d15/d1d/d5c/d47/d67/d80/ce3 to d3/d18/d89/d70/db5/c118 0 2024-03-22T07:28:43.543 INFO:tasks.workunit.client.0.smithi134.stdout:9/596: dwrite d3/d9/d37/d3c/d71/fa8 [0,4194304] 0 2024-03-22T07:28:43.544 INFO:tasks.workunit.client.1.smithi195.stdout:7/877: creat d0/d13/d22/d57/d7b/f134 x:0 0 0 2024-03-22T07:28:43.547 INFO:tasks.workunit.client.0.smithi134.stdout:0/709: mkdir dc/de/d55/dd9 0 2024-03-22T07:28:43.551 INFO:tasks.workunit.client.0.smithi134.stdout:1/702: creat d5/da/d13/dac/ffa x:0 0 0 2024-03-22T07:28:43.551 INFO:tasks.workunit.client.1.smithi195.stdout:8/962: symlink da/d17/l12d 0 2024-03-22T07:28:43.556 INFO:tasks.workunit.client.1.smithi195.stdout:4/878: creat d13/d15/f128 x:0 0 0 2024-03-22T07:28:43.556 INFO:tasks.workunit.client.1.smithi195.stdout:4/879: stat d13/d15/d64 0 2024-03-22T07:28:43.558 INFO:tasks.workunit.client.0.smithi134.stdout:7/835: rename d1/de/d11/d97/c9a to d1/de/d11/d48/c10a 0 2024-03-22T07:28:43.559 INFO:tasks.workunit.client.1.smithi195.stdout:9/986: dread d2/fbe [0,4194304] 0 2024-03-22T07:28:43.560 INFO:tasks.workunit.client.0.smithi134.stdout:4/688: truncate d2/d2a/f4d 3749504 0 2024-03-22T07:28:43.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/909: dwrite d2/d3/d7/d19/d22/d26/d3c/f9e [0,4194304] 0 2024-03-22T07:28:43.561 INFO:tasks.workunit.client.1.smithi195.stdout:2/910: read d2/d3/d7/d19/d22/d26/f4b [278310,12868] 0 2024-03-22T07:28:43.563 INFO:tasks.workunit.client.1.smithi195.stdout:6/790: sync 2024-03-22T07:28:43.563 INFO:tasks.workunit.client.1.smithi195.stdout:1/783: sync 2024-03-22T07:28:43.564 INFO:tasks.workunit.client.1.smithi195.stdout:1/784: fdatasync d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/f6d 0 2024-03-22T07:28:43.564 INFO:tasks.workunit.client.0.smithi134.stdout:8/831: rmdir d1/d4/d61/d85 39 2024-03-22T07:28:43.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/881: unlink d1/d10/d19/d20/f61 0 2024-03-22T07:28:43.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/882: chown d1/d4/d12/d6c/dbc/d47 354431 1 2024-03-22T07:28:43.565 INFO:tasks.workunit.client.1.smithi195.stdout:0/883: creat d1/d10/d19/d20/f113 x:0 0 0 2024-03-22T07:28:43.566 INFO:tasks.workunit.client.0.smithi134.stdout:1/703: dwrite d5/da/d13/d1e/d34/f59 [0,4194304] 0 2024-03-22T07:28:43.567 INFO:tasks.workunit.client.1.smithi195.stdout:5/958: rename d9/d2d/d84/dcf/f6c to d9/d73/d125/f138 0 2024-03-22T07:28:43.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/959: fdatasync d9/d12/d1d/d69/d101/f103 0 2024-03-22T07:28:43.568 INFO:tasks.workunit.client.1.smithi195.stdout:5/960: chown d9/d12/d1d/d69/d78/fb1 171226 1 2024-03-22T07:28:43.571 INFO:tasks.workunit.client.1.smithi195.stdout:3/881: unlink d3/cb9 0 2024-03-22T07:28:43.574 INFO:tasks.workunit.client.1.smithi195.stdout:7/878: unlink d0/d13/d14/d20/f131 0 2024-03-22T07:28:43.578 INFO:tasks.workunit.client.1.smithi195.stdout:8/963: mkdir da/d82/dc0/d12e 0 2024-03-22T07:28:43.580 INFO:tasks.workunit.client.0.smithi134.stdout:1/704: dread d5/d1d/d49/f5c [0,4194304] 0 2024-03-22T07:28:43.580 INFO:tasks.workunit.client.0.smithi134.stdout:0/710: mknod dc/de/dc9/cda 0 2024-03-22T07:28:43.580 INFO:tasks.workunit.client.0.smithi134.stdout:0/711: truncate dc/f57 4684828 0 2024-03-22T07:28:43.580 INFO:tasks.workunit.client.0.smithi134.stdout:0/712: readlink dc/d18/l7b 0 2024-03-22T07:28:43.581 INFO:tasks.workunit.client.1.smithi195.stdout:9/987: creat d2/d4/d32/d6d/d78/d107/f164 x:0 0 0 2024-03-22T07:28:43.583 INFO:tasks.workunit.client.1.smithi195.stdout:2/911: unlink d2/d3/d7/d19/d22/d26/d99/la1 0 2024-03-22T07:28:43.583 INFO:tasks.workunit.client.0.smithi134.stdout:7/836: symlink d1/de/d41/d87/l10b 0 2024-03-22T07:28:43.584 INFO:tasks.workunit.client.1.smithi195.stdout:6/791: getdents d5/d5e/d34 0 2024-03-22T07:28:43.584 INFO:tasks.workunit.client.1.smithi195.stdout:9/988: dread d2/d4/d6/ff4 [0,4194304] 0 2024-03-22T07:28:43.587 INFO:tasks.workunit.client.0.smithi134.stdout:5/658: dwrite d1/d8/d20/d62/d65/f43 [0,4194304] 0 2024-03-22T07:28:43.588 INFO:tasks.workunit.client.0.smithi134.stdout:4/689: link d2/l92 d2/d15/d6f/lf5 0 2024-03-22T07:28:43.588 INFO:tasks.workunit.client.0.smithi134.stdout:4/690: write d2/d2a/d80/d85/faa [124921,50893] 0 2024-03-22T07:28:43.592 INFO:tasks.workunit.client.0.smithi134.stdout:8/832: link d1/d15/d7b/c7e d1/d15/d42/d25/d6f/ddb/c112 0 2024-03-22T07:28:43.592 INFO:tasks.workunit.client.0.smithi134.stdout:8/833: write d1/d15/d42/d76/dda/f10e [798433,98222] 0 2024-03-22T07:28:43.595 INFO:tasks.workunit.client.1.smithi195.stdout:0/884: truncate d1/d10/d19/d20/f3c 251399 0 2024-03-22T07:28:43.596 INFO:tasks.workunit.client.0.smithi134.stdout:7/837: write d1/de/d11/d48/d52/d46/fb1 [1537610,100533] 0 2024-03-22T07:28:43.596 INFO:tasks.workunit.client.0.smithi134.stdout:7/838: write d1/de/d11/d48/fed [8551,32223] 0 2024-03-22T07:28:43.596 INFO:tasks.workunit.client.0.smithi134.stdout:7/839: chown d1/d19/d9c/db3/cd3 169 1 2024-03-22T07:28:43.596 INFO:tasks.workunit.client.0.smithi134.stdout:7/840: write d1/de/f5a [2428615,124032] 0 2024-03-22T07:28:43.598 INFO:tasks.workunit.client.0.smithi134.stdout:4/691: write d2/d15/f30 [2466786,6112] 0 2024-03-22T07:28:43.598 INFO:tasks.workunit.client.0.smithi134.stdout:4/692: stat d2/d25/d48/d6e/f73 0 2024-03-22T07:28:43.598 INFO:tasks.workunit.client.0.smithi134.stdout:1/705: symlink d5/da/d13/d1e/d45/lfb 0 2024-03-22T07:28:43.600 INFO:tasks.workunit.client.0.smithi134.stdout:0/713: mkdir dc/de/dc9/dd0/ddb 0 2024-03-22T07:28:43.602 INFO:tasks.workunit.client.1.smithi195.stdout:3/882: unlink d3/d98/d115/da0/dd1/f10b 0 2024-03-22T07:28:43.602 INFO:tasks.workunit.client.1.smithi195.stdout:0/885: dread d1/d4/dd/df/d44/fea [0,4194304] 0 2024-03-22T07:28:43.602 INFO:tasks.workunit.client.0.smithi134.stdout:5/659: creat d1/d8/d20/d62/d65/dac/dad/fd9 x:0 0 0 2024-03-22T07:28:43.604 INFO:tasks.workunit.client.0.smithi134.stdout:7/841: dread d1/de/d11/d2b/d31/d85/fc3 [0,4194304] 0 2024-03-22T07:28:43.605 INFO:tasks.workunit.client.1.smithi195.stdout:8/964: mkdir da/d82/dc6/db4/d12f 0 2024-03-22T07:28:43.605 INFO:tasks.workunit.client.1.smithi195.stdout:8/965: write da/de/f2d [4345811,95087] 0 2024-03-22T07:28:43.605 INFO:tasks.workunit.client.1.smithi195.stdout:8/966: readlink da/ld2 0 2024-03-22T07:28:43.605 INFO:tasks.workunit.client.1.smithi195.stdout:8/967: write da/d17/d32/d61/d88/d91/fd1 [604763,60908] 0 2024-03-22T07:28:43.606 INFO:tasks.workunit.client.1.smithi195.stdout:8/968: creat da/de/f130 x:0 0 0 2024-03-22T07:28:43.607 INFO:tasks.workunit.client.1.smithi195.stdout:2/912: creat d2/d3/d7/d19/d22/d26/d3c/f139 x:0 0 0 2024-03-22T07:28:43.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/834: link d1/d15/d42/d76/d8f/dad/dae/lbe d1/d15/d42/d76/l113 0 2024-03-22T07:28:43.608 INFO:tasks.workunit.client.0.smithi134.stdout:8/835: fsync d1/d15/f19 0 2024-03-22T07:28:43.613 INFO:tasks.workunit.client.0.smithi134.stdout:4/693: rmdir d2/d25/dcf 39 2024-03-22T07:28:43.617 INFO:tasks.workunit.client.0.smithi134.stdout:1/706: truncate d5/da/d1b/f1c 1036334 0 2024-03-22T07:28:43.621 INFO:tasks.workunit.client.1.smithi195.stdout:4/880: rename d13/d63/d36/d9e/faa to d13/d63/d79/f129 0 2024-03-22T07:28:43.622 INFO:tasks.workunit.client.1.smithi195.stdout:4/881: fdatasync d13/d63/d79/de9/d7e/f8e 0 2024-03-22T07:28:43.622 INFO:tasks.workunit.client.1.smithi195.stdout:4/882: write d13/d63/d3e/d5c/d65/f10b [5381,55160] 0 2024-03-22T07:28:43.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/714: mknod dc/cdc 0 2024-03-22T07:28:43.622 INFO:tasks.workunit.client.1.smithi195.stdout:3/883: stat d3/c62 0 2024-03-22T07:28:43.628 INFO:tasks.workunit.client.0.smithi134.stdout:8/836: symlink d1/d15/d42/d25/d6f/l114 0 2024-03-22T07:28:43.628 INFO:tasks.workunit.client.1.smithi195.stdout:0/886: unlink d1/d4/dd/df/lc9 0 2024-03-22T07:28:43.631 INFO:tasks.workunit.client.1.smithi195.stdout:7/879: mkdir d0/d13/d14/d20/deb/d135 0 2024-03-22T07:28:43.635 INFO:tasks.workunit.client.0.smithi134.stdout:0/715: mknod dc/de/d55/d65/cdd 0 2024-03-22T07:28:43.636 INFO:tasks.workunit.client.0.smithi134.stdout:7/842: dwrite d1/de/d11/d48/fed [0,4194304] 0 2024-03-22T07:28:43.636 INFO:tasks.workunit.client.0.smithi134.stdout:7/843: write d1/d40/fd2 [953455,74179] 0 2024-03-22T07:28:43.638 INFO:tasks.workunit.client.1.smithi195.stdout:8/969: unlink da/de/f105 0 2024-03-22T07:28:43.638 INFO:tasks.workunit.client.1.smithi195.stdout:8/970: creat da/d82/dc6/d53/dff/f131 x:0 0 0 2024-03-22T07:28:43.638 INFO:tasks.workunit.client.1.smithi195.stdout:8/971: fdatasync da/dc/f7b 0 2024-03-22T07:28:43.638 INFO:tasks.workunit.client.1.smithi195.stdout:8/972: read - da/d82/f10f zero size 2024-03-22T07:28:43.639 INFO:tasks.workunit.client.0.smithi134.stdout:5/660: getdents d1 0 2024-03-22T07:28:43.644 INFO:tasks.workunit.client.1.smithi195.stdout:2/913: unlink d2/d3/d7/da/d1b/d98/fc8 0 2024-03-22T07:28:43.645 INFO:tasks.workunit.client.0.smithi134.stdout:8/837: rename d1/d15/d42/d12/d20/d41/fa3 to d1/d15/d42/d76/de1/f115 0 2024-03-22T07:28:43.646 INFO:tasks.workunit.client.0.smithi134.stdout:8/838: write d1/d46/f9c [903026,72540] 0 2024-03-22T07:28:43.647 INFO:tasks.workunit.client.0.smithi134.stdout:1/707: mknod d5/da/d1b/d27/d39/cfc 0 2024-03-22T07:28:43.647 INFO:tasks.workunit.client.0.smithi134.stdout:1/708: chown d5/da/d13/d1e/d63/lc2 7087 1 2024-03-22T07:28:43.647 INFO:tasks.workunit.client.1.smithi195.stdout:6/792: mkdir d5/d16/d11b 0 2024-03-22T07:28:43.648 INFO:tasks.workunit.client.1.smithi195.stdout:9/989: getdents d2/d4/d32/d6d/d78/d79 0 2024-03-22T07:28:43.648 INFO:tasks.workunit.client.0.smithi134.stdout:7/844: mkdir d1/d19/d32/d10c 0 2024-03-22T07:28:43.648 INFO:tasks.workunit.client.0.smithi134.stdout:7/845: chown d1/de/d41/d87/d8f 1261078270 1 2024-03-22T07:28:43.652 INFO:tasks.workunit.client.0.smithi134.stdout:5/661: rename d1/d8/d20/d62/d65/dac/fba to d1/da0/fda 0 2024-03-22T07:28:43.652 INFO:tasks.workunit.client.0.smithi134.stdout:5/662: getdents d1/d8/dc5/dd6 0 2024-03-22T07:28:43.653 INFO:tasks.workunit.client.1.smithi195.stdout:5/961: rename d9/d2d/d84/dcf/l99 to d9/d12/d1d/d36/d7d/dd2/dfc/l139 0 2024-03-22T07:28:43.653 INFO:tasks.workunit.client.1.smithi195.stdout:5/962: chown d9/d12/d1d/d36/f5a 727516696 1 2024-03-22T07:28:43.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/883: link f11 d13/d63/d3e/f12a 0 2024-03-22T07:28:43.653 INFO:tasks.workunit.client.1.smithi195.stdout:4/884: readlink d13/d15/d6b/da6/ded/def/lf5 0 2024-03-22T07:28:43.653 INFO:tasks.workunit.client.1.smithi195.stdout:0/887: dwrite d1/d4/dd/d66/fd4 [0,4194304] 0 2024-03-22T07:28:43.656 INFO:tasks.workunit.client.0.smithi134.stdout:8/839: creat d1/d15/d7b/d83/f116 x:0 0 0 2024-03-22T07:28:43.663 INFO:tasks.workunit.client.1.smithi195.stdout:7/880: rmdir d0/d13/d14/d29/d35/de7 39 2024-03-22T07:28:43.663 INFO:tasks.workunit.client.0.smithi134.stdout:1/709: symlink d5/d1d/d2d/lfd 0 2024-03-22T07:28:43.664 INFO:tasks.workunit.client.0.smithi134.stdout:1/710: readlink d5/da/d13/d1e/d62/lcd 0 2024-03-22T07:28:43.664 INFO:tasks.workunit.client.0.smithi134.stdout:0/716: dwrite dc/f57 [0,4194304] 0 2024-03-22T07:28:43.664 INFO:tasks.workunit.client.0.smithi134.stdout:0/717: write dc/d17/f7f [1800211,25598] 0 2024-03-22T07:28:43.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/793: rename d5/d16/d45/df8/d104/d5f/de7 to d5/d16/d45/d53/d11c 0 2024-03-22T07:28:43.666 INFO:tasks.workunit.client.1.smithi195.stdout:6/794: read - d5/d16/d45/f119 zero size 2024-03-22T07:28:43.668 INFO:tasks.workunit.client.1.smithi195.stdout:5/963: mkdir d9/d73/dbb/d13a 0 2024-03-22T07:28:43.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/711: link d5/d1d/d49/cf4 d5/da/dce/cfe 0 2024-03-22T07:28:43.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/718: creat dc/de/d55/fde x:0 0 0 2024-03-22T07:28:43.673 INFO:tasks.workunit.client.0.smithi134.stdout:0/719: read dc/de/d55/f71 [1847225,72990] 0 2024-03-22T07:28:43.674 INFO:tasks.workunit.client.1.smithi195.stdout:4/885: symlink d13/d15/d6b/dd0/df3/l12b 0 2024-03-22T07:28:43.677 INFO:tasks.workunit.client.0.smithi134.stdout:1/712: link d5/da/d1b/d27/f80 d5/d1d/d49/d92/fff 0 2024-03-22T07:28:43.678 INFO:tasks.workunit.client.1.smithi195.stdout:6/795: dread d5/d5e/d34/d55/d3b/d6e/d3c/f44 [4194304,4194304] 0 2024-03-22T07:28:43.678 INFO:tasks.workunit.client.1.smithi195.stdout:0/888: symlink d1/d4/dd/df/d67/l114 0 2024-03-22T07:28:43.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/694: dwrite d2/f62 [4194304,4194304] 0 2024-03-22T07:28:43.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/695: chown d2/d2a/d80/dd6/la6 874257 1 2024-03-22T07:28:43.679 INFO:tasks.workunit.client.1.smithi195.stdout:3/884: dwrite d3/d98/d115/f113 [0,4194304] 0 2024-03-22T07:28:43.680 INFO:tasks.workunit.client.0.smithi134.stdout:0/720: mkdir dc/d17/da9/ddf 0 2024-03-22T07:28:43.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/785: dwrite d0/d2/d6/dad/db1/d97/d41/d47/f49 [0,4194304] 0 2024-03-22T07:28:43.682 INFO:tasks.workunit.client.1.smithi195.stdout:1/786: chown d0/d2/d6/cd 153459 1 2024-03-22T07:28:43.686 INFO:tasks.workunit.client.0.smithi134.stdout:4/696: link d2/d15/lc1 d2/d25/d74/dde/dc0/lf6 0 2024-03-22T07:28:43.686 INFO:tasks.workunit.client.0.smithi134.stdout:4/697: read d2/d25/d74/dde/d76/fb0 [2203643,38437] 0 2024-03-22T07:28:43.687 INFO:tasks.workunit.client.1.smithi195.stdout:4/886: creat d13/d63/d79/d68/f12c x:0 0 0 2024-03-22T07:28:43.688 INFO:tasks.workunit.client.0.smithi134.stdout:7/846: dwrite d1/de/fd8 [0,4194304] 0 2024-03-22T07:28:43.688 INFO:tasks.workunit.client.0.smithi134.stdout:1/713: symlink d5/da/d1b/d27/d39/l100 0 2024-03-22T07:28:43.689 INFO:tasks.workunit.client.1.smithi195.stdout:6/796: rmdir d5/d6d/d95/d100 39 2024-03-22T07:28:43.689 INFO:tasks.workunit.client.1.smithi195.stdout:6/797: truncate d5/d5e/dc0/f113 4936613 0 2024-03-22T07:28:43.691 INFO:tasks.workunit.client.1.smithi195.stdout:0/889: creat d1/d4/d22/f115 x:0 0 0 2024-03-22T07:28:43.694 INFO:tasks.workunit.client.0.smithi134.stdout:0/721: dread dc/f29 [4194304,4194304] 0 2024-03-22T07:28:43.698 INFO:tasks.workunit.client.1.smithi195.stdout:8/973: dwrite da/d82/dc6/db4/ffa [0,4194304] 0 2024-03-22T07:28:43.702 INFO:tasks.workunit.client.1.smithi195.stdout:8/974: dread da/d17/d32/d61/f72 [0,4194304] 0 2024-03-22T07:28:43.704 INFO:tasks.workunit.client.1.smithi195.stdout:4/887: rmdir d13/d63/d3e/d5c/d65/d11e 0 2024-03-22T07:28:43.706 INFO:tasks.workunit.client.1.smithi195.stdout:6/798: symlink d5/d16/d45/df8/l11d 0 2024-03-22T07:28:43.708 INFO:tasks.workunit.client.1.smithi195.stdout:0/890: mknod d1/d4/d12/d6c/d87/c116 0 2024-03-22T07:28:43.713 INFO:tasks.workunit.client.1.smithi195.stdout:7/881: dwrite d0/d13/d22/d28/f64 [4194304,4194304] 0 2024-03-22T07:28:43.717 INFO:tasks.workunit.client.1.smithi195.stdout:9/990: dwrite d2/f63 [0,4194304] 0 2024-03-22T07:28:43.717 INFO:tasks.workunit.client.0.smithi134.stdout:5/663: dwrite d1/d8/d16/f5a [0,4194304] 0 2024-03-22T07:28:43.717 INFO:tasks.workunit.client.0.smithi134.stdout:8/840: dwrite d1/d15/d57/f68 [0,4194304] 0 2024-03-22T07:28:43.717 INFO:tasks.workunit.client.0.smithi134.stdout:8/841: write d1/d15/f2c [389972,78382] 0 2024-03-22T07:28:43.718 INFO:tasks.workunit.client.0.smithi134.stdout:8/842: chown d1/d46/d75/d8b/db4/d102/l10a 4571 1 2024-03-22T07:28:43.718 INFO:tasks.workunit.client.0.smithi134.stdout:8/843: chown d1/f77 76092 1 2024-03-22T07:28:43.723 INFO:tasks.workunit.client.0.smithi134.stdout:1/714: truncate d5/da/d13/f6c 3949084 0 2024-03-22T07:28:43.723 INFO:tasks.workunit.client.0.smithi134.stdout:7/847: dwrite d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:43.723 INFO:tasks.workunit.client.0.smithi134.stdout:7/848: truncate d1/de/d41/fd7 8422772 0 2024-03-22T07:28:43.730 INFO:tasks.workunit.client.0.smithi134.stdout:4/698: getdents d2/d25/d48/d87 0 2024-03-22T07:28:43.732 INFO:tasks.workunit.client.0.smithi134.stdout:8/844: write d1/d15/f27 [41826,45529] 0 2024-03-22T07:28:43.732 INFO:tasks.workunit.client.1.smithi195.stdout:5/964: dwrite d9/d22/f2b [4194304,4194304] 0 2024-03-22T07:28:43.732 INFO:tasks.workunit.client.1.smithi195.stdout:7/882: dread d0/d13/d14/f112 [0,4194304] 0 2024-03-22T07:28:43.732 INFO:tasks.workunit.client.1.smithi195.stdout:5/965: fsync d9/d12/d1d/d69/d78/d41/fc2 0 2024-03-22T07:28:43.732 INFO:tasks.workunit.client.1.smithi195.stdout:7/883: read - d0/d13/d22/d57/d7b/f134 zero size 2024-03-22T07:28:43.733 INFO:tasks.workunit.client.0.smithi134.stdout:4/699: dread d2/d25/f3e [0,4194304] 0 2024-03-22T07:28:43.734 INFO:tasks.workunit.client.1.smithi195.stdout:1/787: rmdir d0/d2/d27 39 2024-03-22T07:28:43.736 INFO:tasks.workunit.client.0.smithi134.stdout:5/664: creat d1/d8/fdb x:0 0 0 2024-03-22T07:28:43.738 INFO:tasks.workunit.client.0.smithi134.stdout:7/849: read d1/de/d11/d2b/d31/fcd [1952354,73149] 0 2024-03-22T07:28:43.738 INFO:tasks.workunit.client.1.smithi195.stdout:4/888: creat d13/d63/d79/de9/d7e/d8c/d108/f12d x:0 0 0 2024-03-22T07:28:43.738 INFO:tasks.workunit.client.1.smithi195.stdout:4/889: fsync d13/d63/d36/d5f/d83/f11f 0 2024-03-22T07:28:43.738 INFO:tasks.workunit.client.1.smithi195.stdout:4/890: readlink d13/d15/d64/l8a 0 2024-03-22T07:28:43.741 INFO:tasks.workunit.client.1.smithi195.stdout:6/799: mknod d5/d16/d45/df8/d104/da2/dad/c11e 0 2024-03-22T07:28:43.743 INFO:tasks.workunit.client.0.smithi134.stdout:1/715: creat d5/da/d13/d1e/d63/d9d/f101 x:0 0 0 2024-03-22T07:28:43.743 INFO:tasks.workunit.client.0.smithi134.stdout:1/716: fsync d5/da/d13/d1e/d34/f43 0 2024-03-22T07:28:43.744 INFO:tasks.workunit.client.1.smithi195.stdout:0/891: creat d1/d10/d1f/dbf/f117 x:0 0 0 2024-03-22T07:28:43.744 INFO:tasks.workunit.client.1.smithi195.stdout:0/892: truncate d1/d10/d1f/de3/fc5 857664 0 2024-03-22T07:28:43.748 INFO:tasks.workunit.client.0.smithi134.stdout:0/722: dwrite dc/d18/f8e [0,4194304] 0 2024-03-22T07:28:43.749 INFO:tasks.workunit.client.0.smithi134.stdout:8/845: mkdir d1/d4/d117 0 2024-03-22T07:28:43.751 INFO:tasks.workunit.client.0.smithi134.stdout:4/700: mknod d2/cf7 0 2024-03-22T07:28:43.754 INFO:tasks.workunit.client.1.smithi195.stdout:9/991: dwrite d2/d4/d32/d6d/d78/d79/f104 [0,4194304] 0 2024-03-22T07:28:43.754 INFO:tasks.workunit.client.1.smithi195.stdout:7/884: dwrite d0/d13/d14/d5b/f105 [0,4194304] 0 2024-03-22T07:28:43.754 INFO:tasks.workunit.client.1.smithi195.stdout:8/975: dwrite da/d17/d32/f58 [0,4194304] 0 2024-03-22T07:28:43.754 INFO:tasks.workunit.client.1.smithi195.stdout:8/976: write da/de/db3/f12c [57887,39067] 0 2024-03-22T07:28:43.755 INFO:tasks.workunit.client.0.smithi134.stdout:5/665: unlink d1/d4/l47 0 2024-03-22T07:28:43.756 INFO:tasks.workunit.client.1.smithi195.stdout:5/966: mkdir d9/d12/d1d/d69/d11f/d13b 0 2024-03-22T07:28:43.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/850: symlink d1/de/d11/d48/d52/d46/l10d 0 2024-03-22T07:28:43.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/851: stat d1/d19/d9c/db3/dc4/df7 0 2024-03-22T07:28:43.758 INFO:tasks.workunit.client.0.smithi134.stdout:7/852: fdatasync d1/de/d11/d48/d52/d46/f84 0 2024-03-22T07:28:43.760 INFO:tasks.workunit.client.1.smithi195.stdout:1/788: symlink d0/d2/d6/dad/db1/l104 0 2024-03-22T07:28:43.762 INFO:tasks.workunit.client.0.smithi134.stdout:1/717: creat d5/d1d/dd0/ddc/de3/df6/f102 x:0 0 0 2024-03-22T07:28:43.765 INFO:tasks.workunit.client.1.smithi195.stdout:4/891: mkdir d13/d63/d79/de9/d7e/d85/d101/d12e 0 2024-03-22T07:28:43.765 INFO:tasks.workunit.client.1.smithi195.stdout:4/892: write d13/d63/d79/de9/d7e/d8c/f11c [70865,2709] 0 2024-03-22T07:28:43.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/800: getdents d5/d16/d45/d53/d107 0 2024-03-22T07:28:43.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/801: creat d5/d5e/d34/d55/d3b/dc2/f11f x:0 0 0 2024-03-22T07:28:43.766 INFO:tasks.workunit.client.1.smithi195.stdout:6/802: getdents d5/d16/d45/d53/d11c 0 2024-03-22T07:28:43.768 INFO:tasks.workunit.client.0.smithi134.stdout:0/723: mknod dc/d17/ce0 0 2024-03-22T07:28:43.768 INFO:tasks.workunit.client.0.smithi134.stdout:0/724: chown dc/d18/d89/da0/fd8 303 1 2024-03-22T07:28:43.768 INFO:tasks.workunit.client.0.smithi134.stdout:7/853: dread d1/de/d41/fcb [0,4194304] 0 2024-03-22T07:28:43.768 INFO:tasks.workunit.client.0.smithi134.stdout:7/854: write d1/d40/fc9 [349733,2732] 0 2024-03-22T07:28:43.768 INFO:tasks.workunit.client.0.smithi134.stdout:7/855: fdatasync d1/de/d11/d48/f3c 0 2024-03-22T07:28:43.769 INFO:tasks.workunit.client.1.smithi195.stdout:0/893: mknod d1/d4/dd/df/d6b/c118 0 2024-03-22T07:28:43.771 INFO:tasks.workunit.client.1.smithi195.stdout:5/967: dread d9/d2d/d58/f93 [0,4194304] 0 2024-03-22T07:28:43.775 INFO:tasks.workunit.client.0.smithi134.stdout:4/701: creat d2/d2a/ff8 x:0 0 0 2024-03-22T07:28:43.779 INFO:tasks.workunit.client.1.smithi195.stdout:9/992: link d2/d4/d32/d102/f146 d2/d4/d6/db5/f165 0 2024-03-22T07:28:43.780 INFO:tasks.workunit.client.0.smithi134.stdout:1/718: dwrite d5/d1d/dd0/ddc/fe0 [0,4194304] 0 2024-03-22T07:28:43.785 INFO:tasks.workunit.client.1.smithi195.stdout:7/885: creat d0/d13/d14/d20/f136 x:0 0 0 2024-03-22T07:28:43.786 INFO:tasks.workunit.client.0.smithi134.stdout:5/666: symlink d1/d8/d16/dbd/dc0/ldc 0 2024-03-22T07:28:43.791 INFO:tasks.workunit.client.0.smithi134.stdout:0/725: mkdir dc/de/d55/de1 0 2024-03-22T07:28:43.791 INFO:tasks.workunit.client.0.smithi134.stdout:0/726: write f5 [4835447,44711] 0 2024-03-22T07:28:43.794 INFO:tasks.workunit.client.0.smithi134.stdout:7/856: mknod d1/d19/d9c/db3/dc4/df7/c10e 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/857: dread d1/de/d11/d48/d52/d46/fb1 [0,4194304] 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/858: write d1/f17 [8588447,76619] 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/859: write d1/d19/d9c/db3/dc4/ffb [914514,18428] 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/860: dread - d1/de/d11/d2b/fad zero size 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/861: creat d1/dae/f10f x:0 0 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/862: write d1/de/d11/d48/fed [5071353,97298] 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/863: creat d1/de/d41/d87/d8f/f110 x:0 0 0 2024-03-22T07:28:43.804 INFO:tasks.workunit.client.0.smithi134.stdout:7/864: fdatasync d1/d19/f23 0 2024-03-22T07:28:43.808 INFO:tasks.workunit.client.0.smithi134.stdout:7/865: dread d1/da8/ff5 [0,4194304] 0 2024-03-22T07:28:43.852 INFO:tasks.workunit.client.0.smithi134.stdout:7/866: dwrite d1/da8/ff5 [0,4194304] 0 2024-03-22T07:28:43.852 INFO:tasks.workunit.client.0.smithi134.stdout:5/667: dwrite d1/fb2 [0,4194304] 0 2024-03-22T07:28:43.854 INFO:tasks.workunit.client.1.smithi195.stdout:7/886: dwrite d0/d13/d14/d2f/dae/fc6 [0,4194304] 0 2024-03-22T07:28:43.854 INFO:tasks.workunit.client.1.smithi195.stdout:9/993: dwrite d2/f9c [0,4194304] 0 2024-03-22T07:28:43.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/994: chown d2/d4/d1d/c4d 12133191 1 2024-03-22T07:28:43.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/995: stat d2/d4/d23/d74/l141 0 2024-03-22T07:28:43.855 INFO:tasks.workunit.client.1.smithi195.stdout:9/996: stat d2/d4/d23/c12a 0 2024-03-22T07:28:43.871 INFO:tasks.workunit.client.0.smithi134.stdout:8/846: mknod d1/d15/d42/d12/d20/c118 0 2024-03-22T07:28:43.872 INFO:tasks.workunit.client.0.smithi134.stdout:4/702: creat d2/d25/d74/dde/dc0/de5/ff9 x:0 0 0 2024-03-22T07:28:43.879 INFO:tasks.workunit.client.0.smithi134.stdout:8/847: write d1/f4b [252193,95726] 0 2024-03-22T07:28:43.879 INFO:tasks.workunit.client.0.smithi134.stdout:1/719: symlink d5/da/d13/d1e/d45/l103 0 2024-03-22T07:28:43.883 INFO:tasks.workunit.client.1.smithi195.stdout:1/789: truncate d0/d2/d27/d91/dc8/f61 3485119 0 2024-03-22T07:28:43.885 INFO:tasks.workunit.client.1.smithi195.stdout:4/893: truncate d13/d63/d36/d5f/d83/fbe 245168 0 2024-03-22T07:28:43.885 INFO:tasks.workunit.client.1.smithi195.stdout:4/894: chown d13/d63/d36/l67 11398 1 2024-03-22T07:28:43.892 INFO:tasks.workunit.client.0.smithi134.stdout:0/727: stat dc/de/d55/d65/l88 0 2024-03-22T07:28:43.892 INFO:tasks.workunit.client.0.smithi134.stdout:0/728: fdatasync dc/d18/f5e 0 2024-03-22T07:28:43.893 INFO:tasks.workunit.client.1.smithi195.stdout:0/894: stat d1/d4/dd/df/d67/c8a 0 2024-03-22T07:28:43.895 INFO:tasks.workunit.client.1.smithi195.stdout:5/968: mkdir d9/d7f/d13c 0 2024-03-22T07:28:43.911 INFO:tasks.workunit.client.1.smithi195.stdout:5/969: dwrite d9/d73/d125/f138 [0,4194304] 0 2024-03-22T07:28:43.911 INFO:tasks.workunit.client.1.smithi195.stdout:5/970: truncate d9/d22/d7b/d98/da0/f127 159424 0 2024-03-22T07:28:43.911 INFO:tasks.workunit.client.1.smithi195.stdout:4/895: dwrite d13/d63/d79/d68/fc2 [0,4194304] 0 2024-03-22T07:28:43.960 INFO:tasks.workunit.client.0.smithi134.stdout:3/657: sync 2024-03-22T07:28:43.960 INFO:tasks.workunit.client.0.smithi134.stdout:3/658: fdatasync d4/d10/d6c/f84 0 2024-03-22T07:28:43.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/659: dwrite d4/d10/d4b/fb7 [0,4194304] 0 2024-03-22T07:28:44.044 INFO:tasks.workunit.client.0.smithi134.stdout:7/867: creat d1/d19/d9c/db3/f111 x:0 0 0 2024-03-22T07:28:44.049 INFO:tasks.workunit.client.0.smithi134.stdout:5/668: creat d1/d8/d20/d62/d65/dac/fdd x:0 0 0 2024-03-22T07:28:44.050 INFO:tasks.workunit.client.0.smithi134.stdout:5/669: creat d1/d8/d16/dbd/fde x:0 0 0 2024-03-22T07:28:44.050 INFO:tasks.workunit.client.0.smithi134.stdout:5/670: truncate d1/d8/f42 809577 0 2024-03-22T07:28:44.055 INFO:tasks.workunit.client.1.smithi195.stdout:2/914: sync 2024-03-22T07:28:44.055 INFO:tasks.workunit.client.1.smithi195.stdout:3/885: sync 2024-03-22T07:28:44.064 INFO:tasks.workunit.client.0.smithi134.stdout:9/597: sync 2024-03-22T07:28:44.064 INFO:tasks.workunit.client.0.smithi134.stdout:9/598: dread - d3/d9/d37/d6f/d54/d9d/dc0/f4d zero size 2024-03-22T07:28:44.065 INFO:tasks.workunit.client.0.smithi134.stdout:6/532: sync 2024-03-22T07:28:44.065 INFO:tasks.workunit.client.0.smithi134.stdout:2/610: sync 2024-03-22T07:28:44.075 INFO:tasks.workunit.client.0.smithi134.stdout:6/533: write d2/fb4 [3877230,60628] 0 2024-03-22T07:28:44.079 INFO:tasks.workunit.client.0.smithi134.stdout:5/671: dwrite d1/d8/d20/d8a/d75/fb8 [0,4194304] 0 2024-03-22T07:28:44.080 INFO:tasks.workunit.client.1.smithi195.stdout:2/915: dwrite d2/d3/d7/da/de/f65 [0,4194304] 0 2024-03-22T07:28:44.080 INFO:tasks.workunit.client.0.smithi134.stdout:9/599: write d3/d9/d37/d3c/d71/d7a/f9c [550042,5049] 0 2024-03-22T07:28:44.081 INFO:tasks.workunit.client.0.smithi134.stdout:9/600: truncate d3/d9/f7c 854873 0 2024-03-22T07:28:44.085 INFO:tasks.workunit.client.0.smithi134.stdout:4/703: mkdir d2/d15/d35/da8/dfa 0 2024-03-22T07:28:44.086 INFO:tasks.workunit.client.0.smithi134.stdout:4/704: truncate d2/d25/d74/dde/fdf 196779 0 2024-03-22T07:28:44.094 INFO:tasks.workunit.client.0.smithi134.stdout:8/848: link d1/d46/f10c d1/d15/d42/d12/dbb/f119 0 2024-03-22T07:28:44.099 INFO:tasks.workunit.client.0.smithi134.stdout:1/720: rename d5/da/d13/d1e/d45/fa0 to d5/d1d/d2d/f104 0 2024-03-22T07:28:44.099 INFO:tasks.workunit.client.0.smithi134.stdout:1/721: write d5/da/d1b/d27/d60/d72/f7d [4596144,62508] 0 2024-03-22T07:28:44.099 INFO:tasks.workunit.client.0.smithi134.stdout:1/722: stat d5/d1d/d49/f52 0 2024-03-22T07:28:44.109 INFO:tasks.workunit.client.1.smithi195.stdout:7/887: link d0/d13/d14/d20/d40/d82/da0/d59/f7c d0/d13/d14/d80/d109/f137 0 2024-03-22T07:28:44.109 INFO:tasks.workunit.client.1.smithi195.stdout:7/888: write d0/d13/d14/d80/fb6 [859568,114206] 0 2024-03-22T07:28:44.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/660: symlink d4/d8/d7f/lcf 0 2024-03-22T07:28:44.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/661: fdatasync d4/d10/fb4 0 2024-03-22T07:28:44.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/662: write d4/d8/f49 [2485971,111865] 0 2024-03-22T07:28:44.111 INFO:tasks.workunit.client.0.smithi134.stdout:3/663: write d4/d8/fa [503957,31905] 0 2024-03-22T07:28:44.113 INFO:tasks.workunit.client.1.smithi195.stdout:9/997: mkdir d2/d4/d6/db5/d166 0 2024-03-22T07:28:44.113 INFO:tasks.workunit.client.1.smithi195.stdout:9/998: chown d2/d4/d6/d18/d50/f133 15414125 1 2024-03-22T07:28:44.114 INFO:tasks.workunit.client.0.smithi134.stdout:7/868: symlink d1/de/d8d/l112 0 2024-03-22T07:28:44.114 INFO:tasks.workunit.client.0.smithi134.stdout:7/869: read - d1/de/d11/d2b/fe0 zero size 2024-03-22T07:28:44.114 INFO:tasks.workunit.client.0.smithi134.stdout:7/870: truncate d1/d40/fd2 1475749 0 2024-03-22T07:28:44.118 INFO:tasks.workunit.client.0.smithi134.stdout:0/729: dwrite dc/d18/f62 [4194304,4194304] 0 2024-03-22T07:28:44.126 INFO:tasks.workunit.client.0.smithi134.stdout:3/664: dwrite d4/d22/f20 [0,4194304] 0 2024-03-22T07:28:44.129 INFO:tasks.workunit.client.0.smithi134.stdout:5/672: getdents d1/d8/d16/dbd/dc0 0 2024-03-22T07:28:44.129 INFO:tasks.workunit.client.0.smithi134.stdout:5/673: truncate d1/d8/d20/d62/d65/dac/dad/fd9 547188 0 2024-03-22T07:28:44.129 INFO:tasks.workunit.client.0.smithi134.stdout:5/674: fdatasync d1/d8/d20/d62/d65/d95/faa 0 2024-03-22T07:28:44.133 INFO:tasks.workunit.client.0.smithi134.stdout:9/601: unlink d3/d9/d37/d3c/d71/d7a/fa5 0 2024-03-22T07:28:44.135 INFO:tasks.workunit.client.1.smithi195.stdout:1/790: creat d0/d2/d27/d91/dc8/da4/dc0/dfa/f105 x:0 0 0 2024-03-22T07:28:44.136 INFO:tasks.workunit.client.0.smithi134.stdout:4/705: getdents d2/d25/d48 0 2024-03-22T07:28:44.145 INFO:tasks.workunit.client.0.smithi134.stdout:1/723: mkdir d5/d1d/dd0/ddc/de3/d105 0 2024-03-22T07:28:44.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/791: write d0/d2/d6/dad/db1/d97/d39/d64/fc3 [3483963,110514] 0 2024-03-22T07:28:44.146 INFO:tasks.workunit.client.1.smithi195.stdout:1/792: write d0/d2/d27/d91/dc8/f81 [4602662,120042] 0 2024-03-22T07:28:44.149 INFO:tasks.workunit.client.1.smithi195.stdout:5/971: rename d9/d7f/de7/f118 to d9/d2d/d58/f13d 0 2024-03-22T07:28:44.150 INFO:tasks.workunit.client.0.smithi134.stdout:7/871: creat d1/de/d11/d48/daf/dbf/f113 x:0 0 0 2024-03-22T07:28:44.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/872: dread - d1/de/d11/d2b/d69/fa0 zero size 2024-03-22T07:28:44.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/873: dread - d1/de/d11/d2b/d31/fc0 zero size 2024-03-22T07:28:44.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/874: write d1/de/d11/d2b/d31/fcd [2907692,51146] 0 2024-03-22T07:28:44.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/875: creat d1/de/d11/d48/dbc/f114 x:0 0 0 2024-03-22T07:28:44.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/876: creat d1/de/d11/d48/daf/f115 x:0 0 0 2024-03-22T07:28:44.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/877: read - d1/de/d11/d48/daf/dbf/f113 zero size 2024-03-22T07:28:44.155 INFO:tasks.workunit.client.0.smithi134.stdout:1/724: dread d5/da/d68/da1/fbd [0,4194304] 0 2024-03-22T07:28:44.159 INFO:tasks.workunit.client.1.smithi195.stdout:4/896: truncate d13/d63/d36/f8d 1684477 0 2024-03-22T07:28:44.162 INFO:tasks.workunit.client.0.smithi134.stdout:5/675: symlink d1/d8/da1/ldf 0 2024-03-22T07:28:44.164 INFO:tasks.workunit.client.0.smithi134.stdout:5/676: write d1/d8/d20/d62/d68/fca [640624,48010] 0 2024-03-22T07:28:44.164 INFO:tasks.workunit.client.0.smithi134.stdout:5/677: readlink d1/d8/d20/l5e 0 2024-03-22T07:28:44.164 INFO:tasks.workunit.client.0.smithi134.stdout:9/602: chown d3/f22 553378 1 2024-03-22T07:28:44.166 INFO:tasks.workunit.client.1.smithi195.stdout:4/897: dread d13/d15/f37 [0,4194304] 0 2024-03-22T07:28:44.169 INFO:tasks.workunit.client.0.smithi134.stdout:2/611: rename d2/d5/d8/d31/f81 to d2/d5/d8/fc3 0 2024-03-22T07:28:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:1/793: dwrite d0/d2/d27/d91/dc8/f6c [0,4194304] 0 2024-03-22T07:28:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:1/794: chown d0/d2/f1b 59870 1 2024-03-22T07:28:44.173 INFO:tasks.workunit.client.1.smithi195.stdout:1/795: chown d0/d2/d27/d91/dc8/l18 14479 1 2024-03-22T07:28:44.173 INFO:tasks.workunit.client.0.smithi134.stdout:1/725: dwrite d5/d1d/d49/f9e [0,4194304] 0 2024-03-22T07:28:44.178 INFO:tasks.workunit.client.1.smithi195.stdout:2/916: mknod d2/d3/d7/d19/d22/d26/d3c/d116/c13a 0 2024-03-22T07:28:44.180 INFO:tasks.workunit.client.0.smithi134.stdout:7/878: mkdir d1/de/d8d/d116 0 2024-03-22T07:28:44.183 INFO:tasks.workunit.client.1.smithi195.stdout:7/889: getdents d0/d13/d22/d57 0 2024-03-22T07:28:44.185 INFO:tasks.workunit.client.1.smithi195.stdout:2/917: dread d2/d3/db/fd6 [0,4194304] 0 2024-03-22T07:28:44.186 INFO:tasks.workunit.client.1.smithi195.stdout:9/999: creat d2/d122/f167 x:0 0 0 2024-03-22T07:28:44.188 INFO:tasks.workunit.client.1.smithi195.stdout:7/890: dread d0/d13/d14/d29/d35/d3a/f3e [0,4194304] 0 2024-03-22T07:28:44.193 INFO:tasks.workunit.client.0.smithi134.stdout:2/612: creat d2/d5/d8/d5d/da1/d3c/fc4 x:0 0 0 2024-03-22T07:28:44.194 INFO:tasks.workunit.client.1.smithi195.stdout:4/898: creat d13/d63/d7a/f12f x:0 0 0 2024-03-22T07:28:44.197 INFO:tasks.workunit.client.1.smithi195.stdout:3/886: mknod d3/c119 0 2024-03-22T07:28:44.199 INFO:tasks.workunit.client.0.smithi134.stdout:5/678: mkdir d1/d8/d16/d4a/dce/de0 0 2024-03-22T07:28:44.218 INFO:tasks.workunit.client.1.smithi195.stdout:7/891: symlink d0/d13/d14/d20/d40/d82/da6/l138 0 2024-03-22T07:28:44.218 INFO:tasks.workunit.client.1.smithi195.stdout:7/892: truncate d0/d13/d22/d28/ff8 1374719 0 2024-03-22T07:28:44.218 INFO:tasks.workunit.client.1.smithi195.stdout:7/893: chown d0/l15 9306 1 2024-03-22T07:28:44.221 INFO:tasks.workunit.client.0.smithi134.stdout:5/679: dread d1/d8/d20/f39 [0,4194304] 0 2024-03-22T07:28:44.222 INFO:tasks.workunit.client.1.smithi195.stdout:4/899: rmdir d13/d63/d79/de9/d7e/d85/d101/d12e 0 2024-03-22T07:28:44.223 INFO:tasks.workunit.client.0.smithi134.stdout:9/603: rmdir d3/d9/d37/d6f/d54 39 2024-03-22T07:28:44.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/894: truncate d0/d13/d14/f30 3379597 0 2024-03-22T07:28:44.225 INFO:tasks.workunit.client.1.smithi195.stdout:7/895: creat d0/d13/d14/d20/d40/d82/da0/d59/f139 x:0 0 0 2024-03-22T07:28:44.226 INFO:tasks.workunit.client.1.smithi195.stdout:4/900: mknod d13/d63/d79/d68/dfb/c130 0 2024-03-22T07:28:44.230 INFO:tasks.workunit.client.1.smithi195.stdout:2/918: dwrite d2/d1e/d93/d112/f3a [0,4194304] 0 2024-03-22T07:28:44.230 INFO:tasks.workunit.client.0.smithi134.stdout:3/665: mknod d4/d8/d69/cd0 0 2024-03-22T07:28:44.230 INFO:tasks.workunit.client.0.smithi134.stdout:7/879: dwrite d1/d40/f7f [4194304,4194304] 0 2024-03-22T07:28:44.232 INFO:tasks.workunit.client.1.smithi195.stdout:1/796: creat d0/d2/d27/d91/dc8/f106 x:0 0 0 2024-03-22T07:28:44.236 INFO:tasks.workunit.client.1.smithi195.stdout:2/919: dread d2/d3/f74 [0,4194304] 0 2024-03-22T07:28:44.237 INFO:tasks.workunit.client.1.smithi195.stdout:3/887: dread d3/df/d15/d1d/d5c/f2e [0,4194304] 0 2024-03-22T07:28:44.237 INFO:tasks.workunit.client.1.smithi195.stdout:7/896: mkdir d0/d13/d22/d13a 0 2024-03-22T07:28:44.243 INFO:tasks.workunit.client.0.smithi134.stdout:4/706: unlink d2/d2a/d80/lae 0 2024-03-22T07:28:44.243 INFO:tasks.workunit.client.0.smithi134.stdout:4/707: chown d2/d2a/d50/f5c 20 1 2024-03-22T07:28:44.244 INFO:tasks.workunit.client.0.smithi134.stdout:4/708: dread d2/d25/d48/d6e/d7b/f8e [4194304,4194304] 0 2024-03-22T07:28:44.246 INFO:tasks.workunit.client.0.smithi134.stdout:5/680: link d1/d8/d20/d62/d68/fca d1/d8/fe1 0 2024-03-22T07:28:44.247 INFO:tasks.workunit.client.1.smithi195.stdout:4/901: dwrite d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:44.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/902: dread d13/d63/d3e/d5c/d65/f10b [0,4194304] 0 2024-03-22T07:28:44.249 INFO:tasks.workunit.client.1.smithi195.stdout:4/903: getdents d13/d63/d79/de9/d7e/d85/d101/d114 0 2024-03-22T07:28:44.249 INFO:tasks.workunit.client.1.smithi195.stdout:1/797: creat d0/d2/d6/dad/db1/d97/d39/d40/dc9/f107 x:0 0 0 2024-03-22T07:28:44.251 INFO:tasks.workunit.client.1.smithi195.stdout:2/920: rmdir d2/d3/d7/da 39 2024-03-22T07:28:44.251 INFO:tasks.workunit.client.1.smithi195.stdout:2/921: dread - d2/d3/d7/d19/d22/d26/fd4 zero size 2024-03-22T07:28:44.254 INFO:tasks.workunit.client.0.smithi134.stdout:7/880: mkdir d1/d19/d9c/db3/dc4/df7/d117 0 2024-03-22T07:28:44.256 INFO:tasks.workunit.client.1.smithi195.stdout:4/904: mkdir d13/d15/d6b/dd0/df3/d131 0 2024-03-22T07:28:44.257 INFO:tasks.workunit.client.1.smithi195.stdout:3/888: dwrite d3/fe7 [0,4194304] 0 2024-03-22T07:28:44.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/922: symlink d2/d3/d7/d19/d22/d26/d3c/d116/d121/l13b 0 2024-03-22T07:28:44.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/923: dread - d2/fc4 zero size 2024-03-22T07:28:44.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/924: write d2/d3/d21/ffb [223400,116191] 0 2024-03-22T07:28:44.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/925: write d2/d3/d21/d40/f5d [1547495,128218] 0 2024-03-22T07:28:44.262 INFO:tasks.workunit.client.0.smithi134.stdout:5/681: symlink d1/d8/dc5/dd6/le2 0 2024-03-22T07:28:44.262 INFO:tasks.workunit.client.0.smithi134.stdout:5/682: write d1/d8/d20/d62/d65/f15 [4936572,28716] 0 2024-03-22T07:28:44.265 INFO:tasks.workunit.client.1.smithi195.stdout:3/889: dread d3/fd [0,4194304] 0 2024-03-22T07:28:44.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/881: dwrite d1/de/d11/d48/d52/d46/fd1 [0,4194304] 0 2024-03-22T07:28:44.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/882: chown d1/de/d11/d48/c109 124588 1 2024-03-22T07:28:44.270 INFO:tasks.workunit.client.0.smithi134.stdout:7/883: dread - d1/dae/f108 zero size 2024-03-22T07:28:44.275 INFO:tasks.workunit.client.0.smithi134.stdout:7/884: mknod d1/da8/c118 0 2024-03-22T07:28:44.275 INFO:tasks.workunit.client.0.smithi134.stdout:7/885: stat d1/de/d41/d87/l10b 0 2024-03-22T07:28:44.276 INFO:tasks.workunit.client.0.smithi134.stdout:6/534: creat d2/d1b/d4d/fc7 x:0 0 0 2024-03-22T07:28:44.276 INFO:tasks.workunit.client.0.smithi134.stdout:6/535: creat d2/d6e/fc8 x:0 0 0 2024-03-22T07:28:44.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/536: truncate d2/d1b/f29 4525136 0 2024-03-22T07:28:44.279 INFO:tasks.workunit.client.1.smithi195.stdout:2/926: dwrite d2/d3/d7/d19/d22/d26/d3c/f9e [0,4194304] 0 2024-03-22T07:28:44.279 INFO:tasks.workunit.client.1.smithi195.stdout:2/927: chown d2/d3/d21/d40/cc1 180338 1 2024-03-22T07:28:44.280 INFO:tasks.workunit.client.0.smithi134.stdout:6/537: creat d2/d1b/daa/fc9 x:0 0 0 2024-03-22T07:28:44.281 INFO:tasks.workunit.client.1.smithi195.stdout:2/928: truncate d2/d3/d21/d40/f9b 1880926 0 2024-03-22T07:28:44.282 INFO:tasks.workunit.client.0.smithi134.stdout:6/538: rmdir d2/d3f/d99/dab 39 2024-03-22T07:28:44.282 INFO:tasks.workunit.client.0.smithi134.stdout:6/539: write d2/d1b/f6c [5073637,66256] 0 2024-03-22T07:28:44.284 INFO:tasks.workunit.client.1.smithi195.stdout:2/929: truncate d2/fcd 4012133 0 2024-03-22T07:28:44.284 INFO:tasks.workunit.client.1.smithi195.stdout:2/930: dread - d2/d3/d7/da/d4e/f8d zero size 2024-03-22T07:28:44.295 INFO:tasks.workunit.client.0.smithi134.stdout:4/709: rmdir d2 39 2024-03-22T07:28:44.296 INFO:tasks.workunit.client.0.smithi134.stdout:4/710: dread - d2/d25/fe9 zero size 2024-03-22T07:28:44.296 INFO:tasks.workunit.client.0.smithi134.stdout:4/711: chown d2/d2a/d93/cbe 111261 1 2024-03-22T07:28:44.296 INFO:tasks.workunit.client.0.smithi134.stdout:4/712: dread - d2/d2a/ff8 zero size 2024-03-22T07:28:44.296 INFO:tasks.workunit.client.0.smithi134.stdout:4/713: write d2/f46 [4476020,54427] 0 2024-03-22T07:28:44.296 INFO:tasks.workunit.client.0.smithi134.stdout:4/714: chown d2/d25/d48/d6e/d7b/dd7 38524229 1 2024-03-22T07:28:44.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/931: dwrite d2/f4d [0,4194304] 0 2024-03-22T07:28:44.304 INFO:tasks.workunit.client.1.smithi195.stdout:2/932: write d2/d3/d7/d19/d22/d26/d99/d118/ff9 [689292,124704] 0 2024-03-22T07:28:44.305 INFO:tasks.workunit.client.1.smithi195.stdout:2/933: read d2/d3/d7/da/d4e/f10c [566220,28323] 0 2024-03-22T07:28:44.308 INFO:tasks.workunit.client.1.smithi195.stdout:5/972: rename d9/d12/de4 to d9/d22/d7b/d13e 0 2024-03-22T07:28:44.308 INFO:tasks.workunit.client.1.smithi195.stdout:5/973: chown d9/d73/da1/lf7 8362329 1 2024-03-22T07:28:44.312 INFO:tasks.workunit.client.0.smithi134.stdout:4/715: dwrite d2/d25/d74/dde/f55 [0,4194304] 0 2024-03-22T07:28:44.320 INFO:tasks.workunit.client.1.smithi195.stdout:2/934: dwrite d2/d3/d7/d19/f33 [0,4194304] 0 2024-03-22T07:28:44.320 INFO:tasks.workunit.client.1.smithi195.stdout:2/935: fdatasync d2/d3/d21/d40/fa0 0 2024-03-22T07:28:44.320 INFO:tasks.workunit.client.1.smithi195.stdout:2/936: chown d2/d3/d21/c7e 37281274 1 2024-03-22T07:28:44.322 INFO:tasks.workunit.client.0.smithi134.stdout:8/849: rename d1/d15/d42/d12 to d1/d4/d117/d11a 0 2024-03-22T07:28:44.322 INFO:tasks.workunit.client.0.smithi134.stdout:8/850: fsync d1/d4/f54 0 2024-03-22T07:28:44.324 INFO:tasks.workunit.client.1.smithi195.stdout:2/937: mkdir d2/d3/d7/d19/d22/d26/d3c/d116/d13c 0 2024-03-22T07:28:44.326 INFO:tasks.workunit.client.0.smithi134.stdout:0/730: rename dc/de/d55/d65/d82/faa to dc/de/d55/d60/fe2 0 2024-03-22T07:28:44.329 INFO:tasks.workunit.client.0.smithi134.stdout:0/731: symlink dc/d18/d89/da0/le3 0 2024-03-22T07:28:44.330 INFO:tasks.workunit.client.0.smithi134.stdout:8/851: write d1/f5d [1715227,46059] 0 2024-03-22T07:28:44.330 INFO:tasks.workunit.client.0.smithi134.stdout:8/852: getdents d1/d15/d57 0 2024-03-22T07:28:44.331 INFO:tasks.workunit.client.0.smithi134.stdout:1/726: rename d5/da/d1b/cc4 to d5/da/d1b/d27/d39/c106 0 2024-03-22T07:28:44.332 INFO:tasks.workunit.client.0.smithi134.stdout:1/727: write d5/da/d13/d1e/de7/fa2 [109134,25270] 0 2024-03-22T07:28:44.332 INFO:tasks.workunit.client.0.smithi134.stdout:0/732: symlink dc/d18/d89/da0/le4 0 2024-03-22T07:28:44.335 INFO:tasks.workunit.client.1.smithi195.stdout:2/938: write d2/d3/db/db3/feb [787048,50455] 0 2024-03-22T07:28:44.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/895: unlink d1/d4/dd/f3a 0 2024-03-22T07:28:44.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/896: dread - d1/d4/dd/d3f/fd6 zero size 2024-03-22T07:28:44.337 INFO:tasks.workunit.client.1.smithi195.stdout:0/897: fsync d1/d4/dd/df/d44/d8d/fba 0 2024-03-22T07:28:44.337 INFO:tasks.workunit.client.0.smithi134.stdout:8/853: creat d1/d15/d42/d76/dda/f11b x:0 0 0 2024-03-22T07:28:44.339 INFO:tasks.workunit.client.0.smithi134.stdout:5/683: rename d1/f60 to d1/da0/fe3 0 2024-03-22T07:28:44.339 INFO:tasks.workunit.client.0.smithi134.stdout:5/684: creat d1/d8/fe4 x:0 0 0 2024-03-22T07:28:44.340 INFO:tasks.workunit.client.0.smithi134.stdout:5/685: chown d1/d8/d16/f59 23169567 1 2024-03-22T07:28:44.341 INFO:tasks.workunit.client.0.smithi134.stdout:1/728: rmdir d5 39 2024-03-22T07:28:44.342 INFO:tasks.workunit.client.1.smithi195.stdout:2/939: creat d2/d3/d21/ddd/f13d x:0 0 0 2024-03-22T07:28:44.343 INFO:tasks.workunit.client.0.smithi134.stdout:8/854: getdents d1/d4/d117/d11a/d20/d69 0 2024-03-22T07:28:44.344 INFO:tasks.workunit.client.0.smithi134.stdout:8/855: truncate d1/d4/d117/d11a/fc6 996919 0 2024-03-22T07:28:44.346 INFO:tasks.workunit.client.1.smithi195.stdout:3/890: creat d3/df/d15/f11a x:0 0 0 2024-03-22T07:28:44.347 INFO:tasks.workunit.client.1.smithi195.stdout:2/940: mknod d2/d1e/c13e 0 2024-03-22T07:28:44.348 INFO:tasks.workunit.client.0.smithi134.stdout:5/686: dread d1/d8/f21 [0,4194304] 0 2024-03-22T07:28:44.348 INFO:tasks.workunit.client.0.smithi134.stdout:5/687: write d1/f73 [4841820,58433] 0 2024-03-22T07:28:44.349 INFO:tasks.workunit.client.0.smithi134.stdout:0/733: dwrite dc/de/d55/d60/fe2 [0,4194304] 0 2024-03-22T07:28:44.350 INFO:tasks.workunit.client.0.smithi134.stdout:6/540: rename d2/d3f/d99 to d2/d1b/d1d/d5e/d6f/da8/dca 0 2024-03-22T07:28:44.352 INFO:tasks.workunit.client.1.smithi195.stdout:3/891: symlink d3/d18/d89/d70/l11b 0 2024-03-22T07:28:44.355 INFO:tasks.workunit.client.1.smithi195.stdout:0/898: dread d1/d4/dd/df/d6b/ffc [0,4194304] 0 2024-03-22T07:28:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:2/941: unlink d2/d3/d7/d19/f28 0 2024-03-22T07:28:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:2/942: fsync d2/d3/d7/d19/d22/f12f 0 2024-03-22T07:28:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:2/943: fdatasync d2/d3/f79 0 2024-03-22T07:28:44.356 INFO:tasks.workunit.client.1.smithi195.stdout:3/892: dread d3/df/d15/d1d/d5c/d47/d67/d80/f8f [0,4194304] 0 2024-03-22T07:28:44.357 INFO:tasks.workunit.client.0.smithi134.stdout:8/856: mkdir d1/d15/d7b/d83/de3/d11c 0 2024-03-22T07:28:44.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/688: dread d1/fa6 [0,4194304] 0 2024-03-22T07:28:44.360 INFO:tasks.workunit.client.0.smithi134.stdout:6/541: write d2/d1b/d4d/f90 [1725407,84533] 0 2024-03-22T07:28:44.360 INFO:tasks.workunit.client.1.smithi195.stdout:2/944: symlink d2/d3/d21/d60/d81/dfd/l13f 0 2024-03-22T07:28:44.362 INFO:tasks.workunit.client.0.smithi134.stdout:4/716: rename d2/d15/d35/f78 to d2/d25/d74/dde/dc0/de5/ffb 0 2024-03-22T07:28:44.364 INFO:tasks.workunit.client.1.smithi195.stdout:3/893: unlink d3/df/d50/c5b 0 2024-03-22T07:28:44.365 INFO:tasks.workunit.client.1.smithi195.stdout:3/894: truncate d3/df/d15/d1d/d5c/f83 4886669 0 2024-03-22T07:28:44.365 INFO:tasks.workunit.client.1.smithi195.stdout:3/895: write d3/df/d15/d1d/d5c/f6c [677865,87444] 0 2024-03-22T07:28:44.365 INFO:tasks.workunit.client.0.smithi134.stdout:6/542: dread d2/f1c [4194304,4194304] 0 2024-03-22T07:28:44.367 INFO:tasks.workunit.client.1.smithi195.stdout:2/945: creat d2/d3/d7/d19/d22/d26/d3c/d116/f140 x:0 0 0 2024-03-22T07:28:44.367 INFO:tasks.workunit.client.1.smithi195.stdout:2/946: write d2/d3/d21/d60/d81/da8/fb7 [431456,3440] 0 2024-03-22T07:28:44.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/896: mknod d3/d18/d89/d70/db5/d117/c11c 0 2024-03-22T07:28:44.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/897: read d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea [742737,122383] 0 2024-03-22T07:28:44.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/898: write d3/d98/d115/da0/fa1 [643054,59079] 0 2024-03-22T07:28:44.369 INFO:tasks.workunit.client.1.smithi195.stdout:3/899: fsync d3/d18/d89/d70/ffd 0 2024-03-22T07:28:44.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/899: dwrite d1/d4/dd/f13 [0,4194304] 0 2024-03-22T07:28:44.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/900: write d1/d4/d83/f106 [875108,36221] 0 2024-03-22T07:28:44.370 INFO:tasks.workunit.client.1.smithi195.stdout:0/901: readlink d1/l2 0 2024-03-22T07:28:44.370 INFO:tasks.workunit.client.0.smithi134.stdout:8/857: link d1/d4/d61/fed d1/d15/d42/d9e/dbd/f11d 0 2024-03-22T07:28:44.371 INFO:tasks.workunit.client.1.smithi195.stdout:2/947: unlink d2/d3/d21/d60/d81/l10e 0 2024-03-22T07:28:44.374 INFO:tasks.workunit.client.1.smithi195.stdout:0/902: mkdir d1/d10/d4d/da6/d119 0 2024-03-22T07:28:44.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/900: write d3/d22/f8a [3550108,71132] 0 2024-03-22T07:28:44.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/901: fsync d3/d98/d115/da0/dd1/f108 0 2024-03-22T07:28:44.376 INFO:tasks.workunit.client.1.smithi195.stdout:3/902: readlink d3/df/d50/l10d 0 2024-03-22T07:28:44.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/729: rename d5/d93/f94 to d5/d1d/dd0/ddc/de3/df6/f107 0 2024-03-22T07:28:44.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/730: write d5/da/d13/d1e/d63/d9d/f101 [318298,9584] 0 2024-03-22T07:28:44.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/731: fdatasync d5/da/d13/f98 0 2024-03-22T07:28:44.383 INFO:tasks.workunit.client.0.smithi134.stdout:1/732: chown d5/da/f86 12643 1 2024-03-22T07:28:44.383 INFO:tasks.workunit.client.0.smithi134.stdout:4/717: mkdir d2/d25/dcf/dfc 0 2024-03-22T07:28:44.383 INFO:tasks.workunit.client.0.smithi134.stdout:4/718: dread - d2/d25/d74/fdd zero size 2024-03-22T07:28:44.384 INFO:tasks.workunit.client.1.smithi195.stdout:2/948: mknod d2/d3/db/db3/c141 0 2024-03-22T07:28:44.389 INFO:tasks.workunit.client.0.smithi134.stdout:1/733: write d5/da/d13/d1e/d34/f59 [3812294,121831] 0 2024-03-22T07:28:44.389 INFO:tasks.workunit.client.0.smithi134.stdout:8/858: rename d1/d15/d42/d25/d6f/ddb to d1/d15/d42/d25/d6f/d11e 0 2024-03-22T07:28:44.389 INFO:tasks.workunit.client.0.smithi134.stdout:1/734: write d5/da/f21 [3755049,91704] 0 2024-03-22T07:28:44.390 INFO:tasks.workunit.client.0.smithi134.stdout:5/689: truncate d1/d8/d20/d62/f92 117476 0 2024-03-22T07:28:44.390 INFO:tasks.workunit.client.0.smithi134.stdout:5/690: stat d1/d8/d83 0 2024-03-22T07:28:44.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/859: creat d1/d15/d7b/d83/f11f x:0 0 0 2024-03-22T07:28:44.395 INFO:tasks.workunit.client.0.smithi134.stdout:8/860: write d1/d4/d6e/fb8 [1504175,83585] 0 2024-03-22T07:28:44.397 INFO:tasks.workunit.client.0.smithi134.stdout:5/691: truncate d1/d8/d20/f30 9302 0 2024-03-22T07:28:44.399 INFO:tasks.workunit.client.0.smithi134.stdout:4/719: dwrite d2/fd [0,4194304] 0 2024-03-22T07:28:44.400 INFO:tasks.workunit.client.0.smithi134.stdout:8/861: creat d1/d46/d75/d8b/f120 x:0 0 0 2024-03-22T07:28:44.402 INFO:tasks.workunit.client.0.smithi134.stdout:5/692: write d1/d8/d20/d62/d65/f1e [3045629,75783] 0 2024-03-22T07:28:44.402 INFO:tasks.workunit.client.0.smithi134.stdout:5/693: chown d1/d8/dc5/f9b 28079 1 2024-03-22T07:28:44.402 INFO:tasks.workunit.client.0.smithi134.stdout:5/694: creat d1/d8/d16/dbd/fe5 x:0 0 0 2024-03-22T07:28:44.405 INFO:tasks.workunit.client.0.smithi134.stdout:8/862: creat d1/d15/d42/d76/d8f/f121 x:0 0 0 2024-03-22T07:28:44.405 INFO:tasks.workunit.client.0.smithi134.stdout:8/863: creat d1/d15/d42/d76/d8f/f122 x:0 0 0 2024-03-22T07:28:44.409 INFO:tasks.workunit.client.1.smithi195.stdout:1/798: rename d0/d2/d27/c5e to d0/d2/c108 0 2024-03-22T07:28:44.410 INFO:tasks.workunit.client.0.smithi134.stdout:4/720: write d2/fd [3841481,66588] 0 2024-03-22T07:28:44.410 INFO:tasks.workunit.client.0.smithi134.stdout:4/721: readlink d2/d2a/d80/dd6/la6 0 2024-03-22T07:28:44.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/735: dwrite d5/da/d13/d1e/de7/fa2 [0,4194304] 0 2024-03-22T07:28:44.415 INFO:tasks.workunit.client.0.smithi134.stdout:4/722: symlink d2/d25/d48/d6e/dc6/lfd 0 2024-03-22T07:28:44.417 INFO:tasks.workunit.client.0.smithi134.stdout:1/736: creat d5/da/d1b/de5/f108 x:0 0 0 2024-03-22T07:28:44.419 INFO:tasks.workunit.client.0.smithi134.stdout:4/723: mknod d2/d15/d35/da8/dec/cfe 0 2024-03-22T07:28:44.423 INFO:tasks.workunit.client.1.smithi195.stdout:5/974: rename d9/d2d/d8f/lf3 to d9/d73/dbb/l13f 0 2024-03-22T07:28:44.424 INFO:tasks.workunit.client.1.smithi195.stdout:1/799: symlink d0/d2/d27/l109 0 2024-03-22T07:28:44.425 INFO:tasks.workunit.client.0.smithi134.stdout:8/864: dwrite d1/d46/d75/d8b/db4/fcd [0,4194304] 0 2024-03-22T07:28:44.427 INFO:tasks.workunit.client.1.smithi195.stdout:3/903: rename f0 to d3/df/d15/d1d/d5c/d47/d67/f11d 0 2024-03-22T07:28:44.433 INFO:tasks.workunit.client.1.smithi195.stdout:1/800: creat d0/d2/d6/dad/db1/d97/d39/d40/f10a x:0 0 0 2024-03-22T07:28:44.433 INFO:tasks.workunit.client.1.smithi195.stdout:1/801: readlink d0/d2/d6/dad/db1/d97/d39/d40/lcb 0 2024-03-22T07:28:44.433 INFO:tasks.workunit.client.1.smithi195.stdout:1/802: stat d0/d2/d27/d91/dc8/d2a/d6f 0 2024-03-22T07:28:44.435 INFO:tasks.workunit.client.0.smithi134.stdout:8/865: truncate d1/d15/f19 1247139 0 2024-03-22T07:28:44.437 INFO:tasks.workunit.client.1.smithi195.stdout:2/949: rename d2/d1e/l87 to d2/d3/db/db3/l142 0 2024-03-22T07:28:44.440 INFO:tasks.workunit.client.1.smithi195.stdout:1/803: symlink d0/d2/d27/d91/dc8/d2a/da0/l10b 0 2024-03-22T07:28:44.441 INFO:tasks.workunit.client.0.smithi134.stdout:1/737: dwrite d5/da/d13/db9/fba [0,4194304] 0 2024-03-22T07:28:44.443 INFO:tasks.workunit.client.1.smithi195.stdout:1/804: creat d0/dd5/f10c x:0 0 0 2024-03-22T07:28:44.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/738: mkdir d5/da/d1b/d27/dae/d109 0 2024-03-22T07:28:44.446 INFO:tasks.workunit.client.1.smithi195.stdout:1/805: symlink d0/d2/d27/d91/dc8/da4/dc0/l10d 0 2024-03-22T07:28:44.447 INFO:tasks.workunit.client.0.smithi134.stdout:8/866: dread d1/d15/d42/f28 [0,4194304] 0 2024-03-22T07:28:44.447 INFO:tasks.workunit.client.0.smithi134.stdout:8/867: chown d1/d4/lc 10163 1 2024-03-22T07:28:44.447 INFO:tasks.workunit.client.0.smithi134.stdout:1/739: symlink d5/da/d1b/d27/dae/l10a 0 2024-03-22T07:28:44.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/740: mkdir d5/da/d13/dac/d10b 0 2024-03-22T07:28:44.449 INFO:tasks.workunit.client.0.smithi134.stdout:1/741: chown d5/da 0 1 2024-03-22T07:28:44.455 INFO:tasks.workunit.client.0.smithi134.stdout:6/543: getdents d2/d1b/d4d 0 2024-03-22T07:28:44.455 INFO:tasks.workunit.client.0.smithi134.stdout:6/544: dread - d2/d1b/d1d/d5e/fc0 zero size 2024-03-22T07:28:44.456 INFO:tasks.workunit.client.1.smithi195.stdout:2/950: dwrite d2/d3/d7/d19/fe0 [0,4194304] 0 2024-03-22T07:28:44.457 INFO:tasks.workunit.client.0.smithi134.stdout:4/724: dwrite d2/d25/d74/dde/fdf [0,4194304] 0 2024-03-22T07:28:44.457 INFO:tasks.workunit.client.0.smithi134.stdout:4/725: write d2/d25/d74/fdd [980131,84251] 0 2024-03-22T07:28:44.458 INFO:tasks.workunit.client.0.smithi134.stdout:4/726: write d2/d2a/d80/d85/faa [292656,29655] 0 2024-03-22T07:28:44.459 INFO:tasks.workunit.client.0.smithi134.stdout:6/545: creat d2/d3f/d28/d97/fcb x:0 0 0 2024-03-22T07:28:44.462 INFO:tasks.workunit.client.0.smithi134.stdout:8/868: write d1/d15/d42/d25/d6f/d11e/f9b [3432037,37295] 0 2024-03-22T07:28:44.463 INFO:tasks.workunit.client.1.smithi195.stdout:3/904: dwrite d3/df/d15/fd8 [0,4194304] 0 2024-03-22T07:28:44.463 INFO:tasks.workunit.client.0.smithi134.stdout:8/869: write d1/d46/f9c [93431,13572] 0 2024-03-22T07:28:44.463 INFO:tasks.workunit.client.0.smithi134.stdout:8/870: chown d1/d4/d38/l56 1014027 1 2024-03-22T07:28:44.465 INFO:tasks.workunit.client.1.smithi195.stdout:2/951: rename d2/d3/d21/d40/c49 to d2/d3/d21/d60/d81/c143 0 2024-03-22T07:28:44.465 INFO:tasks.workunit.client.1.smithi195.stdout:2/952: dread - d2/d3/d21/d40/fa0 zero size 2024-03-22T07:28:44.468 INFO:tasks.workunit.client.1.smithi195.stdout:4/905: mknod d13/d15/c132 0 2024-03-22T07:28:44.470 INFO:tasks.workunit.client.1.smithi195.stdout:3/905: write d3/df/d15/d1d/f31 [8236293,6434] 0 2024-03-22T07:28:44.472 INFO:tasks.workunit.client.1.smithi195.stdout:1/806: dwrite d0/d2/d6/dad/db1/d97/d39/d40/f10a [0,4194304] 0 2024-03-22T07:28:44.472 INFO:tasks.workunit.client.1.smithi195.stdout:1/807: dread - d0/d2/d27/d91/dc8/da4/dc0/dfa/f105 zero size 2024-03-22T07:28:44.473 INFO:tasks.workunit.client.1.smithi195.stdout:2/953: mkdir d2/d122/d144 0 2024-03-22T07:28:44.473 INFO:tasks.workunit.client.1.smithi195.stdout:2/954: chown d2/d3/d7/d19/d22/d26/d3c/d116/d13c 0 1 2024-03-22T07:28:44.473 INFO:tasks.workunit.client.1.smithi195.stdout:2/955: write d2/d3/d7/da/d18/fee [893278,24288] 0 2024-03-22T07:28:44.474 INFO:tasks.workunit.client.1.smithi195.stdout:6/803: symlink d5/d5e/d34/d55/d3b/d6e/l120 0 2024-03-22T07:28:44.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/906: mknod d13/c133 0 2024-03-22T07:28:44.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/907: chown d13/d63/d36/d5f/la3 0 1 2024-03-22T07:28:44.476 INFO:tasks.workunit.client.1.smithi195.stdout:4/908: chown d13/d63/f18 7859 1 2024-03-22T07:28:44.478 INFO:tasks.workunit.client.1.smithi195.stdout:5/975: unlink d9/d2d/f72 0 2024-03-22T07:28:44.478 INFO:tasks.workunit.client.1.smithi195.stdout:1/808: dread d0/d2/d27/d91/dc8/d2a/fb0 [0,4194304] 0 2024-03-22T07:28:44.479 INFO:tasks.workunit.client.0.smithi134.stdout:8/871: symlink d1/d46/d75/l123 0 2024-03-22T07:28:44.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/872: truncate d1/d4/d117/d11a/d20/d41/f45 4384167 0 2024-03-22T07:28:44.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/873: write d1/d15/d57/d79/fba [658077,22632] 0 2024-03-22T07:28:44.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/874: readlink d1/d4/d117/d11a/l60 0 2024-03-22T07:28:44.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/875: chown d1/d15/d57/d79/l95 234225684 1 2024-03-22T07:28:44.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/876: write d1/f24 [2949191,92651] 0 2024-03-22T07:28:44.480 INFO:tasks.workunit.client.0.smithi134.stdout:8/877: creat d1/d15/d42/d49/f124 x:0 0 0 2024-03-22T07:28:44.483 INFO:tasks.workunit.client.1.smithi195.stdout:7/897: creat d0/d13/d14/d80/f13b x:0 0 0 2024-03-22T07:28:44.485 INFO:tasks.workunit.client.1.smithi195.stdout:2/956: creat d2/d3/d7/f145 x:0 0 0 2024-03-22T07:28:44.486 INFO:tasks.workunit.client.1.smithi195.stdout:2/957: readlink d2/d3/d21/d60/d7c/la7 0 2024-03-22T07:28:44.486 INFO:tasks.workunit.client.1.smithi195.stdout:3/906: write d3/d18/ff2 [430929,94366] 0 2024-03-22T07:28:44.488 INFO:tasks.workunit.client.1.smithi195.stdout:6/804: rename d5/d5e/d34/d55/d3b/d7f/db4 to d5/d5e/d34/d55/d3b/dc2/d121 0 2024-03-22T07:28:44.491 INFO:tasks.workunit.client.0.smithi134.stdout:8/878: dread d1/d15/d42/d25/d6f/d11e/f3e [0,4194304] 0 2024-03-22T07:28:44.493 INFO:tasks.workunit.client.1.smithi195.stdout:5/976: link d9/d12/d1d/d36/d7d/c107 d9/d12/c140 0 2024-03-22T07:28:44.495 INFO:tasks.workunit.client.0.smithi134.stdout:4/727: dwrite d2/d25/d48/d6e/f82 [0,4194304] 0 2024-03-22T07:28:44.495 INFO:tasks.workunit.client.0.smithi134.stdout:6/546: dwrite d2/d1b/d1d/d5e/d6f/da8/fc2 [0,4194304] 0 2024-03-22T07:28:44.495 INFO:tasks.workunit.client.1.smithi195.stdout:7/898: creat d0/d13/d14/d20/d40/d82/f13c x:0 0 0 2024-03-22T07:28:44.495 INFO:tasks.workunit.client.1.smithi195.stdout:7/899: stat d0/d13/d22/def 0 2024-03-22T07:28:44.498 INFO:tasks.workunit.client.1.smithi195.stdout:3/907: link d3/d98/d115/f10c d3/d18/d89/d8c/d9d/f11e 0 2024-03-22T07:28:44.498 INFO:tasks.workunit.client.1.smithi195.stdout:3/908: chown d3/df 109688784 1 2024-03-22T07:28:44.505 INFO:tasks.workunit.client.0.smithi134.stdout:8/879: dread d1/f77 [0,4194304] 0 2024-03-22T07:28:44.505 INFO:tasks.workunit.client.1.smithi195.stdout:6/805: mkdir d5/d6d/d95/d122 0 2024-03-22T07:28:44.508 INFO:tasks.workunit.client.1.smithi195.stdout:5/977: link d9/d22/f2b d9/d7f/de7/f141 0 2024-03-22T07:28:44.508 INFO:tasks.workunit.client.1.smithi195.stdout:5/978: write d9/d2d/f3b [5125717,21896] 0 2024-03-22T07:28:44.511 INFO:tasks.workunit.client.1.smithi195.stdout:3/909: creat d3/df/d15/d1d/d5c/d47/d67/d93/f11f x:0 0 0 2024-03-22T07:28:44.511 INFO:tasks.workunit.client.1.smithi195.stdout:1/809: dwrite d0/d2/d27/d91/dc8/f15 [0,4194304] 0 2024-03-22T07:28:44.512 INFO:tasks.workunit.client.1.smithi195.stdout:5/979: dread d9/f1c [0,4194304] 0 2024-03-22T07:28:44.514 INFO:tasks.workunit.client.1.smithi195.stdout:4/909: rename d13/d63/d36 to d13/d15/d6b/da6/ded/def/d134 0 2024-03-22T07:28:44.516 INFO:tasks.workunit.client.0.smithi134.stdout:6/547: dwrite d2/d1b/d4d/f74 [0,4194304] 0 2024-03-22T07:28:44.523 INFO:tasks.workunit.client.0.smithi134.stdout:8/880: fsync d1/d15/d42/d76/dda/f11b 0 2024-03-22T07:28:44.524 INFO:tasks.workunit.client.1.smithi195.stdout:6/806: dwrite d5/d5e/d34/d55/d3b/d6e/d97/fd0 [0,4194304] 0 2024-03-22T07:28:44.527 INFO:tasks.workunit.client.1.smithi195.stdout:2/958: rename d2/d1e/d93/d112/lc2 to d2/d3/d21/d60/d81/dfd/l146 0 2024-03-22T07:28:44.528 INFO:tasks.workunit.client.1.smithi195.stdout:1/810: read d0/d2/f1b [1139109,6543] 0 2024-03-22T07:28:44.529 INFO:tasks.workunit.client.0.smithi134.stdout:8/881: mknod d1/d4/d38/d106/c125 0 2024-03-22T07:28:44.529 INFO:tasks.workunit.client.0.smithi134.stdout:8/882: stat d1/d4/d117/d11a/fc6 0 2024-03-22T07:28:44.530 INFO:tasks.workunit.client.0.smithi134.stdout:8/883: getdents d1/d15/d57/d8c 0 2024-03-22T07:28:44.547 INFO:tasks.workunit.client.1.smithi195.stdout:3/910: dwrite d3/df/d15/d1d/d5c/d47/f59 [0,4194304] 0 2024-03-22T07:28:44.548 INFO:tasks.workunit.client.1.smithi195.stdout:4/910: write d13/d15/d6b/da6/ded/def/d134/fd5 [3520107,105873] 0 2024-03-22T07:28:44.549 INFO:tasks.workunit.client.1.smithi195.stdout:5/980: dwrite d9/d2d/f100 [0,4194304] 0 2024-03-22T07:28:44.550 INFO:tasks.workunit.client.1.smithi195.stdout:5/981: creat d9/d2d/d8f/f142 x:0 0 0 2024-03-22T07:28:44.552 INFO:tasks.workunit.client.1.smithi195.stdout:4/911: dread d13/d15/d6b/da6/ded/def/d134/fbf [0,4194304] 0 2024-03-22T07:28:44.554 INFO:tasks.workunit.client.1.smithi195.stdout:5/982: mknod d9/d2d/d84/c143 0 2024-03-22T07:28:44.555 INFO:tasks.workunit.client.1.smithi195.stdout:3/911: truncate d3/d98/d115/da0/fa1 446761 0 2024-03-22T07:28:44.558 INFO:tasks.workunit.client.1.smithi195.stdout:3/912: symlink d3/d18/l120 0 2024-03-22T07:28:44.561 INFO:tasks.workunit.client.0.smithi134.stdout:5/695: rename d1/d8/d20/f30 to d1/d8/d83/fe6 0 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/983: dread f0 [0,4194304] 0 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/984: dread - d9/d2d/d84/f104 zero size 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/985: stat d9/la 0 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/986: fsync d9/f6f 0 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/987: creat d9/d12/d1d/d69/d78/d41/f144 x:0 0 0 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/988: chown d9/d2d/d84/l87 1277882 1 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/989: stat d9/d22/dd1/fe8 0 2024-03-22T07:28:44.562 INFO:tasks.workunit.client.1.smithi195.stdout:5/990: chown d9/d73/dbb 49131 1 2024-03-22T07:28:44.563 INFO:tasks.workunit.client.0.smithi134.stdout:1/742: rename d5/d1d/d49/f95 to d5/d1d/dd0/f10c 0 2024-03-22T07:28:44.566 INFO:tasks.workunit.client.0.smithi134.stdout:5/696: creat d1/d8/d16/dbd/dc0/fe7 x:0 0 0 2024-03-22T07:28:44.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/807: dwrite d5/d5e/d34/d55/d3b/dc2/f11f [0,4194304] 0 2024-03-22T07:28:44.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/808: fsync d5/d5e/d34/d55/d3b/dc2/f11f 0 2024-03-22T07:28:44.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/809: write d5/f1e [766344,82760] 0 2024-03-22T07:28:44.568 INFO:tasks.workunit.client.1.smithi195.stdout:6/810: getdents d5/d5e/d34/d55/d3b/d6e/d97/d112 0 2024-03-22T07:28:44.573 INFO:tasks.workunit.client.0.smithi134.stdout:8/884: dwrite d1/ffd [0,4194304] 0 2024-03-22T07:28:44.576 INFO:tasks.workunit.client.0.smithi134.stdout:4/728: rename d2/d25/d48/lb4 to d2/d98/lff 0 2024-03-22T07:28:44.580 INFO:tasks.workunit.client.1.smithi195.stdout:2/959: dwrite d2/d3/db/d82/fd0 [0,4194304] 0 2024-03-22T07:28:44.580 INFO:tasks.workunit.client.1.smithi195.stdout:3/913: dwrite d3/df/d15/d1d/d5c/d47/d67/d93/f11f [0,4194304] 0 2024-03-22T07:28:44.580 INFO:tasks.workunit.client.1.smithi195.stdout:4/912: dwrite d13/d15/d6b/ffa [0,4194304] 0 2024-03-22T07:28:44.580 INFO:tasks.workunit.client.1.smithi195.stdout:1/811: dwrite d0/d2/fd6 [0,4194304] 0 2024-03-22T07:28:44.581 INFO:tasks.workunit.client.1.smithi195.stdout:6/811: getdents d5/d16/d45/df8/d104/da2/d82 0 2024-03-22T07:28:44.585 INFO:tasks.workunit.client.0.smithi134.stdout:1/743: dwrite d5/da/d13/d1e/d63/f97 [0,4194304] 0 2024-03-22T07:28:44.586 INFO:tasks.workunit.client.1.smithi195.stdout:2/960: truncate d2/d3/d7/d19/d22/d26/d3c/d116/f140 145874 0 2024-03-22T07:28:44.588 INFO:tasks.workunit.client.0.smithi134.stdout:6/548: rename d2/d1b/d1d/d5e/d6f/da8/dca/dab to d2/d1b/d1d/dcc 0 2024-03-22T07:28:44.591 INFO:tasks.workunit.client.0.smithi134.stdout:4/729: symlink d2/d25/l100 0 2024-03-22T07:28:44.600 INFO:tasks.workunit.client.0.smithi134.stdout:4/730: dread d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:44.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/914: truncate d3/d98/d115/fdc 11042 0 2024-03-22T07:28:44.601 INFO:tasks.workunit.client.1.smithi195.stdout:3/915: chown d3/df/l95 7286074 1 2024-03-22T07:28:44.603 INFO:tasks.workunit.client.1.smithi195.stdout:4/913: rmdir d13/d15/d6b/dd0/df3 39 2024-03-22T07:28:44.608 INFO:tasks.workunit.client.0.smithi134.stdout:6/549: dwrite d2/d3f/d28/d6b/f8e [0,4194304] 0 2024-03-22T07:28:44.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/550: getdents d2/d1b 0 2024-03-22T07:28:44.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/551: write d2/d1b/f6c [3284231,95133] 0 2024-03-22T07:28:44.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/552: stat d2/l3b 0 2024-03-22T07:28:44.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/553: dread - d2/d1b/d1d/d5e/d6f/d7d/f85 zero size 2024-03-22T07:28:44.609 INFO:tasks.workunit.client.1.smithi195.stdout:1/812: creat d0/d2/d6/dad/db1/d97/d39/d40/db3/f10e x:0 0 0 2024-03-22T07:28:44.609 INFO:tasks.workunit.client.1.smithi195.stdout:1/813: write d0/d2/d27/d91/dc8/da4/ff9 [5001381,94226] 0 2024-03-22T07:28:44.610 INFO:tasks.workunit.client.0.smithi134.stdout:6/554: write d2/d1b/d4d/d65/fa0 [56932,35120] 0 2024-03-22T07:28:44.610 INFO:tasks.workunit.client.0.smithi134.stdout:1/744: mkdir d5/da/d68/d10d 0 2024-03-22T07:28:44.611 INFO:tasks.workunit.client.0.smithi134.stdout:6/555: truncate d2/d1b/d1d/d5e/d6f/d7d/f85 262895 0 2024-03-22T07:28:44.612 INFO:tasks.workunit.client.0.smithi134.stdout:1/745: write d5/da/d13/d1e/d9b/f9f [551086,83485] 0 2024-03-22T07:28:44.613 INFO:tasks.workunit.client.1.smithi195.stdout:6/812: mkdir d5/d5e/d34/d55/d3b/d6e/d3c/d123 0 2024-03-22T07:28:44.613 INFO:tasks.workunit.client.1.smithi195.stdout:6/813: write d5/d5e/d34/d55/d3b/d6e/d97/fb5 [1496999,27533] 0 2024-03-22T07:28:44.613 INFO:tasks.workunit.client.1.smithi195.stdout:6/814: creat d5/d5e/d34/d55/dab/dbf/f124 x:0 0 0 2024-03-22T07:28:44.615 INFO:tasks.workunit.client.0.smithi134.stdout:8/885: rename d1/d46/d75/d8b/db4/d102/f108 to d1/d15/d7b/f126 0 2024-03-22T07:28:44.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/731: getdents d2/d15/d35/da8/dec 0 2024-03-22T07:28:44.617 INFO:tasks.workunit.client.0.smithi134.stdout:4/732: fdatasync d2/d15/fdb 0 2024-03-22T07:28:44.620 INFO:tasks.workunit.client.1.smithi195.stdout:2/961: dread d2/d3/d21/d4c/f52 [0,4194304] 0 2024-03-22T07:28:44.624 INFO:tasks.workunit.client.1.smithi195.stdout:3/916: link d3/df/d15/d1d/d5c/d47/d67/d80/d87/dd9/fdb d3/d18/d89/d70/db5/d117/f121 0 2024-03-22T07:28:44.626 INFO:tasks.workunit.client.1.smithi195.stdout:4/914: rename d13/d63/d21/c26 to d13/d63/c135 0 2024-03-22T07:28:44.631 INFO:tasks.workunit.client.0.smithi134.stdout:8/886: rmdir d1/d4/d61 39 2024-03-22T07:28:44.634 INFO:tasks.workunit.client.0.smithi134.stdout:1/746: truncate f4 7363784 0 2024-03-22T07:28:44.636 INFO:tasks.workunit.client.1.smithi195.stdout:6/815: creat d5/d16/f125 x:0 0 0 2024-03-22T07:28:44.638 INFO:tasks.workunit.client.0.smithi134.stdout:8/887: rename d1/d4/d117/d11a/d20/d69/cc3 to d1/d15/d42/d76/de1/c127 0 2024-03-22T07:28:44.641 INFO:tasks.workunit.client.0.smithi134.stdout:4/733: dwrite d2/d25/dcf/fda [0,4194304] 0 2024-03-22T07:28:44.642 INFO:tasks.workunit.client.0.smithi134.stdout:1/747: rename d5/da/d13/d1e/d62/l6d to d5/da/d68/da1/l10e 0 2024-03-22T07:28:44.642 INFO:tasks.workunit.client.0.smithi134.stdout:1/748: creat d5/da/d1b/d27/f10f x:0 0 0 2024-03-22T07:28:44.645 INFO:tasks.workunit.client.1.smithi195.stdout:4/915: dwrite d13/d63/d3e/f97 [0,4194304] 0 2024-03-22T07:28:44.646 INFO:tasks.workunit.client.0.smithi134.stdout:4/734: mkdir d2/d2a/d80/d101 0 2024-03-22T07:28:44.647 INFO:tasks.workunit.client.1.smithi195.stdout:4/916: dread d13/d15/faf [0,4194304] 0 2024-03-22T07:28:44.648 INFO:tasks.workunit.client.0.smithi134.stdout:8/888: rename d1/fde to d1/d15/d7b/d83/de3/da2/f128 0 2024-03-22T07:28:44.649 INFO:tasks.workunit.client.1.smithi195.stdout:6/816: dread d5/d16/d45/df8/d104/da2/d1a/f54 [0,4194304] 0 2024-03-22T07:28:44.649 INFO:tasks.workunit.client.1.smithi195.stdout:3/917: dwrite d3/df/d50/f116 [0,4194304] 0 2024-03-22T07:28:44.658 INFO:tasks.workunit.client.1.smithi195.stdout:4/917: read d13/d63/d79/de9/f88 [5172689,73220] 0 2024-03-22T07:28:44.680 INFO:tasks.workunit.client.1.smithi195.stdout:8/977: sync 2024-03-22T07:28:44.684 INFO:tasks.workunit.client.1.smithi195.stdout:5/991: fsync d9/d7f/de7/f141 0 2024-03-22T07:28:44.684 INFO:tasks.workunit.client.0.smithi134.stdout:1/749: mknod d5/da/d13/d1e/d62/dda/c110 0 2024-03-22T07:28:44.685 INFO:tasks.workunit.client.1.smithi195.stdout:2/962: getdents d2/d1e/d93 0 2024-03-22T07:28:44.685 INFO:tasks.workunit.client.1.smithi195.stdout:2/963: truncate d2/d1e/d93/d112/f128 20933 0 2024-03-22T07:28:44.686 INFO:tasks.workunit.client.1.smithi195.stdout:2/964: dread - d2/d1e/d93/d112/f125 zero size 2024-03-22T07:28:44.687 INFO:tasks.workunit.client.0.smithi134.stdout:4/735: creat d2/f102 x:0 0 0 2024-03-22T07:28:44.687 INFO:tasks.workunit.client.0.smithi134.stdout:4/736: fdatasync d2/d25/d74/dde/dc0/de5/ffb 0 2024-03-22T07:28:44.689 INFO:tasks.workunit.client.1.smithi195.stdout:6/817: dwrite d5/d16/d45/df8/d104/da2/d1a/f4d [0,4194304] 0 2024-03-22T07:28:44.697 INFO:tasks.workunit.client.0.smithi134.stdout:4/737: write d2/f62 [2264039,27554] 0 2024-03-22T07:28:44.698 INFO:tasks.workunit.client.1.smithi195.stdout:5/992: dwrite d9/d2d/d58/fb0 [0,4194304] 0 2024-03-22T07:28:44.803 INFO:tasks.workunit.client.0.smithi134.stdout:8/889: symlink d1/dce/l129 0 2024-03-22T07:28:44.807 INFO:tasks.workunit.client.1.smithi195.stdout:0/903: sync 2024-03-22T07:28:44.807 INFO:tasks.workunit.client.1.smithi195.stdout:0/904: readlink d1/d4/dd/df/d44/db4/ld3 0 2024-03-22T07:28:44.814 INFO:tasks.workunit.client.1.smithi195.stdout:3/918: creat d3/d18/d89/d76/def/df9/f122 x:0 0 0 2024-03-22T07:28:44.814 INFO:tasks.workunit.client.1.smithi195.stdout:3/919: truncate d3/df/d15/d1d/d5c/d47/f110 1023549 0 2024-03-22T07:28:44.817 INFO:tasks.workunit.client.1.smithi195.stdout:4/918: creat d13/d15/d6b/da6/ded/def/d134/d9e/f136 x:0 0 0 2024-03-22T07:28:44.818 INFO:tasks.workunit.client.0.smithi134.stdout:8/890: dwrite d1/d15/d42/d25/d6f/d11e/f9b [0,4194304] 0 2024-03-22T07:28:44.821 INFO:tasks.workunit.client.0.smithi134.stdout:1/750: rename d5/da/d1b/d27/d39/la6 to d5/d1d/ddd/l111 0 2024-03-22T07:28:44.822 INFO:tasks.workunit.client.0.smithi134.stdout:1/751: dread d5/da/d61/fc1 [0,4194304] 0 2024-03-22T07:28:44.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/978: getdents da/d17 0 2024-03-22T07:28:44.823 INFO:tasks.workunit.client.1.smithi195.stdout:8/979: chown da/de/db3/f12c 5686825 1 2024-03-22T07:28:44.823 INFO:tasks.workunit.client.1.smithi195.stdout:2/965: chown d2/d3/l11 2 1 2024-03-22T07:28:44.823 INFO:tasks.workunit.client.1.smithi195.stdout:2/966: fdatasync d2/d1e/ff2 0 2024-03-22T07:28:44.824 INFO:tasks.workunit.client.1.smithi195.stdout:2/967: dread d2/d3/d21/d60/d81/da8/fb7 [0,4194304] 0 2024-03-22T07:28:44.827 INFO:tasks.workunit.client.1.smithi195.stdout:6/818: rename d5/d5e/d34/d55/d3b/d6e/d56/d8f/c9d to d5/d16/d45/df8/d104/ddc/c126 0 2024-03-22T07:28:44.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/738: dread d2/d2a/f4d [0,4194304] 0 2024-03-22T07:28:44.831 INFO:tasks.workunit.client.0.smithi134.stdout:4/739: unlink d2/d2a/d80/dd6/lf0 0 2024-03-22T07:28:44.831 INFO:tasks.workunit.client.0.smithi134.stdout:4/740: stat d2/d25/d74/fb6 0 2024-03-22T07:28:44.833 INFO:tasks.workunit.client.1.smithi195.stdout:5/993: creat d9/d12/d1d/d69/d78/f145 x:0 0 0 2024-03-22T07:28:44.836 INFO:tasks.workunit.client.0.smithi134.stdout:4/741: link d2/d2a/d93/cbe d2/d25/dcf/c103 0 2024-03-22T07:28:44.839 INFO:tasks.workunit.client.0.smithi134.stdout:4/742: symlink d2/d25/d48/l104 0 2024-03-22T07:28:44.839 INFO:tasks.workunit.client.0.smithi134.stdout:4/743: truncate d2/d2a/d80/dd6/fbc 211760 0 2024-03-22T07:28:44.841 INFO:tasks.workunit.client.1.smithi195.stdout:0/905: symlink d1/d4/d22/df0/l11a 0 2024-03-22T07:28:44.842 INFO:tasks.workunit.client.1.smithi195.stdout:3/920: unlink d3/df/d15/fd8 0 2024-03-22T07:28:44.843 INFO:tasks.workunit.client.0.smithi134.stdout:4/744: mknod d2/d15/d35/da8/c105 0 2024-03-22T07:28:44.845 INFO:tasks.workunit.client.1.smithi195.stdout:4/919: link d13/d15/d6b/da6/ded/def/d134/d9e/cfe d13/d63/d79/de9/d7e/d85/d101/d114/c137 0 2024-03-22T07:28:44.845 INFO:tasks.workunit.client.1.smithi195.stdout:4/920: dread - d13/d15/f128 zero size 2024-03-22T07:28:44.845 INFO:tasks.workunit.client.1.smithi195.stdout:6/819: dwrite d5/d5e/f84 [0,4194304] 0 2024-03-22T07:28:44.846 INFO:tasks.workunit.client.1.smithi195.stdout:8/980: creat da/d82/dc6/d53/d124/f132 x:0 0 0 2024-03-22T07:28:44.848 INFO:tasks.workunit.client.1.smithi195.stdout:2/968: write d2/d3/dac/ffc [941132,117826] 0 2024-03-22T07:28:44.848 INFO:tasks.workunit.client.1.smithi195.stdout:2/969: fsync d2/d3/d21/d40/f5d 0 2024-03-22T07:28:44.849 INFO:tasks.workunit.client.1.smithi195.stdout:5/994: unlink d9/d12/d1d/d69/d78/c43 0 2024-03-22T07:28:44.852 INFO:tasks.workunit.client.1.smithi195.stdout:0/906: creat d1/d4/dd/df/d44/d6f/dcb/dfa/f11b x:0 0 0 2024-03-22T07:28:44.854 INFO:tasks.workunit.client.1.smithi195.stdout:3/921: rename d3/df/d15/d1d/lf6 to d3/d98/l123 0 2024-03-22T07:28:44.857 INFO:tasks.workunit.client.1.smithi195.stdout:4/921: creat d13/d15/d6b/da6/ded/def/d134/d5f/d83/f138 x:0 0 0 2024-03-22T07:28:44.861 INFO:tasks.workunit.client.1.smithi195.stdout:6/820: symlink d5/l127 0 2024-03-22T07:28:44.861 INFO:tasks.workunit.client.1.smithi195.stdout:2/970: dwrite d2/d3/d21/ffb [0,4194304] 0 2024-03-22T07:28:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:3/922: dread d3/df/d15/f103 [0,4194304] 0 2024-03-22T07:28:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/981: rmdir da/d82/dc6 39 2024-03-22T07:28:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/982: creat da/d17/d32/d61/d88/f133 x:0 0 0 2024-03-22T07:28:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/983: stat da/d82/dc6/d53/f89 0 2024-03-22T07:28:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/984: stat da/de/c11a 0 2024-03-22T07:28:44.863 INFO:tasks.workunit.client.1.smithi195.stdout:8/985: dread da/d17/d32/d61/d88/f121 [4194304,4194304] 0 2024-03-22T07:28:44.864 INFO:tasks.workunit.client.1.smithi195.stdout:8/986: chown da/d17/d32/d61/d88/d91 229870052 1 2024-03-22T07:28:44.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/987: write da/d17/d32/d61/d88/d91/fa8 [81691,84941] 0 2024-03-22T07:28:44.865 INFO:tasks.workunit.client.1.smithi195.stdout:8/988: chown da/d17/d32/d61/f117 0 1 2024-03-22T07:28:44.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/922: write d13/d63/d79/de9/fbd [4462365,72989] 0 2024-03-22T07:28:44.866 INFO:tasks.workunit.client.1.smithi195.stdout:5/995: link d9/d2d/d84/cea d9/d2d/d8f/c146 0 2024-03-22T07:28:44.866 INFO:tasks.workunit.client.1.smithi195.stdout:5/996: fsync d9/d2d/d84/dcf/f75 0 2024-03-22T07:28:44.866 INFO:tasks.workunit.client.1.smithi195.stdout:4/923: read d13/d15/d64/f112 [12556,116482] 0 2024-03-22T07:28:44.867 INFO:tasks.workunit.client.1.smithi195.stdout:4/924: write d13/d15/d64/fc1 [368294,12658] 0 2024-03-22T07:28:44.867 INFO:tasks.workunit.client.1.smithi195.stdout:0/907: getdents d1/d4 0 2024-03-22T07:28:44.869 INFO:tasks.workunit.client.1.smithi195.stdout:6/821: symlink d5/d16/d11b/l128 0 2024-03-22T07:28:44.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/923: write d3/df/d15/d1d/f7e [2777051,44137] 0 2024-03-22T07:28:44.873 INFO:tasks.workunit.client.1.smithi195.stdout:6/822: dread d5/d5e/d34/d55/d3b/d6e/d3c/f44 [4194304,4194304] 0 2024-03-22T07:28:44.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/989: dread da/dc/f6f [0,4194304] 0 2024-03-22T07:28:44.874 INFO:tasks.workunit.client.1.smithi195.stdout:8/990: write da/d17/d32/d61/d88/d91/fc8 [4810340,90628] 0 2024-03-22T07:28:44.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/991: dread da/d82/dc6/d53/f8f [0,4194304] 0 2024-03-22T07:28:44.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/992: chown da/d17/d32/de8/l12a 77313716 1 2024-03-22T07:28:44.875 INFO:tasks.workunit.client.1.smithi195.stdout:8/993: fsync da/f4e 0 2024-03-22T07:28:44.877 INFO:tasks.workunit.client.1.smithi195.stdout:2/971: mknod d2/d3/d7/da/c147 0 2024-03-22T07:28:44.884 INFO:tasks.workunit.client.1.smithi195.stdout:2/972: dread d2/d3/d7/da/de/f35 [0,4194304] 0 2024-03-22T07:28:44.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/997: symlink d9/d12/l147 0 2024-03-22T07:28:44.884 INFO:tasks.workunit.client.1.smithi195.stdout:5/998: read d9/da8/fed [352804,22697] 0 2024-03-22T07:28:44.885 INFO:tasks.workunit.client.1.smithi195.stdout:1/814: truncate d0/d2/d27/d91/dc8/f15 3331754 0 2024-03-22T07:28:44.889 INFO:tasks.workunit.client.1.smithi195.stdout:0/908: rmdir d1/d4/dd/df/d44/d6f/dca 0 2024-03-22T07:28:44.889 INFO:tasks.workunit.client.1.smithi195.stdout:0/909: chown d1/d4/c7f 22559 1 2024-03-22T07:28:44.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/924: mknod d3/d98/d115/da0/dd1/c124 0 2024-03-22T07:28:44.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/925: chown d3/df/c3d 154 1 2024-03-22T07:28:44.890 INFO:tasks.workunit.client.1.smithi195.stdout:3/926: write d3/df/d15/d1d/d5c/d47/d67/d80/db8/fea [974826,109369] 0 2024-03-22T07:28:44.891 INFO:tasks.workunit.client.1.smithi195.stdout:6/823: truncate d5/d5e/d34/d55/d3b/d6e/d3c/f70 118621 0 2024-03-22T07:28:44.891 INFO:tasks.workunit.client.1.smithi195.stdout:8/994: getdents da/de/db3/dc7/dd3 0 2024-03-22T07:28:44.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/973: rmdir d2/d3/d21/d60/d81/dfd 39 2024-03-22T07:28:44.893 INFO:tasks.workunit.client.1.smithi195.stdout:2/974: creat d2/d3/d7/d5c/da4/f148 x:0 0 0 2024-03-22T07:28:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:5/999: creat d9/d73/da1/d137/f148 x:0 0 0 2024-03-22T07:28:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/975: dread d2/d3/d21/d60/d81/f84 [0,4194304] 0 2024-03-22T07:28:44.895 INFO:tasks.workunit.client.1.smithi195.stdout:2/976: truncate d2/d3/d7/da/d18/fee 1314677 0 2024-03-22T07:28:44.896 INFO:tasks.workunit.client.1.smithi195.stdout:1/815: creat d0/d2/d6/dad/db1/d97/d41/f10f x:0 0 0 2024-03-22T07:28:44.896 INFO:tasks.workunit.client.1.smithi195.stdout:1/816: chown d0/d2/d6/dad/db1/d97/d39/d40/dc9/le2 102193 1 2024-03-22T07:28:44.896 INFO:tasks.workunit.client.1.smithi195.stdout:1/817: creat d0/d2/d27/d91/dc8/f110 x:0 0 0 2024-03-22T07:28:44.898 INFO:tasks.workunit.client.1.smithi195.stdout:0/910: truncate d1/d4/dd/f13 3955826 0 2024-03-22T07:28:44.899 INFO:tasks.workunit.client.1.smithi195.stdout:3/927: truncate d3/df/d15/d1d/d5c/f83 2954890 0 2024-03-22T07:28:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:6/824: unlink d5/d16/f48 0 2024-03-22T07:28:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:6/825: readlink d5/d16/d45/df8/lf9 0 2024-03-22T07:28:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:6/826: getdents d5/d5e/d34 0 2024-03-22T07:28:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:6/827: fsync d5/d16/d45/df8/d104/d5f/f60 0 2024-03-22T07:28:44.904 INFO:tasks.workunit.client.1.smithi195.stdout:6/828: write d5/d5e/d34/d55/d3b/d6e/d97/f9a [4381667,43724] 0 2024-03-22T07:28:44.909 INFO:tasks.workunit.client.1.smithi195.stdout:4/925: rename d13/d15/d64 to d13/d63/d79/de9/d7e/d8c/dd2/d139 0 2024-03-22T07:28:44.911 INFO:tasks.workunit.client.1.smithi195.stdout:3/928: creat d3/d18/d89/d76/d10a/f125 x:0 0 0 2024-03-22T07:28:44.917 INFO:tasks.workunit.client.1.smithi195.stdout:6/829: dread d5/d5e/d34/d55/d3b/d6e/d3c/fb0 [0,4194304] 0 2024-03-22T07:28:44.917 INFO:tasks.workunit.client.1.smithi195.stdout:8/995: rename da/d82/f9a to da/d82/dc6/db4/d10a/f134 0 2024-03-22T07:28:44.918 INFO:tasks.workunit.client.1.smithi195.stdout:3/929: mknod d3/d18/d89/d76/def/df9/c126 0 2024-03-22T07:28:44.919 INFO:tasks.workunit.client.1.smithi195.stdout:8/996: mkdir da/d82/dc6/db4/d12f/d135 0 2024-03-22T07:28:44.920 INFO:tasks.workunit.client.1.smithi195.stdout:8/997: chown da/de/db3/ddd/cdb 371 1 2024-03-22T07:28:44.926 INFO:tasks.workunit.client.1.smithi195.stdout:0/911: dwrite d1/d4/d22/dd8/ff4 [0,4194304] 0 2024-03-22T07:28:44.933 INFO:tasks.workunit.client.1.smithi195.stdout:1/818: dwrite d0/d2/d6/f71 [0,4194304] 0 2024-03-22T07:28:44.934 INFO:tasks.workunit.client.1.smithi195.stdout:0/912: creat d1/d4/d12/f11c x:0 0 0 2024-03-22T07:28:44.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/977: dwrite d2/d3/d21/ddd/ff3 [0,4194304] 0 2024-03-22T07:28:44.936 INFO:tasks.workunit.client.1.smithi195.stdout:2/978: write d2/d3/d7/d19/d22/d26/f4b [2780793,26435] 0 2024-03-22T07:28:44.938 INFO:tasks.workunit.client.1.smithi195.stdout:1/819: rmdir d0/d2/d6/dad/db1/d97/d41/d47 39 2024-03-22T07:28:44.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/830: dread d5/d16/d45/df8/d104/da2/d4a/f5c [0,4194304] 0 2024-03-22T07:28:44.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/831: write d5/d16/d45/df8/d104/da2/d4a/f5c [5217575,110088] 0 2024-03-22T07:28:44.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/832: dread - d5/d5e/d34/d55/dab/dbf/f124 zero size 2024-03-22T07:28:44.939 INFO:tasks.workunit.client.1.smithi195.stdout:6/833: stat d5/d5e/dc0/f113 0 2024-03-22T07:28:44.940 INFO:tasks.workunit.client.1.smithi195.stdout:2/979: creat d2/d122/d144/f149 x:0 0 0 2024-03-22T07:28:44.944 INFO:tasks.workunit.client.1.smithi195.stdout:0/913: write d1/d4/d12/d6c/dbc/d43/f53 [3877268,36403] 0 2024-03-22T07:28:44.949 INFO:tasks.workunit.client.1.smithi195.stdout:0/914: creat d1/da2/f11d x:0 0 0 2024-03-22T07:28:44.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/900: sync 2024-03-22T07:28:44.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/901: write d0/fdc [618378,106706] 0 2024-03-22T07:28:44.951 INFO:tasks.workunit.client.1.smithi195.stdout:7/902: fdatasync d0/d13/d22/d57/d7b/f134 0 2024-03-22T07:28:44.952 INFO:tasks.workunit.client.1.smithi195.stdout:0/915: getdents d1/d10/d4d/da6 0 2024-03-22T07:28:44.955 INFO:tasks.workunit.client.1.smithi195.stdout:0/916: symlink d1/d4/d12/d6c/dbc/d47/db6/l11e 0 2024-03-22T07:28:44.955 INFO:tasks.workunit.client.1.smithi195.stdout:0/917: write d1/d4/f7 [2124523,118317] 0 2024-03-22T07:28:44.956 INFO:tasks.workunit.client.1.smithi195.stdout:0/918: symlink d1/d4/dd/df/d44/d8d/l11f 0 2024-03-22T07:28:44.956 INFO:tasks.workunit.client.1.smithi195.stdout:0/919: read - d1/d4/dd/d3f/fd6 zero size 2024-03-22T07:28:44.957 INFO:tasks.workunit.client.1.smithi195.stdout:0/920: write d1/d4/dd/df/d44/d8d/fc4 [1773140,55737] 0 2024-03-22T07:28:44.957 INFO:tasks.workunit.client.1.smithi195.stdout:0/921: mknod d1/d4/dd/df/d44/d6f/c120 0 2024-03-22T07:28:44.958 INFO:tasks.workunit.client.1.smithi195.stdout:7/903: write d0/d13/d14/d20/d40/d82/da0/d59/f5f [1809493,42195] 0 2024-03-22T07:28:44.958 INFO:tasks.workunit.client.1.smithi195.stdout:1/820: dread d0/d2/d6/dad/db1/d97/d39/d40/f43 [0,4194304] 0 2024-03-22T07:28:44.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/821: creat d0/dd5/f111 x:0 0 0 2024-03-22T07:28:44.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/822: creat d0/d2/d6/dad/df2/f112 x:0 0 0 2024-03-22T07:28:44.960 INFO:tasks.workunit.client.1.smithi195.stdout:0/922: link d1/d4/d12/d6c/dbc/d47/db6/fd5 d1/d10/d1f/dbf/d104/f121 0 2024-03-22T07:28:44.966 INFO:tasks.workunit.client.1.smithi195.stdout:0/923: symlink d1/d4/dd/df/d2b/l122 0 2024-03-22T07:28:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:0/924: creat d1/d4/d12/d6c/d89/f123 x:0 0 0 2024-03-22T07:28:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:0/925: truncate d1/d4/d12/d6c/d7b/f10a 588813 0 2024-03-22T07:28:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:0/926: readlink d1/d4/dd/df/d44/db4/led 0 2024-03-22T07:28:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/904: getdents d0/d13/d14/d80 0 2024-03-22T07:28:44.967 INFO:tasks.workunit.client.1.smithi195.stdout:7/905: fsync d0/d13/d14/f30 0 2024-03-22T07:28:44.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/930: dwrite d3/d98/d115/f10c [4194304,4194304] 0 2024-03-22T07:28:44.975 INFO:tasks.workunit.client.1.smithi195.stdout:3/931: write d3/d18/d89/d70/db5/d117/f121 [829512,127337] 0 2024-03-22T07:28:44.977 INFO:tasks.workunit.client.1.smithi195.stdout:3/932: mknod d3/df/d15/d1d/d5c/d47/d67/d93/c127 0 2024-03-22T07:28:44.978 INFO:tasks.workunit.client.1.smithi195.stdout:6/834: dwrite d5/d5e/d34/d55/d3b/d6e/d56/d8f/fa8 [0,4194304] 0 2024-03-22T07:28:44.979 INFO:tasks.workunit.client.1.smithi195.stdout:3/933: getdents d3/d98/d115 0 2024-03-22T07:28:44.979 INFO:tasks.workunit.client.1.smithi195.stdout:0/927: dread d1/d4/dd/df/d44/d8d/fba [0,4194304] 0 2024-03-22T07:28:44.981 INFO:tasks.workunit.client.1.smithi195.stdout:1/823: dwrite d0/d2/d6/dad/db1/d97/d39/d40/db3/fbf [0,4194304] 0 2024-03-22T07:28:44.981 INFO:tasks.workunit.client.1.smithi195.stdout:8/998: dwrite da/f35 [0,4194304] 0 2024-03-22T07:28:44.981 INFO:tasks.workunit.client.1.smithi195.stdout:8/999: creat da/d17/d32/de8/f136 x:0 0 0 2024-03-22T07:28:44.983 INFO:tasks.workunit.client.1.smithi195.stdout:3/934: creat d3/d22/f128 x:0 0 0 2024-03-22T07:28:44.984 INFO:tasks.workunit.client.1.smithi195.stdout:0/928: mkdir d1/d10/d4d/da6/d124 0 2024-03-22T07:28:44.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/835: dread d5/d5e/d34/d55/d3b/d6e/d56/d8f/fa8 [0,4194304] 0 2024-03-22T07:28:44.985 INFO:tasks.workunit.client.1.smithi195.stdout:6/836: truncate d5/d5e/d34/d55/f36 5125299 0 2024-03-22T07:28:44.995 INFO:tasks.workunit.client.1.smithi195.stdout:3/935: symlink d3/df/d15/d1d/d5c/l129 0 2024-03-22T07:28:44.995 INFO:tasks.workunit.client.1.smithi195.stdout:7/906: dwrite d0/d13/d14/d20/d40/d82/da0/fd9 [0,4194304] 0 2024-03-22T07:28:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/929: symlink d1/d4/d12/d6c/d87/l125 0 2024-03-22T07:28:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/930: fdatasync d1/d4/dd/d66/d80/f95 0 2024-03-22T07:28:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:0/931: fsync d1/d10/d19/d20/fff 0 2024-03-22T07:28:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/837: mkdir d5/d5e/d34/d55/d3b/d6e/d3c/d129 0 2024-03-22T07:28:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/838: dread - d5/d16/d45/d53/d59/d87/ffc zero size 2024-03-22T07:28:44.996 INFO:tasks.workunit.client.1.smithi195.stdout:6/839: readlink d5/d16/d45/d53/d59/lda 0 2024-03-22T07:28:44.997 INFO:tasks.workunit.client.1.smithi195.stdout:6/840: chown d5/d16/d5b/f7c 1978 1 2024-03-22T07:28:44.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/824: rmdir d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66 39 2024-03-22T07:28:44.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/825: dread d0/d2/d6/f84 [0,4194304] 0 2024-03-22T07:28:44.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/936: symlink d3/d18/d89/d70/l12a 0 2024-03-22T07:28:44.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/937: truncate d3/d98/d115/fc6 11904 0 2024-03-22T07:28:44.998 INFO:tasks.workunit.client.1.smithi195.stdout:3/938: truncate d3/fe7 4882706 0 2024-03-22T07:28:44.999 INFO:tasks.workunit.client.1.smithi195.stdout:7/907: symlink d0/d98/dab/dd7/l13d 0 2024-03-22T07:28:45.000 INFO:tasks.workunit.client.1.smithi195.stdout:7/908: dread d0/d13/d22/d28/ff8 [0,4194304] 0 2024-03-22T07:28:45.001 INFO:tasks.workunit.client.1.smithi195.stdout:1/826: link d0/d2/d27/d91/dc8/da4/lb8 d0/d2/d6/dad/db1/d97/d39/l113 0 2024-03-22T07:28:45.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/909: mkdir d0/d13/d22/d28/d13e 0 2024-03-22T07:28:45.006 INFO:tasks.workunit.client.1.smithi195.stdout:7/910: write d0/d13/d22/f115 [1117199,96358] 0 2024-03-22T07:28:45.007 INFO:tasks.workunit.client.1.smithi195.stdout:3/939: truncate d3/df/d50/f114 63080 0 2024-03-22T07:28:45.008 INFO:tasks.workunit.client.1.smithi195.stdout:0/932: dwrite d1/d4/dd/df/d44/fea [4194304,4194304] 0 2024-03-22T07:28:45.009 INFO:tasks.workunit.client.1.smithi195.stdout:3/940: mknod d3/d98/d115/c12b 0 2024-03-22T07:28:45.009 INFO:tasks.workunit.client.1.smithi195.stdout:3/941: creat d3/df/d50/f12c x:0 0 0 2024-03-22T07:28:45.012 INFO:tasks.workunit.client.1.smithi195.stdout:0/933: symlink d1/d4/dd/df/d44/d8d/l126 0 2024-03-22T07:28:45.017 INFO:tasks.workunit.client.1.smithi195.stdout:0/934: creat d1/d10/d1f/de3/f127 x:0 0 0 2024-03-22T07:28:45.019 INFO:tasks.workunit.client.1.smithi195.stdout:0/935: symlink d1/d4/d12/d6c/dbc/d47/l128 0 2024-03-22T07:28:45.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/936: rename d1/d10/d1f/dbf/ff3 to d1/d4/d12/d6c/dbc/d43/f129 0 2024-03-22T07:28:45.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/937: fsync d1/d10/d1f/f2f 0 2024-03-22T07:28:45.022 INFO:tasks.workunit.client.1.smithi195.stdout:0/938: fsync d1/d4/dd/df/d44/fea 0 2024-03-22T07:28:45.024 INFO:tasks.workunit.client.1.smithi195.stdout:0/939: mkdir d1/d4/dd/df/d44/d6f/dcb/dfa/d12a 0 2024-03-22T07:28:45.026 INFO:tasks.workunit.client.1.smithi195.stdout:0/940: rename d1/d10/d19/d20/f113 to d1/d4/d22/d107/d10d/f12b 0 2024-03-22T07:28:45.027 INFO:tasks.workunit.client.1.smithi195.stdout:0/941: symlink d1/d4/dd/df/d67/l12c 0 2024-03-22T07:28:45.028 INFO:tasks.workunit.client.1.smithi195.stdout:0/942: symlink d1/d10/d1f/dbf/de0/l12d 0 2024-03-22T07:28:45.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/943: truncate d1/d4/dd/df/d44/f50 2989513 0 2024-03-22T07:28:45.029 INFO:tasks.workunit.client.1.smithi195.stdout:0/944: dread - d1/d4/dd/d66/fdd zero size 2024-03-22T07:28:45.030 INFO:tasks.workunit.client.1.smithi195.stdout:0/945: symlink d1/d4/dd/df/d6b/l12e 0 2024-03-22T07:28:45.031 INFO:tasks.workunit.client.1.smithi195.stdout:0/946: dread - d1/d4/dd/df/d44/d6f/dcb/fd9 zero size 2024-03-22T07:28:45.031 INFO:tasks.workunit.client.1.smithi195.stdout:7/911: dwrite d0/d13/d14/f112 [0,4194304] 0 2024-03-22T07:28:45.032 INFO:tasks.workunit.client.1.smithi195.stdout:0/947: link d1/d4/d12/d6c/dbc/ce4 d1/d4/dd/d66/c12f 0 2024-03-22T07:28:45.034 INFO:tasks.workunit.client.1.smithi195.stdout:3/942: dwrite d3/d18/d89/f6d [0,4194304] 0 2024-03-22T07:28:45.035 INFO:tasks.workunit.client.1.smithi195.stdout:0/948: creat d1/d10b/f130 x:0 0 0 2024-03-22T07:28:45.039 INFO:tasks.workunit.client.1.smithi195.stdout:3/943: link d3/df/d15/d1d/f31 d3/df/d15/d1d/d5c/d47/d67/d93/da2/f12d 0 2024-03-22T07:28:45.041 INFO:tasks.workunit.client.1.smithi195.stdout:3/944: dread d3/df/d15/d1d/f30 [4194304,4194304] 0 2024-03-22T07:28:45.041 INFO:tasks.workunit.client.1.smithi195.stdout:0/949: creat d1/d4/f131 x:0 0 0 2024-03-22T07:28:45.041 INFO:tasks.workunit.client.1.smithi195.stdout:0/950: readlink d1/d10/d19/l108 0 2024-03-22T07:28:45.041 INFO:tasks.workunit.client.1.smithi195.stdout:0/951: readlink d1/d4/dd/df/d44/db4/ld3 0 2024-03-22T07:28:45.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/952: write d1/d4/f18 [2892693,109480] 0 2024-03-22T07:28:45.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/953: readlink d1/d10/d19/d20/l5e 0 2024-03-22T07:28:45.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/954: write d1/d10/d4d/da6/fb5 [826054,48361] 0 2024-03-22T07:28:45.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/955: fsync d1/d4/dd/df/d44/d6f/f71 0 2024-03-22T07:28:45.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/956: write d1/d4/dd/df/d6b/ffc [5011812,28552] 0 2024-03-22T07:28:45.042 INFO:tasks.workunit.client.1.smithi195.stdout:0/957: read - d1/d4/dd/df/d44/d6f/dae/fd1 zero size 2024-03-22T07:28:45.043 INFO:tasks.workunit.client.1.smithi195.stdout:7/912: dwrite d0/d13/d14/d29/dcf/fe4 [0,4194304] 0 2024-03-22T07:28:45.043 INFO:tasks.workunit.client.1.smithi195.stdout:7/913: dread - d0/d13/d14/d20/d40/d82/da6/f127 zero size 2024-03-22T07:28:45.043 INFO:tasks.workunit.client.1.smithi195.stdout:7/914: stat d0/d13/d14/d29/d35/d3a/f5d 0 2024-03-22T07:28:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:44 smithi134 ceph-mon[29057]: pgmap v8: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 163 MiB/s rd, 185 MiB/s wr, 270 op/s 2024-03-22T07:28:45.121 INFO:tasks.workunit.client.1.smithi195.stdout:0/958: unlink d1/d4/dd/df/d2b/cda 0 2024-03-22T07:28:45.124 INFO:tasks.workunit.client.1.smithi195.stdout:7/915: mknod d0/d98/dab/dd7/c13f 0 2024-03-22T07:28:45.125 INFO:tasks.workunit.client.1.smithi195.stdout:3/945: getdents d3/d98/d115/da0/dd1 0 2024-03-22T07:28:45.125 INFO:tasks.workunit.client.1.smithi195.stdout:3/946: write d3/f84 [671101,39909] 0 2024-03-22T07:28:45.130 INFO:tasks.workunit.client.1.smithi195.stdout:0/959: symlink d1/d4/dd/df/d44/d8d/dd2/l132 0 2024-03-22T07:28:45.131 INFO:tasks.workunit.client.1.smithi195.stdout:7/916: creat d0/d13/d14/d2f/f140 x:0 0 0 2024-03-22T07:28:45.131 INFO:tasks.workunit.client.1.smithi195.stdout:7/917: stat d0/d13/d14/d20/d40/d82/db8/f113 0 2024-03-22T07:28:45.134 INFO:tasks.workunit.client.1.smithi195.stdout:0/960: unlink d1/d4/dd/df/d2b/ca0 0 2024-03-22T07:28:45.136 INFO:tasks.workunit.client.1.smithi195.stdout:3/947: truncate d3/f14 1963325 0 2024-03-22T07:28:45.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/961: mknod d1/d10b/c133 0 2024-03-22T07:28:45.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/962: write d1/d4/f131 [874646,38081] 0 2024-03-22T07:28:45.137 INFO:tasks.workunit.client.1.smithi195.stdout:0/963: write d1/d4/dd/df/f110 [264305,50342] 0 2024-03-22T07:28:45.138 INFO:tasks.workunit.client.1.smithi195.stdout:7/918: truncate d0/d13/d14/d20/f78 390239 0 2024-03-22T07:28:45.144 INFO:tasks.workunit.client.1.smithi195.stdout:0/964: read d1/d4/dd/f13 [612946,60898] 0 2024-03-22T07:28:45.144 INFO:tasks.workunit.client.1.smithi195.stdout:0/965: write d1/d4/dd/df/d44/d6f/dcb/dfa/f11b [275770,64024] 0 2024-03-22T07:28:45.145 INFO:tasks.workunit.client.1.smithi195.stdout:0/966: symlink d1/d4/dd/df/d6b/l134 0 2024-03-22T07:28:45.146 INFO:tasks.workunit.client.1.smithi195.stdout:7/919: write d0/d13/d14/d2f/dae/dc3/fc7 [260934,8009] 0 2024-03-22T07:28:45.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/967: truncate d1/d4/dd/d66/d80/f8f 76117 0 2024-03-22T07:28:45.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/968: fsync d1/d4/dd/df/d44/d6f/f79 0 2024-03-22T07:28:45.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/969: readlink d1/d4/dd/df/d44/lbb 0 2024-03-22T07:28:45.146 INFO:tasks.workunit.client.1.smithi195.stdout:0/970: creat d1/d10/d19/d20/f135 x:0 0 0 2024-03-22T07:28:45.147 INFO:tasks.workunit.client.1.smithi195.stdout:0/971: chown d1/d4/d12/d6c/d7b/fa5 1 1 2024-03-22T07:28:45.149 INFO:tasks.workunit.client.1.smithi195.stdout:7/920: mkdir d0/d13/d22/d57/d7b/d8c/d141 0 2024-03-22T07:28:45.150 INFO:tasks.workunit.client.1.smithi195.stdout:7/921: dread d0/d13/d14/d29/d35/d3a/d7e/f11b [0,4194304] 0 2024-03-22T07:28:45.150 INFO:tasks.workunit.client.1.smithi195.stdout:0/972: creat d1/d4/dd/df/d44/f136 x:0 0 0 2024-03-22T07:28:45.151 INFO:tasks.workunit.client.1.smithi195.stdout:0/973: read - d1/d4/d12/d6c/dbc/d43/f129 zero size 2024-03-22T07:28:45.151 INFO:tasks.workunit.client.1.smithi195.stdout:7/922: creat d0/d13/d22/d13a/f142 x:0 0 0 2024-03-22T07:28:45.152 INFO:tasks.workunit.client.1.smithi195.stdout:7/923: dread - d0/d13/d22/d57/fb1 zero size 2024-03-22T07:28:45.152 INFO:tasks.workunit.client.1.smithi195.stdout:0/974: mknod d1/da2/c137 0 2024-03-22T07:28:45.154 INFO:tasks.workunit.client.1.smithi195.stdout:7/924: creat d0/d13/d14/d80/f143 x:0 0 0 2024-03-22T07:28:45.160 INFO:tasks.workunit.client.1.smithi195.stdout:3/948: truncate d3/f84 530603 0 2024-03-22T07:28:45.160 INFO:tasks.workunit.client.1.smithi195.stdout:4/926: sync 2024-03-22T07:28:45.160 INFO:tasks.workunit.client.1.smithi195.stdout:6/841: sync 2024-03-22T07:28:45.160 INFO:tasks.workunit.client.1.smithi195.stdout:2/980: sync 2024-03-22T07:28:45.160 INFO:tasks.workunit.client.1.smithi195.stdout:1/827: sync 2024-03-22T07:28:45.161 INFO:tasks.workunit.client.1.smithi195.stdout:3/949: symlink d3/d18/d89/d76/l12e 0 2024-03-22T07:28:45.162 INFO:tasks.workunit.client.1.smithi195.stdout:3/950: truncate d3/d98/d115/da0/dd1/f108 266285 0 2024-03-22T07:28:45.164 INFO:tasks.workunit.client.1.smithi195.stdout:6/842: mkdir d5/d16/d45/d53/d107/d12a 0 2024-03-22T07:28:45.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/981: creat d2/d3/d7/d19/d22/d26/f14a x:0 0 0 2024-03-22T07:28:45.166 INFO:tasks.workunit.client.1.smithi195.stdout:2/982: dread - d2/d3/d21/d40/fa0 zero size 2024-03-22T07:28:45.167 INFO:tasks.workunit.client.0.smithi134.stdout:9/604: sync 2024-03-22T07:28:45.168 INFO:tasks.workunit.client.0.smithi134.stdout:2/613: sync 2024-03-22T07:28:45.168 INFO:tasks.workunit.client.1.smithi195.stdout:4/927: mknod d13/d15/d6b/da6/ded/def/d134/d5f/d83/c13a 0 2024-03-22T07:28:45.171 INFO:tasks.workunit.client.1.smithi195.stdout:6/843: rename d5/d5e/d34/d55/d3b/d7f/fd4 to d5/d16/d11b/f12b 0 2024-03-22T07:28:45.171 INFO:tasks.workunit.client.1.smithi195.stdout:6/844: write d5/d5e/d34/d55/d3b/d6e/d3c/f7e [1340168,41434] 0 2024-03-22T07:28:45.173 INFO:tasks.workunit.client.0.smithi134.stdout:2/614: rename d2/d5/d8/d5d/da1/d3c/d60/l7f to d2/d5/d8/d7e/lc5 0 2024-03-22T07:28:45.174 INFO:tasks.workunit.client.0.smithi134.stdout:2/615: dread - d2/d5/fa9 zero size 2024-03-22T07:28:45.176 INFO:tasks.workunit.client.1.smithi195.stdout:2/983: rmdir d2/d3/d7/da/de/d10b 39 2024-03-22T07:28:45.177 INFO:tasks.workunit.client.1.smithi195.stdout:0/975: rmdir d1/d4/dd/df/d44 39 2024-03-22T07:28:45.177 INFO:tasks.workunit.client.1.smithi195.stdout:0/976: read - d1/d4/dd/df/d67/ff9 zero size 2024-03-22T07:28:45.178 INFO:tasks.workunit.client.0.smithi134.stdout:2/616: mkdir d2/d5/d8/d7e/dba/dc6 0 2024-03-22T07:28:45.178 INFO:tasks.workunit.client.0.smithi134.stdout:2/617: chown d2/d5/d8/d5d/d5f 1985632036 1 2024-03-22T07:28:45.180 INFO:tasks.workunit.client.1.smithi195.stdout:3/951: dwrite d3/df/d15/d1d/d5c/d47/d67/d80/f102 [0,4194304] 0 2024-03-22T07:28:45.180 INFO:tasks.workunit.client.1.smithi195.stdout:3/952: fsync d3/d98/d115/da0/dd1/f108 0 2024-03-22T07:28:45.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/925: dwrite d0/d13/f46 [0,4194304] 0 2024-03-22T07:28:45.180 INFO:tasks.workunit.client.1.smithi195.stdout:7/926: stat d0/d13/d14/l2a 0 2024-03-22T07:28:45.180 INFO:tasks.workunit.client.1.smithi195.stdout:1/828: rmdir d0/d2/d6/dad/db1/d97/d39/d64 39 2024-03-22T07:28:45.183 INFO:tasks.workunit.client.1.smithi195.stdout:4/928: creat d13/d15/d6b/da6/ded/def/d134/f13b x:0 0 0 2024-03-22T07:28:45.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/977: truncate d1/d4/dd/d66/d80/fac 541354 0 2024-03-22T07:28:45.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/978: write d1/d4/dd/df/d44/d6f/f71 [4977902,39518] 0 2024-03-22T07:28:45.188 INFO:tasks.workunit.client.1.smithi195.stdout:0/979: dread - d1/d10/d1f/de3/f127 zero size 2024-03-22T07:28:45.191 INFO:tasks.workunit.client.1.smithi195.stdout:7/927: dread d0/d13/d14/d29/d35/d6d/f7a [0,4194304] 0 2024-03-22T07:28:45.191 INFO:tasks.workunit.client.0.smithi134.stdout:9/605: dwrite d3/d9/df/d12/f58 [4194304,4194304] 0 2024-03-22T07:28:45.191 INFO:tasks.workunit.client.0.smithi134.stdout:9/606: fdatasync d3/d9/df/f49 0 2024-03-22T07:28:45.192 INFO:tasks.workunit.client.1.smithi195.stdout:1/829: symlink d0/d2/d6/dad/db1/d97/d39/d40/dc9/l114 0 2024-03-22T07:28:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:7/928: rename d0/d13/d14/d20/d40/d82/da0/d59/f5f to d0/d13/d22/def/f144 0 2024-03-22T07:28:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:7/929: creat d0/d13/d14/d5b/f145 x:0 0 0 2024-03-22T07:28:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:1/830: rmdir d0/d2/d6/dad/db1/d97 39 2024-03-22T07:28:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:1/831: write d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/dd7/feb [863031,60330] 0 2024-03-22T07:28:45.196 INFO:tasks.workunit.client.1.smithi195.stdout:1/832: chown d0/d2/d6/dad/db1/d97/laa 1 1 2024-03-22T07:28:45.197 INFO:tasks.workunit.client.0.smithi134.stdout:2/618: dwrite d2/f4c [0,4194304] 0 2024-03-22T07:28:45.197 INFO:tasks.workunit.client.1.smithi195.stdout:4/929: rmdir d13/d63/d7a/ddf 39 2024-03-22T07:28:45.201 INFO:tasks.workunit.client.0.smithi134.stdout:2/619: creat d2/d5/d8/d7e/d83/fc7 x:0 0 0 2024-03-22T07:28:45.202 INFO:tasks.workunit.client.1.smithi195.stdout:7/930: rename d0/d13/d14/d29/cd0 to d0/d13/d14/d5b/c146 0 2024-03-22T07:28:45.202 INFO:tasks.workunit.client.1.smithi195.stdout:0/980: dread d1/d4/dd/df/d6b/f81 [0,4194304] 0 2024-03-22T07:28:45.203 INFO:tasks.workunit.client.1.smithi195.stdout:4/930: creat d13/d15/d6b/da6/f13c x:0 0 0 2024-03-22T07:28:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:44 smithi195 ceph-mon[36144]: pgmap v8: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 163 MiB/s rd, 185 MiB/s wr, 270 op/s 2024-03-22T07:28:45.206 INFO:tasks.workunit.client.1.smithi195.stdout:2/984: dwrite d2/d3/db/fd6 [0,4194304] 0 2024-03-22T07:28:45.207 INFO:tasks.workunit.client.0.smithi134.stdout:2/620: link d2/f3b d2/d5/d22/dbc/fc8 0 2024-03-22T07:28:45.207 INFO:tasks.workunit.client.0.smithi134.stdout:2/621: truncate d2/d5/d8/d5d/da1/d3c/d60/f8e 141133 0 2024-03-22T07:28:45.208 INFO:tasks.workunit.client.1.smithi195.stdout:7/931: mknod d0/d98/dab/c147 0 2024-03-22T07:28:45.210 INFO:tasks.workunit.client.1.smithi195.stdout:4/931: mknod d13/d63/d7a/de4/df7/c13d 0 2024-03-22T07:28:45.211 INFO:tasks.workunit.client.1.smithi195.stdout:2/985: creat d2/d3/d7/d19/d22/d26/d3c/d116/d13c/f14b x:0 0 0 2024-03-22T07:28:45.212 INFO:tasks.workunit.client.0.smithi134.stdout:9/607: dwrite d3/fa3 [0,4194304] 0 2024-03-22T07:28:45.214 INFO:tasks.workunit.client.0.smithi134.stdout:2/622: dread d2/d5/d8/d5d/f66 [4194304,4194304] 0 2024-03-22T07:28:45.214 INFO:tasks.workunit.client.0.smithi134.stdout:2/623: stat d2/d5/d8/d5d/da1/d3c 0 2024-03-22T07:28:45.215 INFO:tasks.workunit.client.0.smithi134.stdout:2/624: write d2/d5/d8/d5d/fbd [209135,106973] 0 2024-03-22T07:28:45.215 INFO:tasks.workunit.client.0.smithi134.stdout:2/625: write d2/d5/d8/f88 [4376592,59052] 0 2024-03-22T07:28:45.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/626: write d2/d5/d8/d5d/d5f/f6f [786781,53350] 0 2024-03-22T07:28:45.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/627: readlink d2/d5/d8/d5d/da1/d3c/d4f/l97 0 2024-03-22T07:28:45.216 INFO:tasks.workunit.client.1.smithi195.stdout:7/932: link d0/d13/d14/d2f/l74 d0/d13/d14/d29/d35/d3a/d7e/l148 0 2024-03-22T07:28:45.218 INFO:tasks.workunit.client.1.smithi195.stdout:4/932: unlink d13/d63/d79/de9/d7e/d8c/f11c 0 2024-03-22T07:28:45.222 INFO:tasks.workunit.client.0.smithi134.stdout:9/608: creat d3/d9/d37/d5a/d7f/fcd x:0 0 0 2024-03-22T07:28:45.223 INFO:tasks.workunit.client.0.smithi134.stdout:2/628: dread d2/d5/d8/d5d/da1/d3c/d60/f72 [0,4194304] 0 2024-03-22T07:28:45.224 INFO:tasks.workunit.client.1.smithi195.stdout:1/833: dwrite d0/d2/d27/d91/dc8/da4/fb4 [4194304,4194304] 0 2024-03-22T07:28:45.227 INFO:tasks.workunit.client.1.smithi195.stdout:7/933: mknod d0/d98/dab/c149 0 2024-03-22T07:28:45.228 INFO:tasks.workunit.client.0.smithi134.stdout:9/609: fdatasync d3/f73 0 2024-03-22T07:28:45.228 INFO:tasks.workunit.client.0.smithi134.stdout:9/610: chown d3/d9/d37/d3c/f78 4533092 1 2024-03-22T07:28:45.228 INFO:tasks.workunit.client.0.smithi134.stdout:9/611: chown d3/d9/df/d57/d67/d5f 1 1 2024-03-22T07:28:45.229 INFO:tasks.workunit.client.0.smithi134.stdout:2/629: mknod d2/d5/d22/dbc/cc9 0 2024-03-22T07:28:45.230 INFO:tasks.workunit.client.1.smithi195.stdout:7/934: mkdir d0/d13/d14/d20/d40/d82/da0/d117/d14a 0 2024-03-22T07:28:45.231 INFO:tasks.workunit.client.1.smithi195.stdout:7/935: mknod d0/d13/d22/d28/d13e/c14b 0 2024-03-22T07:28:45.232 INFO:tasks.workunit.client.1.smithi195.stdout:7/936: symlink d0/d13/d22/d57/d7b/d8c/d141/l14c 0 2024-03-22T07:28:45.232 INFO:tasks.workunit.client.1.smithi195.stdout:7/937: read d0/d13/d14/d20/d40/d82/db8/ff7 [26532,38072] 0 2024-03-22T07:28:45.232 INFO:tasks.workunit.client.1.smithi195.stdout:7/938: chown d0/d13/c38 165712 1 2024-03-22T07:28:45.233 INFO:tasks.workunit.client.1.smithi195.stdout:7/939: mkdir d0/d98/d14d 0 2024-03-22T07:28:45.234 INFO:tasks.workunit.client.1.smithi195.stdout:7/940: truncate d0/d13/d14/d20/f4b 583481 0 2024-03-22T07:28:45.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/981: dwrite d1/d4/ff7 [0,4194304] 0 2024-03-22T07:28:45.235 INFO:tasks.workunit.client.1.smithi195.stdout:0/982: read - d1/d4/dd/df/d67/ff9 zero size 2024-03-22T07:28:45.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/941: creat d0/d13/d14/d80/d9c/d122/d110/f14e x:0 0 0 2024-03-22T07:28:45.236 INFO:tasks.workunit.client.1.smithi195.stdout:7/942: stat d0/d98/dab/dd7 0 2024-03-22T07:28:45.239 INFO:tasks.workunit.client.0.smithi134.stdout:2/630: write d2/d5/d22/f2a [537668,92998] 0 2024-03-22T07:28:45.243 INFO:tasks.workunit.client.0.smithi134.stdout:2/631: symlink d2/d5/d8/d7e/lca 0 2024-03-22T07:28:45.245 INFO:tasks.workunit.client.0.smithi134.stdout:2/632: mknod d2/d5/d8/d7e/dba/dc6/ccb 0 2024-03-22T07:28:45.245 INFO:tasks.workunit.client.1.smithi195.stdout:2/986: dwrite d2/d3/d21/f102 [0,4194304] 0 2024-03-22T07:28:45.246 INFO:tasks.workunit.client.0.smithi134.stdout:2/633: mknod d2/d5/d22/ccc 0 2024-03-22T07:28:45.247 INFO:tasks.workunit.client.1.smithi195.stdout:0/983: write d1/d4/dd/df/d2b/d63/fad [2829998,39092] 0 2024-03-22T07:28:45.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/834: dwrite d0/d2/d6/dad/db1/d97/d39/d64/fea [0,4194304] 0 2024-03-22T07:28:45.247 INFO:tasks.workunit.client.1.smithi195.stdout:1/835: chown d0/d2/d6/f62 124925307 1 2024-03-22T07:28:45.247 INFO:tasks.workunit.client.0.smithi134.stdout:9/612: dread d3/d9/d37/d6f/d54/d9d/fb0 [0,4194304] 0 2024-03-22T07:28:45.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/933: dwrite d13/f34 [0,4194304] 0 2024-03-22T07:28:45.249 INFO:tasks.workunit.client.0.smithi134.stdout:2/634: symlink d2/d5/lcd 0 2024-03-22T07:28:45.254 INFO:tasks.workunit.client.1.smithi195.stdout:7/943: dwrite d0/d13/d14/d29/d35/f37 [0,4194304] 0 2024-03-22T07:28:45.260 INFO:tasks.workunit.client.1.smithi195.stdout:2/987: dread d2/d3/f79 [0,4194304] 0 2024-03-22T07:28:45.261 INFO:tasks.workunit.client.1.smithi195.stdout:1/836: dread d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:45.263 INFO:tasks.workunit.client.1.smithi195.stdout:0/984: creat d1/d10/d1f/dbf/d104/f138 x:0 0 0 2024-03-22T07:28:45.266 INFO:tasks.workunit.client.1.smithi195.stdout:4/934: rename d13/d63/d79/de9/dfd/l106 to d13/d63/d3e/d5c/l13e 0 2024-03-22T07:28:45.267 INFO:tasks.workunit.client.1.smithi195.stdout:4/935: creat d13/d15/d44/f13f x:0 0 0 2024-03-22T07:28:45.268 INFO:tasks.workunit.client.1.smithi195.stdout:2/988: mkdir d2/d122/d14c 0 2024-03-22T07:28:45.268 INFO:tasks.workunit.client.1.smithi195.stdout:7/944: dread d0/d13/d14/d29/f33 [0,4194304] 0 2024-03-22T07:28:45.269 INFO:tasks.workunit.client.1.smithi195.stdout:1/837: creat d0/d2/d27/d91/dc8/da4/dc0/f115 x:0 0 0 2024-03-22T07:28:45.269 INFO:tasks.workunit.client.1.smithi195.stdout:1/838: fdatasync d0/d2/d27/d91/dc8/dba/fd2 0 2024-03-22T07:28:45.272 INFO:tasks.workunit.client.0.smithi134.stdout:9/613: dwrite d3/d9/df/f86 [0,4194304] 0 2024-03-22T07:28:45.272 INFO:tasks.workunit.client.1.smithi195.stdout:0/985: symlink d1/d4/dd/l139 0 2024-03-22T07:28:45.272 INFO:tasks.workunit.client.0.smithi134.stdout:2/635: dwrite d2/d5/d22/d99/fa6 [0,4194304] 0 2024-03-22T07:28:45.274 INFO:tasks.workunit.client.1.smithi195.stdout:4/936: truncate d13/d63/d79/de9/d7e/d8c/db7/ff8 1702784 0 2024-03-22T07:28:45.277 INFO:tasks.workunit.client.1.smithi195.stdout:2/989: mknod d2/d122/c14d 0 2024-03-22T07:28:45.281 INFO:tasks.workunit.client.1.smithi195.stdout:1/839: symlink d0/d2/d27/d91/dc8/d2a/l116 0 2024-03-22T07:28:45.281 INFO:tasks.workunit.client.1.smithi195.stdout:1/840: fsync d0/d2/d6/dad/db1/d97/d41/d47/f49 0 2024-03-22T07:28:45.283 INFO:tasks.workunit.client.0.smithi134.stdout:2/636: creat d2/d5/d22/fce x:0 0 0 2024-03-22T07:28:45.284 INFO:tasks.workunit.client.1.smithi195.stdout:0/986: dwrite d1/d4/dd/df/f110 [0,4194304] 0 2024-03-22T07:28:45.286 INFO:tasks.workunit.client.0.smithi134.stdout:2/637: link d2/d5/d8/d5d/da1/fb8 d2/d5/d8/d7e/dba/fcf 0 2024-03-22T07:28:45.287 INFO:tasks.workunit.client.1.smithi195.stdout:4/937: write d13/f14 [2392965,75529] 0 2024-03-22T07:28:45.290 INFO:tasks.workunit.client.0.smithi134.stdout:2/638: creat d2/d5/d54/fd0 x:0 0 0 2024-03-22T07:28:45.293 INFO:tasks.workunit.client.1.smithi195.stdout:7/945: dwrite d0/d98/dab/fd4 [0,4194304] 0 2024-03-22T07:28:45.293 INFO:tasks.workunit.client.1.smithi195.stdout:0/987: creat d1/d4/dd/df/d44/d6f/dcb/dfa/f13a x:0 0 0 2024-03-22T07:28:45.295 INFO:tasks.workunit.client.1.smithi195.stdout:7/946: stat d0/d13/d22/d28/l32 0 2024-03-22T07:28:45.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/947: readlink d0/d13/d14/d29/d35/d3a/d7e/l119 0 2024-03-22T07:28:45.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/948: stat d0/d13/d22/d57/d7b/d8c/fa4 0 2024-03-22T07:28:45.296 INFO:tasks.workunit.client.1.smithi195.stdout:7/949: creat d0/d13/d14/d20/d40/d82/daa/f14f x:0 0 0 2024-03-22T07:28:45.296 INFO:tasks.workunit.client.1.smithi195.stdout:0/988: creat d1/d10/d4d/da6/d100/f13b x:0 0 0 2024-03-22T07:28:45.301 INFO:tasks.workunit.client.0.smithi134.stdout:2/639: dread d2/f4c [0,4194304] 0 2024-03-22T07:28:45.301 INFO:tasks.workunit.client.0.smithi134.stdout:9/614: dwrite d3/d9/df/f7d [0,4194304] 0 2024-03-22T07:28:45.301 INFO:tasks.workunit.client.0.smithi134.stdout:9/615: fsync d3/d9/df/d57/f7e 0 2024-03-22T07:28:45.302 INFO:tasks.workunit.client.1.smithi195.stdout:7/950: unlink d0/d98/dab/c149 0 2024-03-22T07:28:45.302 INFO:tasks.workunit.client.1.smithi195.stdout:2/990: dwrite d2/d3/d24/f39 [0,4194304] 0 2024-03-22T07:28:45.306 INFO:tasks.workunit.client.1.smithi195.stdout:2/991: creat d2/d3/d21/d60/d81/da8/f14e x:0 0 0 2024-03-22T07:28:45.310 INFO:tasks.workunit.client.1.smithi195.stdout:0/989: rmdir d1/d4/dd/df/d6b 39 2024-03-22T07:28:45.310 INFO:tasks.workunit.client.1.smithi195.stdout:0/990: write d1/d4/d12/d6c/dbc/d47/f84 [1876208,68894] 0 2024-03-22T07:28:45.311 INFO:tasks.workunit.client.1.smithi195.stdout:4/938: write d13/d63/d79/de9/d7e/d8c/db7/ff8 [2239334,87053] 0 2024-03-22T07:28:45.311 INFO:tasks.workunit.client.1.smithi195.stdout:7/951: write d0/d13/d14/d29/dcf/fe4 [1670926,111319] 0 2024-03-22T07:28:45.312 INFO:tasks.workunit.client.0.smithi134.stdout:9/616: truncate d3/f8 900013 0 2024-03-22T07:28:45.315 INFO:tasks.workunit.client.1.smithi195.stdout:0/991: mkdir d1/d4/dd/df/d44/db4/dcd/d13c 0 2024-03-22T07:28:45.315 INFO:tasks.workunit.client.1.smithi195.stdout:0/992: truncate d1/d10/d1f/dbf/d104/f121 632841 0 2024-03-22T07:28:45.315 INFO:tasks.workunit.client.1.smithi195.stdout:2/992: dread d2/d3/d7/d5c/da4/ff5 [0,4194304] 0 2024-03-22T07:28:45.316 INFO:tasks.workunit.client.0.smithi134.stdout:9/617: link d3/d9/d37/d6f/f32 d3/d9/d37/d5a/dc5/fce 0 2024-03-22T07:28:45.316 INFO:tasks.workunit.client.0.smithi134.stdout:2/640: dwrite d2/d5/d8/d5d/d5f/d75/fc2 [0,4194304] 0 2024-03-22T07:28:45.317 INFO:tasks.workunit.client.1.smithi195.stdout:4/939: mkdir d13/d63/d79/de9/d7e/d85/d140 0 2024-03-22T07:28:45.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/952: rename d0/d13/d14/d29/d35/d3a/d7e/cfd to d0/d13/d22/d13a/c150 0 2024-03-22T07:28:45.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/953: creat d0/d13/d14/d20/d40/d82/daa/f151 x:0 0 0 2024-03-22T07:28:45.323 INFO:tasks.workunit.client.1.smithi195.stdout:7/954: creat d0/d13/d14/d2f/f152 x:0 0 0 2024-03-22T07:28:45.328 INFO:tasks.workunit.client.1.smithi195.stdout:0/993: link d1/d4/d22/df0/ff5 d1/d4/dd/df/d44/d8d/f13d 0 2024-03-22T07:28:45.328 INFO:tasks.workunit.client.1.smithi195.stdout:0/994: truncate d1/d10/d1f/f9d 607805 0 2024-03-22T07:28:45.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/940: dwrite d13/d15/d6b/da6/db3/fd1 [0,4194304] 0 2024-03-22T07:28:45.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/941: chown d13/d15/d6b/da6/ded/def/d134/d5f/l9d 459 1 2024-03-22T07:28:45.336 INFO:tasks.workunit.client.1.smithi195.stdout:4/942: fdatasync d13/d63/d79/f129 0 2024-03-22T07:28:45.337 INFO:tasks.workunit.client.1.smithi195.stdout:7/955: truncate d0/d13/d14/d20/d40/d82/da0/d59/d79/fb0 1333401 0 2024-03-22T07:28:45.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/641: symlink d2/d5/d8/d5d/da1/d3c/d4f/d6e/d9e/ld1 0 2024-03-22T07:28:45.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/642: write d2/d5/d8/d5d/fc1 [923643,37696] 0 2024-03-22T07:28:45.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/643: readlink d2/d5/d8/d31/l55 0 2024-03-22T07:28:45.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/644: fsync d2/d5/d8/d5d/da1/d3c/d4f/faf 0 2024-03-22T07:28:45.339 INFO:tasks.workunit.client.0.smithi134.stdout:2/645: creat d2/d5/d8/d7e/fd2 x:0 0 0 2024-03-22T07:28:45.339 INFO:tasks.workunit.client.1.smithi195.stdout:0/995: mknod d1/d10/d1f/de3/c13e 0 2024-03-22T07:28:45.341 INFO:tasks.workunit.client.1.smithi195.stdout:2/993: rmdir d2/d1e/d93/d112 39 2024-03-22T07:28:45.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/996: read d1/d4/d12/d6c/dbc/fcf [3201394,112062] 0 2024-03-22T07:28:45.347 INFO:tasks.workunit.client.1.smithi195.stdout:4/943: creat d13/d63/d79/de9/dfd/f141 x:0 0 0 2024-03-22T07:28:45.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/997: write d1/d10/d19/d20/fff [874575,70914] 0 2024-03-22T07:28:45.347 INFO:tasks.workunit.client.1.smithi195.stdout:0/998: chown d1/d4/dd/df/d44/ca9 799838038 1 2024-03-22T07:28:45.348 INFO:tasks.workunit.client.1.smithi195.stdout:2/994: write d2/d3/db/fd6 [2690047,122472] 0 2024-03-22T07:28:45.348 INFO:tasks.workunit.client.1.smithi195.stdout:2/995: write d2/d3/d21/d4c/f52 [1119729,11945] 0 2024-03-22T07:28:45.348 INFO:tasks.workunit.client.1.smithi195.stdout:2/996: truncate d2/d122/d144/f149 242408 0 2024-03-22T07:28:45.351 INFO:tasks.workunit.client.1.smithi195.stdout:4/944: creat d13/d63/d79/de9/d7e/d85/d101/d114/f142 x:0 0 0 2024-03-22T07:28:45.353 INFO:tasks.workunit.client.1.smithi195.stdout:0/999: truncate d1/d4/d12/d6c/d87/fc7 15853 0 2024-03-22T07:28:45.354 INFO:tasks.workunit.client.1.smithi195.stdout:7/956: dwrite d0/d13/d14/d29/f10f [0,4194304] 0 2024-03-22T07:28:45.354 INFO:tasks.workunit.client.1.smithi195.stdout:7/957: write d0/d13/d14/d80/d9c/d122/d110/f9d [342321,48793] 0 2024-03-22T07:28:45.357 INFO:tasks.workunit.client.0.smithi134.stdout:3/666: sync 2024-03-22T07:28:45.358 INFO:tasks.workunit.client.0.smithi134.stdout:0/734: sync 2024-03-22T07:28:45.358 INFO:tasks.workunit.client.0.smithi134.stdout:7/886: sync 2024-03-22T07:28:45.358 INFO:tasks.workunit.client.0.smithi134.stdout:0/735: truncate dc/de/d55/d65/fac 1018963 0 2024-03-22T07:28:45.358 INFO:tasks.workunit.client.1.smithi195.stdout:4/945: rename d13/d63/d7a/de4/df7 to d13/d63/d79/de9/d7e/d8c/db7/d143 0 2024-03-22T07:28:45.360 INFO:tasks.workunit.client.0.smithi134.stdout:9/618: rmdir d3/d9 39 2024-03-22T07:28:45.363 INFO:tasks.workunit.client.1.smithi195.stdout:6/845: sync 2024-03-22T07:28:45.363 INFO:tasks.workunit.client.1.smithi195.stdout:3/953: sync 2024-03-22T07:28:45.367 INFO:tasks.workunit.client.0.smithi134.stdout:2/646: readlink d2/l34 0 2024-03-22T07:28:45.372 INFO:tasks.workunit.client.0.smithi134.stdout:9/619: write d3/d9/df/fc8 [314518,57079] 0 2024-03-22T07:28:45.374 INFO:tasks.workunit.client.1.smithi195.stdout:6/846: dread d5/d5e/dc0/f113 [0,4194304] 0 2024-03-22T07:28:45.374 INFO:tasks.workunit.client.1.smithi195.stdout:6/847: stat d5/d16/d5b/c7d 0 2024-03-22T07:28:45.378 INFO:tasks.workunit.client.0.smithi134.stdout:2/647: getdents d2/d5/d8/d7e/dba/dc6 0 2024-03-22T07:28:45.380 INFO:tasks.workunit.client.1.smithi195.stdout:7/958: rename d0/d13/d14/d80/d9c/d122/d110/fce to d0/d13/d22/d57/f153 0 2024-03-22T07:28:45.380 INFO:tasks.workunit.client.1.smithi195.stdout:7/959: dread - d0/d13/d14/d20/d40/d82/da0/d59/fb2 zero size 2024-03-22T07:28:45.381 INFO:tasks.workunit.client.0.smithi134.stdout:7/887: rmdir d1/d19/d9c/db3 39 2024-03-22T07:28:45.382 INFO:tasks.workunit.client.1.smithi195.stdout:4/946: mkdir d13/d63/d79/d68/dfb/d144 0 2024-03-22T07:28:45.382 INFO:tasks.workunit.client.1.smithi195.stdout:4/947: write d13/d15/d44/fe3 [344307,2403] 0 2024-03-22T07:28:45.383 INFO:tasks.workunit.client.0.smithi134.stdout:2/648: stat d2/d5/d8/d5d/da1/d3c/d4f/l59 0 2024-03-22T07:28:45.385 INFO:tasks.workunit.client.0.smithi134.stdout:7/888: link d1/de/d11/d48/d52/d46/l81 d1/de/d11/d48/l119 0 2024-03-22T07:28:45.386 INFO:tasks.workunit.client.1.smithi195.stdout:3/954: creat d3/df/d15/d1d/f12f x:0 0 0 2024-03-22T07:28:45.388 INFO:tasks.workunit.client.0.smithi134.stdout:2/649: mkdir d2/d5/d8/d7e/dd3 0 2024-03-22T07:28:45.388 INFO:tasks.workunit.client.0.smithi134.stdout:2/650: chown d2/d5/d22/f24 109051634 1 2024-03-22T07:28:45.388 INFO:tasks.workunit.client.0.smithi134.stdout:2/651: read - d2/d5/d22/fce zero size 2024-03-22T07:28:45.391 INFO:tasks.workunit.client.0.smithi134.stdout:7/889: rename d1/de/d8d/fb5 to d1/de/d41/d87/f11a 0 2024-03-22T07:28:45.391 INFO:tasks.workunit.client.0.smithi134.stdout:7/890: write d1/de/d11/d2b/fb6 [351422,122205] 0 2024-03-22T07:28:45.392 INFO:tasks.workunit.client.0.smithi134.stdout:3/667: dwrite d4/d10/f14 [0,4194304] 0 2024-03-22T07:28:45.392 INFO:tasks.workunit.client.0.smithi134.stdout:2/652: symlink d2/d5/d8/d5d/da1/d3c/d4f/d6e/ld4 0 2024-03-22T07:28:45.393 INFO:tasks.workunit.client.1.smithi195.stdout:3/955: dread d3/f29 [4194304,4194304] 0 2024-03-22T07:28:45.393 INFO:tasks.workunit.client.1.smithi195.stdout:3/956: readlink d3/df/d15/d1d/d5c/d47/l101 0 2024-03-22T07:28:45.396 INFO:tasks.workunit.client.0.smithi134.stdout:7/891: mkdir d1/d19/d9c/db3/dc4/df7/d11b 0 2024-03-22T07:28:45.396 INFO:tasks.workunit.client.0.smithi134.stdout:7/892: readlink d1/d19/d32/l4c 0 2024-03-22T07:28:45.399 INFO:tasks.workunit.client.1.smithi195.stdout:6/848: creat d5/d5e/f12c x:0 0 0 2024-03-22T07:28:45.399 INFO:tasks.workunit.client.1.smithi195.stdout:6/849: fdatasync d5/d16/d45/d53/f108 0 2024-03-22T07:28:45.400 INFO:tasks.workunit.client.0.smithi134.stdout:3/668: truncate d4/d8/d5c/fb3 1275647 0 2024-03-22T07:28:45.401 INFO:tasks.workunit.client.0.smithi134.stdout:9/620: dwrite d3/d9/df/d57/d67/d5f/fb9 [0,4194304] 0 2024-03-22T07:28:45.403 INFO:tasks.workunit.client.0.smithi134.stdout:0/736: dwrite dc/de/f84 [0,4194304] 0 2024-03-22T07:28:45.403 INFO:tasks.workunit.client.0.smithi134.stdout:0/737: chown dc/d17/fb3 100189448 1 2024-03-22T07:28:45.403 INFO:tasks.workunit.client.0.smithi134.stdout:0/738: write dc/d18/f5a [3969443,31568] 0 2024-03-22T07:28:45.404 INFO:tasks.workunit.client.1.smithi195.stdout:4/948: dwrite d13/d63/d79/de9/d7e/fb6 [0,4194304] 0 2024-03-22T07:28:45.404 INFO:tasks.workunit.client.1.smithi195.stdout:7/960: rmdir d0/d13/d14/d29 39 2024-03-22T07:28:45.405 INFO:tasks.workunit.client.0.smithi134.stdout:2/653: mkdir d2/d5/d8/d31/dd5 0 2024-03-22T07:28:45.405 INFO:tasks.workunit.client.0.smithi134.stdout:2/654: creat d2/d5/d8/d5d/da1/fd6 x:0 0 0 2024-03-22T07:28:45.406 INFO:tasks.workunit.client.0.smithi134.stdout:7/893: unlink d1/de/d11/d2b/d69/f6c 0 2024-03-22T07:28:45.408 INFO:tasks.workunit.client.1.smithi195.stdout:6/850: creat d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/f12d x:0 0 0 2024-03-22T07:28:45.409 INFO:tasks.workunit.client.0.smithi134.stdout:3/669: rename d4/d8/c8c to d4/d10/d4b/dcc/cd1 0 2024-03-22T07:28:45.414 INFO:tasks.workunit.client.1.smithi195.stdout:4/949: creat d13/d15/d6b/da6/ded/f145 x:0 0 0 2024-03-22T07:28:45.415 INFO:tasks.workunit.client.1.smithi195.stdout:3/957: dwrite d3/df/d15/d1d/d5c/f72 [0,4194304] 0 2024-03-22T07:28:45.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/961: symlink d0/d13/d14/d2f/l154 0 2024-03-22T07:28:45.418 INFO:tasks.workunit.client.1.smithi195.stdout:7/962: creat d0/d13/d14/d20/d40/d82/da0/f155 x:0 0 0 2024-03-22T07:28:45.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/621: chown d3/c15 373453375 1 2024-03-22T07:28:45.419 INFO:tasks.workunit.client.0.smithi134.stdout:2/655: write d2/f3b [3646573,91270] 0 2024-03-22T07:28:45.420 INFO:tasks.workunit.client.1.smithi195.stdout:4/950: link d13/d63/d79/de9/d7e/d8c/l96 d13/d15/d6b/da6/ded/def/l146 0 2024-03-22T07:28:45.424 INFO:tasks.workunit.client.1.smithi195.stdout:3/958: rename d3/d18/d89/d76/fee to d3/d98/f130 0 2024-03-22T07:28:45.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/851: dwrite d5/d5e/f12c [0,4194304] 0 2024-03-22T07:28:45.428 INFO:tasks.workunit.client.0.smithi134.stdout:2/656: dread d2/d5/d8/f88 [0,4194304] 0 2024-03-22T07:28:45.428 INFO:tasks.workunit.client.0.smithi134.stdout:2/657: write d2/d5/fa9 [381441,29947] 0 2024-03-22T07:28:45.428 INFO:tasks.workunit.client.0.smithi134.stdout:2/658: truncate d2/d5/d8/d5d/da1/fb8 790779 0 2024-03-22T07:28:45.429 INFO:tasks.workunit.client.0.smithi134.stdout:2/659: chown d2/d5/d8/fc3 6908408 1 2024-03-22T07:28:45.429 INFO:tasks.workunit.client.0.smithi134.stdout:2/660: creat d2/d5/d8/d5d/d5f/d75/fd7 x:0 0 0 2024-03-22T07:28:45.430 INFO:tasks.workunit.client.0.smithi134.stdout:9/622: dread d3/d9/d37/d3c/d71/d7a/f9c [0,4194304] 0 2024-03-22T07:28:45.431 INFO:tasks.workunit.client.0.smithi134.stdout:9/623: write d3/d9/d37/d5a/d7f/daf/fca [145594,3889] 0 2024-03-22T07:28:45.433 INFO:tasks.workunit.client.1.smithi195.stdout:7/963: dwrite d0/d13/d14/d29/d35/d6d/f7a [0,4194304] 0 2024-03-22T07:28:45.439 INFO:tasks.workunit.client.1.smithi195.stdout:6/852: getdents d5/d16/d45/df8/d104/da2 0 2024-03-22T07:28:45.441 INFO:tasks.workunit.client.0.smithi134.stdout:0/739: creat dc/de/d55/fe5 x:0 0 0 2024-03-22T07:28:45.444 INFO:tasks.workunit.client.1.smithi195.stdout:4/951: link d13/d63/d79/ce2 d13/d15/d6b/da6/c147 0 2024-03-22T07:28:45.444 INFO:tasks.workunit.client.1.smithi195.stdout:4/952: chown d13/d63/d79/de9/d7e/d8c/l96 18 1 2024-03-22T07:28:45.454 INFO:tasks.workunit.client.0.smithi134.stdout:6/556: sync 2024-03-22T07:28:45.455 INFO:tasks.workunit.client.0.smithi134.stdout:6/557: readlink d2/l10 0 2024-03-22T07:28:45.455 INFO:tasks.workunit.client.0.smithi134.stdout:7/894: link d1/de/d41/d87/d8f/le4 d1/de/d11/d2b/d31/d85/l11c 0 2024-03-22T07:28:45.455 INFO:tasks.workunit.client.0.smithi134.stdout:7/895: creat d1/de/d11/d48/daf/f11d x:0 0 0 2024-03-22T07:28:45.459 INFO:tasks.workunit.client.0.smithi134.stdout:3/670: mknod d4/d8/d5c/cd2 0 2024-03-22T07:28:45.460 INFO:tasks.workunit.client.0.smithi134.stdout:5/697: sync 2024-03-22T07:28:45.460 INFO:tasks.workunit.client.0.smithi134.stdout:5/698: creat d1/d8/d16/fe8 x:0 0 0 2024-03-22T07:28:45.465 INFO:tasks.workunit.client.1.smithi195.stdout:4/953: dwrite d13/d63/d79/de9/d7e/d8c/dd2/f122 [0,4194304] 0 2024-03-22T07:28:45.466 INFO:tasks.workunit.client.0.smithi134.stdout:9/624: link d3/d9/d37/d6f/d54/f83 d3/d9/d37/fcf 0 2024-03-22T07:28:45.469 INFO:tasks.workunit.client.0.smithi134.stdout:0/740: rename dc/de/l28 to dc/de/d55/d65/d82/db7/le6 0 2024-03-22T07:28:45.469 INFO:tasks.workunit.client.0.smithi134.stdout:0/741: write dc/d17/f41 [3944178,70040] 0 2024-03-22T07:28:45.469 INFO:tasks.workunit.client.0.smithi134.stdout:0/742: truncate dc/de/d55/d65/db8/f7d 952437 0 2024-03-22T07:28:45.469 INFO:tasks.workunit.client.0.smithi134.stdout:0/743: write dc/de/d55/d65/dc1/fd6 [661207,19940] 0 2024-03-22T07:28:45.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/964: mknod d0/d13/d14/d20/d40/d82/da0/d59/c156 0 2024-03-22T07:28:45.470 INFO:tasks.workunit.client.1.smithi195.stdout:7/965: fsync d0/d13/d14/d2f/dae/fe6 0 2024-03-22T07:28:45.471 INFO:tasks.workunit.client.0.smithi134.stdout:8/891: sync 2024-03-22T07:28:45.471 INFO:tasks.workunit.client.0.smithi134.stdout:1/752: sync 2024-03-22T07:28:45.471 INFO:tasks.workunit.client.0.smithi134.stdout:4/745: sync 2024-03-22T07:28:45.471 INFO:tasks.workunit.client.0.smithi134.stdout:4/746: stat d2/f5f 0 2024-03-22T07:28:45.471 INFO:tasks.workunit.client.0.smithi134.stdout:8/892: stat d1/d4/d61/c8a 0 2024-03-22T07:28:45.472 INFO:tasks.workunit.client.0.smithi134.stdout:6/558: mknod d2/d1b/daa/dc1/ccd 0 2024-03-22T07:28:45.474 INFO:tasks.workunit.client.1.smithi195.stdout:6/853: symlink d5/d16/d45/d53/d11c/l12e 0 2024-03-22T07:28:45.477 INFO:tasks.workunit.client.1.smithi195.stdout:3/959: rename d3/df/d15 to d3/d18/d89/d70/db5/d131 0 2024-03-22T07:28:45.477 INFO:tasks.workunit.client.1.smithi195.stdout:3/960: fdatasync d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/d80/f7d 0 2024-03-22T07:28:45.477 INFO:tasks.workunit.client.1.smithi195.stdout:4/954: dread d13/d63/d79/de9/d7e/fb6 [0,4194304] 0 2024-03-22T07:28:45.481 INFO:tasks.workunit.client.0.smithi134.stdout:3/671: dwrite d4/d8/d23/f55 [0,4194304] 0 2024-03-22T07:28:45.482 INFO:tasks.workunit.client.1.smithi195.stdout:7/966: mknod d0/d13/d22/d57/d7b/d8c/d141/c157 0 2024-03-22T07:28:45.483 INFO:tasks.workunit.client.0.smithi134.stdout:9/625: rename d3/d9/d37/c43 to d3/d9/d37/d5a/dc5/cd0 0 2024-03-22T07:28:45.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/961: mkdir d3/d18/d89/d8c/d9d/d132 0 2024-03-22T07:28:45.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/962: chown d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/d80/l111 0 1 2024-03-22T07:28:45.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/963: stat d3/d18/d89/d70/ffd 0 2024-03-22T07:28:45.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/964: write d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/f11d [4365042,110586] 0 2024-03-22T07:28:45.485 INFO:tasks.workunit.client.1.smithi195.stdout:3/965: write d3/d98/d115/ff7 [711595,107528] 0 2024-03-22T07:28:45.486 INFO:tasks.workunit.client.0.smithi134.stdout:8/893: creat d1/d4/d61/f12a x:0 0 0 2024-03-22T07:28:45.487 INFO:tasks.workunit.client.1.smithi195.stdout:4/955: mkdir d13/d15/d6b/da6/ded/def/d148 0 2024-03-22T07:28:45.488 INFO:tasks.workunit.client.0.smithi134.stdout:1/753: symlink d5/da/d68/d10d/l112 0 2024-03-22T07:28:45.489 INFO:tasks.workunit.client.1.smithi195.stdout:7/967: creat d0/f158 x:0 0 0 2024-03-22T07:28:45.489 INFO:tasks.workunit.client.1.smithi195.stdout:7/968: truncate d0/d13/d22/def/f103 205529 0 2024-03-22T07:28:45.490 INFO:tasks.workunit.client.0.smithi134.stdout:6/559: link d2/d3f/d28/l96 d2/d3f/d28/d6b/lce 0 2024-03-22T07:28:45.492 INFO:tasks.workunit.client.1.smithi195.stdout:3/966: symlink d3/d98/d115/da0/l133 0 2024-03-22T07:28:45.494 INFO:tasks.workunit.client.0.smithi134.stdout:3/672: symlink d4/d22/d3c/d88/ld3 0 2024-03-22T07:28:45.495 INFO:tasks.workunit.client.1.smithi195.stdout:4/956: symlink d13/d63/d3e/d5c/d65/df1/l149 0 2024-03-22T07:28:45.495 INFO:tasks.workunit.client.1.smithi195.stdout:4/957: write d13/d63/d3e/d5c/d65/f72 [2558662,9206] 0 2024-03-22T07:28:45.497 INFO:tasks.workunit.client.0.smithi134.stdout:0/744: rename dc/de/d55/f97 to dc/d18/d89/da0/fe7 0 2024-03-22T07:28:45.500 INFO:tasks.workunit.client.0.smithi134.stdout:6/560: creat d2/d1b/d1d/d5e/d6f/da8/dca/fcf x:0 0 0 2024-03-22T07:28:45.500 INFO:tasks.workunit.client.1.smithi195.stdout:6/854: dwrite d5/f1e [0,4194304] 0 2024-03-22T07:28:45.501 INFO:tasks.workunit.client.0.smithi134.stdout:3/673: truncate d4/d22/d29/f97 37852 0 2024-03-22T07:28:45.501 INFO:tasks.workunit.client.0.smithi134.stdout:3/674: write d4/d22/d3c/f98 [4922273,44985] 0 2024-03-22T07:28:45.501 INFO:tasks.workunit.client.0.smithi134.stdout:3/675: fdatasync d4/d8/d23/fbc 0 2024-03-22T07:28:45.502 INFO:tasks.workunit.client.0.smithi134.stdout:1/754: write d5/da/d13/d1e/d34/f43 [2922571,1287] 0 2024-03-22T07:28:45.502 INFO:tasks.workunit.client.0.smithi134.stdout:4/747: dwrite d2/d2a/d93/fcd [0,4194304] 0 2024-03-22T07:28:45.502 INFO:tasks.workunit.client.0.smithi134.stdout:5/699: dwrite d1/d8/fe4 [0,4194304] 0 2024-03-22T07:28:45.502 INFO:tasks.workunit.client.0.smithi134.stdout:8/894: rename d1/ffd to d1/d4/d38/f12b 0 2024-03-22T07:28:45.503 INFO:tasks.workunit.client.0.smithi134.stdout:0/745: getdents dc/de/d55/d65 0 2024-03-22T07:28:45.507 INFO:tasks.workunit.client.0.smithi134.stdout:6/561: mknod d2/d1b/d1d/d5e/d84/cd0 0 2024-03-22T07:28:45.513 INFO:tasks.workunit.client.0.smithi134.stdout:7/896: dwrite d1/de/d11/fd4 [0,4194304] 0 2024-03-22T07:28:45.514 INFO:tasks.workunit.client.0.smithi134.stdout:7/897: creat d1/de/d11/d48/dbc/f11e x:0 0 0 2024-03-22T07:28:45.514 INFO:tasks.workunit.client.0.smithi134.stdout:7/898: write d1/f33 [869690,77705] 0 2024-03-22T07:28:45.515 INFO:tasks.workunit.client.1.smithi195.stdout:2/997: sync 2024-03-22T07:28:45.515 INFO:tasks.workunit.client.1.smithi195.stdout:1/841: sync 2024-03-22T07:28:45.515 INFO:tasks.workunit.client.1.smithi195.stdout:1/842: truncate d0/d2/d6/dad/db1/d97/d41/d47/d4a/fbc 788125 0 2024-03-22T07:28:45.516 INFO:tasks.workunit.client.1.smithi195.stdout:3/967: dread d3/f2d [0,4194304] 0 2024-03-22T07:28:45.517 INFO:tasks.workunit.client.0.smithi134.stdout:3/676: read d4/d8/d5c/f85 [3099462,42568] 0 2024-03-22T07:28:45.517 INFO:tasks.workunit.client.1.smithi195.stdout:7/969: dwrite d0/d13/d14/d29/d35/d3a/f5d [0,4194304] 0 2024-03-22T07:28:45.518 INFO:tasks.workunit.client.0.smithi134.stdout:5/700: creat d1/da0/fe9 x:0 0 0 2024-03-22T07:28:45.518 INFO:tasks.workunit.client.0.smithi134.stdout:5/701: chown d1/d8/d20/f3e 0 1 2024-03-22T07:28:45.518 INFO:tasks.workunit.client.0.smithi134.stdout:5/702: write d1/d4/f94 [1041401,61446] 0 2024-03-22T07:28:45.520 INFO:tasks.workunit.client.1.smithi195.stdout:6/855: dread d5/d16/d45/df8/d104/da2/d1a/f32 [0,4194304] 0 2024-03-22T07:28:45.520 INFO:tasks.workunit.client.1.smithi195.stdout:2/998: rename d2/d3/d7/d19/d22/d26/d99/d118 to d2/d3/d7/da/de/d14f 0 2024-03-22T07:28:45.522 INFO:tasks.workunit.client.0.smithi134.stdout:2/661: truncate d2/d5/fa9 321399 0 2024-03-22T07:28:45.524 INFO:tasks.workunit.client.0.smithi134.stdout:9/626: dwrite d3/d9/f94 [0,4194304] 0 2024-03-22T07:28:45.524 INFO:tasks.workunit.client.0.smithi134.stdout:4/748: dwrite d2/d2a/d80/dd6/f24 [0,4194304] 0 2024-03-22T07:28:45.524 INFO:tasks.workunit.client.0.smithi134.stdout:1/755: dread d5/da/d13/d1e/d34/f5f [0,4194304] 0 2024-03-22T07:28:45.524 INFO:tasks.workunit.client.0.smithi134.stdout:0/746: unlink dc/d18/f1a 0 2024-03-22T07:28:45.526 INFO:tasks.workunit.client.0.smithi134.stdout:4/749: dread d2/d2a/d80/d85/faa [0,4194304] 0 2024-03-22T07:28:45.527 INFO:tasks.workunit.client.0.smithi134.stdout:1/756: dread d5/da/d1b/d27/fab [0,4194304] 0 2024-03-22T07:28:45.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/968: symlink d3/d18/d89/d70/db5/d131/l134 0 2024-03-22T07:28:45.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/969: creat d3/d18/d89/d76/f135 x:0 0 0 2024-03-22T07:28:45.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/970: fsync d3/fe7 0 2024-03-22T07:28:45.530 INFO:tasks.workunit.client.1.smithi195.stdout:3/971: fdatasync d3/f58 0 2024-03-22T07:28:45.532 INFO:tasks.workunit.client.0.smithi134.stdout:8/895: dwrite d1/d15/d5b/f6d [0,4194304] 0 2024-03-22T07:28:45.533 INFO:tasks.workunit.client.1.smithi195.stdout:7/970: mknod d0/d13/d14/d20/d40/d82/db8/c159 0 2024-03-22T07:28:45.533 INFO:tasks.workunit.client.1.smithi195.stdout:7/971: fsync d0/d13/d22/d57/f153 0 2024-03-22T07:28:45.534 INFO:tasks.workunit.client.0.smithi134.stdout:6/562: dwrite d2/d1b/d1d/f55 [0,4194304] 0 2024-03-22T07:28:45.535 INFO:tasks.workunit.client.1.smithi195.stdout:3/972: dread d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/d80/f8f [0,4194304] 0 2024-03-22T07:28:45.535 INFO:tasks.workunit.client.1.smithi195.stdout:3/973: creat d3/d18/d89/d76/def/df9/f136 x:0 0 0 2024-03-22T07:28:45.535 INFO:tasks.workunit.client.1.smithi195.stdout:3/974: fdatasync d3/d18/d89/d76/def/df9/f122 0 2024-03-22T07:28:45.535 INFO:tasks.workunit.client.1.smithi195.stdout:6/856: write d5/d5e/f84 [3360980,90609] 0 2024-03-22T07:28:45.537 INFO:tasks.workunit.client.0.smithi134.stdout:7/899: symlink d1/dae/l11f 0 2024-03-22T07:28:45.538 INFO:tasks.workunit.client.0.smithi134.stdout:3/677: mknod d4/d22/d3c/d88/cd4 0 2024-03-22T07:28:45.544 INFO:tasks.workunit.client.0.smithi134.stdout:5/703: mkdir d1/d8/d83/dea 0 2024-03-22T07:28:45.547 INFO:tasks.workunit.client.0.smithi134.stdout:2/662: rename d2/d5/d8/d31/f98 to d2/d5/d8/d5d/da1/d3c/d4f/fd8 0 2024-03-22T07:28:45.547 INFO:tasks.workunit.client.0.smithi134.stdout:2/663: truncate d2/d5/d8/d5d/da1/f76 1621507 0 2024-03-22T07:28:45.554 INFO:tasks.workunit.client.1.smithi195.stdout:2/999: symlink d2/d3/d24/l150 0 2024-03-22T07:28:45.555 INFO:tasks.workunit.client.0.smithi134.stdout:9/627: creat d3/d9/d37/d70/fd1 x:0 0 0 2024-03-22T07:28:45.555 INFO:tasks.workunit.client.0.smithi134.stdout:9/628: write d3/d9/df/d57/d67/fcc [1004112,93484] 0 2024-03-22T07:28:45.556 INFO:tasks.workunit.client.1.smithi195.stdout:1/843: rename d0/d2/d27/d91/dc8/da4/dc0/cc7 to d0/d2/d27/d91/dc8/d2a/da0/c117 0 2024-03-22T07:28:45.558 INFO:tasks.workunit.client.0.smithi134.stdout:6/563: dwrite d2/d3f/d28/f7e [4194304,4194304] 0 2024-03-22T07:28:45.559 INFO:tasks.workunit.client.0.smithi134.stdout:0/747: rmdir dc/d17/da9 39 2024-03-22T07:28:45.560 INFO:tasks.workunit.client.0.smithi134.stdout:0/748: write dc/f29 [1687104,21281] 0 2024-03-22T07:28:45.560 INFO:tasks.workunit.client.0.smithi134.stdout:0/749: readlink dc/d18/d89/l9f 0 2024-03-22T07:28:45.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/972: dwrite d0/d13/d14/d80/d9c/fea [0,4194304] 0 2024-03-22T07:28:45.562 INFO:tasks.workunit.client.1.smithi195.stdout:7/973: fsync d0/d13/d22/d28/f10d 0 2024-03-22T07:28:45.562 INFO:tasks.workunit.client.1.smithi195.stdout:3/975: dwrite d3/d18/d89/d70/ffd [0,4194304] 0 2024-03-22T07:28:45.563 INFO:tasks.workunit.client.0.smithi134.stdout:4/750: stat d2/d2a/d50/c53 0 2024-03-22T07:28:45.563 INFO:tasks.workunit.client.0.smithi134.stdout:4/751: fsync d2/d2a/d80/dd6/f5e 0 2024-03-22T07:28:45.566 INFO:tasks.workunit.client.0.smithi134.stdout:1/757: getdents d5/da 0 2024-03-22T07:28:45.571 INFO:tasks.workunit.client.1.smithi195.stdout:6/857: creat d5/d16/d5b/f12f x:0 0 0 2024-03-22T07:28:45.575 INFO:tasks.workunit.client.0.smithi134.stdout:8/896: creat d1/d4/d61/d85/f12c x:0 0 0 2024-03-22T07:28:45.577 INFO:tasks.workunit.client.1.smithi195.stdout:1/844: unlink d0/d2/d6/dad/df2/f112 0 2024-03-22T07:28:45.577 INFO:tasks.workunit.client.1.smithi195.stdout:1/845: chown d0/d2/d6/dad/db1/d97/d41/d47/d4a/d66/fee 331036 1 2024-03-22T07:28:45.577 INFO:tasks.workunit.client.1.smithi195.stdout:1/846: chown d0/d2/d6/dad/db1/d97/d39/l113 1963 1 2024-03-22T07:28:45.579 INFO:tasks.workunit.client.0.smithi134.stdout:7/900: link d1/dae/fc7 d1/d19/d9c/db3/dc4/de2/f120 0 2024-03-22T07:28:45.583 INFO:tasks.workunit.client.0.smithi134.stdout:3/678: unlink d4/d8/d45/da9/lb1 0 2024-03-22T07:28:45.583 INFO:tasks.workunit.client.0.smithi134.stdout:0/750: dwrite dc/f57 [0,4194304] 0 2024-03-22T07:28:45.585 INFO:tasks.workunit.client.0.smithi134.stdout:9/629: dwrite d3/d9/df/d12/f1d [0,4194304] 0 2024-03-22T07:28:45.588 INFO:tasks.workunit.client.0.smithi134.stdout:5/704: rename d1/d8/d20/c4f to d1/d8/d20/d62/d68/ceb 0 2024-03-22T07:28:45.592 INFO:tasks.workunit.client.0.smithi134.stdout:2/664: symlink d2/d5/ld9 0 2024-03-22T07:28:45.595 INFO:tasks.workunit.client.1.smithi195.stdout:3/976: getdents d3/df 0 2024-03-22T07:28:45.596 INFO:tasks.workunit.client.0.smithi134.stdout:9/630: dread d3/d9/df/d12/f16 [0,4194304] 0 2024-03-22T07:28:45.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/631: fdatasync d3/d9/d37/d6f/d54/f68 0 2024-03-22T07:28:45.597 INFO:tasks.workunit.client.0.smithi134.stdout:9/632: getdents d3/d9/d37/d3c/d71/d8c 0 2024-03-22T07:28:45.598 INFO:tasks.workunit.client.1.smithi195.stdout:6/858: creat d5/d5e/d34/d55/dab/f130 x:0 0 0 2024-03-22T07:28:45.602 INFO:tasks.workunit.client.0.smithi134.stdout:6/564: creat d2/d1b/d1d/d5e/d6f/fd1 x:0 0 0 2024-03-22T07:28:45.603 INFO:tasks.workunit.client.0.smithi134.stdout:5/705: write d1/d8/d20/d62/d65/f43 [2254371,116122] 0 2024-03-22T07:28:45.603 INFO:tasks.workunit.client.1.smithi195.stdout:6/859: creat d5/d5e/d34/f131 x:0 0 0 2024-03-22T07:28:45.604 INFO:tasks.workunit.client.1.smithi195.stdout:6/860: fsync d5/d6d/d95/fd9 0 2024-03-22T07:28:45.606 INFO:tasks.workunit.client.0.smithi134.stdout:4/752: mkdir d2/d15/d35/da8/dec/def/d106 0 2024-03-22T07:28:45.606 INFO:tasks.workunit.client.0.smithi134.stdout:8/897: dwrite d1/d15/d42/d25/d6f/fca [0,4194304] 0 2024-03-22T07:28:45.606 INFO:tasks.workunit.client.0.smithi134.stdout:8/898: creat d1/d46/d75/d8b/db4/d102/f12d x:0 0 0 2024-03-22T07:28:45.608 INFO:tasks.workunit.client.0.smithi134.stdout:7/901: dwrite d1/de/d11/d2b/d31/f8a [0,4194304] 0 2024-03-22T07:28:45.610 INFO:tasks.workunit.client.1.smithi195.stdout:6/861: rename d5/d16/d45/df8/d104/da2/d1a/f71 to d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/dd5/f132 0 2024-03-22T07:28:45.613 INFO:tasks.workunit.client.1.smithi195.stdout:1/847: dwrite d0/d2/d27/d91/dc8/f6c [0,4194304] 0 2024-03-22T07:28:45.615 INFO:tasks.workunit.client.1.smithi195.stdout:6/862: creat d5/d5e/d34/d55/d3b/d6e/d97/d112/f133 x:0 0 0 2024-03-22T07:28:45.615 INFO:tasks.workunit.client.0.smithi134.stdout:3/679: dwrite d4/d8/d23/f70 [4194304,4194304] 0 2024-03-22T07:28:45.620 INFO:tasks.workunit.client.0.smithi134.stdout:8/899: write d1/d4/d117/d11a/d20/f74 [1556621,45609] 0 2024-03-22T07:28:45.624 INFO:tasks.workunit.client.0.smithi134.stdout:4/753: dwrite d2/d15/f11 [0,4194304] 0 2024-03-22T07:28:45.624 INFO:tasks.workunit.client.0.smithi134.stdout:4/754: write d2/d2a/d50/f5c [2988281,86463] 0 2024-03-22T07:28:45.624 INFO:tasks.workunit.client.0.smithi134.stdout:7/902: dread d1/de/d11/d48/daf/dbf/fe9 [0,4194304] 0 2024-03-22T07:28:45.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/900: dread d1/d15/d42/d76/d8f/dad/dae/fbc [0,4194304] 0 2024-03-22T07:28:45.624 INFO:tasks.workunit.client.0.smithi134.stdout:8/901: readlink d1/d4/d61/l98 0 2024-03-22T07:28:45.625 INFO:tasks.workunit.client.1.smithi195.stdout:6/863: dread d5/d5e/d34/d55/d3b/dc2/f10c [0,4194304] 0 2024-03-22T07:28:45.625 INFO:tasks.workunit.client.1.smithi195.stdout:6/864: write d5/d5e/d34/d55/d3b/f8e [221896,60690] 0 2024-03-22T07:28:45.625 INFO:tasks.workunit.client.1.smithi195.stdout:6/865: fsync d5/d16/d45/d53/d59/d87/ffc 0 2024-03-22T07:28:45.625 INFO:tasks.workunit.client.1.smithi195.stdout:6/866: creat d5/d5e/d34/d55/dab/dbf/f134 x:0 0 0 2024-03-22T07:28:45.625 INFO:tasks.workunit.client.1.smithi195.stdout:6/867: truncate d5/d16/f125 82551 0 2024-03-22T07:28:45.632 INFO:tasks.workunit.client.1.smithi195.stdout:6/868: dread d5/d16/d45/f6f [0,4194304] 0 2024-03-22T07:28:45.632 INFO:tasks.workunit.client.1.smithi195.stdout:6/869: write d5/d5e/d34/d55/d3b/d6e/d3c/f6c [588156,87286] 0 2024-03-22T07:28:45.633 INFO:tasks.workunit.client.0.smithi134.stdout:2/665: symlink d2/d5/d22/d99/lda 0 2024-03-22T07:28:45.633 INFO:tasks.workunit.client.0.smithi134.stdout:2/666: chown d2/d5/d8/d5d/da1/d3c/f69 240084 1 2024-03-22T07:28:45.633 INFO:tasks.workunit.client.0.smithi134.stdout:9/633: mknod d3/d9/d37/d3c/dcb/cd2 0 2024-03-22T07:28:45.633 INFO:tasks.workunit.client.0.smithi134.stdout:9/634: write d3/d9/d37/d3c/d71/d8e/fbc [203786,64885] 0 2024-03-22T07:28:45.635 INFO:tasks.workunit.client.0.smithi134.stdout:6/565: rename d2/d1b/d4d/d65/c72 to d2/d1b/d1d/d5e/d6f/da8/cd2 0 2024-03-22T07:28:45.636 INFO:tasks.workunit.client.0.smithi134.stdout:6/566: getdents d2/d1b/d4d 0 2024-03-22T07:28:45.637 INFO:tasks.workunit.client.1.smithi195.stdout:6/870: mkdir d5/d16/d45/df8/d104/ddc/d135 0 2024-03-22T07:28:45.638 INFO:tasks.workunit.client.1.smithi195.stdout:6/871: chown d5/d5e/d34/fa6 2828305 1 2024-03-22T07:28:45.640 INFO:tasks.workunit.client.0.smithi134.stdout:5/706: symlink d1/d8/dc5/da2/lec 0 2024-03-22T07:28:45.640 INFO:tasks.workunit.client.0.smithi134.stdout:5/707: readlink d1/d4/l2d 0 2024-03-22T07:28:45.641 INFO:tasks.workunit.client.1.smithi195.stdout:6/872: symlink d5/d16/d45/df8/d104/ddc/d135/l136 0 2024-03-22T07:28:45.650 INFO:tasks.workunit.client.1.smithi195.stdout:6/873: symlink d5/d16/d45/df8/d104/da2/dad/de3/l137 0 2024-03-22T07:28:45.652 INFO:tasks.workunit.client.0.smithi134.stdout:3/680: mkdir d4/d8/d7f/dd5 0 2024-03-22T07:28:45.652 INFO:tasks.workunit.client.0.smithi134.stdout:6/567: dwrite d2/d1b/d1d/d5e/d63/fa2 [4194304,4194304] 0 2024-03-22T07:28:45.652 INFO:tasks.workunit.client.0.smithi134.stdout:6/568: readlink d2/d6e/l78 0 2024-03-22T07:28:45.653 INFO:tasks.workunit.client.1.smithi195.stdout:6/874: mkdir d5/d16/d45/df8/d104/da2/d82/ddf/d138 0 2024-03-22T07:28:45.654 INFO:tasks.workunit.client.0.smithi134.stdout:3/681: dread d4/d22/d3c/fb6 [0,4194304] 0 2024-03-22T07:28:45.655 INFO:tasks.workunit.client.1.smithi195.stdout:6/875: creat d5/d5e/d34/d55/dcb/f139 x:0 0 0 2024-03-22T07:28:45.656 INFO:tasks.workunit.client.0.smithi134.stdout:4/755: unlink d2/d15/ce6 0 2024-03-22T07:28:45.657 INFO:tasks.workunit.client.0.smithi134.stdout:8/902: creat d1/d15/d7b/d83/de3/f12e x:0 0 0 2024-03-22T07:28:45.659 INFO:tasks.workunit.client.1.smithi195.stdout:6/876: mkdir d5/d16/d45/df8/d104/ddc/d13a 0 2024-03-22T07:28:45.660 INFO:tasks.workunit.client.0.smithi134.stdout:0/751: mkdir dc/de/d55/de1/de8 0 2024-03-22T07:28:45.660 INFO:tasks.workunit.client.0.smithi134.stdout:0/752: creat dc/d18/d85/fe9 x:0 0 0 2024-03-22T07:28:45.660 INFO:tasks.workunit.client.0.smithi134.stdout:0/753: chown dc/de/d55/f9a 229 1 2024-03-22T07:28:45.661 INFO:tasks.workunit.client.0.smithi134.stdout:2/667: symlink d2/d5/d8/d5d/da1/d3c/d4f/d6e/ldb 0 2024-03-22T07:28:45.662 INFO:tasks.workunit.client.0.smithi134.stdout:2/668: fdatasync d2/d5/d22/f2a 0 2024-03-22T07:28:45.663 INFO:tasks.workunit.client.0.smithi134.stdout:9/635: getdents d3/d9/d37/d5a/dc5 0 2024-03-22T07:28:45.667 INFO:tasks.workunit.client.0.smithi134.stdout:5/708: symlink d1/d8/d20/d8a/d75/led 0 2024-03-22T07:28:45.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/569: mknod d2/d1b/d1d/cd3 0 2024-03-22T07:28:45.671 INFO:tasks.workunit.client.0.smithi134.stdout:6/570: write d2/f69 [242360,15965] 0 2024-03-22T07:28:45.672 INFO:tasks.workunit.client.0.smithi134.stdout:3/682: symlink d4/d10/d6c/ld6 0 2024-03-22T07:28:45.672 INFO:tasks.workunit.client.0.smithi134.stdout:3/683: fdatasync d4/f66 0 2024-03-22T07:28:45.677 INFO:tasks.workunit.client.0.smithi134.stdout:0/754: creat dc/de/dc9/dd0/fea x:0 0 0 2024-03-22T07:28:45.678 INFO:tasks.workunit.client.0.smithi134.stdout:2/669: symlink d2/d5/d8/d31/dd5/ldc 0 2024-03-22T07:28:45.680 INFO:tasks.workunit.client.0.smithi134.stdout:4/756: dwrite d2/d2a/d80/d85/faa [0,4194304] 0 2024-03-22T07:28:45.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/709: creat d1/d8/d16/d4a/fee x:0 0 0 2024-03-22T07:28:45.680 INFO:tasks.workunit.client.0.smithi134.stdout:5/710: chown d1/d8/d83/f8f 70 1 2024-03-22T07:28:45.681 INFO:tasks.workunit.client.0.smithi134.stdout:6/571: mknod d2/d3f/d28/cd4 0 2024-03-22T07:28:45.682 INFO:tasks.workunit.client.0.smithi134.stdout:8/903: dwrite d1/d15/d42/d76/d8f/dad/dae/fbc [0,4194304] 0 2024-03-22T07:28:45.683 INFO:tasks.workunit.client.0.smithi134.stdout:3/684: mkdir d4/d8/d69/dd7 0 2024-03-22T07:28:45.686 INFO:tasks.workunit.client.0.smithi134.stdout:0/755: link dc/d17/f38 dc/de/d55/feb 0 2024-03-22T07:28:45.688 INFO:tasks.workunit.client.0.smithi134.stdout:7/903: rename d1/de/d11/d97 to d1/de/d11/d2b/d31/d85/d121 0 2024-03-22T07:28:45.689 INFO:tasks.workunit.client.0.smithi134.stdout:4/757: read f1 [556872,15988] 0 2024-03-22T07:28:45.689 INFO:tasks.workunit.client.0.smithi134.stdout:7/904: chown d1/de/d11/d48/daf/lec 72 1 2024-03-22T07:28:45.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/670: read d2/f3a [2074466,101742] 0 2024-03-22T07:28:45.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/671: fsync d2/d5/d8/d5d/da1/d3c/d60/f72 0 2024-03-22T07:28:45.690 INFO:tasks.workunit.client.0.smithi134.stdout:2/672: write d2/d5/d8/d5d/da1/fb8 [1607686,58217] 0 2024-03-22T07:28:45.690 INFO:tasks.workunit.client.0.smithi134.stdout:8/904: write d1/d46/d75/d8b/db4/fcd [4002855,26486] 0 2024-03-22T07:28:45.690 INFO:tasks.workunit.client.0.smithi134.stdout:8/905: dread - d1/d4/d117/d11a/d20/fe4 zero size 2024-03-22T07:28:45.690 INFO:tasks.workunit.client.0.smithi134.stdout:8/906: fdatasync d1/d4/f54 0 2024-03-22T07:28:45.693 INFO:tasks.workunit.client.0.smithi134.stdout:5/711: mknod d1/d8/d16/d4a/dce/de0/cef 0 2024-03-22T07:28:45.696 INFO:tasks.workunit.client.0.smithi134.stdout:3/685: mknod d4/d22/dce/cd8 0 2024-03-22T07:28:45.698 INFO:tasks.workunit.client.0.smithi134.stdout:3/686: dread d4/f94 [0,4194304] 0 2024-03-22T07:28:45.698 INFO:tasks.workunit.client.0.smithi134.stdout:7/905: write d1/d40/f7f [7693914,89287] 0 2024-03-22T07:28:45.698 INFO:tasks.workunit.client.0.smithi134.stdout:3/687: chown d4/d10/fbe 936 1 2024-03-22T07:28:45.698 INFO:tasks.workunit.client.0.smithi134.stdout:3/688: chown d4/d22/f6d 704 1 2024-03-22T07:28:45.702 INFO:tasks.workunit.client.0.smithi134.stdout:5/712: write d1/d8/dc5/fb6 [2981810,76453] 0 2024-03-22T07:28:45.702 INFO:tasks.workunit.client.0.smithi134.stdout:5/713: write d1/d8/f1b [796250,51753] 0 2024-03-22T07:28:45.704 INFO:tasks.workunit.client.0.smithi134.stdout:9/636: rename d3/d9/df/d57/d67/l3f to d3/d9/d37/d6f/d54/d9d/dc0/ld3 0 2024-03-22T07:28:45.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/758: mknod d2/d15/c107 0 2024-03-22T07:28:45.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/759: chown d2/d25/d74/dde/d76/l84 588590 1 2024-03-22T07:28:45.708 INFO:tasks.workunit.client.0.smithi134.stdout:8/907: link d1/d15/d42/d76/d8f/f121 d1/d15/d7b/d83/de3/f12f 0 2024-03-22T07:28:45.710 INFO:tasks.workunit.client.0.smithi134.stdout:6/572: getdents d2/d1b/d1d/d5e/d6f 0 2024-03-22T07:28:45.710 INFO:tasks.workunit.client.0.smithi134.stdout:2/673: dwrite d2/f3a [0,4194304] 0 2024-03-22T07:28:45.710 INFO:tasks.workunit.client.0.smithi134.stdout:0/756: write dc/de/f84 [2888660,89715] 0 2024-03-22T07:28:45.711 INFO:tasks.workunit.client.1.smithi195.stdout:4/958: sync 2024-03-22T07:28:45.711 INFO:tasks.workunit.client.1.smithi195.stdout:4/959: creat d13/d63/d79/d68/f14a x:0 0 0 2024-03-22T07:28:45.711 INFO:tasks.workunit.client.1.smithi195.stdout:4/960: chown d13/d15/d6b/da6/ded/def/d134/l67 113812 1 2024-03-22T07:28:45.712 INFO:tasks.workunit.client.0.smithi134.stdout:7/906: mkdir d1/d19/d9c/db3/dc4/df7/d122 0 2024-03-22T07:28:45.712 INFO:tasks.workunit.client.0.smithi134.stdout:7/907: write d1/de/d11/d2b/faa [600989,16942] 0 2024-03-22T07:28:45.712 INFO:tasks.workunit.client.0.smithi134.stdout:3/689: creat d4/d22/d3c/d88/fd9 x:0 0 0 2024-03-22T07:28:45.713 INFO:tasks.workunit.client.0.smithi134.stdout:3/690: getdents d4/d8/d7f/dd5 0 2024-03-22T07:28:45.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/714: write d1/d8/d20/d62/f8e [263755,108789] 0 2024-03-22T07:28:45.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/715: truncate d1/d8/dc5/da2/f6d 26094 0 2024-03-22T07:28:45.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/716: chown d1/fcd 6661 1 2024-03-22T07:28:45.715 INFO:tasks.workunit.client.0.smithi134.stdout:5/717: chown d1/d8/d20/d62/d65/dac/dad/fd9 50503310 1 2024-03-22T07:28:45.717 INFO:tasks.workunit.client.0.smithi134.stdout:4/760: link d2/d2a/d80/dd6/c21 d2/d15/d6f/c108 0 2024-03-22T07:28:45.719 INFO:tasks.workunit.client.0.smithi134.stdout:8/908: creat d1/d46/d75/d8b/db4/f130 x:0 0 0 2024-03-22T07:28:45.719 INFO:tasks.workunit.client.0.smithi134.stdout:8/909: truncate d1/d15/d42/d76/dda/f10e 1049887 0 2024-03-22T07:28:45.720 INFO:tasks.workunit.client.0.smithi134.stdout:6/573: link d2/d1b/f29 d2/d3f/d28/fd5 0 2024-03-22T07:28:45.723 INFO:tasks.workunit.client.0.smithi134.stdout:9/637: dwrite d3/d9/df/d12/f16 [4194304,4194304] 0 2024-03-22T07:28:45.724 INFO:tasks.workunit.client.0.smithi134.stdout:9/638: fsync d3/d9/f18 0 2024-03-22T07:28:45.725 INFO:tasks.workunit.client.0.smithi134.stdout:2/674: rmdir d2/d5/d8/d5d 39 2024-03-22T07:28:45.725 INFO:tasks.workunit.client.0.smithi134.stdout:3/691: dread d4/d22/d29/f67 [0,4194304] 0 2024-03-22T07:28:45.728 INFO:tasks.workunit.client.0.smithi134.stdout:7/908: rename d1/de/d11/d2b/c94 to d1/de/d41/d87/c123 0 2024-03-22T07:28:45.742 INFO:tasks.workunit.client.0.smithi134.stdout:8/910: dwrite d1/d15/d42/d76/f78 [0,4194304] 0 2024-03-22T07:28:45.743 INFO:tasks.workunit.client.0.smithi134.stdout:4/761: symlink d2/d2a/d93/deb/l109 0 2024-03-22T07:28:45.743 INFO:tasks.workunit.client.0.smithi134.stdout:4/762: creat d2/d25/d48/d6e/d7b/dd7/f10a x:0 0 0 2024-03-22T07:28:45.744 INFO:tasks.workunit.client.0.smithi134.stdout:4/763: getdents d2/d25/d48/da4 0 2024-03-22T07:28:45.745 INFO:tasks.workunit.client.0.smithi134.stdout:6/574: mknod d2/d1b/d1d/d5e/d6f/cd6 0 2024-03-22T07:28:45.746 INFO:tasks.workunit.client.0.smithi134.stdout:7/909: dwrite d1/de/d11/d2b/d31/fc0 [0,4194304] 0 2024-03-22T07:28:45.746 INFO:tasks.workunit.client.0.smithi134.stdout:7/910: truncate d1/de/d11/d48/dbc/f114 1033953 0 2024-03-22T07:28:45.748 INFO:tasks.workunit.client.0.smithi134.stdout:9/639: unlink d3/d9/d37/d5a/d7f/daf/fca 0 2024-03-22T07:28:45.749 INFO:tasks.workunit.client.0.smithi134.stdout:2/675: mknod d2/d5/d8/d7e/dba/dc6/cdd 0 2024-03-22T07:28:45.749 INFO:tasks.workunit.client.0.smithi134.stdout:2/676: fdatasync d2/f3b 0 2024-03-22T07:28:45.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/692: creat d4/d8/d69/dd7/fda x:0 0 0 2024-03-22T07:28:45.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/693: fsync d4/d10/f35 0 2024-03-22T07:28:45.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/694: stat d4/d22/d3c/d88/fd9 0 2024-03-22T07:28:45.751 INFO:tasks.workunit.client.0.smithi134.stdout:3/695: chown d4/l54 156836862 1 2024-03-22T07:28:45.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/696: fdatasync d4/d8/d7f/d9c/db9/fc4 0 2024-03-22T07:28:45.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/697: dread - d4/d22/f6d zero size 2024-03-22T07:28:45.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/698: readlink d4/d8/d23/l2f 0 2024-03-22T07:28:45.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/699: chown d4/d8/d23/l79 0 1 2024-03-22T07:28:45.752 INFO:tasks.workunit.client.0.smithi134.stdout:0/757: rmdir dc/de/d55/d60 39 2024-03-22T07:28:45.753 INFO:tasks.workunit.client.0.smithi134.stdout:8/911: unlink d1/d15/d42/d49/c4d 0 2024-03-22T07:28:45.753 INFO:tasks.workunit.client.0.smithi134.stdout:8/912: chown d1/d46/d75/d8b/db4/fcd 6525963 1 2024-03-22T07:28:45.753 INFO:tasks.workunit.client.0.smithi134.stdout:8/913: chown d1/d15/d42/d76/d8f/dad/dae/fc0 39 1 2024-03-22T07:28:45.754 INFO:tasks.workunit.client.0.smithi134.stdout:4/764: symlink d2/d15/d35/da8/l10b 0 2024-03-22T07:28:45.755 INFO:tasks.workunit.client.0.smithi134.stdout:6/575: truncate d2/d1b/d1d/d5e/d63/f64 2707434 0 2024-03-22T07:28:45.759 INFO:tasks.workunit.client.0.smithi134.stdout:9/640: read d3/d9/df/d12/f1d [2659525,117094] 0 2024-03-22T07:28:45.759 INFO:tasks.workunit.client.0.smithi134.stdout:8/914: read d1/d15/d42/d76/dda/f10e [578033,49341] 0 2024-03-22T07:28:45.760 INFO:tasks.workunit.client.0.smithi134.stdout:8/915: fsync d1/d4/d117/d11a/d2a/f23 0 2024-03-22T07:28:45.760 INFO:tasks.workunit.client.0.smithi134.stdout:8/916: chown d1/d15/d57/d79/l95 9 1 2024-03-22T07:28:45.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/911: mkdir d1/de/d11/d48/daf/dbf/d124 0 2024-03-22T07:28:45.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/912: chown d1/de/d8d/l112 15571139 1 2024-03-22T07:28:45.762 INFO:tasks.workunit.client.0.smithi134.stdout:3/700: mknod d4/d8/d7f/d9c/db9/cdb 0 2024-03-22T07:28:45.762 INFO:tasks.workunit.client.0.smithi134.stdout:3/701: readlink d4/d22/d29/d50/lc6 0 2024-03-22T07:28:45.763 INFO:tasks.workunit.client.0.smithi134.stdout:3/702: truncate d4/d8/d23/fbc 521934 0 2024-03-22T07:28:45.763 INFO:tasks.workunit.client.0.smithi134.stdout:0/758: mknod dc/d17/da7/cec 0 2024-03-22T07:28:45.763 INFO:tasks.workunit.client.0.smithi134.stdout:0/759: chown dc/d17/f38 23430849 1 2024-03-22T07:28:45.763 INFO:tasks.workunit.client.0.smithi134.stdout:8/917: dread d1/d15/d5b/f81 [0,4194304] 0 2024-03-22T07:28:45.764 INFO:tasks.workunit.client.0.smithi134.stdout:9/641: creat d3/d9/d37/d5a/d7f/fd4 x:0 0 0 2024-03-22T07:28:45.766 INFO:tasks.workunit.client.0.smithi134.stdout:3/703: symlink d4/d8/d7f/d9c/ldc 0 2024-03-22T07:28:45.766 INFO:tasks.workunit.client.0.smithi134.stdout:3/704: readlink d4/d10/d6c/ld6 0 2024-03-22T07:28:45.766 INFO:tasks.workunit.client.0.smithi134.stdout:3/705: readlink d4/d22/d29/l47 0 2024-03-22T07:28:45.767 INFO:tasks.workunit.client.0.smithi134.stdout:0/760: creat dc/de/dc9/dd0/ddb/fed x:0 0 0 2024-03-22T07:28:45.770 INFO:tasks.workunit.client.0.smithi134.stdout:8/918: creat d1/f131 x:0 0 0 2024-03-22T07:28:45.770 INFO:tasks.workunit.client.0.smithi134.stdout:0/761: dread dc/de/d55/f56 [4194304,4194304] 0 2024-03-22T07:28:45.770 INFO:tasks.workunit.client.0.smithi134.stdout:9/642: link d3/d9/d37/d70/fd1 d3/d9/d37/d3c/d71/d8e/fd5 0 2024-03-22T07:28:45.771 INFO:tasks.workunit.client.0.smithi134.stdout:0/762: read dc/d17/f75 [8176,71341] 0 2024-03-22T07:28:45.772 INFO:tasks.workunit.client.0.smithi134.stdout:9/643: symlink d3/d9/df/d57/d67/d5f/ld6 0 2024-03-22T07:28:45.774 INFO:tasks.workunit.client.0.smithi134.stdout:4/765: dwrite d2/d15/d6f/fd5 [0,4194304] 0 2024-03-22T07:28:45.775 INFO:tasks.workunit.client.0.smithi134.stdout:0/763: mkdir dc/de/d55/d60/dee 0 2024-03-22T07:28:45.775 INFO:tasks.workunit.client.0.smithi134.stdout:3/706: rmdir d4/d8/d45/da9 39 2024-03-22T07:28:45.776 INFO:tasks.workunit.client.0.smithi134.stdout:9/644: mkdir d3/d9/df/d12/dd7 0 2024-03-22T07:28:45.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/766: unlink d2/d2a/d80/dd6/fbc 0 2024-03-22T07:28:45.782 INFO:tasks.workunit.client.0.smithi134.stdout:2/677: dwrite d2/d5/d8/d5d/da1/d3c/d60/f91 [0,4194304] 0 2024-03-22T07:28:45.782 INFO:tasks.workunit.client.0.smithi134.stdout:2/678: write d2/d5/d8/d5d/da1/d3c/f89 [2360924,97312] 0 2024-03-22T07:28:45.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/764: rename dc/l22 to dc/de/d55/lef 0 2024-03-22T07:28:45.783 INFO:tasks.workunit.client.0.smithi134.stdout:9/645: mknod d3/d9/d37/d3c/cd8 0 2024-03-22T07:28:45.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/707: dread d4/d8/d23/f60 [0,4194304] 0 2024-03-22T07:28:45.785 INFO:tasks.workunit.client.0.smithi134.stdout:3/708: truncate d4/d22/f25 2098531 0 2024-03-22T07:28:45.785 INFO:tasks.workunit.client.0.smithi134.stdout:4/767: symlink d2/d25/d48/d6e/d7b/dd7/l10c 0 2024-03-22T07:28:45.787 INFO:tasks.workunit.client.0.smithi134.stdout:2/679: mkdir d2/d5/dde 0 2024-03-22T07:28:45.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/765: chown dc/de/c54 441 1 2024-03-22T07:28:45.788 INFO:tasks.workunit.client.0.smithi134.stdout:0/766: write dc/d17/f77 [2342540,105107] 0 2024-03-22T07:28:45.789 INFO:tasks.workunit.client.0.smithi134.stdout:7/913: dwrite d1/de/d11/d48/d52/d46/fb1 [0,4194304] 0 2024-03-22T07:28:45.789 INFO:tasks.workunit.client.0.smithi134.stdout:9/646: dread d3/d9/f62 [0,4194304] 0 2024-03-22T07:28:45.790 INFO:tasks.workunit.client.0.smithi134.stdout:2/680: creat d2/d5/d22/dbe/fdf x:0 0 0 2024-03-22T07:28:45.791 INFO:tasks.workunit.client.0.smithi134.stdout:2/681: dread - d2/d5/d8/d5d/da1/d3c/fc4 zero size 2024-03-22T07:28:45.792 INFO:tasks.workunit.client.0.smithi134.stdout:8/919: dwrite d1/d15/d42/d76/d8f/f122 [0,4194304] 0 2024-03-22T07:28:45.794 INFO:tasks.workunit.client.0.smithi134.stdout:7/914: truncate d1/de/d11/d48/d52/fa4 2418278 0 2024-03-22T07:28:45.797 INFO:tasks.workunit.client.0.smithi134.stdout:2/682: unlink d2/d5/d22/d99/cc0 0 2024-03-22T07:28:45.798 INFO:tasks.workunit.client.0.smithi134.stdout:2/683: fdatasync d2/d5/d8/d5d/da1/f76 0 2024-03-22T07:28:45.798 INFO:tasks.workunit.client.0.smithi134.stdout:2/684: chown d2/fa3 37444 1 2024-03-22T07:28:45.798 INFO:tasks.workunit.client.0.smithi134.stdout:2/685: truncate d2/d5/d8/f5a 1028870 0 2024-03-22T07:28:45.798 INFO:tasks.workunit.client.0.smithi134.stdout:2/686: readlink d2/d5/d54/l8c 0 2024-03-22T07:28:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:7/974: sync 2024-03-22T07:28:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:3/977: sync 2024-03-22T07:28:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:1/848: sync 2024-03-22T07:28:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:6/877: sync 2024-03-22T07:28:45.799 INFO:tasks.workunit.client.1.smithi195.stdout:1/849: chown d0/d2/d6/dad/db1/d97/d41/d47/d4a 210032998 1 2024-03-22T07:28:45.803 INFO:tasks.workunit.client.0.smithi134.stdout:4/768: dwrite d2/d2a/d50/fa9 [0,4194304] 0 2024-03-22T07:28:45.803 INFO:tasks.workunit.client.0.smithi134.stdout:4/769: symlink d2/d25/d48/d6e/d7b/l10d 2 2024-03-22T07:28:45.804 INFO:tasks.workunit.client.1.smithi195.stdout:3/978: rename d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/d80/f43 to d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/d93/da2/f137 0 2024-03-22T07:28:45.804 INFO:tasks.workunit.client.1.smithi195.stdout:3/979: fdatasync d3/d18/f51 0 2024-03-22T07:28:45.805 INFO:tasks.workunit.client.0.smithi134.stdout:8/920: creat d1/d15/d42/d76/d8f/dad/dfc/f132 x:0 0 0 2024-03-22T07:28:45.806 INFO:tasks.workunit.client.1.smithi195.stdout:6/878: creat d5/d5e/d34/d55/d3b/d6e/d3c/d129/f13b x:0 0 0 2024-03-22T07:28:45.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/975: write d0/d13/d14/d80/d9c/d122/d110/f9b [1533422,99438] 0 2024-03-22T07:28:45.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/976: write d0/d13/d14/d29/fe1 [3039789,126177] 0 2024-03-22T07:28:45.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/977: write d0/d13/d14/d2f/dae/f11f [26869,108176] 0 2024-03-22T07:28:45.810 INFO:tasks.workunit.client.1.smithi195.stdout:7/978: readlink d0/d13/d14/d80/d9c/d122/d110/l66 0 2024-03-22T07:28:45.810 INFO:tasks.workunit.client.1.smithi195.stdout:1/850: mkdir d0/d2/d27/d91/dc8/dba/d118 0 2024-03-22T07:28:45.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/915: dread d1/d40/f7f [0,4194304] 0 2024-03-22T07:28:45.811 INFO:tasks.workunit.client.0.smithi134.stdout:7/916: fsync d1/de/d11/d2b/fb6 0 2024-03-22T07:28:45.817 INFO:tasks.workunit.client.1.smithi195.stdout:6/879: dread d5/d5e/d34/d55/d3b/dc2/f11f [0,4194304] 0 2024-03-22T07:28:45.817 INFO:tasks.workunit.client.0.smithi134.stdout:4/770: dread d2/d15/d6f/fd5 [0,4194304] 0 2024-03-22T07:28:45.817 INFO:tasks.workunit.client.0.smithi134.stdout:4/771: chown d2/d2a/d50/f59 1009424157 1 2024-03-22T07:28:45.818 INFO:tasks.workunit.client.0.smithi134.stdout:0/767: dwrite dc/de/d55/fe5 [0,4194304] 0 2024-03-22T07:28:45.818 INFO:tasks.workunit.client.0.smithi134.stdout:0/768: write dc/de/d55/d65/db8/fa2 [211293,130155] 0 2024-03-22T07:28:45.818 INFO:tasks.workunit.client.0.smithi134.stdout:8/921: dread d1/d15/d57/d79/f9f [0,4194304] 0 2024-03-22T07:28:45.821 INFO:tasks.workunit.client.0.smithi134.stdout:7/917: mknod d1/de/d11/d48/d52/c125 0 2024-03-22T07:28:45.822 INFO:tasks.workunit.client.1.smithi195.stdout:3/980: dwrite d3/d18/d89/d70/db5/d131/d1d/d5c/d47/fb4 [0,4194304] 0 2024-03-22T07:28:45.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/851: mkdir d0/d2/d6/d119 0 2024-03-22T07:28:45.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/852: fsync d0/d2/d6/dad/db1/d97/d39/fa9 0 2024-03-22T07:28:45.823 INFO:tasks.workunit.client.1.smithi195.stdout:3/981: write d3/d98/f130 [154618,625] 0 2024-03-22T07:28:45.824 INFO:tasks.workunit.client.0.smithi134.stdout:2/687: link d2/d5/d8/d5d/da1/d3c/d4f/l97 d2/d5/d8/d5d/d5f/le0 0 2024-03-22T07:28:45.825 INFO:tasks.workunit.client.1.smithi195.stdout:3/982: read d3/d18/d89/d70/db5/d131/f103 [4123420,87584] 0 2024-03-22T07:28:45.827 INFO:tasks.workunit.client.1.smithi195.stdout:6/880: rename d5/d16/d45/d53/d59/cde to d5/d5e/d34/d55/dab/c13c 0 2024-03-22T07:28:45.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/983: rename d3/d18/d89/d70/db5/d131/d1d/d5c/d47 to d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/ded/d138 22 2024-03-22T07:28:45.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/984: dread - d3/d18/d89/d70/db5/d131/d1d/d5c/f46 zero size 2024-03-22T07:28:45.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/985: chown d3/d18/d89/d76/f85 242 1 2024-03-22T07:28:45.827 INFO:tasks.workunit.client.1.smithi195.stdout:3/986: stat d3/d18/d89/d70/db5/d131/d1d/d5c/d47/dbb/lf8 0 2024-03-22T07:28:45.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/772: truncate d2/d2a/d80/dd6/f90 653232 0 2024-03-22T07:28:45.828 INFO:tasks.workunit.client.0.smithi134.stdout:4/773: write d2/d15/f13 [4716183,121086] 0 2024-03-22T07:28:45.832 INFO:tasks.workunit.client.0.smithi134.stdout:4/774: dread d2/d15/f11 [4194304,4194304] 0 2024-03-22T07:28:45.832 INFO:tasks.workunit.client.0.smithi134.stdout:4/775: write d2/d25/d74/dde/dc0/de5/ff9 [1009974,8281] 0 2024-03-22T07:28:45.833 INFO:tasks.workunit.client.1.smithi195.stdout:6/881: write d5/d16/d45/df8/d104/da2/dad/de3/ff7 [913867,82635] 0 2024-03-22T07:28:45.835 INFO:tasks.workunit.client.1.smithi195.stdout:7/979: dwrite d0/d13/d14/d2f/dae/f123 [0,4194304] 0 2024-03-22T07:28:45.835 INFO:tasks.workunit.client.1.smithi195.stdout:7/980: chown d0/d13/d14/c8f 126389587 1 2024-03-22T07:28:45.836 INFO:tasks.workunit.client.0.smithi134.stdout:0/769: link dc/de/d55/d65/db8/f7d dc/de/dc9/ff0 0 2024-03-22T07:28:45.837 INFO:tasks.workunit.client.1.smithi195.stdout:3/987: link d3/d98/d115/fc6 d3/d18/d89/d76/f139 0 2024-03-22T07:28:45.838 INFO:tasks.workunit.client.0.smithi134.stdout:8/922: link d1/d46/d75/d8b/db4/fcd d1/d4/d38/d106/f133 0 2024-03-22T07:28:45.840 INFO:tasks.workunit.client.0.smithi134.stdout:7/918: mknod d1/de/d11/d2b/c126 0 2024-03-22T07:28:45.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/853: dwrite d0/dd5/f111 [0,4194304] 0 2024-03-22T07:28:45.844 INFO:tasks.workunit.client.1.smithi195.stdout:1/854: chown d0/d2/d6/dad/db1/d97/c78 25934023 1 2024-03-22T07:28:45.845 INFO:tasks.workunit.client.0.smithi134.stdout:2/688: rename d2/d5/d8/d5d/da1/d3c/d4f/d6e/l7d to d2/d5/d8/d5d/da1/d3c/d4f/d6e/le1 0 2024-03-22T07:28:45.848 INFO:tasks.workunit.client.1.smithi195.stdout:3/988: mknod d3/d18/d89/d70/db5/d131/d1d/d5c/c13a 0 2024-03-22T07:28:45.850 INFO:tasks.workunit.client.0.smithi134.stdout:4/776: mknod d2/d15/d35/da8/dfa/c10e 0 2024-03-22T07:28:45.850 INFO:tasks.workunit.client.0.smithi134.stdout:4/777: readlink d2/l92 0 2024-03-22T07:28:45.851 INFO:tasks.workunit.client.0.smithi134.stdout:0/770: dread dc/de/d55/f71 [0,4194304] 0 2024-03-22T07:28:45.854 INFO:tasks.workunit.client.0.smithi134.stdout:8/923: symlink d1/d15/d42/d76/dda/df7/l134 0 2024-03-22T07:28:45.858 INFO:tasks.workunit.client.0.smithi134.stdout:0/771: dread dc/de/d55/d65/db8/f7c [0,4194304] 0 2024-03-22T07:28:45.858 INFO:tasks.workunit.client.0.smithi134.stdout:0/772: write dc/d17/fb3 [858275,101887] 0 2024-03-22T07:28:45.858 INFO:tasks.workunit.client.0.smithi134.stdout:4/778: mknod d2/d25/d74/dde/d76/d9a/c10f 0 2024-03-22T07:28:45.858 INFO:tasks.workunit.client.0.smithi134.stdout:4/779: dread - d2/d25/d48/d6e/fea zero size 2024-03-22T07:28:45.858 INFO:tasks.workunit.client.0.smithi134.stdout:4/780: write d2/d25/d48/d6e/d7b/f8e [5101426,77359] 0 2024-03-22T07:28:45.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/981: dwrite d0/d13/d14/d20/d40/d82/da0/f9f [0,4194304] 0 2024-03-22T07:28:45.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/982: fsync d0/d13/d14/d2f/fdf 0 2024-03-22T07:28:45.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/983: chown d0/d13/d14/d20 75288 1 2024-03-22T07:28:45.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/984: chown d0/d13/d22/d28/d13e/c14b 13758 1 2024-03-22T07:28:45.859 INFO:tasks.workunit.client.1.smithi195.stdout:7/985: write d0/d13/d14/d80/d9c/fbb [1278589,65888] 0 2024-03-22T07:28:45.860 INFO:tasks.workunit.client.0.smithi134.stdout:8/924: dread d1/d15/d57/d79/fd1 [0,4194304] 0 2024-03-22T07:28:45.860 INFO:tasks.workunit.client.0.smithi134.stdout:8/925: write d1/d46/d75/d8b/db4/fcd [5017130,29210] 0 2024-03-22T07:28:45.863 INFO:tasks.workunit.client.0.smithi134.stdout:7/919: dwrite d1/d19/f53 [0,4194304] 0 2024-03-22T07:28:45.867 INFO:tasks.workunit.client.1.smithi195.stdout:1/855: creat d0/d2/d27/d91/dc8/d2a/f11a x:0 0 0 2024-03-22T07:28:45.867 INFO:tasks.workunit.client.1.smithi195.stdout:1/856: truncate d0/d2/d6/dad/db1/d97/d39/d40/dc9/f107 650824 0 2024-03-22T07:28:45.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/989: truncate d3/d18/d89/d70/db5/d131/d1d/f30 1997798 0 2024-03-22T07:28:45.870 INFO:tasks.workunit.client.1.smithi195.stdout:3/990: chown d3/d18/d89/d70/db5/d131/d1d/d5c/cff 12043 1 2024-03-22T07:28:45.878 INFO:tasks.workunit.client.1.smithi195.stdout:7/986: creat d0/d13/d22/f15a x:0 0 0 2024-03-22T07:28:45.878 INFO:tasks.workunit.client.1.smithi195.stdout:4/961: sync 2024-03-22T07:28:45.878 INFO:tasks.workunit.client.0.smithi134.stdout:2/689: dwrite d2/d5/d8/d31/f5b [4194304,4194304] 0 2024-03-22T07:28:45.880 INFO:tasks.workunit.client.1.smithi195.stdout:3/991: mkdir d3/df/d50/d13b 0 2024-03-22T07:28:45.883 INFO:tasks.workunit.client.1.smithi195.stdout:4/962: truncate d13/d63/d3e/d5c/f69 2409534 0 2024-03-22T07:28:45.886 INFO:tasks.workunit.client.0.smithi134.stdout:0/773: mkdir dc/de/d55/d65/dbe/df1 0 2024-03-22T07:28:45.889 INFO:tasks.workunit.client.1.smithi195.stdout:4/963: creat d13/d63/d79/de9/d7e/f14b x:0 0 0 2024-03-22T07:28:45.890 INFO:tasks.workunit.client.0.smithi134.stdout:8/926: dwrite d1/d15/d42/d76/fc5 [0,4194304] 0 2024-03-22T07:28:45.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/920: mkdir d1/de/d11/d48/daf/dbf/d124/d127 0 2024-03-22T07:28:45.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/921: chown d1/de/d11/d2b/d31/c5c 4800257 1 2024-03-22T07:28:45.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/922: chown d1/de/d11/d2b/d31/d85/fc3 16250884 1 2024-03-22T07:28:45.890 INFO:tasks.workunit.client.0.smithi134.stdout:7/923: fdatasync d1/de/d11/d48/daf/f11d 0 2024-03-22T07:28:45.891 INFO:tasks.workunit.client.0.smithi134.stdout:7/924: getdents d1/de/d11/d48/dbc/d100 0 2024-03-22T07:28:45.894 INFO:tasks.workunit.client.0.smithi134.stdout:2/690: creat d2/d5/d8/d5d/fe2 x:0 0 0 2024-03-22T07:28:45.894 INFO:tasks.workunit.client.0.smithi134.stdout:2/691: dread - d2/f87 zero size 2024-03-22T07:28:45.897 INFO:tasks.workunit.client.0.smithi134.stdout:4/781: dwrite d2/d25/d74/dde/dc0/fd9 [0,4194304] 0 2024-03-22T07:28:45.897 INFO:tasks.workunit.client.0.smithi134.stdout:4/782: creat d2/d2a/d93/f110 x:0 0 0 2024-03-22T07:28:45.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/925: creat d1/de/d11/d2b/d31/d85/d121/f128 x:0 0 0 2024-03-22T07:28:45.899 INFO:tasks.workunit.client.0.smithi134.stdout:7/926: write d1/de/d11/d48/fc [4566898,102144] 0 2024-03-22T07:28:45.899 INFO:tasks.workunit.client.1.smithi195.stdout:4/964: dread d13/d63/d3e/fc8 [0,4194304] 0 2024-03-22T07:28:45.901 INFO:tasks.workunit.client.0.smithi134.stdout:2/692: dread d2/d5/d8/d5d/da1/d3c/d60/f8e [0,4194304] 0 2024-03-22T07:28:45.902 INFO:tasks.workunit.client.0.smithi134.stdout:2/693: fsync d2/d5/d8/fc3 0 2024-03-22T07:28:45.902 INFO:tasks.workunit.client.0.smithi134.stdout:2/694: truncate d2/d5/d8/d7e/dba/fcf 1948177 0 2024-03-22T07:28:45.903 INFO:tasks.workunit.client.0.smithi134.stdout:4/783: link d2/d25/d74/dde/dc0/ce1 d2/d15/d35/da8/dec/c111 0 2024-03-22T07:28:45.904 INFO:tasks.workunit.client.0.smithi134.stdout:7/927: rmdir d1/de/d41 39 2024-03-22T07:28:45.905 INFO:tasks.workunit.client.0.smithi134.stdout:2/695: chown d2/c77 725987 1 2024-03-22T07:28:45.906 INFO:tasks.workunit.client.0.smithi134.stdout:4/784: creat d2/d15/d35/da8/dec/def/d106/f112 x:0 0 0 2024-03-22T07:28:45.908 INFO:tasks.workunit.client.0.smithi134.stdout:7/928: creat d1/de/f129 x:0 0 0 2024-03-22T07:28:45.908 INFO:tasks.workunit.client.0.smithi134.stdout:7/929: readlink d1/de/d11/d48/d52/l6e 0 2024-03-22T07:28:45.909 INFO:tasks.workunit.client.0.smithi134.stdout:2/696: mkdir d2/d5/d8/d5d/da1/de3 0 2024-03-22T07:28:45.910 INFO:tasks.workunit.client.1.smithi195.stdout:1/857: dwrite d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 [0,4194304] 0 2024-03-22T07:28:45.929 INFO:tasks.workunit.client.1.smithi195.stdout:7/987: dwrite d0/d13/d22/d57/d7b/f134 [0,4194304] 0 2024-03-22T07:28:45.932 INFO:tasks.workunit.client.1.smithi195.stdout:7/988: symlink d0/d13/d22/d28/l15b 0 2024-03-22T07:28:45.932 INFO:tasks.workunit.client.1.smithi195.stdout:7/989: chown d0/d13/d22/d28/lb4 188369 1 2024-03-22T07:28:45.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/990: symlink d0/d13/l15c 0 2024-03-22T07:28:45.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/991: write d0/d13/d14/d20/d40/d82/db8/ff7 [318737,94867] 0 2024-03-22T07:28:45.933 INFO:tasks.workunit.client.1.smithi195.stdout:7/992: creat d0/d13/d14/d29/d35/d3a/d7e/f15d x:0 0 0 2024-03-22T07:28:45.935 INFO:tasks.workunit.client.1.smithi195.stdout:7/993: mknod d0/d13/d14/d20/d40/d82/da0/c15e 0 2024-03-22T07:28:45.936 INFO:tasks.workunit.client.1.smithi195.stdout:7/994: mkdir d0/d13/d14/d20/d40/d82/d15f 0 2024-03-22T07:28:45.938 INFO:tasks.workunit.client.0.smithi134.stdout:0/774: dwrite dc/de/dc9/dd0/fd1 [0,4194304] 0 2024-03-22T07:28:45.938 INFO:tasks.workunit.client.0.smithi134.stdout:0/775: read dc/de/d55/d65/db8/fa2 [278313,983] 0 2024-03-22T07:28:45.938 INFO:tasks.workunit.client.0.smithi134.stdout:0/776: read - dc/d18/d89/da0/fab zero size 2024-03-22T07:28:45.939 INFO:tasks.workunit.client.1.smithi195.stdout:7/995: truncate d0/d13/d14/d20/d40/d82/da0/d59/d79/fb0 118566 0 2024-03-22T07:28:45.939 INFO:tasks.workunit.client.1.smithi195.stdout:7/996: read - d0/d13/d22/d57/f153 zero size 2024-03-22T07:28:45.939 INFO:tasks.workunit.client.1.smithi195.stdout:7/997: fsync d0/f25 0 2024-03-22T07:28:45.939 INFO:tasks.workunit.client.1.smithi195.stdout:7/998: read - d0/d13/d14/d29/d35/d3a/d7e/f15d zero size 2024-03-22T07:28:45.941 INFO:tasks.workunit.client.1.smithi195.stdout:3/992: dwrite d3/f24 [4194304,4194304] 0 2024-03-22T07:28:45.941 INFO:tasks.workunit.client.1.smithi195.stdout:4/965: dwrite d13/d63/d79/de9/d7e/dd6/f105 [0,4194304] 0 2024-03-22T07:28:45.942 INFO:tasks.workunit.client.1.smithi195.stdout:7/999: creat d0/d13/f160 x:0 0 0 2024-03-22T07:28:45.945 INFO:tasks.workunit.client.1.smithi195.stdout:3/993: symlink d3/d18/d89/d76/l13c 0 2024-03-22T07:28:45.945 INFO:tasks.workunit.client.1.smithi195.stdout:4/966: write d13/d63/d79/f4b [7559691,45224] 0 2024-03-22T07:28:45.945 INFO:tasks.workunit.client.1.smithi195.stdout:4/967: chown d13/d15/d6b/dd0/df3 18 1 2024-03-22T07:28:45.946 INFO:tasks.workunit.client.0.smithi134.stdout:7/930: dwrite d1/d40/f7f [0,4194304] 0 2024-03-22T07:28:45.946 INFO:tasks.workunit.client.0.smithi134.stdout:8/927: dwrite d1/d15/d42/d49/f124 [0,4194304] 0 2024-03-22T07:28:45.947 INFO:tasks.workunit.client.1.smithi195.stdout:1/858: dwrite d0/d2/d6/dad/ffc [0,4194304] 0 2024-03-22T07:28:45.947 INFO:tasks.workunit.client.1.smithi195.stdout:1/859: truncate d0/d2/d6/dad/db1/d97/d39/d64/fbe 8963422 0 2024-03-22T07:28:45.947 INFO:tasks.workunit.client.1.smithi195.stdout:3/994: rename d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/l7a to d3/d18/d89/d70/db5/d131/d1d/d5c/d47/dbb/l13d 0 2024-03-22T07:28:45.948 INFO:tasks.workunit.client.1.smithi195.stdout:3/995: read d3/d18/d89/d76/f106 [115048,92512] 0 2024-03-22T07:28:45.948 INFO:tasks.workunit.client.1.smithi195.stdout:3/996: fdatasync d3/d18/d89/d70/db5/d131/fcc 0 2024-03-22T07:28:45.950 INFO:tasks.workunit.client.0.smithi134.stdout:2/697: dwrite d2/d5/d8/d5d/fb5 [0,4194304] 0 2024-03-22T07:28:45.951 INFO:tasks.workunit.client.1.smithi195.stdout:4/968: truncate d13/d63/d79/de9/d7e/fb6 1740899 0 2024-03-22T07:28:45.954 INFO:tasks.workunit.client.0.smithi134.stdout:7/931: link d1/de/d41/c64 d1/de/d41/c12a 0 2024-03-22T07:28:45.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/860: getdents d0/d2/d6/dad/db1/d97/d39/d64/d7a 0 2024-03-22T07:28:45.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/861: write d0/d2/d27/d91/dc8/da4/fb7 [380226,79396] 0 2024-03-22T07:28:45.957 INFO:tasks.workunit.client.1.smithi195.stdout:1/862: creat d0/d2/d27/d91/dc8/d2a/f11b x:0 0 0 2024-03-22T07:28:45.959 INFO:tasks.workunit.client.1.smithi195.stdout:1/863: dread d0/d2/d27/d91/dc8/da4/dc0/fe6 [0,4194304] 0 2024-03-22T07:28:45.961 INFO:tasks.workunit.client.0.smithi134.stdout:8/928: mkdir d1/d15/d57/d79/d135 0 2024-03-22T07:28:45.961 INFO:tasks.workunit.client.0.smithi134.stdout:8/929: write d1/d15/d7b/f126 [275869,90009] 0 2024-03-22T07:28:45.963 INFO:tasks.workunit.client.0.smithi134.stdout:8/930: write d1/d15/d42/d49/f5f [475066,79230] 0 2024-03-22T07:28:45.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/997: rename d3/d18/d89/d70/db5/d131/f6a to d3/d18/d89/d70/db5/d131/d1d/d5c/d47/d67/f13e 0 2024-03-22T07:28:45.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/998: dread - d3/d18/d89/d70/db5/d131/ff5 zero size 2024-03-22T07:28:45.971 INFO:tasks.workunit.client.1.smithi195.stdout:3/999: write d3/d18/d89/d76/def/df9/f136 [140253,77622] 0 2024-03-22T07:28:45.976 INFO:tasks.workunit.client.0.smithi134.stdout:2/698: rename d2/d5/d8/d5d/da1/d3c/d4f/l61 to d2/d5/d22/dbe/le4 0 2024-03-22T07:28:45.981 INFO:tasks.workunit.client.1.smithi195.stdout:4/969: truncate f9 5333252 0 2024-03-22T07:28:45.985 INFO:tasks.workunit.client.0.smithi134.stdout:2/699: dread d2/d5/d8/d5d/da1/d3c/f89 [0,4194304] 0 2024-03-22T07:28:45.987 INFO:tasks.workunit.client.1.smithi195.stdout:1/864: dwrite d0/d2/d6/dad/db1/d97/d41/f5a [4194304,4194304] 0 2024-03-22T07:28:45.987 INFO:tasks.workunit.client.0.smithi134.stdout:8/931: dwrite d1/d15/d42/d25/f59 [0,4194304] 0 2024-03-22T07:28:45.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/700: unlink d2/f49 0 2024-03-22T07:28:45.988 INFO:tasks.workunit.client.0.smithi134.stdout:2/701: stat d2/d5/d8/d5d/da1/d3c/d60/d7c 0 2024-03-22T07:28:45.992 INFO:tasks.workunit.client.0.smithi134.stdout:8/932: creat d1/d15/d42/f136 x:0 0 0 2024-03-22T07:28:45.992 INFO:tasks.workunit.client.0.smithi134.stdout:8/933: dread - d1/d15/d42/f136 zero size 2024-03-22T07:28:45.994 INFO:tasks.workunit.client.1.smithi195.stdout:1/865: rename d0/d2/d27/d91/dc8/d2a/la7 to d0/d2/d27/d91/dc8/da4/dc0/dfa/l11c 0 2024-03-22T07:28:45.997 INFO:tasks.workunit.client.1.smithi195.stdout:1/866: rename d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/cc2 to d0/d2/d6/dad/df2/df8/c11d 0 2024-03-22T07:28:45.998 INFO:tasks.workunit.client.1.smithi195.stdout:1/867: fsync d0/d2/d27/d91/dc8/da4/dc0/f102 0 2024-03-22T07:28:45.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/970: dwrite d13/d63/d79/de9/d7e/f14b [0,4194304] 0 2024-03-22T07:28:45.999 INFO:tasks.workunit.client.1.smithi195.stdout:4/971: write d13/d15/d6b/da6/ded/def/d134/f13b [371874,94782] 0 2024-03-22T07:28:46.000 INFO:tasks.workunit.client.0.smithi134.stdout:2/702: rmdir d2/d5/d8/d5d/da1/d3c/d4f/d6e 39 2024-03-22T07:28:46.000 INFO:tasks.workunit.client.0.smithi134.stdout:8/934: write d1/d15/d42/f28 [1188140,118422] 0 2024-03-22T07:28:46.000 INFO:tasks.workunit.client.0.smithi134.stdout:8/935: write d1/d4/d117/d11a/d20/f74 [4441168,60182] 0 2024-03-22T07:28:46.001 INFO:tasks.workunit.client.1.smithi195.stdout:1/868: symlink d0/d2/d6/dad/df2/l11e 0 2024-03-22T07:28:46.004 INFO:tasks.workunit.client.0.smithi134.stdout:8/936: creat d1/d15/d42/d76/f137 x:0 0 0 2024-03-22T07:28:46.009 INFO:tasks.workunit.client.0.smithi134.stdout:2/703: rename d2/d5/d8/d5d/da1/d3c/d60/db9 to d2/de5 0 2024-03-22T07:28:46.009 INFO:tasks.workunit.client.0.smithi134.stdout:2/704: fdatasync d2/f4c 0 2024-03-22T07:28:46.014 INFO:tasks.workunit.client.1.smithi195.stdout:4/972: dwrite d13/d63/fac [0,4194304] 0 2024-03-22T07:28:46.014 INFO:tasks.workunit.client.1.smithi195.stdout:4/973: chown d13/d15/d6b/da6/ded/def/d134/fbf 55546 1 2024-03-22T07:28:46.015 INFO:tasks.workunit.client.0.smithi134.stdout:2/705: truncate d2/f30 3571820 0 2024-03-22T07:28:46.015 INFO:tasks.workunit.client.0.smithi134.stdout:7/932: write d1/de/d11/d2b/d31/f83 [1444624,80023] 0 2024-03-22T07:28:46.015 INFO:tasks.workunit.client.0.smithi134.stdout:7/933: dread - d1/da8/fb7 zero size 2024-03-22T07:28:46.015 INFO:tasks.workunit.client.0.smithi134.stdout:7/934: truncate d1/de/d11/d48/d52/fa4 3120207 0 2024-03-22T07:28:46.015 INFO:tasks.workunit.client.0.smithi134.stdout:7/935: chown d1/l28 19 1 2024-03-22T07:28:46.023 INFO:tasks.workunit.client.1.smithi195.stdout:4/974: link d13/d15/d6b/da6/ded/def/d134/f5d d13/d15/d6b/da6/ded/def/d134/f14c 0 2024-03-22T07:28:46.026 INFO:tasks.workunit.client.1.smithi195.stdout:4/975: rename d13/d63/d79/de9/d7e/d8c/d108/c113 to d13/d63/d79/de9/d7e/d8c/d108/c14d 0 2024-03-22T07:28:46.026 INFO:tasks.workunit.client.1.smithi195.stdout:4/976: readlink d13/d63/leb 0 2024-03-22T07:28:46.027 INFO:tasks.workunit.client.1.smithi195.stdout:1/869: dwrite d0/d2/d27/d91/dc8/f15 [0,4194304] 0 2024-03-22T07:28:46.028 INFO:tasks.workunit.client.0.smithi134.stdout:2/706: unlink d2/d5/d8/cd 0 2024-03-22T07:28:46.029 INFO:tasks.workunit.client.1.smithi195.stdout:4/977: mkdir d13/d63/d79/de9/d7e/d8c/db7/d14e 0 2024-03-22T07:28:46.030 INFO:tasks.workunit.client.1.smithi195.stdout:4/978: getdents d13/d63/d3e/d5c/da8 0 2024-03-22T07:28:46.031 INFO:tasks.workunit.client.0.smithi134.stdout:2/707: creat d2/d5/d8/d5d/d5f/fe6 x:0 0 0 2024-03-22T07:28:46.033 INFO:tasks.workunit.client.0.smithi134.stdout:2/708: creat d2/d5/d8/d7e/dd3/fe7 x:0 0 0 2024-03-22T07:28:46.033 INFO:tasks.workunit.client.0.smithi134.stdout:7/936: dwrite d1/de/d11/d48/f3c [0,4194304] 0 2024-03-22T07:28:46.034 INFO:tasks.workunit.client.0.smithi134.stdout:2/709: stat d2/l1d 0 2024-03-22T07:28:46.036 INFO:tasks.workunit.client.0.smithi134.stdout:2/710: mknod d2/d5/d8/d5d/da1/ce8 0 2024-03-22T07:28:46.037 INFO:tasks.workunit.client.0.smithi134.stdout:2/711: symlink d2/d5/d22/dbe/le9 0 2024-03-22T07:28:46.037 INFO:tasks.workunit.client.0.smithi134.stdout:2/712: truncate d2/d5/d8/d5d/da1/d3c/d60/fa7 251263 0 2024-03-22T07:28:46.039 INFO:tasks.workunit.client.0.smithi134.stdout:2/713: link d2/d5/d8/l17 d2/d5/d8/d5d/d5f/lea 0 2024-03-22T07:28:46.040 INFO:tasks.workunit.client.0.smithi134.stdout:2/714: dread d2/d5/fa9 [0,4194304] 0 2024-03-22T07:28:46.041 INFO:tasks.workunit.client.0.smithi134.stdout:2/715: getdents d2/d5/d8/d5d/da1/de3 0 2024-03-22T07:28:46.041 INFO:tasks.workunit.client.0.smithi134.stdout:2/716: write d2/d5/d8/d5d/fbd [1872056,30006] 0 2024-03-22T07:28:46.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/717: mkdir d2/d5/d8/d5d/da1/d3c/d4f/deb 0 2024-03-22T07:28:46.042 INFO:tasks.workunit.client.0.smithi134.stdout:2/718: symlink d2/d5/lec 0 2024-03-22T07:28:46.043 INFO:tasks.workunit.client.0.smithi134.stdout:7/937: dread d1/de/d11/f55 [0,4194304] 0 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: Standby manager daemon smithi134.wtwqre started 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/crt"}]: dispatch 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/key"}]: dispatch 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: mgrmap e25: smithi195.jxfsnc(active, since 11s), standbys: smithi134.wtwqre 2024-03-22T07:28:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:45 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:28:46.046 INFO:tasks.workunit.client.1.smithi195.stdout:1/870: dwrite d0/d2/d6/f2f [0,4194304] 0 2024-03-22T07:28:46.046 INFO:tasks.workunit.client.1.smithi195.stdout:4/979: dwrite d13/d63/d3e/f97 [0,4194304] 0 2024-03-22T07:28:46.047 INFO:tasks.workunit.client.0.smithi134.stdout:2/719: dread d2/d5/d8/d5d/da1/f76 [0,4194304] 0 2024-03-22T07:28:46.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/882: sync 2024-03-22T07:28:46.047 INFO:tasks.workunit.client.1.smithi195.stdout:6/883: fdatasync d5/d16/d45/df8/d104/da2/d4a/fbe 0 2024-03-22T07:28:46.049 INFO:tasks.workunit.client.0.smithi134.stdout:7/938: dread d1/de/d11/d48/f29 [0,4194304] 0 2024-03-22T07:28:46.050 INFO:tasks.workunit.client.1.smithi195.stdout:4/980: unlink d13/d15/d6b/da6/ded/def/d134/d5f/d83/c13a 0 2024-03-22T07:28:46.051 INFO:tasks.workunit.client.0.smithi134.stdout:7/939: creat d1/de/d11/d2b/ddf/f12b x:0 0 0 2024-03-22T07:28:46.052 INFO:tasks.workunit.client.0.smithi134.stdout:7/940: stat d1/de/c10 0 2024-03-22T07:28:46.053 INFO:tasks.workunit.client.1.smithi195.stdout:4/981: mkdir d13/d63/d3e/d14f 0 2024-03-22T07:28:46.055 INFO:tasks.workunit.client.0.smithi134.stdout:7/941: link d1/de/d41/f49 d1/d19/d9c/db3/dc4/f12c 0 2024-03-22T07:28:46.058 INFO:tasks.workunit.client.0.smithi134.stdout:7/942: rename d1/de/d41/d87/d8f/f110 to d1/de/d8d/f12d 0 2024-03-22T07:28:46.059 INFO:tasks.workunit.client.0.smithi134.stdout:7/943: chown d1/de/d11/d48/f6b 52565440 1 2024-03-22T07:28:46.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/884: dwrite d5/d5e/d34/fa6 [0,4194304] 0 2024-03-22T07:28:46.075 INFO:tasks.workunit.client.1.smithi195.stdout:6/885: readlink d5/d5e/d34/d55/d3b/l58 0 2024-03-22T07:28:46.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/758: sync 2024-03-22T07:28:46.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/759: chown d5/da/d1b/de5/f108 1 1 2024-03-22T07:28:46.076 INFO:tasks.workunit.client.0.smithi134.stdout:1/760: chown d5/da/d1b/d27/d39/da4 2377 1 2024-03-22T07:28:46.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/886: symlink d5/d5e/l13d 0 2024-03-22T07:28:46.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/887: dread - d5/d5e/d34/d55/dcb/f139 zero size 2024-03-22T07:28:46.077 INFO:tasks.workunit.client.1.smithi195.stdout:6/888: write d5/d16/d45/df8/d104/f65 [1519719,42363] 0 2024-03-22T07:28:46.078 INFO:tasks.workunit.client.1.smithi195.stdout:6/889: stat d5/d16/d45/d53/d59/c96 0 2024-03-22T07:28:46.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/720: dwrite d2/d5/d8/d5d/da1/d3c/f69 [0,4194304] 0 2024-03-22T07:28:46.083 INFO:tasks.workunit.client.0.smithi134.stdout:1/761: dread d5/da/d13/d1e/f44 [0,4194304] 0 2024-03-22T07:28:46.084 INFO:tasks.workunit.client.1.smithi195.stdout:1/871: dwrite d0/d2/d6/dad/db1/d97/d39/d40/f43 [4194304,4194304] 0 2024-03-22T07:28:46.085 INFO:tasks.workunit.client.1.smithi195.stdout:4/982: dwrite d13/d15/d6b/da6/ded/def/d134/fd5 [0,4194304] 0 2024-03-22T07:28:46.085 INFO:tasks.workunit.client.0.smithi134.stdout:7/944: dwrite d1/de/d11/d2b/d31/d85/fc3 [4194304,4194304] 0 2024-03-22T07:28:46.095 INFO:tasks.workunit.client.1.smithi195.stdout:4/983: dread d13/d15/d6b/da6/ded/def/d134/fc5 [0,4194304] 0 2024-03-22T07:28:46.096 INFO:tasks.workunit.client.1.smithi195.stdout:6/890: dwrite d5/d16/d45/df8/d104/da2/dad/de3/f105 [0,4194304] 0 2024-03-22T07:28:46.097 INFO:tasks.workunit.client.1.smithi195.stdout:1/872: rename d0/d2/d6/dad/db1/d97/d41 to d0/d2/d6/dad/df2/df8/d11f 0 2024-03-22T07:28:46.099 INFO:tasks.workunit.client.1.smithi195.stdout:6/891: dread d5/d5e/d34/d55/d3b/dc2/f11f [0,4194304] 0 2024-03-22T07:28:46.100 INFO:tasks.workunit.client.0.smithi134.stdout:2/721: mknod d2/d5/d8/d5d/da1/d3c/ced 0 2024-03-22T07:28:46.104 INFO:tasks.workunit.client.1.smithi195.stdout:1/873: creat d0/d2/d6/dad/db1/d6b/d9c/f120 x:0 0 0 2024-03-22T07:28:46.106 INFO:tasks.workunit.client.1.smithi195.stdout:4/984: dread d13/d15/f22 [0,4194304] 0 2024-03-22T07:28:46.106 INFO:tasks.workunit.client.0.smithi134.stdout:2/722: mkdir d2/d5/d8/d7e/dee 0 2024-03-22T07:28:46.107 INFO:tasks.workunit.client.0.smithi134.stdout:2/723: creat d2/d5/d8/d7e/d83/fef x:0 0 0 2024-03-22T07:28:46.108 INFO:tasks.workunit.client.0.smithi134.stdout:7/945: getdents d1/de/d11/d2b/d31/d85 0 2024-03-22T07:28:46.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/892: read d5/d16/d45/df8/d104/da2/d4a/fbe [1493142,85639] 0 2024-03-22T07:28:46.111 INFO:tasks.workunit.client.1.smithi195.stdout:4/985: creat d13/d63/d79/d68/dfb/f150 x:0 0 0 2024-03-22T07:28:46.111 INFO:tasks.workunit.client.1.smithi195.stdout:6/893: write d5/d16/d5b/f12f [850253,67552] 0 2024-03-22T07:28:46.112 INFO:tasks.workunit.client.1.smithi195.stdout:1/874: dread d0/d2/d6/dad/db1/d97/d39/d64/fbe [4194304,4194304] 0 2024-03-22T07:28:46.112 INFO:tasks.workunit.client.0.smithi134.stdout:7/946: rmdir d1/d19/d9c 39 2024-03-22T07:28:46.114 INFO:tasks.workunit.client.1.smithi195.stdout:4/986: rename d13/d63/d7a/f12f to d13/d63/d3e/f151 0 2024-03-22T07:28:46.115 INFO:tasks.workunit.client.0.smithi134.stdout:7/947: creat d1/d19/d9c/db3/dc4/de2/f12e x:0 0 0 2024-03-22T07:28:46.117 INFO:tasks.workunit.client.1.smithi195.stdout:6/894: getdents d5/d16/d45/df8/d104/da2/d82/ddf 0 2024-03-22T07:28:46.117 INFO:tasks.workunit.client.1.smithi195.stdout:6/895: truncate d5/d5e/d34/d55/d3b/d6e/d3c/fa0 242803 0 2024-03-22T07:28:46.117 INFO:tasks.workunit.client.1.smithi195.stdout:6/896: truncate d5/d16/d45/d53/d59/d87/fb6 4303067 0 2024-03-22T07:28:46.119 INFO:tasks.workunit.client.0.smithi134.stdout:7/948: mknod d1/de/d11/d48/daf/dbf/c12f 0 2024-03-22T07:28:46.121 INFO:tasks.workunit.client.1.smithi195.stdout:4/987: creat d13/d63/d79/de9/f152 x:0 0 0 2024-03-22T07:28:46.122 INFO:tasks.workunit.client.1.smithi195.stdout:6/897: mkdir d5/d6d/d95/d13e 0 2024-03-22T07:28:46.123 INFO:tasks.workunit.client.1.smithi195.stdout:1/875: mkdir d0/d2/d6/dad/db1/d97/d121 0 2024-03-22T07:28:46.125 INFO:tasks.workunit.client.1.smithi195.stdout:4/988: link d13/d15/f37 d13/d63/d79/dcd/f153 0 2024-03-22T07:28:46.126 INFO:tasks.workunit.client.1.smithi195.stdout:4/989: chown d13/d15/d6b/da6/ded/def/d134/c38 442 1 2024-03-22T07:28:46.127 INFO:tasks.workunit.client.1.smithi195.stdout:4/990: symlink d13/d63/d3e/l154 0 2024-03-22T07:28:46.129 INFO:tasks.workunit.client.1.smithi195.stdout:1/876: dread d0/d2/d6/f71 [0,4194304] 0 2024-03-22T07:28:46.130 INFO:tasks.workunit.client.0.smithi134.stdout:2/724: dwrite d2/d5/d8/d5d/da1/d3c/fc4 [0,4194304] 0 2024-03-22T07:28:46.131 INFO:tasks.workunit.client.1.smithi195.stdout:1/877: mkdir d0/d2/d27/d91/dc8/da4/dc0/d122 0 2024-03-22T07:28:46.131 INFO:tasks.workunit.client.1.smithi195.stdout:1/878: fdatasync d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 0 2024-03-22T07:28:46.133 INFO:tasks.workunit.client.0.smithi134.stdout:7/949: write d1/d40/f9f [7894642,70261] 0 2024-03-22T07:28:46.133 INFO:tasks.workunit.client.0.smithi134.stdout:7/950: fsync d1/de/d11/d2b/d31/f8e 0 2024-03-22T07:28:46.133 INFO:tasks.workunit.client.0.smithi134.stdout:7/951: fdatasync d1/de/d11/d48/d52/d46/f61 0 2024-03-22T07:28:46.134 INFO:tasks.workunit.client.0.smithi134.stdout:2/725: dread d2/d5/d22/f2a [0,4194304] 0 2024-03-22T07:28:46.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/952: mknod d1/de/d11/d48/daf/c130 0 2024-03-22T07:28:46.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/953: dread - d1/de/d11/d2b/fe0 zero size 2024-03-22T07:28:46.137 INFO:tasks.workunit.client.0.smithi134.stdout:7/954: stat d1/de/d11/d48/d52 0 2024-03-22T07:28:46.141 INFO:tasks.workunit.client.0.smithi134.stdout:7/955: creat d1/de/d11/d2b/d31/d85/f131 x:0 0 0 2024-03-22T07:28:46.141 INFO:tasks.workunit.client.1.smithi195.stdout:6/898: dread d5/d16/d5a/f99 [0,4194304] 0 2024-03-22T07:28:46.143 INFO:tasks.workunit.client.0.smithi134.stdout:7/956: rmdir d1/d19/d9c 39 2024-03-22T07:28:46.145 INFO:tasks.workunit.client.1.smithi195.stdout:6/899: mkdir d5/d16/d45/df8/d104/da2/dad/d13f 0 2024-03-22T07:28:46.148 INFO:tasks.workunit.client.0.smithi134.stdout:2/726: rename d2/d5/d8/d5d/da1/d3c to d2/d5/d22/d99/df0 0 2024-03-22T07:28:46.148 INFO:tasks.workunit.client.0.smithi134.stdout:2/727: stat d2/d5/l1e 0 2024-03-22T07:28:46.148 INFO:tasks.workunit.client.0.smithi134.stdout:2/728: dread - d2/f8f zero size 2024-03-22T07:28:46.150 INFO:tasks.workunit.client.0.smithi134.stdout:2/729: dread d2/d5/d22/d99/fa6 [4194304,4194304] 0 2024-03-22T07:28:46.150 INFO:tasks.workunit.client.0.smithi134.stdout:2/730: fsync d2/d5/d22/d99/df0/f89 0 2024-03-22T07:28:46.150 INFO:tasks.workunit.client.0.smithi134.stdout:2/731: fdatasync d2/d5/d22/d99/df0/d60/fb3 0 2024-03-22T07:28:46.151 INFO:tasks.workunit.client.1.smithi195.stdout:1/879: dwrite d0/d2/d27/d91/dc8/d2a/f11a [0,4194304] 0 2024-03-22T07:28:46.151 INFO:tasks.workunit.client.1.smithi195.stdout:1/880: creat d0/d2/d6/dad/df2/f123 x:0 0 0 2024-03-22T07:28:46.151 INFO:tasks.workunit.client.1.smithi195.stdout:6/900: link d5/d5e/d34/d55/d3b/d6e/d97/fd0 d5/d16/d45/f140 0 2024-03-22T07:28:46.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/957: rmdir d1/d19/d32 39 2024-03-22T07:28:46.151 INFO:tasks.workunit.client.0.smithi134.stdout:7/958: write d1/de/d11/d48/d52/fa4 [1983822,1377] 0 2024-03-22T07:28:46.156 INFO:tasks.workunit.client.0.smithi134.stdout:2/732: read d2/d5/d8/d5d/da1/fb8 [1369372,56096] 0 2024-03-22T07:28:46.157 INFO:tasks.workunit.client.1.smithi195.stdout:6/901: mkdir d5/d16/d45/d53/d59/d141 0 2024-03-22T07:28:46.162 INFO:tasks.workunit.client.0.smithi134.stdout:6/576: sync 2024-03-22T07:28:46.162 INFO:tasks.workunit.client.0.smithi134.stdout:5/718: sync 2024-03-22T07:28:46.167 INFO:tasks.workunit.client.0.smithi134.stdout:2/733: write d2/d5/d54/f63 [2312962,53365] 0 2024-03-22T07:28:46.168 INFO:tasks.workunit.client.0.smithi134.stdout:2/734: write d2/d5/d22/f2a [4830686,64324] 0 2024-03-22T07:28:46.168 INFO:tasks.workunit.client.0.smithi134.stdout:6/577: rename d2/d3f/d28/d6b to d2/d1b/d1d/d5e/d6f/dd7 0 2024-03-22T07:28:46.168 INFO:tasks.workunit.client.0.smithi134.stdout:6/578: readlink d2/d1b/d1d/d5e/d6f/da8/lb2 0 2024-03-22T07:28:46.174 INFO:tasks.workunit.client.0.smithi134.stdout:5/719: dread d1/f73 [0,4194304] 0 2024-03-22T07:28:46.174 INFO:tasks.workunit.client.0.smithi134.stdout:2/735: unlink d2/f30 0 2024-03-22T07:28:46.176 INFO:tasks.workunit.client.0.smithi134.stdout:5/720: creat d1/d8/d20/d62/d68/d9c/ff0 x:0 0 0 2024-03-22T07:28:46.176 INFO:tasks.workunit.client.0.smithi134.stdout:5/721: fdatasync d1/d8/d20/d62/d65/f43 0 2024-03-22T07:28:46.176 INFO:tasks.workunit.client.0.smithi134.stdout:5/722: write d1/d8/d83/f8f [1052792,13153] 0 2024-03-22T07:28:46.178 INFO:tasks.workunit.client.0.smithi134.stdout:5/723: getdents d1/d8/dc5 0 2024-03-22T07:28:46.179 INFO:tasks.workunit.client.0.smithi134.stdout:5/724: mkdir d1/d8/d16/dbd/df1 0 2024-03-22T07:28:46.196 INFO:tasks.workunit.client.1.smithi195.stdout:6/902: dwrite d5/d5e/d34/d55/d3b/d6e/d56/f77 [0,4194304] 0 2024-03-22T07:28:46.196 INFO:tasks.workunit.client.0.smithi134.stdout:5/725: dwrite d1/d8/d16/dbd/fde [0,4194304] 0 2024-03-22T07:28:46.198 INFO:tasks.workunit.client.1.smithi195.stdout:6/903: fdatasync d5/d16/d5b/f12f 0 2024-03-22T07:28:46.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/904: write d5/d16/d45/f6f [1214445,111843] 0 2024-03-22T07:28:46.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/905: fdatasync d5/d5e/d34/d55/d3b/d7f/fcc 0 2024-03-22T07:28:46.201 INFO:tasks.workunit.client.1.smithi195.stdout:6/906: getdents d5/d5e/d34/d55/d3b/d6e/d3c/d123 0 2024-03-22T07:28:46.202 INFO:tasks.workunit.client.1.smithi195.stdout:6/907: getdents d5/d16/d45/df8/d104/da2/d82/dec 0 2024-03-22T07:28:46.202 INFO:tasks.workunit.client.1.smithi195.stdout:6/908: symlink d5/d5e/d34/d55/l142 0 2024-03-22T07:28:46.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/909: truncate d5/d16/d45/df8/d104/f111 154751 0 2024-03-22T07:28:46.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/910: mknod d5/d16/d45/df8/d104/da2/dad/c143 0 2024-03-22T07:28:46.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/911: readlink d5/d5e/d34/d55/d3b/d6e/l1b 0 2024-03-22T07:28:46.203 INFO:tasks.workunit.client.1.smithi195.stdout:6/912: chown d5/d16/d45/df8/l10f 57676440 1 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: Standby manager daemon smithi134.wtwqre started 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/crt"}]: dispatch 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/key"}]: dispatch 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3624948816' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: mgrmap e25: smithi195.jxfsnc(active, since 11s), standbys: smithi134.wtwqre 2024-03-22T07:28:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:45 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:28:46.215 INFO:tasks.workunit.client.1.smithi195.stdout:1/881: dwrite d0/d2/d6/dad/df2/df8/d11f/f5a [0,4194304] 0 2024-03-22T07:28:46.216 INFO:tasks.workunit.client.1.smithi195.stdout:1/882: creat d0/d2/d27/d91/dc8/f124 x:0 0 0 2024-03-22T07:28:46.238 INFO:tasks.workunit.client.1.smithi195.stdout:4/991: dwrite d13/d63/d3e/d5c/f69 [0,4194304] 0 2024-03-22T07:28:46.239 INFO:tasks.workunit.client.0.smithi134.stdout:6/579: dwrite d2/d3f/d28/fac [0,4194304] 0 2024-03-22T07:28:46.239 INFO:tasks.workunit.client.0.smithi134.stdout:6/580: truncate d2/d1b/d1d/d5e/d63/f64 2976397 0 2024-03-22T07:28:46.239 INFO:tasks.workunit.client.1.smithi195.stdout:6/913: dwrite d5/d16/d45/df8/d104/da2/f4e [0,4194304] 0 2024-03-22T07:28:46.240 INFO:tasks.workunit.client.1.smithi195.stdout:1/883: dwrite d0/d2/d6/dad/db1/d97/d39/d64/d7a/fa5 [0,4194304] 0 2024-03-22T07:28:46.240 INFO:tasks.workunit.client.1.smithi195.stdout:4/992: link d13/d63/d3e/f12a d13/d63/d79/de9/d7e/d8c/dd2/d139/f155 0 2024-03-22T07:28:46.245 INFO:tasks.workunit.client.1.smithi195.stdout:1/884: symlink d0/d2/d27/d91/dc8/da4/dc0/dfa/l125 0 2024-03-22T07:28:46.248 INFO:tasks.workunit.client.1.smithi195.stdout:4/993: rename d13/d15/f22 to d13/d63/f156 0 2024-03-22T07:28:46.249 INFO:tasks.workunit.client.1.smithi195.stdout:1/885: symlink d0/d2/d6/dad/df2/df8/l126 0 2024-03-22T07:28:46.250 INFO:tasks.workunit.client.1.smithi195.stdout:4/994: truncate d13/d63/d79/de9/d7e/d85/d101/f10d 65629 0 2024-03-22T07:28:46.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/726: write d1/d8/dc5/da2/f6d [55804,80597] 0 2024-03-22T07:28:46.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/727: chown d1/d8/d83/f8f 0 1 2024-03-22T07:28:46.253 INFO:tasks.workunit.client.0.smithi134.stdout:5/728: mkdir d1/d8/d20/d62/df2 0 2024-03-22T07:28:46.253 INFO:tasks.workunit.client.0.smithi134.stdout:5/729: creat d1/d8/d16/dbd/dc0/ff3 x:0 0 0 2024-03-22T07:28:46.253 INFO:tasks.workunit.client.0.smithi134.stdout:5/730: write d1/d8/d20/d62/d65/d95/faa [817887,100910] 0 2024-03-22T07:28:46.254 INFO:tasks.workunit.client.0.smithi134.stdout:5/731: chown d1/d8/d16/d4a/lb5 1288524 1 2024-03-22T07:28:46.254 INFO:tasks.workunit.client.0.smithi134.stdout:5/732: truncate d1/d8/d20/d62/f92 399145 0 2024-03-22T07:28:46.258 INFO:tasks.workunit.client.0.smithi134.stdout:5/733: read d1/d8/d20/f5c [312680,80474] 0 2024-03-22T07:28:46.261 INFO:tasks.workunit.client.1.smithi195.stdout:1/886: write d0/d2/d27/d91/dc8/f15 [2409234,76365] 0 2024-03-22T07:28:46.267 INFO:tasks.workunit.client.0.smithi134.stdout:5/734: write d1/d8/d20/d8a/d75/f76 [1363335,119412] 0 2024-03-22T07:28:46.267 INFO:tasks.workunit.client.0.smithi134.stdout:5/735: dread - d1/d8/dc5/da2/fa7 zero size 2024-03-22T07:28:46.267 INFO:tasks.workunit.client.0.smithi134.stdout:6/581: dwrite d2/d6e/fc3 [0,4194304] 0 2024-03-22T07:28:46.270 INFO:tasks.workunit.client.0.smithi134.stdout:6/582: rmdir d2/d1b/d1d/d5e/d6f/da8/dca 39 2024-03-22T07:28:46.270 INFO:tasks.workunit.client.0.smithi134.stdout:6/583: truncate d2/d1b/d1d/d5e/d6f/f98 187833 0 2024-03-22T07:28:46.270 INFO:tasks.workunit.client.0.smithi134.stdout:5/736: dread d1/d4/f94 [0,4194304] 0 2024-03-22T07:28:46.270 INFO:tasks.workunit.client.0.smithi134.stdout:5/737: stat d1/d8/d20/l27 0 2024-03-22T07:28:46.270 INFO:tasks.workunit.client.0.smithi134.stdout:5/738: chown d1/d8/d20/d8a/d75 1651 1 2024-03-22T07:28:46.271 INFO:tasks.workunit.client.1.smithi195.stdout:6/914: dwrite d5/d5e/d34/d55/d3b/d6e/d56/f77 [0,4194304] 0 2024-03-22T07:28:46.272 INFO:tasks.workunit.client.1.smithi195.stdout:4/995: dwrite d13/d63/d79/de9/f152 [0,4194304] 0 2024-03-22T07:28:46.272 INFO:tasks.workunit.client.0.smithi134.stdout:6/584: mkdir d2/d1b/d1d/d5e/d6f/d7d/dd8 0 2024-03-22T07:28:46.272 INFO:tasks.workunit.client.0.smithi134.stdout:6/585: write d2/f94 [347483,58491] 0 2024-03-22T07:28:46.273 INFO:tasks.workunit.client.1.smithi195.stdout:6/915: creat d5/d5e/d34/d55/d3b/d6e/d3c/f144 x:0 0 0 2024-03-22T07:28:46.274 INFO:tasks.workunit.client.1.smithi195.stdout:6/916: chown d5/d5e/d34/d55/d3b/d6e/d3c 147 1 2024-03-22T07:28:46.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/887: write d0/d2/d27/d91/dc8/f6c [3043611,121821] 0 2024-03-22T07:28:46.277 INFO:tasks.workunit.client.1.smithi195.stdout:1/888: truncate d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 4646747 0 2024-03-22T07:28:46.278 INFO:tasks.workunit.client.1.smithi195.stdout:1/889: stat d0/d2/d6/dad/lf4 0 2024-03-22T07:28:46.283 INFO:tasks.workunit.client.0.smithi134.stdout:6/586: rename d2/c12 to d2/d1b/d1d/d5e/d6f/d7d/cd9 0 2024-03-22T07:28:46.283 INFO:tasks.workunit.client.1.smithi195.stdout:1/890: mkdir d0/d2/d27/d91/dc8/d127 0 2024-03-22T07:28:46.284 INFO:tasks.workunit.client.1.smithi195.stdout:1/891: write d0/d2/d6/dad/db1/d97/d39/d40/f10a [4390825,87359] 0 2024-03-22T07:28:46.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/892: symlink d0/d2/d27/d91/dc8/dba/l128 0 2024-03-22T07:28:46.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/893: readlink d0/d2/d6/dad/db1/d97/d39/d40/l60 0 2024-03-22T07:28:46.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/894: dread - d0/d2/d6/dad/df2/f123 zero size 2024-03-22T07:28:46.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/895: fsync d0/d2/d6/dad/db1/d6b/fe0 0 2024-03-22T07:28:46.287 INFO:tasks.workunit.client.1.smithi195.stdout:1/896: truncate d0/d2/d27/d91/dc8/da4/fb7 1478395 0 2024-03-22T07:28:46.290 INFO:tasks.workunit.client.1.smithi195.stdout:1/897: mkdir d0/d2/d6/d129 0 2024-03-22T07:28:46.290 INFO:tasks.workunit.client.1.smithi195.stdout:6/917: dread d5/d5e/d34/d55/d3b/d6e/d3c/fb0 [0,4194304] 0 2024-03-22T07:28:46.290 INFO:tasks.workunit.client.1.smithi195.stdout:6/918: readlink d5/d16/d45/d53/ld2 0 2024-03-22T07:28:46.290 INFO:tasks.workunit.client.1.smithi195.stdout:6/919: chown d5/d5e/d34/d55/d3b/d6e/l120 445036649 1 2024-03-22T07:28:46.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/739: dwrite d1/d8/d16/dbd/dc0/ff3 [0,4194304] 0 2024-03-22T07:28:46.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/740: write d1/d8/d20/d62/d65/fb7 [437932,28708] 0 2024-03-22T07:28:46.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/741: fdatasync d1/d8/d20/d62/d65/dac/fdd 0 2024-03-22T07:28:46.293 INFO:tasks.workunit.client.1.smithi195.stdout:6/920: unlink d5/d5e/d34/d55/d3b/d6e/d56/dee/ff6 0 2024-03-22T07:28:46.296 INFO:tasks.workunit.client.1.smithi195.stdout:6/921: getdents d5/d5e/d34/d55/dab 0 2024-03-22T07:28:46.296 INFO:tasks.workunit.client.1.smithi195.stdout:6/922: readlink d5/d5e/d34/l49 0 2024-03-22T07:28:46.298 INFO:tasks.workunit.client.1.smithi195.stdout:1/898: write d0/d2/d6/dad/db1/d97/d39/d40/f43 [6300160,23554] 0 2024-03-22T07:28:46.300 INFO:tasks.workunit.client.1.smithi195.stdout:4/996: dwrite d13/d63/d3e/f10a [4194304,4194304] 0 2024-03-22T07:28:46.302 INFO:tasks.workunit.client.1.smithi195.stdout:4/997: mknod d13/d15/d6b/da6/ded/def/d134/c157 0 2024-03-22T07:28:46.303 INFO:tasks.workunit.client.0.smithi134.stdout:6/587: dwrite d2/d1b/fa3 [4194304,4194304] 0 2024-03-22T07:28:46.304 INFO:tasks.workunit.client.1.smithi195.stdout:4/998: creat d13/d63/f158 x:0 0 0 2024-03-22T07:28:46.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/742: dread d1/faf [0,4194304] 0 2024-03-22T07:28:46.306 INFO:tasks.workunit.client.1.smithi195.stdout:4/999: creat d13/d63/d21/f159 x:0 0 0 2024-03-22T07:28:46.306 INFO:tasks.workunit.client.1.smithi195.stdout:1/899: dread d0/d2/d27/d91/dc8/f61 [0,4194304] 0 2024-03-22T07:28:46.307 INFO:tasks.workunit.client.1.smithi195.stdout:1/900: truncate d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/fa8 1011573 0 2024-03-22T07:28:46.308 INFO:tasks.workunit.client.1.smithi195.stdout:6/923: dread d5/d16/d45/d53/d59/d87/fb6 [0,4194304] 0 2024-03-22T07:28:46.309 INFO:tasks.workunit.client.0.smithi134.stdout:5/743: rmdir d1/da0 39 2024-03-22T07:28:46.309 INFO:tasks.workunit.client.0.smithi134.stdout:5/744: fdatasync d1/d8/d20/d62/f8e 0 2024-03-22T07:28:46.336 INFO:tasks.workunit.client.1.smithi195.stdout:6/924: rename d5/d16/c38 to d5/d5e/d34/d55/d3b/d6e/c145 0 2024-03-22T07:28:46.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/925: symlink d5/d5e/d34/d55/d3b/d6e/d97/l146 0 2024-03-22T07:28:46.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/926: chown d5/d6d/d95/fd9 0 1 2024-03-22T07:28:46.339 INFO:tasks.workunit.client.1.smithi195.stdout:6/927: write d5/d5e/d34/d55/dab/dbf/f124 [185904,124062] 0 2024-03-22T07:28:46.340 INFO:tasks.workunit.client.1.smithi195.stdout:1/901: write d0/d2/d6/dad/df2/df8/d11f/d47/d4a/fbc [569745,29956] 0 2024-03-22T07:28:46.340 INFO:tasks.workunit.client.0.smithi134.stdout:5/745: creat d1/d4/ff4 x:0 0 0 2024-03-22T07:28:46.342 INFO:tasks.workunit.client.1.smithi195.stdout:1/902: symlink d0/d2/d6/d129/l12a 0 2024-03-22T07:28:46.345 INFO:tasks.workunit.client.0.smithi134.stdout:5/746: mkdir d1/d8/da1/db0/df5 0 2024-03-22T07:28:46.346 INFO:tasks.workunit.client.1.smithi195.stdout:6/928: dread d5/d16/d45/d53/f108 [0,4194304] 0 2024-03-22T07:28:46.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/747: unlink d1/d8/d20/d62/d65/d95/faa 0 2024-03-22T07:28:46.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/748: creat d1/d8/d20/d62/d65/dac/ff6 x:0 0 0 2024-03-22T07:28:46.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/749: write d1/da0/fe9 [479355,87875] 0 2024-03-22T07:28:46.349 INFO:tasks.workunit.client.1.smithi195.stdout:1/903: write d0/d2/d6/f2f [1124161,55960] 0 2024-03-22T07:28:46.349 INFO:tasks.workunit.client.0.smithi134.stdout:5/750: symlink d1/d8/dc5/lf7 0 2024-03-22T07:28:46.349 INFO:tasks.workunit.client.0.smithi134.stdout:5/751: write d1/d8/d20/d8a/d75/fab [4619756,24567] 0 2024-03-22T07:28:46.352 INFO:tasks.workunit.client.1.smithi195.stdout:1/904: creat d0/d2/d27/d91/f12b x:0 0 0 2024-03-22T07:28:46.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/752: dread d1/d8/d16/f5a [0,4194304] 0 2024-03-22T07:28:46.354 INFO:tasks.workunit.client.0.smithi134.stdout:5/753: dread - d1/d8/d20/d62/d68/fd7 zero size 2024-03-22T07:28:46.354 INFO:tasks.workunit.client.0.smithi134.stdout:5/754: getdents d1/d8/d83 0 2024-03-22T07:28:46.357 INFO:tasks.workunit.client.0.smithi134.stdout:5/755: unlink d1/d4/fc4 0 2024-03-22T07:28:46.360 INFO:tasks.workunit.client.0.smithi134.stdout:5/756: link d1/d8/f66 d1/d8/d20/d62/ff8 0 2024-03-22T07:28:46.360 INFO:tasks.workunit.client.0.smithi134.stdout:5/757: chown d1/d8/d16/fa9 64988 1 2024-03-22T07:28:46.362 INFO:tasks.workunit.client.0.smithi134.stdout:5/758: truncate d1/d8/d16/f40 2332229 0 2024-03-22T07:28:46.362 INFO:tasks.workunit.client.0.smithi134.stdout:5/759: write d1/d8/d20/d62/d68/d9c/ff0 [315993,67183] 0 2024-03-22T07:28:46.364 INFO:tasks.workunit.client.1.smithi195.stdout:6/929: truncate d5/d5e/d34/d55/d3b/d6e/d56/f77 3536945 0 2024-03-22T07:28:46.366 INFO:tasks.workunit.client.1.smithi195.stdout:1/905: dwrite d0/d2/d6/f71 [0,4194304] 0 2024-03-22T07:28:46.366 INFO:tasks.workunit.client.1.smithi195.stdout:1/906: read d0/d2/d6/dad/db1/d97/d39/f65 [544087,11601] 0 2024-03-22T07:28:46.366 INFO:tasks.workunit.client.1.smithi195.stdout:1/907: readlink d0/d2/d27/l67 0 2024-03-22T07:28:46.389 INFO:tasks.workunit.client.1.smithi195.stdout:6/930: dwrite d5/d5e/d34/d55/d3b/d6e/d3c/fa0 [0,4194304] 0 2024-03-22T07:28:46.391 INFO:tasks.workunit.client.1.smithi195.stdout:6/931: symlink d5/d5e/d34/d55/d3b/d6e/d3c/l147 0 2024-03-22T07:28:46.391 INFO:tasks.workunit.client.1.smithi195.stdout:6/932: chown d5/d5e/d34/d55/d3b/d6e/d56 35084 1 2024-03-22T07:28:46.392 INFO:tasks.workunit.client.0.smithi134.stdout:5/760: dwrite d1/d8/d20/d8a/d75/fab [0,4194304] 0 2024-03-22T07:28:46.392 INFO:tasks.workunit.client.1.smithi195.stdout:1/908: dwrite d0/d2/d6/dad/db1/d97/d39/d64/d7a/fc5 [0,4194304] 0 2024-03-22T07:28:46.392 INFO:tasks.workunit.client.1.smithi195.stdout:1/909: write d0/d2/d6/dad/db1/d97/d39/d64/fc3 [3730228,98481] 0 2024-03-22T07:28:46.393 INFO:tasks.workunit.client.1.smithi195.stdout:6/933: getdents d5/d16/d45/d53/d59/d87 0 2024-03-22T07:28:46.395 INFO:tasks.workunit.client.1.smithi195.stdout:6/934: rename d5/l127 to d5/d16/d45/d53/d59/d87/l148 0 2024-03-22T07:28:46.400 INFO:tasks.workunit.client.0.smithi134.stdout:9/647: sync 2024-03-22T07:28:46.400 INFO:tasks.workunit.client.0.smithi134.stdout:3/709: sync 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/910: dread d0/d2/f1f [4194304,4194304] 0 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/911: chown d0/d2/d27/d91/dc8/d2a/ce9 202723 1 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/912: readlink d0/d2/d6/dad/db1/d97/d39/d40/dc9/dd0/lca 0 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/913: readlink d0/d2/d6/dad/db1/l104 0 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/914: write d0/d2/d27/d91/dc8/f124 [229601,119415] 0 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/915: stat d0/d2/d6/dad/db1/d97/d39/d40/db3/fbf 0 2024-03-22T07:28:46.407 INFO:tasks.workunit.client.1.smithi195.stdout:1/916: chown d0/d2/d6/dad/db1/d97/d39/d40/dc9/le2 1845365812 1 2024-03-22T07:28:46.410 INFO:tasks.workunit.client.1.smithi195.stdout:1/917: truncate d0/d2/d6/dad/db1/d97/d39/d64/fea 2605801 0 2024-03-22T07:28:46.413 INFO:tasks.workunit.client.0.smithi134.stdout:3/710: dread d4/d10/f14 [0,4194304] 0 2024-03-22T07:28:46.415 INFO:tasks.workunit.client.0.smithi134.stdout:3/711: rename d4/d10/d6c/fa5 to d4/fdd 0 2024-03-22T07:28:46.418 INFO:tasks.workunit.client.0.smithi134.stdout:5/761: dwrite d1/d8/d20/d8a/d75/fab [4194304,4194304] 0 2024-03-22T07:28:46.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/762: mknod d1/d8/d20/d62/d65/d95/cf9 0 2024-03-22T07:28:46.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/763: stat d1/d8/d20/d62/d65/f43 0 2024-03-22T07:28:46.420 INFO:tasks.workunit.client.0.smithi134.stdout:5/764: unlink d1/d8/f72 0 2024-03-22T07:28:46.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/935: dwrite d5/d16/d45/df8/d104/f65 [0,4194304] 0 2024-03-22T07:28:46.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/936: truncate d5/d16/d5b/f7c 473565 0 2024-03-22T07:28:46.424 INFO:tasks.workunit.client.1.smithi195.stdout:6/937: readlink d5/d5e/d34/d55/d3b/dc2/d121/l106 0 2024-03-22T07:28:46.440 INFO:tasks.workunit.client.1.smithi195.stdout:6/938: dwrite d5/d16/f125 [0,4194304] 0 2024-03-22T07:28:46.441 INFO:tasks.workunit.client.1.smithi195.stdout:6/939: stat d5/d16/d45/df8/d104/da2/cce 0 2024-03-22T07:28:46.441 INFO:tasks.workunit.client.0.smithi134.stdout:5/765: dwrite d1/d8/d20/d62/d65/fc9 [0,4194304] 0 2024-03-22T07:28:46.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/940: symlink d5/d16/d45/df8/d104/ddc/d13a/l149 0 2024-03-22T07:28:46.443 INFO:tasks.workunit.client.1.smithi195.stdout:6/941: chown d5/d16/d45/df8/d104/da2/d1a/f32 0 1 2024-03-22T07:28:46.445 INFO:tasks.workunit.client.0.smithi134.stdout:5/766: creat d1/d8/d20/d62/ffa x:0 0 0 2024-03-22T07:28:46.446 INFO:tasks.workunit.client.1.smithi195.stdout:6/942: creat d5/d5e/d34/d55/dab/f14a x:0 0 0 2024-03-22T07:28:46.448 INFO:tasks.workunit.client.1.smithi195.stdout:6/943: symlink d5/d5e/d34/l14b 0 2024-03-22T07:28:46.448 INFO:tasks.workunit.client.1.smithi195.stdout:6/944: mknod d5/d16/d45/df8/c14c 0 2024-03-22T07:28:46.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/945: symlink d5/d16/d45/df8/d104/da2/d82/ddf/d138/l14d 0 2024-03-22T07:28:46.449 INFO:tasks.workunit.client.1.smithi195.stdout:6/946: chown d5/d5e/d34/d55/c37 5173613 1 2024-03-22T07:28:46.450 INFO:tasks.workunit.client.1.smithi195.stdout:6/947: mkdir d5/d16/d45/df8/d104/da2/d82/d14e 0 2024-03-22T07:28:46.450 INFO:tasks.workunit.client.1.smithi195.stdout:6/948: truncate d5/d16/d45/f119 531910 0 2024-03-22T07:28:46.452 INFO:tasks.workunit.client.1.smithi195.stdout:6/949: mknod d5/d16/d45/c14f 0 2024-03-22T07:28:46.453 INFO:tasks.workunit.client.0.smithi134.stdout:9/648: dwrite d3/d9/d37/d5a/d7f/fcd [0,4194304] 0 2024-03-22T07:28:46.453 INFO:tasks.workunit.client.0.smithi134.stdout:9/649: chown d3/d9/df/d57/d67/d5f/fb9 343822 1 2024-03-22T07:28:46.453 INFO:tasks.workunit.client.0.smithi134.stdout:9/650: creat d3/d9/d37/d70/fd9 x:0 0 0 2024-03-22T07:28:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/950: mkdir d5/d150 0 2024-03-22T07:28:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/951: dread - d5/d6d/d95/fd9 zero size 2024-03-22T07:28:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/952: fsync d5/f6 0 2024-03-22T07:28:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/953: fsync d5/d16/d45/df8/d104/da2/d1a/fb2 0 2024-03-22T07:28:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/954: write d5/d5e/d34/d55/d3b/d6e/d97/d112/f133 [97114,47056] 0 2024-03-22T07:28:46.460 INFO:tasks.workunit.client.1.smithi195.stdout:6/955: chown d5/d5e/d34/d55/dcb/l115 38135 1 2024-03-22T07:28:46.461 INFO:tasks.workunit.client.1.smithi195.stdout:6/956: creat d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/f151 x:0 0 0 2024-03-22T07:28:46.462 INFO:tasks.workunit.client.0.smithi134.stdout:9/651: dread d3/d9/d37/d6f/f32 [0,4194304] 0 2024-03-22T07:28:46.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/767: dwrite d1/faf [0,4194304] 0 2024-03-22T07:28:46.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/768: write d1/d8/d20/d62/d68/fca [1542742,9149] 0 2024-03-22T07:28:46.463 INFO:tasks.workunit.client.0.smithi134.stdout:5/769: write d1/d8/d20/d62/d65/f64 [4703910,5859] 0 2024-03-22T07:28:46.463 INFO:tasks.workunit.client.1.smithi195.stdout:6/957: read d5/d16/d45/fa4 [5274111,31451] 0 2024-03-22T07:28:46.464 INFO:tasks.workunit.client.0.smithi134.stdout:9/652: mknod d3/d9/d37/d3c/d71/cda 0 2024-03-22T07:28:46.472 INFO:tasks.workunit.client.0.smithi134.stdout:9/653: rmdir d3/d9/d37/d6f/d54 39 2024-03-22T07:28:46.474 INFO:tasks.workunit.client.0.smithi134.stdout:5/770: fsync d1/d8/d20/d62/ffa 0 2024-03-22T07:28:46.478 INFO:tasks.workunit.client.0.smithi134.stdout:5/771: mkdir d1/d8/d16/dbd/dc0/dfb 0 2024-03-22T07:28:46.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/772: write d1/d8/d20/f39 [5473065,96617] 0 2024-03-22T07:28:46.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/773: write d1/d8/d20/d62/d68/f7c [1768171,82152] 0 2024-03-22T07:28:46.479 INFO:tasks.workunit.client.0.smithi134.stdout:5/774: write d1/d8/d16/f59 [6452688,70619] 0 2024-03-22T07:28:46.480 INFO:tasks.workunit.client.1.smithi195.stdout:6/958: symlink d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/l152 0 2024-03-22T07:28:46.482 INFO:tasks.workunit.client.0.smithi134.stdout:5/775: rmdir d1/d8/dc5/da2 39 2024-03-22T07:28:46.483 INFO:tasks.workunit.client.0.smithi134.stdout:5/776: mkdir d1/d8/dc5/dd6/dfc 0 2024-03-22T07:28:46.483 INFO:tasks.workunit.client.0.smithi134.stdout:5/777: read - d1/d4/ff4 zero size 2024-03-22T07:28:46.486 INFO:tasks.workunit.client.0.smithi134.stdout:9/654: dwrite d3/d9/d37/d6f/d54/d9d/dc0/fa1 [0,4194304] 0 2024-03-22T07:28:46.486 INFO:tasks.workunit.client.0.smithi134.stdout:9/655: truncate d3/d9/d37/d3c/d71/d8e/fbc 703325 0 2024-03-22T07:28:46.487 INFO:tasks.workunit.client.0.smithi134.stdout:9/656: dread d3/d9/d37/d5a/d7f/f98 [0,4194304] 0 2024-03-22T07:28:46.492 INFO:tasks.workunit.client.0.smithi134.stdout:9/657: write d3/d9/d37/d5a/dc5/fce [1898356,121958] 0 2024-03-22T07:28:46.492 INFO:tasks.workunit.client.0.smithi134.stdout:9/658: chown d3/d9/d37/d6f/d54/d9d/lc4 0 1 2024-03-22T07:28:46.493 INFO:tasks.workunit.client.0.smithi134.stdout:9/659: creat d3/d9/d37/d5a/fdb x:0 0 0 2024-03-22T07:28:46.494 INFO:tasks.workunit.client.0.smithi134.stdout:5/778: getdents d1/d8/d16/dbd/dc0 0 2024-03-22T07:28:46.496 INFO:tasks.workunit.client.0.smithi134.stdout:5/779: creat d1/d8/d16/d4a/dce/ffd x:0 0 0 2024-03-22T07:28:46.503 INFO:tasks.workunit.client.0.smithi134.stdout:5/780: dread d1/fcd [0,4194304] 0 2024-03-22T07:28:46.504 INFO:tasks.workunit.client.0.smithi134.stdout:5/781: creat d1/d8/d20/d8a/ffe x:0 0 0 2024-03-22T07:28:46.505 INFO:tasks.workunit.client.0.smithi134.stdout:5/782: link d1/d8/d20/fae d1/d8/d16/dbd/fff 0 2024-03-22T07:28:46.508 INFO:tasks.workunit.client.1.smithi195.stdout:6/959: dwrite d5/d16/d45/df8/f10b [0,4194304] 0 2024-03-22T07:28:46.510 INFO:tasks.workunit.client.1.smithi195.stdout:6/960: creat d5/d16/d45/df8/d104/da2/d82/f153 x:0 0 0 2024-03-22T07:28:46.510 INFO:tasks.workunit.client.1.smithi195.stdout:6/961: dread - d5/d16/d45/df8/d104/da2/d82/f153 zero size 2024-03-22T07:28:46.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/785: sync 2024-03-22T07:28:46.511 INFO:tasks.workunit.client.0.smithi134.stdout:4/786: fdatasync d2/d15/d6f/fd5 0 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/787: dread f1 [0,4194304] 0 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/788: creat d2/d98/f113 x:0 0 0 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/789: dread - d2/d25/fe9 zero size 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/790: creat d2/d25/d74/dde/d76/d9a/f114 x:0 0 0 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/791: creat d2/d2a/d93/f115 x:0 0 0 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:4/792: write d2/d15/f39 [3252921,4846] 0 2024-03-22T07:28:46.515 INFO:tasks.workunit.client.0.smithi134.stdout:9/660: dwrite d3/d9/d37/d6f/d54/f68 [0,4194304] 0 2024-03-22T07:28:46.516 INFO:tasks.workunit.client.1.smithi195.stdout:6/962: rename d5/d5e/d34/d55/d3b/d6e/l120 to d5/d16/d45/df8/l154 0 2024-03-22T07:28:46.522 INFO:tasks.workunit.client.0.smithi134.stdout:5/783: dwrite d1/d8/d20/d8a/ffe [0,4194304] 0 2024-03-22T07:28:46.523 INFO:tasks.workunit.client.1.smithi195.stdout:6/963: rename d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/dd5/ld7 to d5/d16/l155 0 2024-03-22T07:28:46.526 INFO:tasks.workunit.client.1.smithi195.stdout:6/964: creat d5/d6d/d95/f156 x:0 0 0 2024-03-22T07:28:46.526 INFO:tasks.workunit.client.1.smithi195.stdout:6/965: creat d5/d5e/d34/d55/dab/f157 x:0 0 0 2024-03-22T07:28:46.529 INFO:tasks.workunit.client.1.smithi195.stdout:1/918: sync 2024-03-22T07:28:46.532 INFO:tasks.workunit.client.0.smithi134.stdout:9/661: dwrite d3/f72 [0,4194304] 0 2024-03-22T07:28:46.535 INFO:tasks.workunit.client.1.smithi195.stdout:1/919: truncate d0/d2/d6/dad/db1/d97/d39/fa9 105411 0 2024-03-22T07:28:46.535 INFO:tasks.workunit.client.1.smithi195.stdout:1/920: creat d0/d2/d6/dad/db1/d97/d39/d40/dc9/f12c x:0 0 0 2024-03-22T07:28:46.539 INFO:tasks.workunit.client.1.smithi195.stdout:6/966: dwrite d5/d16/d11b/f12b [0,4194304] 0 2024-03-22T07:28:46.540 INFO:tasks.workunit.client.0.smithi134.stdout:9/662: mknod d3/d9/d37/d3c/dcb/cdc 0 2024-03-22T07:28:46.542 INFO:tasks.workunit.client.0.smithi134.stdout:9/663: dread d3/d9/d37/d5a/d7f/d80/fab [0,4194304] 0 2024-03-22T07:28:46.543 INFO:tasks.workunit.client.0.smithi134.stdout:5/784: rename d1/d8/d20/d62/d65/l33 to d1/d8/d20/d62/d65/d95/l100 0 2024-03-22T07:28:46.543 INFO:tasks.workunit.client.0.smithi134.stdout:5/785: chown d1/d8/d20/d62/d65/f67 27017 1 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:2/736: sync 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:1/762: sync 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:0/777: sync 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:6/588: sync 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:7/959: sync 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:8/937: sync 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:8/938: fdatasync d1/d15/d7b/f126 0 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:8/939: dread - d1/f82 zero size 2024-03-22T07:28:46.553 INFO:tasks.workunit.client.0.smithi134.stdout:5/786: dread d1/d8/d20/d62/d65/f64 [0,4194304] 0 2024-03-22T07:28:46.554 INFO:tasks.workunit.client.1.smithi195.stdout:1/921: dwrite d0/d2/d6/dad/db1/d6b/fe0 [0,4194304] 0 2024-03-22T07:28:46.554 INFO:tasks.workunit.client.1.smithi195.stdout:1/922: write d0/d2/d6/dad/db1/d97/d39/d40/f10a [4379885,19446] 0 2024-03-22T07:28:46.555 INFO:tasks.workunit.client.0.smithi134.stdout:6/589: mknod d2/d1b/d1d/d5e/d6f/dd7/cda 0 2024-03-22T07:28:46.556 INFO:tasks.workunit.client.1.smithi195.stdout:6/967: dwrite d5/d5e/f33 [0,4194304] 0 2024-03-22T07:28:46.557 INFO:tasks.workunit.client.0.smithi134.stdout:0/778: symlink dc/de/lf2 0 2024-03-22T07:28:46.560 INFO:tasks.workunit.client.1.smithi195.stdout:6/968: mknod d5/d16/d45/df8/d104/da2/d1a/df5/c158 0 2024-03-22T07:28:46.560 INFO:tasks.workunit.client.1.smithi195.stdout:6/969: chown d5/d16/d45/df8/d104/d5f/l85 324165692 1 2024-03-22T07:28:46.565 INFO:tasks.workunit.client.0.smithi134.stdout:6/590: unlink d2/d3f/f32 0 2024-03-22T07:28:46.566 INFO:tasks.workunit.client.0.smithi134.stdout:2/737: dread d2/d5/d22/d99/df0/fc4 [0,4194304] 0 2024-03-22T07:28:46.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/970: mknod d5/d5e/d34/d55/dab/c159 0 2024-03-22T07:28:46.567 INFO:tasks.workunit.client.1.smithi195.stdout:6/971: write d5/d16/d5a/f99 [5075062,11540] 0 2024-03-22T07:28:46.568 INFO:tasks.workunit.client.0.smithi134.stdout:1/763: rename d5/da/d1b/d27 to d5/d1d/dd0/ddc/d113 0 2024-03-22T07:28:46.568 INFO:tasks.workunit.client.0.smithi134.stdout:1/764: creat d5/d93/f114 x:0 0 0 2024-03-22T07:28:46.579 INFO:tasks.workunit.client.0.smithi134.stdout:1/765: write f3 [2757136,128975] 0 2024-03-22T07:28:46.581 INFO:tasks.workunit.client.1.smithi195.stdout:1/923: dwrite d0/d2/d27/d91/dc8/da4/dc0/fe6 [0,4194304] 0 2024-03-22T07:28:46.581 INFO:tasks.workunit.client.0.smithi134.stdout:7/960: dwrite d1/d19/d9c/db3/dc4/de2/f120 [0,4194304] 0 2024-03-22T07:28:46.581 INFO:tasks.workunit.client.0.smithi134.stdout:7/961: fdatasync d1/de/d11/d48/d52/f7 0 2024-03-22T07:28:46.582 INFO:tasks.workunit.client.0.smithi134.stdout:7/962: fsync d1/de/d11/d48/d52/f7 0 2024-03-22T07:28:46.582 INFO:tasks.workunit.client.0.smithi134.stdout:0/779: dwrite dc/de/d55/d65/db8/fa2 [0,4194304] 0 2024-03-22T07:28:46.582 INFO:tasks.workunit.client.0.smithi134.stdout:0/780: read - dc/d17/da7/fca zero size 2024-03-22T07:28:46.606 INFO:tasks.workunit.client.0.smithi134.stdout:6/591: link d2/d1b/d4d/d65/fa0 d2/fdb 0 2024-03-22T07:28:46.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/738: creat d2/d5/d22/d99/df0/d4f/d6e/d9e/ff1 x:0 0 0 2024-03-22T07:28:46.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/739: fdatasync d2/d5/d8/f2f 0 2024-03-22T07:28:46.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/740: chown d2/d5/d8/d7e/d83/fc7 384 1 2024-03-22T07:28:46.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/741: fdatasync d2/d5/d8/d5d/fc1 0 2024-03-22T07:28:46.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/742: chown d2/f1a 3060836 1 2024-03-22T07:28:46.608 INFO:tasks.workunit.client.0.smithi134.stdout:2/743: truncate d2/d5/d22/f2a 5345047 0 2024-03-22T07:28:46.609 INFO:tasks.workunit.client.1.smithi195.stdout:6/972: unlink d5/d16/d45/df8/d104/da2/f4e 0 2024-03-22T07:28:46.609 INFO:tasks.workunit.client.1.smithi195.stdout:6/973: fsync d5/d16/d5b/f12f 0 2024-03-22T07:28:46.611 INFO:tasks.workunit.client.0.smithi134.stdout:5/787: rename d1/d8/da1/db0/ccc to d1/d8/d20/d8a/c101 0 2024-03-22T07:28:46.613 INFO:tasks.workunit.client.1.smithi195.stdout:1/924: rename d0/d2/d6/dad/df2/df8/d11f/d47/l51 to d0/d2/d27/d91/dc8/dba/l12d 0 2024-03-22T07:28:46.616 INFO:tasks.workunit.client.1.smithi195.stdout:6/974: creat d5/d16/d45/df8/d104/da2/dad/d13f/f15a x:0 0 0 2024-03-22T07:28:46.623 INFO:tasks.workunit.client.0.smithi134.stdout:7/963: creat d1/de/d11/d48/daf/dbf/d124/d127/f132 x:0 0 0 2024-03-22T07:28:46.624 INFO:tasks.workunit.client.1.smithi195.stdout:6/975: creat d5/d5e/d34/d55/d3b/d6e/d56/dee/f15b x:0 0 0 2024-03-22T07:28:46.629 INFO:tasks.workunit.client.0.smithi134.stdout:0/781: mkdir dc/de/d55/d65/df3 0 2024-03-22T07:28:46.631 INFO:tasks.workunit.client.0.smithi134.stdout:6/592: symlink d2/d1b/d1d/d5e/d6f/da8/dca/ldc 0 2024-03-22T07:28:46.635 INFO:tasks.workunit.client.0.smithi134.stdout:2/744: rename d2/d5/d8/d31/l95 to d2/d5/d22/d99/df0/lf2 0 2024-03-22T07:28:46.636 INFO:tasks.workunit.client.1.smithi195.stdout:1/925: rename d0/d2/d6/dad/db1 to d0/d2/d27/d91/dc8/d2a/d6f/d12e 0 2024-03-22T07:28:46.637 INFO:tasks.workunit.client.1.smithi195.stdout:1/926: chown d0/d2/d27/d91/dc8/d2a/d6f/l7f 787 1 2024-03-22T07:28:46.637 INFO:tasks.workunit.client.0.smithi134.stdout:1/766: mknod d5/d1d/dd0/ddc/d113/d60/d72/c115 0 2024-03-22T07:28:46.639 INFO:tasks.workunit.client.0.smithi134.stdout:7/964: creat d1/de/d41/f133 x:0 0 0 2024-03-22T07:28:46.644 INFO:tasks.workunit.client.1.smithi195.stdout:6/976: rename d5/d5e/d34/d55/d3b/d6e/d56/f77 to d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/f15c 0 2024-03-22T07:28:46.644 INFO:tasks.workunit.client.1.smithi195.stdout:1/927: truncate d0/d2/d6/dad/df2/df8/d11f/d47/d4a/f83 3100100 0 2024-03-22T07:28:46.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/788: rename d1/d8/d20/d8a/d75/led to d1/d8/d16/dbd/dc0/dfb/l102 0 2024-03-22T07:28:46.649 INFO:tasks.workunit.client.0.smithi134.stdout:1/767: link d5/d1d/d2d/l2f d5/da/d13/l116 0 2024-03-22T07:28:46.649 INFO:tasks.workunit.client.0.smithi134.stdout:1/768: dread - d5/da/d13/dac/ffa zero size 2024-03-22T07:28:46.649 INFO:tasks.workunit.client.0.smithi134.stdout:7/965: write d1/de/d11/d48/d52/d46/fb1 [3711890,104402] 0 2024-03-22T07:28:46.649 INFO:tasks.workunit.client.0.smithi134.stdout:1/769: chown d5/da/d13/d1e/d34/f43 3100797 1 2024-03-22T07:28:46.651 INFO:tasks.workunit.client.1.smithi195.stdout:6/977: truncate d5/d16/d45/df8/d104/da2/dad/de3/f105 582919 0 2024-03-22T07:28:46.651 INFO:tasks.workunit.client.0.smithi134.stdout:5/789: chown d1/d8/d20/d62/f89 5 1 2024-03-22T07:28:46.652 INFO:tasks.workunit.client.0.smithi134.stdout:5/790: readlink d1/d8/d16/d4a/lb5 0 2024-03-22T07:28:46.653 INFO:tasks.workunit.client.1.smithi195.stdout:1/928: mkdir d0/d2/d27/d91/dc8/d2a/d6f/d12e/d12f 0 2024-03-22T07:28:46.654 INFO:tasks.workunit.client.1.smithi195.stdout:6/978: mknod d5/d5e/d34/d55/c15d 0 2024-03-22T07:28:46.656 INFO:tasks.workunit.client.0.smithi134.stdout:7/966: rename d1/de/d11/d2b/d31/d85/f131 to d1/d19/d9c/db3/dc4/f134 0 2024-03-22T07:28:46.657 INFO:tasks.workunit.client.1.smithi195.stdout:6/979: mknod d5/d5e/d34/d55/d3b/d7f/c15e 0 2024-03-22T07:28:46.658 INFO:tasks.workunit.client.0.smithi134.stdout:1/770: mkdir d5/d1d/dd0/ddc/d113/d60/d72/d117 0 2024-03-22T07:28:46.659 INFO:tasks.workunit.client.1.smithi195.stdout:6/980: link d5/d16/d45/df8/d104/da2/d82/ddf/f11a d5/d5e/d34/d55/d3b/d6e/d3c/d123/f15f 0 2024-03-22T07:28:46.660 INFO:tasks.workunit.client.0.smithi134.stdout:0/782: dwrite dc/de/d55/d65/d82/db7/fd5 [0,4194304] 0 2024-03-22T07:28:46.663 INFO:tasks.workunit.client.0.smithi134.stdout:7/967: mkdir d1/d19/d32/d10c/d135 0 2024-03-22T07:28:46.664 INFO:tasks.workunit.client.0.smithi134.stdout:6/593: dwrite d2/d1b/d1d/d5e/d6f/d7d/f85 [0,4194304] 0 2024-03-22T07:28:46.664 INFO:tasks.workunit.client.0.smithi134.stdout:6/594: fsync d2/d1b/d1d/d5e/d6f/da8/dca/fcf 0 2024-03-22T07:28:46.664 INFO:tasks.workunit.client.0.smithi134.stdout:5/791: mknod d1/d8/d20/d62/d65/c103 0 2024-03-22T07:28:46.664 INFO:tasks.workunit.client.0.smithi134.stdout:5/792: truncate d1/da0/fda 229246 0 2024-03-22T07:28:46.666 INFO:tasks.workunit.client.0.smithi134.stdout:2/745: dwrite d2/d5/d8/d5d/da1/f76 [0,4194304] 0 2024-03-22T07:28:46.666 INFO:tasks.workunit.client.0.smithi134.stdout:2/746: chown d2/d5/d22/d99/df0/lf2 53 1 2024-03-22T07:28:46.669 INFO:tasks.workunit.client.0.smithi134.stdout:1/771: rename d5/d1d/dd0/ddc/d113/d39/f58 to d5/da/d13/d1e/d62/dda/f118 0 2024-03-22T07:28:46.673 INFO:tasks.workunit.client.1.smithi195.stdout:1/929: dread d0/d2/f1f [0,4194304] 0 2024-03-22T07:28:46.673 INFO:tasks.workunit.client.0.smithi134.stdout:7/968: dread d1/de/d11/d48/fc [0,4194304] 0 2024-03-22T07:28:46.673 INFO:tasks.workunit.client.0.smithi134.stdout:7/969: chown d1/de/d11/d48/f8b 832 1 2024-03-22T07:28:46.675 INFO:tasks.workunit.client.0.smithi134.stdout:6/595: mknod d2/d1b/daa/dc1/cdd 0 2024-03-22T07:28:46.676 INFO:tasks.workunit.client.0.smithi134.stdout:6/596: readlink d2/l18 0 2024-03-22T07:28:46.676 INFO:tasks.workunit.client.0.smithi134.stdout:6/597: truncate d2/d1b/fbe 936008 0 2024-03-22T07:28:46.677 INFO:tasks.workunit.client.1.smithi195.stdout:6/981: dwrite d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/f12d [0,4194304] 0 2024-03-22T07:28:46.677 INFO:tasks.workunit.client.1.smithi195.stdout:1/930: link d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/d9c/f120 d0/d2/f130 0 2024-03-22T07:28:46.682 INFO:tasks.workunit.client.0.smithi134.stdout:5/793: dwrite d1/d8/dc5/da2/f6d [0,4194304] 0 2024-03-22T07:28:46.682 INFO:tasks.workunit.client.0.smithi134.stdout:5/794: read - d1/d8/d20/d62/d68/fc7 zero size 2024-03-22T07:28:46.685 INFO:tasks.workunit.client.1.smithi195.stdout:6/982: rename d5/d5e/d34/d55/d3b/dc2/d121/ld1 to d5/d16/d45/df8/d104/da2/dad/d13f/l160 0 2024-03-22T07:28:46.687 INFO:tasks.workunit.client.1.smithi195.stdout:1/931: symlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/l131 0 2024-03-22T07:28:46.688 INFO:tasks.workunit.client.0.smithi134.stdout:2/747: rename d2/d5/d8/lbb to d2/d5/d22/d99/df0/d4f/d6e/d9e/lf3 0 2024-03-22T07:28:46.692 INFO:tasks.workunit.client.0.smithi134.stdout:1/772: mkdir d5/d1d/dd0/ddc/d113/d119 0 2024-03-22T07:28:46.692 INFO:tasks.workunit.client.0.smithi134.stdout:1/773: chown d5/d1d/dd0/ddc/d113/dae/l10a 419275 1 2024-03-22T07:28:46.692 INFO:tasks.workunit.client.0.smithi134.stdout:1/774: stat d5/d1d/dd0/ddc/d113/d60/d72 0 2024-03-22T07:28:46.695 INFO:tasks.workunit.client.1.smithi195.stdout:1/932: mknod d0/d2/d27/d91/dc8/c132 0 2024-03-22T07:28:46.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/970: creat d1/de/d11/d2b/ddf/f136 x:0 0 0 2024-03-22T07:28:46.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/971: fdatasync d1/de/d11/d48/daf/dbf/d124/d127/f132 0 2024-03-22T07:28:46.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/972: fsync d1/dae/f10f 0 2024-03-22T07:28:46.696 INFO:tasks.workunit.client.0.smithi134.stdout:7/973: chown d1/de/d11/d48/daf/dbf/lcf 28378 1 2024-03-22T07:28:46.698 INFO:tasks.workunit.client.1.smithi195.stdout:6/983: getdents d5/d5e/d34/d55/dab 0 2024-03-22T07:28:46.700 INFO:tasks.workunit.client.0.smithi134.stdout:6/598: stat d2/d1b/c52 0 2024-03-22T07:28:46.700 INFO:tasks.workunit.client.0.smithi134.stdout:6/599: fdatasync d2/d1b/d4d/f74 0 2024-03-22T07:28:46.701 INFO:tasks.workunit.client.1.smithi195.stdout:1/933: link d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/f43 d0/d2/d27/d91/dc8/da4/dc0/f133 0 2024-03-22T07:28:46.701 INFO:tasks.workunit.client.1.smithi195.stdout:1/934: stat d0/d2/cac 0 2024-03-22T07:28:46.714 INFO:tasks.workunit.client.0.smithi134.stdout:5/795: link d1/d8/d20/d62/d65/f43 d1/da0/f104 0 2024-03-22T07:28:46.716 INFO:tasks.workunit.client.1.smithi195.stdout:1/935: mkdir d0/d2/d27/d91/dc8/d2a/d6f/d12e/d134 0 2024-03-22T07:28:46.719 INFO:tasks.workunit.client.0.smithi134.stdout:6/600: dwrite d2/d1b/d1d/d5e/d6f/da8/dca/fcf [0,4194304] 0 2024-03-22T07:28:46.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/748: creat d2/d5/d22/d99/df0/d60/d7c/ff4 x:0 0 0 2024-03-22T07:28:46.722 INFO:tasks.workunit.client.0.smithi134.stdout:1/775: link d5/d1d/l74 d5/da/d13/d1e/l11a 0 2024-03-22T07:28:46.725 INFO:tasks.workunit.client.1.smithi195.stdout:1/936: symlink d0/d2/d27/d91/dc8/d2a/d6f/l135 0 2024-03-22T07:28:46.727 INFO:tasks.workunit.client.0.smithi134.stdout:7/974: creat d1/d19/d9c/db3/dc4/f137 x:0 0 0 2024-03-22T07:28:46.730 INFO:tasks.workunit.client.1.smithi195.stdout:1/937: link d0/d2/d27/d91/dc8/c132 d0/d2/d27/d91/c136 0 2024-03-22T07:28:46.733 INFO:tasks.workunit.client.1.smithi195.stdout:1/938: unlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d64/d7a/fa5 0 2024-03-22T07:28:46.735 INFO:tasks.workunit.client.0.smithi134.stdout:6/601: creat d2/d1b/d1d/d5e/fde x:0 0 0 2024-03-22T07:28:46.736 INFO:tasks.workunit.client.0.smithi134.stdout:6/602: chown d2/d6e/l78 2840940 1 2024-03-22T07:28:46.736 INFO:tasks.workunit.client.0.smithi134.stdout:7/975: mkdir d1/de/d11/d2b/d31/d138 0 2024-03-22T07:28:46.737 INFO:tasks.workunit.client.0.smithi134.stdout:7/976: chown d1/da8/lee 77958 1 2024-03-22T07:28:46.738 INFO:tasks.workunit.client.0.smithi134.stdout:5/796: rmdir d1/d8/d16/d4a 39 2024-03-22T07:28:46.739 INFO:tasks.workunit.client.0.smithi134.stdout:6/603: truncate d2/d1b/f6c 4524669 0 2024-03-22T07:28:46.739 INFO:tasks.workunit.client.0.smithi134.stdout:6/604: readlink l1 0 2024-03-22T07:28:46.741 INFO:tasks.workunit.client.0.smithi134.stdout:5/797: dread d1/d8/d20/d62/d65/fb7 [0,4194304] 0 2024-03-22T07:28:46.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/798: write d1/d8/d16/d4a/f9f [340981,50867] 0 2024-03-22T07:28:46.743 INFO:tasks.workunit.client.0.smithi134.stdout:5/799: fdatasync d1/d8/d20/d62/f8e 0 2024-03-22T07:28:46.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/800: link d1/d8/d20/d8a/l79 d1/da0/l105 0 2024-03-22T07:28:46.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/801: chown d1/d8/fe1 194396 1 2024-03-22T07:28:46.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/802: write d1/f7f [900610,90903] 0 2024-03-22T07:28:46.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/803: fdatasync d1/d8/d83/fe6 0 2024-03-22T07:28:46.745 INFO:tasks.workunit.client.0.smithi134.stdout:2/749: dwrite d2/d5/d8/d5d/d5f/d75/fd7 [0,4194304] 0 2024-03-22T07:28:46.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/776: dwrite d5/d1d/dd0/ddc/d113/fde [0,4194304] 0 2024-03-22T07:28:46.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/777: read - d5/d1d/d2d/f104 zero size 2024-03-22T07:28:46.746 INFO:tasks.workunit.client.0.smithi134.stdout:5/804: rename d1/d8/d20/d62/d68/f7c to d1/d8/d83/f106 0 2024-03-22T07:28:46.748 INFO:tasks.workunit.client.1.smithi195.stdout:1/939: read d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/db3/fbf [2678142,110887] 0 2024-03-22T07:28:46.754 INFO:tasks.workunit.client.0.smithi134.stdout:1/778: rmdir d5/d1d/dd0/ddc/de3/d105 0 2024-03-22T07:28:46.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/779: truncate d5/d1d/d49/d92/fa5 128148 0 2024-03-22T07:28:46.755 INFO:tasks.workunit.client.0.smithi134.stdout:1/780: chown d5/da/d13/d1e/d34/f59 5 1 2024-03-22T07:28:46.757 INFO:tasks.workunit.client.0.smithi134.stdout:2/750: rename d2/d5/d8/d31/f5b to d2/d5/d22/d99/df0/d4f/ff5 0 2024-03-22T07:28:46.757 INFO:tasks.workunit.client.0.smithi134.stdout:2/751: chown d2/d5/fb6 5 1 2024-03-22T07:28:46.758 INFO:tasks.workunit.client.0.smithi134.stdout:2/752: mkdir d2/d5/d22/d99/df6 0 2024-03-22T07:28:46.760 INFO:tasks.workunit.client.0.smithi134.stdout:6/605: read d2/fb4 [4602684,46097] 0 2024-03-22T07:28:46.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/977: dwrite d1/d19/f23 [4194304,4194304] 0 2024-03-22T07:28:46.760 INFO:tasks.workunit.client.0.smithi134.stdout:7/978: creat d1/de/d11/d2b/d31/d85/d121/f139 x:0 0 0 2024-03-22T07:28:46.761 INFO:tasks.workunit.client.0.smithi134.stdout:2/753: getdents d2/d5/d22/d99/df0/d60 0 2024-03-22T07:28:46.761 INFO:tasks.workunit.client.0.smithi134.stdout:2/754: creat d2/d5/d8/d7e/ff7 x:0 0 0 2024-03-22T07:28:46.762 INFO:tasks.workunit.client.0.smithi134.stdout:7/979: mknod d1/de/d41/c13a 0 2024-03-22T07:28:46.763 INFO:tasks.workunit.client.1.smithi195.stdout:1/940: write d0/d2/d6/dad/ffc [1376661,118901] 0 2024-03-22T07:28:46.765 INFO:tasks.workunit.client.0.smithi134.stdout:2/755: creat d2/d5/d22/d99/df0/d4f/d6e/ff8 x:0 0 0 2024-03-22T07:28:46.765 INFO:tasks.workunit.client.0.smithi134.stdout:2/756: fsync d2/d5/d8/d5d/da1/f76 0 2024-03-22T07:28:46.767 INFO:tasks.workunit.client.0.smithi134.stdout:5/805: dwrite d1/f73 [4194304,4194304] 0 2024-03-22T07:28:46.767 INFO:tasks.workunit.client.0.smithi134.stdout:7/980: rename d1/de/d11/d48/daf/dbf/lcf to d1/de/d11/d2b/d69/l13b 0 2024-03-22T07:28:46.769 INFO:tasks.workunit.client.0.smithi134.stdout:2/757: creat d2/d5/d22/d99/df0/d4f/deb/ff9 x:0 0 0 2024-03-22T07:28:46.769 INFO:tasks.workunit.client.0.smithi134.stdout:2/758: chown d2/d5/d8/f88 2685 1 2024-03-22T07:28:46.775 INFO:tasks.workunit.client.0.smithi134.stdout:6/606: dread d2/d1b/d1d/d5e/f8d [0,4194304] 0 2024-03-22T07:28:46.775 INFO:tasks.workunit.client.0.smithi134.stdout:5/806: mkdir d1/d8/dc5/dd6/dfc/d107 0 2024-03-22T07:28:46.778 INFO:tasks.workunit.client.0.smithi134.stdout:7/981: symlink d1/d19/d32/l13c 0 2024-03-22T07:28:46.780 INFO:tasks.workunit.client.0.smithi134.stdout:2/759: mkdir d2/d5/d22/dfa 0 2024-03-22T07:28:46.780 INFO:tasks.workunit.client.0.smithi134.stdout:2/760: write d2/d5/d8/d5d/fac [708210,15331] 0 2024-03-22T07:28:46.782 INFO:tasks.workunit.client.0.smithi134.stdout:7/982: unlink d1/l68 0 2024-03-22T07:28:46.783 INFO:tasks.workunit.client.0.smithi134.stdout:7/983: mknod d1/d19/d9c/db3/dc4/df7/d11b/c13d 0 2024-03-22T07:28:46.783 INFO:tasks.workunit.client.0.smithi134.stdout:7/984: chown d1/de/d11/d2b/d31/f8a 1 1 2024-03-22T07:28:46.784 INFO:tasks.workunit.client.0.smithi134.stdout:7/985: chown d1/d19/d32/l4c 5 1 2024-03-22T07:28:46.784 INFO:tasks.workunit.client.0.smithi134.stdout:7/986: write d1/dae/fc7 [4476322,86242] 0 2024-03-22T07:28:46.788 INFO:tasks.workunit.client.0.smithi134.stdout:3/712: sync 2024-03-22T07:28:46.789 INFO:tasks.workunit.client.0.smithi134.stdout:3/713: stat d4/f66 0 2024-03-22T07:28:46.791 INFO:tasks.workunit.client.0.smithi134.stdout:3/714: creat d4/d8/d45/da9/fde x:0 0 0 2024-03-22T07:28:46.792 INFO:tasks.workunit.client.0.smithi134.stdout:3/715: write d4/d8/fa [8356273,82281] 0 2024-03-22T07:28:46.793 INFO:tasks.workunit.client.0.smithi134.stdout:1/781: dwrite d5/d1d/dd0/ddc/d113/fab [0,4194304] 0 2024-03-22T07:28:46.794 INFO:tasks.workunit.client.0.smithi134.stdout:3/716: mkdir d4/d8/d7f/d9c/db9/ddf 0 2024-03-22T07:28:46.796 INFO:tasks.workunit.client.0.smithi134.stdout:6/607: dwrite d2/f94 [0,4194304] 0 2024-03-22T07:28:46.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/941: dwrite d0/d2/d27/d91/dc8/da4/dc0/f133 [0,4194304] 0 2024-03-22T07:28:46.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/942: dread - d0/d2/ff3 zero size 2024-03-22T07:28:46.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/943: stat d0/d2/d27/d91/dc8/l18 0 2024-03-22T07:28:46.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/944: chown d0/d2/d27/d91/dc8/l22 0 1 2024-03-22T07:28:46.797 INFO:tasks.workunit.client.1.smithi195.stdout:1/945: chown d0/d2/d27/d91/dc8/d2a/f11a 717375 1 2024-03-22T07:28:46.804 INFO:tasks.workunit.client.0.smithi134.stdout:2/761: dwrite d2/d5/d8/d7e/dba/fcf [0,4194304] 0 2024-03-22T07:28:46.804 INFO:tasks.workunit.client.0.smithi134.stdout:2/762: chown d2/f3b 60411096 1 2024-03-22T07:28:46.804 INFO:tasks.workunit.client.0.smithi134.stdout:1/782: creat d5/d1d/dd0/ddc/d113/d39/da4/f11b x:0 0 0 2024-03-22T07:28:46.804 INFO:tasks.workunit.client.1.smithi195.stdout:1/946: dread d0/d2/d6/dad/df2/df8/d11f/d47/f8f [0,4194304] 0 2024-03-22T07:28:46.805 INFO:tasks.workunit.client.0.smithi134.stdout:3/717: symlink d4/d8/d69/d6a/le0 0 2024-03-22T07:28:46.807 INFO:tasks.workunit.client.1.smithi195.stdout:6/984: write d5/d5e/d34/d55/fb9 [470527,85839] 0 2024-03-22T07:28:46.807 INFO:tasks.workunit.client.1.smithi195.stdout:6/985: write d5/d16/f125 [4721611,63780] 0 2024-03-22T07:28:46.808 INFO:tasks.workunit.client.1.smithi195.stdout:1/947: mkdir d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d64/d7a/d137 0 2024-03-22T07:28:46.811 INFO:tasks.workunit.client.1.smithi195.stdout:6/986: rename d5/d16/d45/df8/d104/da2/c1c to d5/d5e/d34/d55/d3b/c161 0 2024-03-22T07:28:46.813 INFO:tasks.workunit.client.0.smithi134.stdout:6/608: creat d2/d1b/d1d/d5e/d6f/dd7/fdf x:0 0 0 2024-03-22T07:28:46.813 INFO:tasks.workunit.client.0.smithi134.stdout:7/987: dwrite d1/de/d11/d2b/d31/d85/d121/fbd [0,4194304] 0 2024-03-22T07:28:46.813 INFO:tasks.workunit.client.0.smithi134.stdout:7/988: stat d1/de/d11/d48/f1e 0 2024-03-22T07:28:46.816 INFO:tasks.workunit.client.1.smithi195.stdout:1/948: rename d0/d2/d27/d91/dc8/d2a/d6f/d12e/cfb to d0/d2/d6/dad/df2/c138 0 2024-03-22T07:28:46.819 INFO:tasks.workunit.client.1.smithi195.stdout:6/987: mkdir d5/d16/d5a/d162 0 2024-03-22T07:28:46.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/763: symlink d2/d5/d8/d5d/d5f/d75/lfb 0 2024-03-22T07:28:46.821 INFO:tasks.workunit.client.0.smithi134.stdout:2/764: readlink d2/d5/d22/d99/df0/d60/l64 0 2024-03-22T07:28:46.822 INFO:tasks.workunit.client.1.smithi195.stdout:1/949: truncate d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/d9c/fdf 2893301 0 2024-03-22T07:28:46.823 INFO:tasks.workunit.client.0.smithi134.stdout:6/609: dread d2/d3f/d28/fac [0,4194304] 0 2024-03-22T07:28:46.823 INFO:tasks.workunit.client.0.smithi134.stdout:6/610: read d2/fb4 [1869221,123237] 0 2024-03-22T07:28:46.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/783: link d5/da/d13/d1e/d45/l103 d5/d1d/d49/l11c 0 2024-03-22T07:28:46.824 INFO:tasks.workunit.client.0.smithi134.stdout:1/784: readlink d5/d1d/dd0/ddc/d113/d60/leb 0 2024-03-22T07:28:46.825 INFO:tasks.workunit.client.1.smithi195.stdout:6/988: mkdir d5/d16/d45/d53/d107/d12a/d163 0 2024-03-22T07:28:46.826 INFO:tasks.workunit.client.1.smithi195.stdout:6/989: write d5/d5e/d34/d55/d3b/d6e/d56/d8f/dba/dd5/f132 [968244,76330] 0 2024-03-22T07:28:46.826 INFO:tasks.workunit.client.1.smithi195.stdout:6/990: write d5/d16/d45/df8/d104/da2/dad/d13f/f15a [802704,78531] 0 2024-03-22T07:28:46.827 INFO:tasks.workunit.client.0.smithi134.stdout:3/718: truncate d4/d8/d23/f3a 3078585 0 2024-03-22T07:28:46.827 INFO:tasks.workunit.client.0.smithi134.stdout:3/719: read d4/f48 [1566185,43142] 0 2024-03-22T07:28:46.830 INFO:tasks.workunit.client.0.smithi134.stdout:2/765: mknod d2/d5/d8/d7e/dba/cfc 0 2024-03-22T07:28:46.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/991: dread d5/f6 [0,4194304] 0 2024-03-22T07:28:46.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/992: fsync d5/ffa 0 2024-03-22T07:28:46.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/993: chown d5/d5e/d34/d55/d3b/d6e/d3c/f7e 355448884 1 2024-03-22T07:28:46.831 INFO:tasks.workunit.client.1.smithi195.stdout:6/994: fdatasync d5/d5e/d34/d55/dab/dbf/fc7 0 2024-03-22T07:28:46.831 INFO:tasks.workunit.client.1.smithi195.stdout:1/950: mknod d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/dc9/dd0/dd7/c139 0 2024-03-22T07:28:46.833 INFO:tasks.workunit.client.0.smithi134.stdout:7/989: dwrite d1/de/d11/d2b/d31/d85/fc3 [4194304,4194304] 0 2024-03-22T07:28:46.833 INFO:tasks.workunit.client.0.smithi134.stdout:7/990: dread - d1/dae/f10f zero size 2024-03-22T07:28:46.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/611: creat d2/d1b/d4d/da5/fe0 x:0 0 0 2024-03-22T07:28:46.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/612: read - d2/d1b/d1d/d5e/d6f/fd1 zero size 2024-03-22T07:28:46.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/613: write d2/d6e/fc8 [383299,65572] 0 2024-03-22T07:28:46.834 INFO:tasks.workunit.client.0.smithi134.stdout:6/614: write d2/d3f/d28/fd5 [2795477,44270] 0 2024-03-22T07:28:46.837 INFO:tasks.workunit.client.0.smithi134.stdout:3/720: mknod d4/d22/d3c/ce1 0 2024-03-22T07:28:46.838 INFO:tasks.workunit.client.1.smithi195.stdout:1/951: symlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/db3/l13a 0 2024-03-22T07:28:46.843 INFO:tasks.workunit.client.1.smithi195.stdout:6/995: rmdir d5/d5e/d34/d55/d3b/d6e/d3c/d129 39 2024-03-22T07:28:46.843 INFO:tasks.workunit.client.1.smithi195.stdout:6/996: fdatasync d5/d16/d45/d53/f108 0 2024-03-22T07:28:46.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/952: rmdir d0/d2/d27/d91/dc8/d2a/d6f 39 2024-03-22T07:28:46.846 INFO:tasks.workunit.client.1.smithi195.stdout:1/953: write d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/f65 [664791,122274] 0 2024-03-22T07:28:46.847 INFO:tasks.workunit.client.0.smithi134.stdout:7/991: symlink d1/d19/d9c/db3/dc4/df7/d11b/l13e 0 2024-03-22T07:28:46.849 INFO:tasks.workunit.client.1.smithi195.stdout:6/997: mknod d5/d16/d45/df8/d104/da2/dad/d13f/c164 0 2024-03-22T07:28:46.852 INFO:tasks.workunit.client.1.smithi195.stdout:1/954: rename d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/l113 to d0/d2/d6/dad/l13b 0 2024-03-22T07:28:46.853 INFO:tasks.workunit.client.1.smithi195.stdout:6/998: stat d5/d5e/d34/d55/d3b/d6e/l78 0 2024-03-22T07:28:46.855 INFO:tasks.workunit.client.1.smithi195.stdout:1/955: symlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/l13c 0 2024-03-22T07:28:46.857 INFO:tasks.workunit.client.0.smithi134.stdout:3/721: dwrite d4/d8/fa6 [4194304,4194304] 0 2024-03-22T07:28:46.857 INFO:tasks.workunit.client.0.smithi134.stdout:3/722: stat d4/d22/d3c/d88/cd4 0 2024-03-22T07:28:46.858 INFO:tasks.workunit.client.1.smithi195.stdout:6/999: rename d5/d5e/d34/d55/d3b/dc2/f10c to d5/d16/dd8/f165 0 2024-03-22T07:28:46.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/766: rename d2/d5/d22/d99/df0 to d2/d5/d8/d5d/d5f/d75/dfd 0 2024-03-22T07:28:46.859 INFO:tasks.workunit.client.0.smithi134.stdout:2/767: chown d2/d5/d8/f2f 250878126 1 2024-03-22T07:28:46.859 INFO:tasks.workunit.client.0.smithi134.stdout:6/615: dwrite d2/d3f/fb8 [0,4194304] 0 2024-03-22T07:28:46.860 INFO:tasks.workunit.client.1.smithi195.stdout:1/956: mknod d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/c13d 0 2024-03-22T07:28:46.861 INFO:tasks.workunit.client.0.smithi134.stdout:3/723: symlink d4/le2 0 2024-03-22T07:28:46.862 INFO:tasks.workunit.client.0.smithi134.stdout:2/768: creat d2/d5/d8/d5d/d5f/ffe x:0 0 0 2024-03-22T07:28:46.863 INFO:tasks.workunit.client.0.smithi134.stdout:2/769: read - d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/ff1 zero size 2024-03-22T07:28:46.868 INFO:tasks.workunit.client.0.smithi134.stdout:6/616: unlink d2/d1b/d1d/d5e/d6f/dd7/lce 0 2024-03-22T07:28:46.872 INFO:tasks.workunit.client.0.smithi134.stdout:7/992: dwrite d1/de/d11/d48/d52/f7 [4194304,4194304] 0 2024-03-22T07:28:46.872 INFO:tasks.workunit.client.0.smithi134.stdout:2/770: dread d2/d5/d8/d5d/d5f/d75/dfd/d60/f91 [0,4194304] 0 2024-03-22T07:28:46.872 INFO:tasks.workunit.client.0.smithi134.stdout:2/771: read d2/f3b [490179,16532] 0 2024-03-22T07:28:46.873 INFO:tasks.workunit.client.0.smithi134.stdout:2/772: getdents d2/de5 0 2024-03-22T07:28:46.873 INFO:tasks.workunit.client.0.smithi134.stdout:2/773: truncate d2/d5/d8/fc3 44754 0 2024-03-22T07:28:46.874 INFO:tasks.workunit.client.0.smithi134.stdout:7/993: rename d1/c5b to d1/de/d11/d48/c13f 0 2024-03-22T07:28:46.874 INFO:tasks.workunit.client.0.smithi134.stdout:7/994: write d1/de/d11/d48/dbc/f11e [923023,83243] 0 2024-03-22T07:28:46.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/774: mknod d2/d5/d22/d99/df6/cff 0 2024-03-22T07:28:46.877 INFO:tasks.workunit.client.0.smithi134.stdout:2/775: creat d2/de5/f100 x:0 0 0 2024-03-22T07:28:46.878 INFO:tasks.workunit.client.0.smithi134.stdout:2/776: creat d2/d5/d22/f101 x:0 0 0 2024-03-22T07:28:46.880 INFO:tasks.workunit.client.0.smithi134.stdout:6/617: read d2/d1b/f2f [2086730,70768] 0 2024-03-22T07:28:46.880 INFO:tasks.workunit.client.0.smithi134.stdout:3/724: dwrite d4/d8/d7f/d9c/db9/fc4 [0,4194304] 0 2024-03-22T07:28:46.881 INFO:tasks.workunit.client.0.smithi134.stdout:2/777: creat d2/d5/d8/d5d/d5f/d75/dfd/f102 x:0 0 0 2024-03-22T07:28:46.881 INFO:tasks.workunit.client.0.smithi134.stdout:2/778: chown d2/d5/d8/d5d/d5f/d75/dfd/d60/d7c/l8a 27025213 1 2024-03-22T07:28:46.883 INFO:tasks.workunit.client.1.smithi195.stdout:1/957: dwrite d0/d2/d6/dad/df2/df8/d11f/d47/f49 [0,4194304] 0 2024-03-22T07:28:46.891 INFO:tasks.workunit.client.0.smithi134.stdout:7/995: dread d1/de/d11/d48/f6b [0,4194304] 0 2024-03-22T07:28:46.892 INFO:tasks.workunit.client.0.smithi134.stdout:7/996: write d1/d19/d9c/db3/dc4/de2/f120 [5305704,130784] 0 2024-03-22T07:28:46.896 INFO:tasks.workunit.client.0.smithi134.stdout:3/725: write d4/d8/d23/f70 [2649604,7723] 0 2024-03-22T07:28:46.901 INFO:tasks.workunit.client.0.smithi134.stdout:3/726: symlink d4/d8/d69/d6a/le3 0 2024-03-22T07:28:46.901 INFO:tasks.workunit.client.0.smithi134.stdout:7/997: write d1/de/d11/fd4 [632528,57077] 0 2024-03-22T07:28:46.902 INFO:tasks.workunit.client.0.smithi134.stdout:6/618: dwrite d2/d1b/d1d/d5e/d6f/da8/dca/fcf [0,4194304] 0 2024-03-22T07:28:46.904 INFO:tasks.workunit.client.0.smithi134.stdout:7/998: mkdir d1/d19/d9c/db3/dc4/df7/d140 0 2024-03-22T07:28:46.904 INFO:tasks.workunit.client.0.smithi134.stdout:7/999: stat d1/de/d11/d48/d52 0 2024-03-22T07:28:46.904 INFO:tasks.workunit.client.1.smithi195.stdout:1/958: dwrite d0/d2/d27/d91/dc8/da4/dc0/f102 [0,4194304] 0 2024-03-22T07:28:46.906 INFO:tasks.workunit.client.0.smithi134.stdout:6/619: creat d2/d1b/d1d/d5e/d6f/d7d/fe1 x:0 0 0 2024-03-22T07:28:46.915 INFO:tasks.workunit.client.0.smithi134.stdout:2/779: dwrite d2/d5/d8/f33 [0,4194304] 0 2024-03-22T07:28:46.915 INFO:tasks.workunit.client.0.smithi134.stdout:2/780: write d2/d5/d22/f2a [6032922,26260] 0 2024-03-22T07:28:46.922 INFO:tasks.workunit.client.1.smithi195.stdout:1/959: read d0/d2/d27/d91/dc8/d2a/f11a [180687,7938] 0 2024-03-22T07:28:46.923 INFO:tasks.workunit.client.1.smithi195.stdout:1/960: mknod d0/d2/d27/d91/dc8/c13e 0 2024-03-22T07:28:46.926 INFO:tasks.workunit.client.0.smithi134.stdout:6/620: dwrite d2/d1b/d4d/f74 [4194304,4194304] 0 2024-03-22T07:28:46.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/781: dread d2/f28 [4194304,4194304] 0 2024-03-22T07:28:46.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/782: write d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/fae [293640,21441] 0 2024-03-22T07:28:46.926 INFO:tasks.workunit.client.0.smithi134.stdout:2/783: truncate d2/d5/d8/d7e/ff7 35301 0 2024-03-22T07:28:46.927 INFO:tasks.workunit.client.1.smithi195.stdout:1/961: write d0/d2/d27/d91/dc8/f61 [3271305,125099] 0 2024-03-22T07:28:46.927 INFO:tasks.workunit.client.1.smithi195.stdout:1/962: write d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d64/d7a/f57 [468320,84014] 0 2024-03-22T07:28:46.929 INFO:tasks.workunit.client.1.smithi195.stdout:1/963: mkdir d0/d2/d13f 0 2024-03-22T07:28:46.936 INFO:tasks.workunit.client.0.smithi134.stdout:6/621: dread d2/d1b/d4d/f74 [4194304,4194304] 0 2024-03-22T07:28:46.936 INFO:tasks.workunit.client.0.smithi134.stdout:2/784: write d2/d5/d8/d5d/d5f/d75/fd7 [2274498,78076] 0 2024-03-22T07:28:46.938 INFO:tasks.workunit.client.0.smithi134.stdout:2/785: creat d2/d5/d22/dfa/f103 x:0 0 0 2024-03-22T07:28:46.938 INFO:tasks.workunit.client.0.smithi134.stdout:2/786: dread - d2/fa3 zero size 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:4/793: sync 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:8/940: sync 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:0/783: sync 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:9/664: sync 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:4/794: dread - d2/d15/fce zero size 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:4/795: dread - d2/d98/f113 zero size 2024-03-22T07:28:46.941 INFO:tasks.workunit.client.0.smithi134.stdout:8/941: write d1/d4/d61/fed [757193,11201] 0 2024-03-22T07:28:46.943 INFO:tasks.workunit.client.0.smithi134.stdout:0/784: link dc/f29 dc/de/d55/d60/ff4 0 2024-03-22T07:28:46.944 INFO:tasks.workunit.client.0.smithi134.stdout:0/785: creat dc/d18/d89/ff5 x:0 0 0 2024-03-22T07:28:46.944 INFO:tasks.workunit.client.0.smithi134.stdout:0/786: creat dc/d18/d85/ff6 x:0 0 0 2024-03-22T07:28:46.945 INFO:tasks.workunit.client.0.smithi134.stdout:9/665: truncate d3/d9/d37/d6f/d54/f68 3441202 0 2024-03-22T07:28:46.947 INFO:tasks.workunit.client.0.smithi134.stdout:4/796: symlink d2/d25/d48/l116 0 2024-03-22T07:28:46.949 INFO:tasks.workunit.client.0.smithi134.stdout:8/942: mknod d1/d15/c138 0 2024-03-22T07:28:46.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/666: rename d3/d9/d37/d5a/dc5/cd0 to d3/d9/d37/d5a/cdd 0 2024-03-22T07:28:46.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/667: stat d3/d9/d37/d5a/l5e 0 2024-03-22T07:28:46.952 INFO:tasks.workunit.client.0.smithi134.stdout:4/797: mknod d2/d25/d74/dde/dc0/de5/c117 0 2024-03-22T07:28:46.954 INFO:tasks.workunit.client.0.smithi134.stdout:8/943: unlink d1/le0 0 2024-03-22T07:28:46.954 INFO:tasks.workunit.client.0.smithi134.stdout:8/944: chown d1/d15/d42/d76/dda/df7 0 1 2024-03-22T07:28:46.954 INFO:tasks.workunit.client.0.smithi134.stdout:8/945: chown d1/d15/d7b/d83/de3/da2 54 1 2024-03-22T07:28:46.959 INFO:tasks.workunit.client.0.smithi134.stdout:0/787: write dc/de/d55/d65/f67 [5910534,52185] 0 2024-03-22T07:28:46.966 INFO:tasks.workunit.client.0.smithi134.stdout:4/798: dread d2/d25/dcf/fda [0,4194304] 0 2024-03-22T07:28:46.967 INFO:tasks.workunit.client.0.smithi134.stdout:8/946: write d1/d15/d42/f2b [6614895,50854] 0 2024-03-22T07:28:46.968 INFO:tasks.workunit.client.0.smithi134.stdout:8/947: creat d1/d15/d5b/f139 x:0 0 0 2024-03-22T07:28:46.968 INFO:tasks.workunit.client.0.smithi134.stdout:8/948: write d1/d15/d57/d79/f9f [4778289,44338] 0 2024-03-22T07:28:46.970 INFO:tasks.workunit.client.0.smithi134.stdout:6/622: dwrite d2/f35 [0,4194304] 0 2024-03-22T07:28:46.972 INFO:tasks.workunit.client.0.smithi134.stdout:6/623: creat d2/d1b/d4d/fe2 x:0 0 0 2024-03-22T07:28:46.972 INFO:tasks.workunit.client.0.smithi134.stdout:0/788: read dc/de/d55/d60/f7a [243048,9200] 0 2024-03-22T07:28:46.973 INFO:tasks.workunit.client.0.smithi134.stdout:0/789: creat dc/de/d55/d65/d82/db7/ff7 x:0 0 0 2024-03-22T07:28:46.973 INFO:tasks.workunit.client.0.smithi134.stdout:2/787: dwrite d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/ff1 [0,4194304] 0 2024-03-22T07:28:46.974 INFO:tasks.workunit.client.0.smithi134.stdout:6/624: dread d2/d1b/d1d/d5e/d6f/dd7/f9d [0,4194304] 0 2024-03-22T07:28:46.977 INFO:tasks.workunit.client.0.smithi134.stdout:0/790: chown dc/d18/f66 40220 1 2024-03-22T07:28:46.977 INFO:tasks.workunit.client.0.smithi134.stdout:0/791: chown dc/cdc 1574489 1 2024-03-22T07:28:46.977 INFO:tasks.workunit.client.0.smithi134.stdout:0/792: stat dc/de/d55/f8c 0 2024-03-22T07:28:46.980 INFO:tasks.workunit.client.0.smithi134.stdout:2/788: rmdir d2/d5/d22/dbc 39 2024-03-22T07:28:46.980 INFO:tasks.workunit.client.0.smithi134.stdout:2/789: chown d2/d5/f79 1753527 1 2024-03-22T07:28:46.981 INFO:tasks.workunit.client.0.smithi134.stdout:2/790: write d2/d5/d8/d5d/d5f/d75/dfd/d60/fa7 [523422,16190] 0 2024-03-22T07:28:46.983 INFO:tasks.workunit.client.0.smithi134.stdout:6/625: creat d2/d1b/d1d/d5e/d6f/fe3 x:0 0 0 2024-03-22T07:28:46.984 INFO:tasks.workunit.client.0.smithi134.stdout:4/799: dwrite d2/d25/fe9 [0,4194304] 0 2024-03-22T07:28:46.984 INFO:tasks.workunit.client.0.smithi134.stdout:4/800: truncate d2/d25/d48/d87/faf 742085 0 2024-03-22T07:28:46.984 INFO:tasks.workunit.client.0.smithi134.stdout:4/801: creat d2/d15/d35/da8/dec/def/d106/f118 x:0 0 0 2024-03-22T07:28:46.989 INFO:tasks.workunit.client.0.smithi134.stdout:2/791: mkdir d2/d5/d22/dbc/d104 0 2024-03-22T07:28:46.989 INFO:tasks.workunit.client.0.smithi134.stdout:2/792: chown d2/f3b 176 1 2024-03-22T07:28:46.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/626: symlink d2/d1b/d1d/d5e/d6f/da8/dca/le4 0 2024-03-22T07:28:46.991 INFO:tasks.workunit.client.0.smithi134.stdout:6/627: chown d2/d1b/daa 89959486 1 2024-03-22T07:28:46.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/802: dread d2/d2a/d50/f5c [0,4194304] 0 2024-03-22T07:28:46.995 INFO:tasks.workunit.client.0.smithi134.stdout:9/668: dwrite d3/d9/d37/d6f/f29 [0,4194304] 0 2024-03-22T07:28:46.995 INFO:tasks.workunit.client.0.smithi134.stdout:4/803: write d2/d25/d48/dd3/f89 [3647238,15766] 0 2024-03-22T07:28:46.995 INFO:tasks.workunit.client.0.smithi134.stdout:0/793: dread dc/d18/f1d [8388608,4194304] 0 2024-03-22T07:28:46.995 INFO:tasks.workunit.client.0.smithi134.stdout:0/794: chown dc/de/d55/d60 46 1 2024-03-22T07:28:46.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/795: rename dc/de/d55/d65/dc1/cce to dc/cf8 0 2024-03-22T07:28:46.999 INFO:tasks.workunit.client.0.smithi134.stdout:0/796: truncate dc/de/d55/d65/d82/db7/ff7 863429 0 2024-03-22T07:28:47.000 INFO:tasks.workunit.client.0.smithi134.stdout:4/804: dread d2/d25/dcf/fda [0,4194304] 0 2024-03-22T07:28:47.004 INFO:tasks.workunit.client.0.smithi134.stdout:9/669: write d3/d9/d37/d3c/d71/fa8 [2632328,61484] 0 2024-03-22T07:28:47.005 INFO:tasks.workunit.client.0.smithi134.stdout:4/805: mkdir d2/d15/d35/da8/dec/d119 0 2024-03-22T07:28:47.007 INFO:tasks.workunit.client.1.smithi195.stdout:1/964: sync 2024-03-22T07:28:47.007 INFO:tasks.workunit.client.1.smithi195.stdout:1/965: readlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/lfe 0 2024-03-22T07:28:47.008 INFO:tasks.workunit.client.1.smithi195.stdout:1/966: creat d0/d2/d6/dad/df2/f140 x:0 0 0 2024-03-22T07:28:47.011 INFO:tasks.workunit.client.1.smithi195.stdout:1/967: unlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/dc9/l114 0 2024-03-22T07:28:47.012 INFO:tasks.workunit.client.1.smithi195.stdout:1/968: write d0/d2/d27/d91/dc8/da4/dc0/fce [255040,117697] 0 2024-03-22T07:28:47.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/628: dread d2/d3f/d28/fac [0,4194304] 0 2024-03-22T07:28:47.012 INFO:tasks.workunit.client.0.smithi134.stdout:6/629: fdatasync d2/d1b/d4d/d65/fa0 0 2024-03-22T07:28:47.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/969: dread d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/fe0 [0,4194304] 0 2024-03-22T07:28:47.028 INFO:tasks.workunit.client.1.smithi195.stdout:1/970: chown d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d64/fc3 75775623 1 2024-03-22T07:28:47.033 INFO:tasks.workunit.client.0.smithi134.stdout:4/806: fsync d2/d25/d48/dd3/f89 0 2024-03-22T07:28:47.038 INFO:tasks.workunit.client.0.smithi134.stdout:6/630: dread d2/d1b/d1d/d5e/d6f/da8/fc2 [0,4194304] 0 2024-03-22T07:28:47.039 INFO:tasks.workunit.client.0.smithi134.stdout:6/631: rmdir d2/d3f/d28 39 2024-03-22T07:28:47.039 INFO:tasks.workunit.client.0.smithi134.stdout:6/632: write d2/fb4 [5224977,27801] 0 2024-03-22T07:28:47.043 INFO:tasks.workunit.client.0.smithi134.stdout:2/793: dwrite d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/fae [0,4194304] 0 2024-03-22T07:28:47.044 INFO:tasks.workunit.client.0.smithi134.stdout:2/794: creat d2/d5/d8/d7e/d83/f105 x:0 0 0 2024-03-22T07:28:47.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/670: dwrite d3/d9/d37/d5a/d7f/d80/f87 [0,4194304] 0 2024-03-22T07:28:47.045 INFO:tasks.workunit.client.0.smithi134.stdout:6/633: dread d2/d1b/d1d/d5e/d63/f64 [0,4194304] 0 2024-03-22T07:28:47.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/795: creat d2/d5/d8/d7e/dba/f106 x:0 0 0 2024-03-22T07:28:47.055 INFO:tasks.workunit.client.0.smithi134.stdout:9/671: rename d3/d9/d37/d3c/d71/dc2/fc9 to d3/d9/fde 0 2024-03-22T07:28:47.056 INFO:tasks.workunit.client.0.smithi134.stdout:9/672: creat d3/d9/d37/d70/fdf x:0 0 0 2024-03-22T07:28:47.059 INFO:tasks.workunit.client.1.smithi195.stdout:1/971: write d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/dc9/dd0/fa8 [1625383,130865] 0 2024-03-22T07:28:47.060 INFO:tasks.workunit.client.0.smithi134.stdout:2/796: mknod d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/c107 0 2024-03-22T07:28:47.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/972: symlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/l141 0 2024-03-22T07:28:47.062 INFO:tasks.workunit.client.1.smithi195.stdout:1/973: chown d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/dc9/dd0/la6 22 1 2024-03-22T07:28:47.063 INFO:tasks.workunit.client.1.smithi195.stdout:1/974: chown d0/d2/d6/dad/df2/df8/d11f/d47/d4a/d66/f6d 0 1 2024-03-22T07:28:47.064 INFO:tasks.workunit.client.1.smithi195.stdout:1/975: rename d0/d2/d6/dad/df2/df8/d11f/d47 to d0/d2/d6/d119/d142 0 2024-03-22T07:28:47.065 INFO:tasks.workunit.client.1.smithi195.stdout:1/976: creat d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/f143 x:0 0 0 2024-03-22T07:28:47.065 INFO:tasks.workunit.client.0.smithi134.stdout:9/673: dread d3/f14 [0,4194304] 0 2024-03-22T07:28:47.067 INFO:tasks.workunit.client.0.smithi134.stdout:9/674: creat d3/d9/d37/d6f/d54/fe0 x:0 0 0 2024-03-22T07:28:47.068 INFO:tasks.workunit.client.0.smithi134.stdout:6/634: dwrite d2/d3f/fb8 [0,4194304] 0 2024-03-22T07:28:47.068 INFO:tasks.workunit.client.0.smithi134.stdout:6/635: creat d2/d1b/d4d/da5/fe5 x:0 0 0 2024-03-22T07:28:47.068 INFO:tasks.workunit.client.0.smithi134.stdout:6/636: chown d2/d3f/d28/d97/fb5 748 1 2024-03-22T07:28:47.073 INFO:tasks.workunit.client.0.smithi134.stdout:6/637: creat d2/d1b/d1d/d5e/d84/fe6 x:0 0 0 2024-03-22T07:28:47.080 INFO:tasks.workunit.client.0.smithi134.stdout:9/675: truncate d3/d9/d37/d6f/f29 2938768 0 2024-03-22T07:28:47.083 INFO:tasks.workunit.client.0.smithi134.stdout:9/676: rename d3/d9/c2c to d3/d9/d37/d3c/d71/d8c/ce1 0 2024-03-22T07:28:47.113 INFO:tasks.workunit.client.1.smithi195.stdout:1/977: dwrite d0/d2/d6/f84 [0,4194304] 0 2024-03-22T07:28:47.113 INFO:tasks.workunit.client.0.smithi134.stdout:2/797: dwrite d2/f87 [0,4194304] 0 2024-03-22T07:28:47.115 INFO:tasks.workunit.client.0.smithi134.stdout:6/638: dwrite d2/d1b/fa3 [4194304,4194304] 0 2024-03-22T07:28:47.115 INFO:tasks.workunit.client.0.smithi134.stdout:9/677: dwrite d3/d9/df/d12/f58 [4194304,4194304] 0 2024-03-22T07:28:47.120 INFO:tasks.workunit.client.0.smithi134.stdout:2/798: truncate d2/d5/d22/f24 2559756 0 2024-03-22T07:28:47.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/978: creat d0/d2/d6/d119/f144 x:0 0 0 2024-03-22T07:28:47.121 INFO:tasks.workunit.client.1.smithi195.stdout:1/979: chown d0/d2/d27/d91/dc8/da4/dc0/fc1 3220948 1 2024-03-22T07:28:47.122 INFO:tasks.workunit.client.0.smithi134.stdout:6/639: mkdir d2/d1b/d1d/d5e/d6f/de7 0 2024-03-22T07:28:47.126 INFO:tasks.workunit.client.0.smithi134.stdout:6/640: dread d2/d1b/d1d/d5e/d6f/d7d/f50 [0,4194304] 0 2024-03-22T07:28:47.128 INFO:tasks.workunit.client.0.smithi134.stdout:6/641: mknod d2/d1b/d8f/ce8 0 2024-03-22T07:28:47.130 INFO:tasks.workunit.client.0.smithi134.stdout:6/642: unlink d2/d1b/d1d/d5e/d6f/dd7/fdf 0 2024-03-22T07:28:47.130 INFO:tasks.workunit.client.0.smithi134.stdout:6/643: stat d2/d1b/d1d/d5e/d63/l9a 0 2024-03-22T07:28:47.132 INFO:tasks.workunit.client.0.smithi134.stdout:6/644: mknod d2/d1b/ce9 0 2024-03-22T07:28:47.174 INFO:tasks.workunit.client.0.smithi134.stdout:9/678: dwrite d3/d9/df/d12/f2f [0,4194304] 0 2024-03-22T07:28:47.174 INFO:tasks.workunit.client.0.smithi134.stdout:9/679: dread d3/d9/df/d57/fa9 [0,4194304] 0 2024-03-22T07:28:47.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/680: creat d3/d9/d37/d3c/d71/fe2 x:0 0 0 2024-03-22T07:28:47.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/681: read d3/d9/d37/d3c/d71/d7a/f9c [933186,106923] 0 2024-03-22T07:28:47.177 INFO:tasks.workunit.client.0.smithi134.stdout:9/682: rename d3/d9/df/d12/f1d to d3/d9/d37/d6f/fe3 0 2024-03-22T07:28:47.180 INFO:tasks.workunit.client.0.smithi134.stdout:2/799: dwrite d2/d5/d54/f63 [4194304,4194304] 0 2024-03-22T07:28:47.180 INFO:tasks.workunit.client.0.smithi134.stdout:2/800: dread - d2/d5/d8/d7e/dba/f106 zero size 2024-03-22T07:28:47.180 INFO:tasks.workunit.client.0.smithi134.stdout:2/801: chown d2/d5/l4a 55504 1 2024-03-22T07:28:47.181 INFO:tasks.workunit.client.1.smithi195.stdout:1/980: dwrite d0/d2/d27/d91/dc8/f15 [0,4194304] 0 2024-03-22T07:28:47.182 INFO:tasks.workunit.client.0.smithi134.stdout:6/645: dwrite d2/d1b/d4d/da5/fe5 [0,4194304] 0 2024-03-22T07:28:47.183 INFO:tasks.workunit.client.0.smithi134.stdout:2/802: unlink d2/d5/d8/c6b 0 2024-03-22T07:28:47.183 INFO:tasks.workunit.client.0.smithi134.stdout:2/803: fsync d2/d5/d8/d5d/d5f/d75/dfd/d60/f72 0 2024-03-22T07:28:47.183 INFO:tasks.workunit.client.0.smithi134.stdout:2/804: stat d2/d5/d8/d7e/dba/fcf 0 2024-03-22T07:28:47.185 INFO:tasks.workunit.client.0.smithi134.stdout:9/683: write d3/d9/df/d12/f16 [5280059,122127] 0 2024-03-22T07:28:47.193 INFO:tasks.workunit.client.1.smithi195.stdout:1/981: rename d0/d2/d6/d119 to d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/d145 0 2024-03-22T07:28:47.195 INFO:tasks.workunit.client.0.smithi134.stdout:6/646: mknod d2/d1b/daa/dc1/cea 0 2024-03-22T07:28:47.197 INFO:tasks.workunit.client.1.smithi195.stdout:1/982: mkdir d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/d146 0 2024-03-22T07:28:47.197 INFO:tasks.workunit.client.1.smithi195.stdout:1/983: dread - d0/d2/d27/d91/f12b zero size 2024-03-22T07:28:47.197 INFO:tasks.workunit.client.0.smithi134.stdout:9/684: truncate d3/fa3 91152 0 2024-03-22T07:28:47.198 INFO:tasks.workunit.client.0.smithi134.stdout:9/685: fsync d3/d9/df/d57/fa9 0 2024-03-22T07:28:47.199 INFO:tasks.workunit.client.0.smithi134.stdout:6/647: link d2/d1b/c2d d2/ceb 0 2024-03-22T07:28:47.199 INFO:tasks.workunit.client.0.smithi134.stdout:6/648: fsync d2/d1b/d1d/d5e/d63/fa2 0 2024-03-22T07:28:47.200 INFO:tasks.workunit.client.0.smithi134.stdout:9/686: getdents d3/d9/df/d57 0 2024-03-22T07:28:47.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/649: rename d2/d3f to d2/d1b/d4d/da5/dec 0 2024-03-22T07:28:47.204 INFO:tasks.workunit.client.0.smithi134.stdout:6/650: write d2/f35 [4642739,113812] 0 2024-03-22T07:28:47.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:46 smithi195 ceph-mon[36144]: pgmap v9: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 244 MiB/s rd, 292 MiB/s wr, 434 op/s 2024-03-22T07:28:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:46 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:46 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:47.213 INFO:tasks.workunit.client.1.smithi195.stdout:1/984: dread d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d64/fc3 [0,4194304] 0 2024-03-22T07:28:47.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/651: dread d2/d1b/fa3 [0,4194304] 0 2024-03-22T07:28:47.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/652: chown d2/f94 1239964640 1 2024-03-22T07:28:47.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/653: write d2/d1b/d1d/d5e/d6f/dd7/f5b [3819626,93928] 0 2024-03-22T07:28:47.214 INFO:tasks.workunit.client.1.smithi195.stdout:1/985: rename d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/d9c/fdf to d0/d2/d27/d91/dc8/d2a/d6f/d12e/d6b/f147 0 2024-03-22T07:28:47.214 INFO:tasks.workunit.client.1.smithi195.stdout:1/986: write d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d64/d7a/f9b [1424861,20324] 0 2024-03-22T07:28:47.215 INFO:tasks.workunit.client.0.smithi134.stdout:1/785: sync 2024-03-22T07:28:47.215 INFO:tasks.workunit.client.0.smithi134.stdout:5/807: sync 2024-03-22T07:28:47.215 INFO:tasks.workunit.client.0.smithi134.stdout:1/786: chown d5/d1d/d49/f70 234876 1 2024-03-22T07:28:47.215 INFO:tasks.workunit.client.0.smithi134.stdout:1/787: creat d5/d1d/dd0/ddc/de3/df6/f11d x:0 0 0 2024-03-22T07:28:47.216 INFO:tasks.workunit.client.1.smithi195.stdout:1/987: unlink d0/d2/d27/d91/dc8/c3a 0 2024-03-22T07:28:47.218 INFO:tasks.workunit.client.1.smithi195.stdout:1/988: symlink d0/d2/d27/d91/dc8/d2a/l148 0 2024-03-22T07:28:47.218 INFO:tasks.workunit.client.1.smithi195.stdout:1/989: stat d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/fcf 0 2024-03-22T07:28:47.218 INFO:tasks.workunit.client.1.smithi195.stdout:1/990: truncate d0/d2/d27/d91/dc8/da4/dc0/dfa/f105 433469 0 2024-03-22T07:28:47.219 INFO:tasks.workunit.client.0.smithi134.stdout:1/788: mknod d5/da/d13/c11e 0 2024-03-22T07:28:47.219 INFO:tasks.workunit.client.0.smithi134.stdout:1/789: chown d5/f4d 642534619 1 2024-03-22T07:28:47.219 INFO:tasks.workunit.client.0.smithi134.stdout:1/790: write d5/d1d/fa9 [478245,105377] 0 2024-03-22T07:28:47.219 INFO:tasks.workunit.client.0.smithi134.stdout:1/791: creat d5/da/d61/f11f x:0 0 0 2024-03-22T07:28:47.219 INFO:tasks.workunit.client.0.smithi134.stdout:1/792: chown d5/da/d13/d1e/d34/db5/cb7 183 1 2024-03-22T07:28:47.220 INFO:tasks.workunit.client.0.smithi134.stdout:1/793: write d5/da/d13/d1e/d62/fcc [123499,58103] 0 2024-03-22T07:28:47.220 INFO:tasks.workunit.client.0.smithi134.stdout:6/654: dread d2/f69 [0,4194304] 0 2024-03-22T07:28:47.220 INFO:tasks.workunit.client.0.smithi134.stdout:5/808: getdents d1/d8/d20/d8a/d75 0 2024-03-22T07:28:47.220 INFO:tasks.workunit.client.1.smithi195.stdout:1/991: creat d0/d2/d27/d91/dc8/d2a/d6f/d12e/d12f/f149 x:0 0 0 2024-03-22T07:28:47.220 INFO:tasks.workunit.client.1.smithi195.stdout:1/992: write d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/dc9/f107 [799456,123978] 0 2024-03-22T07:28:47.221 INFO:tasks.workunit.client.0.smithi134.stdout:1/794: symlink d5/d1d/dd0/ddc/l120 0 2024-03-22T07:28:47.222 INFO:tasks.workunit.client.1.smithi195.stdout:1/993: rmdir d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97 39 2024-03-22T07:28:47.223 INFO:tasks.workunit.client.0.smithi134.stdout:6/655: truncate d2/d1b/f29 2940210 0 2024-03-22T07:28:47.223 INFO:tasks.workunit.client.0.smithi134.stdout:6/656: read d2/d1b/f6c [3191942,80806] 0 2024-03-22T07:28:47.223 INFO:tasks.workunit.client.0.smithi134.stdout:6/657: stat d2/c1e 0 2024-03-22T07:28:47.223 INFO:tasks.workunit.client.0.smithi134.stdout:6/658: stat d2/d1b/d1d 0 2024-03-22T07:28:47.224 INFO:tasks.workunit.client.0.smithi134.stdout:9/687: dwrite d3/d9/d37/d5a/d7f/d80/fab [0,4194304] 0 2024-03-22T07:28:47.225 INFO:tasks.workunit.client.0.smithi134.stdout:5/809: rename d1/d8/d20/d8a/d75/f76 to d1/d8/d16/dbd/f108 0 2024-03-22T07:28:47.226 INFO:tasks.workunit.client.0.smithi134.stdout:1/795: mknod d5/da/d1b/c121 0 2024-03-22T07:28:47.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/659: symlink d2/d1b/d4d/da5/dec/d28/db0/led 0 2024-03-22T07:28:47.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/660: creat d2/d6e/fee x:0 0 0 2024-03-22T07:28:47.233 INFO:tasks.workunit.client.0.smithi134.stdout:9/688: mknod d3/d9/d37/d6f/d54/d9d/dc0/ce4 0 2024-03-22T07:28:47.234 INFO:tasks.workunit.client.0.smithi134.stdout:5/810: creat d1/d8/dc5/dd6/dfc/f109 x:0 0 0 2024-03-22T07:28:47.236 INFO:tasks.workunit.client.0.smithi134.stdout:1/796: link d5/d1d/l5b d5/da/d13/d1e/d62/dda/l122 0 2024-03-22T07:28:47.240 INFO:tasks.workunit.client.0.smithi134.stdout:6/661: symlink d2/d1b/d1d/d5e/d6f/dd7/lef 0 2024-03-22T07:28:47.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/662: fdatasync d2/d6e/fc8 0 2024-03-22T07:28:47.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/663: write d2/d1b/d4d/da5/dec/d28/d97/fb5 [687004,90888] 0 2024-03-22T07:28:47.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/664: truncate d2/d1b/d4d/da5/fe0 565088 0 2024-03-22T07:28:47.246 INFO:tasks.workunit.client.0.smithi134.stdout:9/689: creat d3/d9/df/d57/d67/fe5 x:0 0 0 2024-03-22T07:28:47.250 INFO:tasks.workunit.client.0.smithi134.stdout:1/797: stat d5/da/dce/cfe 0 2024-03-22T07:28:47.250 INFO:tasks.workunit.client.0.smithi134.stdout:5/811: dread d1/d8/f42 [0,4194304] 0 2024-03-22T07:28:47.250 INFO:tasks.workunit.client.0.smithi134.stdout:6/665: dread d2/d1b/d1d/d5e/f70 [0,4194304] 0 2024-03-22T07:28:47.250 INFO:tasks.workunit.client.0.smithi134.stdout:5/812: symlink d1/d8/d20/d8a/l10a 0 2024-03-22T07:28:47.250 INFO:tasks.workunit.client.0.smithi134.stdout:5/813: write d1/da0/f104 [4460945,107129] 0 2024-03-22T07:28:47.251 INFO:tasks.workunit.client.0.smithi134.stdout:5/814: chown d1/d8/d16/l35 53450540 1 2024-03-22T07:28:47.251 INFO:tasks.workunit.client.0.smithi134.stdout:6/666: creat d2/d1b/d4d/da5/dec/d28/d97/ff0 x:0 0 0 2024-03-22T07:28:47.253 INFO:tasks.workunit.client.0.smithi134.stdout:5/815: rename d1/d8/d20/d8a/d75/fd1 to d1/d8/da1/f10b 0 2024-03-22T07:28:47.255 INFO:tasks.workunit.client.0.smithi134.stdout:6/667: read d2/d1b/d1d/d5e/d6f/da8/fc2 [2478601,70577] 0 2024-03-22T07:28:47.255 INFO:tasks.workunit.client.0.smithi134.stdout:6/668: dread - d2/d1b/d1d/d5e/d63/f9b zero size 2024-03-22T07:28:47.256 INFO:tasks.workunit.client.0.smithi134.stdout:5/816: creat d1/f10c x:0 0 0 2024-03-22T07:28:47.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/669: mknod d2/d1b/d4d/da5/dec/d28/d97/cf1 0 2024-03-22T07:28:47.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/670: dread - d2/d1b/d4d/fc7 zero size 2024-03-22T07:28:47.258 INFO:tasks.workunit.client.0.smithi134.stdout:5/817: symlink d1/d8/d16/dbd/l10d 0 2024-03-22T07:28:47.259 INFO:tasks.workunit.client.0.smithi134.stdout:5/818: readlink d1/d8/dc5/da2/lec 0 2024-03-22T07:28:47.260 INFO:tasks.workunit.client.0.smithi134.stdout:6/671: rename d2/d1b/d4d/da5/dec/d28/d97/cbc to d2/d1b/d1d/d5e/d6f/da8/dc6/cf2 0 2024-03-22T07:28:47.260 INFO:tasks.workunit.client.0.smithi134.stdout:9/690: read d3/d9/df/f49 [1210926,79223] 0 2024-03-22T07:28:47.261 INFO:tasks.workunit.client.0.smithi134.stdout:6/672: dread d2/f69 [0,4194304] 0 2024-03-22T07:28:47.263 INFO:tasks.workunit.client.0.smithi134.stdout:9/691: creat d3/d9/d37/d6f/fe6 x:0 0 0 2024-03-22T07:28:47.263 INFO:tasks.workunit.client.0.smithi134.stdout:9/692: dread - d3/d9/d37/d6f/d54/d9d/dc0/f6e zero size 2024-03-22T07:28:47.263 INFO:tasks.workunit.client.0.smithi134.stdout:9/693: dread - d3/d9/fde zero size 2024-03-22T07:28:47.264 INFO:tasks.workunit.client.0.smithi134.stdout:5/819: link d1/d8/dc5/da2/lec d1/d8/d20/d62/d65/l10e 0 2024-03-22T07:28:47.266 INFO:tasks.workunit.client.0.smithi134.stdout:6/673: symlink d2/d1b/d4d/da5/dec/d28/db0/lf3 0 2024-03-22T07:28:47.266 INFO:tasks.workunit.client.0.smithi134.stdout:6/674: write d2/d1b/d4d/da5/dec/d28/f20 [1454501,28279] 0 2024-03-22T07:28:47.267 INFO:tasks.workunit.client.0.smithi134.stdout:6/675: readlink d2/d1b/d4d/da5/dec/l49 0 2024-03-22T07:28:47.267 INFO:tasks.workunit.client.0.smithi134.stdout:6/676: write d2/d6e/fee [104863,39517] 0 2024-03-22T07:28:47.267 INFO:tasks.workunit.client.0.smithi134.stdout:9/694: mkdir d3/d9/df/d12/dd7/de7 0 2024-03-22T07:28:47.270 INFO:tasks.workunit.client.0.smithi134.stdout:6/677: creat d2/d1b/d1d/d5e/d6f/d7d/dd8/ff4 x:0 0 0 2024-03-22T07:28:47.275 INFO:tasks.workunit.client.0.smithi134.stdout:1/798: dwrite d5/d1d/dd0/ddc/d113/d39/da4/fb8 [0,4194304] 0 2024-03-22T07:28:47.279 INFO:tasks.workunit.client.0.smithi134.stdout:1/799: dread d5/da/d1b/f30 [0,4194304] 0 2024-03-22T07:28:47.279 INFO:tasks.workunit.client.0.smithi134.stdout:1/800: chown d5/d1d/d49/f5c 0 1 2024-03-22T07:28:47.281 INFO:tasks.workunit.client.0.smithi134.stdout:9/695: write d3/d9/df/f7d [3074871,34557] 0 2024-03-22T07:28:47.287 INFO:tasks.workunit.client.0.smithi134.stdout:6/678: getdents d2/d1b/d4d/da5/dec/d28/d97 0 2024-03-22T07:28:47.287 INFO:tasks.workunit.client.0.smithi134.stdout:6/679: creat d2/d1b/daa/ff5 x:0 0 0 2024-03-22T07:28:47.290 INFO:tasks.workunit.client.0.smithi134.stdout:6/680: rmdir d2/d1b/d1d/d5e/d6f/da8/dca 39 2024-03-22T07:28:47.291 INFO:tasks.workunit.client.0.smithi134.stdout:6/681: dread - d2/d1b/d4d/fe2 zero size 2024-03-22T07:28:47.291 INFO:tasks.workunit.client.0.smithi134.stdout:6/682: readlink d2/le 0 2024-03-22T07:28:47.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/820: rmdir d1/d8 39 2024-03-22T07:28:47.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/821: readlink d1/d8/dc5/da2/lb1 0 2024-03-22T07:28:47.293 INFO:tasks.workunit.client.0.smithi134.stdout:6/683: creat d2/d1b/d4d/da5/dec/d28/d97/ff6 x:0 0 0 2024-03-22T07:28:47.293 INFO:tasks.workunit.client.0.smithi134.stdout:6/684: creat d2/d6e/ff7 x:0 0 0 2024-03-22T07:28:47.294 INFO:tasks.workunit.client.0.smithi134.stdout:5/822: write d1/d8/d20/d62/f69 [441970,123824] 0 2024-03-22T07:28:47.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:46 smithi134 ceph-mon[29057]: pgmap v9: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 244 MiB/s rd, 292 MiB/s wr, 434 op/s 2024-03-22T07:28:47.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:46 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:47.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:46 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:47.301 INFO:tasks.workunit.client.0.smithi134.stdout:6/685: dread d2/f17 [0,4194304] 0 2024-03-22T07:28:47.306 INFO:tasks.workunit.client.0.smithi134.stdout:5/823: dread d1/d8/d16/f40 [0,4194304] 0 2024-03-22T07:28:47.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/824: fdatasync d1/f7f 0 2024-03-22T07:28:47.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/825: mknod d1/d8/d20/d62/d68/c10f 0 2024-03-22T07:28:47.307 INFO:tasks.workunit.client.0.smithi134.stdout:5/826: readlink d1/d8/d20/d62/d65/l48 0 2024-03-22T07:28:47.308 INFO:tasks.workunit.client.0.smithi134.stdout:5/827: mkdir d1/d8/d20/d8a/d110 0 2024-03-22T07:28:47.308 INFO:tasks.workunit.client.0.smithi134.stdout:5/828: write d1/d8/d20/d62/d65/dac/fdd [474701,70352] 0 2024-03-22T07:28:47.309 INFO:tasks.workunit.client.1.smithi195.stdout:1/994: sync 2024-03-22T07:28:47.309 INFO:tasks.workunit.client.0.smithi134.stdout:5/829: symlink d1/d8/d16/dbd/dc0/dfb/l111 0 2024-03-22T07:28:47.310 INFO:tasks.workunit.client.1.smithi195.stdout:1/995: symlink d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/d39/d40/d145/d142/d4a/d66/l14a 0 2024-03-22T07:28:47.311 INFO:tasks.workunit.client.1.smithi195.stdout:1/996: write d0/d2/d27/d91/dc8/dba/fd2 [29163,33258] 0 2024-03-22T07:28:47.312 INFO:tasks.workunit.client.0.smithi134.stdout:1/801: dwrite d5/f9 [4194304,4194304] 0 2024-03-22T07:28:47.312 INFO:tasks.workunit.client.0.smithi134.stdout:1/802: write d5/da/fb0 [406864,130783] 0 2024-03-22T07:28:47.312 INFO:tasks.workunit.client.0.smithi134.stdout:9/696: dwrite d3/d9/d37/d5a/d7f/f98 [0,4194304] 0 2024-03-22T07:28:47.312 INFO:tasks.workunit.client.0.smithi134.stdout:9/697: write d3/d9/df/d57/d67/d5f/f9a [296689,25059] 0 2024-03-22T07:28:47.312 INFO:tasks.workunit.client.0.smithi134.stdout:5/830: mkdir d1/d8/dc5/dd6/d112 0 2024-03-22T07:28:47.312 INFO:tasks.workunit.client.0.smithi134.stdout:5/831: fsync d1/d8/dc5/fbc 0 2024-03-22T07:28:47.313 INFO:tasks.workunit.client.1.smithi195.stdout:1/997: rmdir d0/d2/d27/d91/dc8/d2a/d6f/d12e/d97/dab 39 2024-03-22T07:28:47.313 INFO:tasks.workunit.client.1.smithi195.stdout:1/998: dread - d0/d2/d27/d91/dc8/d2a/d6f/d12e/d12f/f149 zero size 2024-03-22T07:28:47.316 INFO:tasks.workunit.client.0.smithi134.stdout:5/832: dread d1/d8/d83/f8f [0,4194304] 0 2024-03-22T07:28:47.316 INFO:tasks.workunit.client.0.smithi134.stdout:5/833: write d1/d8/d20/fae [515709,15048] 0 2024-03-22T07:28:47.323 INFO:tasks.workunit.client.0.smithi134.stdout:1/803: rename d5/da/d13/d1e/d62/fcc to d5/d1d/dd0/ddc/d113/dae/f123 0 2024-03-22T07:28:47.324 INFO:tasks.workunit.client.0.smithi134.stdout:9/698: creat d3/d9/df/d57/d67/d5f/fe8 x:0 0 0 2024-03-22T07:28:47.324 INFO:tasks.workunit.client.0.smithi134.stdout:9/699: readlink d3/d9/df/d12/l4b 0 2024-03-22T07:28:47.325 INFO:tasks.workunit.client.0.smithi134.stdout:9/700: creat d3/d9/d37/d5a/fe9 x:0 0 0 2024-03-22T07:28:47.325 INFO:tasks.workunit.client.1.smithi195.stdout:1/999: dread d0/d2/d6/dad/ffc [0,4194304] 0 2024-03-22T07:28:47.326 INFO:tasks.workunit.client.0.smithi134.stdout:6/686: dwrite d2/f1c [4194304,4194304] 0 2024-03-22T07:28:47.327 INFO:tasks.workunit.client.0.smithi134.stdout:5/834: mknod d1/d8/dc5/dd6/c113 0 2024-03-22T07:28:47.328 INFO:tasks.workunit.client.0.smithi134.stdout:5/835: write d1/d8/d20/d62/d65/dac/fbe [721504,102610] 0 2024-03-22T07:28:47.329 INFO:tasks.workunit.client.0.smithi134.stdout:1/804: rename d5/d1d/dd0/ddc/de3/df6/f11d to d5/d1d/dd0/ddc/d113/d60/f124 0 2024-03-22T07:28:47.333 INFO:tasks.workunit.client.1.smithi195.stderr:+ rm -rf -- ./tmp.cvOFfrMmgg 2024-03-22T07:28:47.335 INFO:tasks.workunit.client.0.smithi134.stdout:6/687: creat d2/d1b/d1d/ff8 x:0 0 0 2024-03-22T07:28:47.336 INFO:tasks.workunit.client.0.smithi134.stdout:5/836: creat d1/d8/dc5/f114 x:0 0 0 2024-03-22T07:28:47.339 INFO:tasks.workunit.client.0.smithi134.stdout:1/805: unlink d5/da/d13/d1e/d63/d9d/cd7 0 2024-03-22T07:28:47.343 INFO:tasks.workunit.client.0.smithi134.stdout:5/837: unlink d1/f7f 0 2024-03-22T07:28:47.343 INFO:tasks.workunit.client.0.smithi134.stdout:3/727: sync 2024-03-22T07:28:47.343 INFO:tasks.workunit.client.0.smithi134.stdout:8/949: sync 2024-03-22T07:28:47.344 INFO:tasks.workunit.client.0.smithi134.stdout:3/728: dread d4/f94 [0,4194304] 0 2024-03-22T07:28:47.345 INFO:tasks.workunit.client.0.smithi134.stdout:9/701: dwrite d3/d9/df/d12/f16 [4194304,4194304] 0 2024-03-22T07:28:47.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/838: creat d1/d8/d20/d62/d65/dac/dad/f115 x:0 0 0 2024-03-22T07:28:47.347 INFO:tasks.workunit.client.0.smithi134.stdout:5/839: fsync d1/d8/d16/dbd/fe5 0 2024-03-22T07:28:47.348 INFO:tasks.workunit.client.0.smithi134.stdout:3/729: creat d4/fe4 x:0 0 0 2024-03-22T07:28:47.352 INFO:tasks.workunit.client.0.smithi134.stdout:9/702: rename d3/d9/d37/d6f/d54/d9d/dc0/ld3 to d3/d9/df/db3/lea 0 2024-03-22T07:28:47.353 INFO:tasks.workunit.client.0.smithi134.stdout:5/840: link d1/d8/d20/d62/f92 d1/d8/d20/d8a/f116 0 2024-03-22T07:28:47.353 INFO:tasks.workunit.client.0.smithi134.stdout:6/688: dwrite d2/d1b/d1d/d5e/d63/fa2 [4194304,4194304] 0 2024-03-22T07:28:47.354 INFO:tasks.workunit.client.0.smithi134.stdout:8/950: dread d1/f77 [0,4194304] 0 2024-03-22T07:28:47.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/730: unlink d4/d10/c71 0 2024-03-22T07:28:47.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/731: truncate d4/d22/d29/f5e 5158049 0 2024-03-22T07:28:47.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/732: creat d4/d8/d45/da9/fe5 x:0 0 0 2024-03-22T07:28:47.355 INFO:tasks.workunit.client.0.smithi134.stdout:3/733: chown d4/d10/d4b/fb7 28407 1 2024-03-22T07:28:47.357 INFO:tasks.workunit.client.0.smithi134.stdout:9/703: creat d3/d9/d37/d5a/d7f/daf/feb x:0 0 0 2024-03-22T07:28:47.357 INFO:tasks.workunit.client.0.smithi134.stdout:6/689: symlink d2/d1b/d4d/da5/dec/d28/db0/lf9 0 2024-03-22T07:28:47.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/841: dread d1/d8/d20/d62/d68/fca [0,4194304] 0 2024-03-22T07:28:47.359 INFO:tasks.workunit.client.0.smithi134.stdout:1/806: dwrite d5/d1d/dd0/ff0 [0,4194304] 0 2024-03-22T07:28:47.359 INFO:tasks.workunit.client.0.smithi134.stdout:1/807: fsync d5/da/d13/f6c 0 2024-03-22T07:28:47.363 INFO:tasks.workunit.client.0.smithi134.stdout:5/842: symlink d1/d8/d20/d62/d68/d9c/l117 0 2024-03-22T07:28:47.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/808: mkdir d5/da/d13/d1e/d63/d9d/d125 0 2024-03-22T07:28:47.370 INFO:tasks.workunit.client.0.smithi134.stdout:8/951: rmdir d1/d15/d7b/d83/de3 39 2024-03-22T07:28:47.370 INFO:tasks.workunit.client.0.smithi134.stdout:8/952: stat d1/d46/d75/l123 0 2024-03-22T07:28:47.371 INFO:tasks.workunit.client.0.smithi134.stdout:1/809: mknod d5/da/d13/d1e/d34/c126 0 2024-03-22T07:28:47.372 INFO:tasks.workunit.client.0.smithi134.stdout:9/704: dread d3/d9/d37/d6f/d54/d9d/dc0/fa2 [0,4194304] 0 2024-03-22T07:28:47.373 INFO:tasks.workunit.client.0.smithi134.stdout:1/810: creat d5/d1d/dd0/ddc/d113/d60/d72/f127 x:0 0 0 2024-03-22T07:28:47.373 INFO:tasks.workunit.client.0.smithi134.stdout:1/811: write d5/da/d13/d1e/d45/ff1 [314657,44625] 0 2024-03-22T07:28:47.373 INFO:tasks.workunit.client.0.smithi134.stdout:1/812: write d5/da/d61/f83 [191883,112728] 0 2024-03-22T07:28:47.376 INFO:tasks.workunit.client.0.smithi134.stdout:9/705: getdents d3/d9/d37/d5a/d7f 0 2024-03-22T07:28:47.376 INFO:tasks.workunit.client.0.smithi134.stdout:9/706: creat d3/d9/df/d57/d67/d5f/fec x:0 0 0 2024-03-22T07:28:47.378 INFO:tasks.workunit.client.0.smithi134.stdout:6/690: dwrite d2/d1b/fbe [0,4194304] 0 2024-03-22T07:28:47.378 INFO:tasks.workunit.client.0.smithi134.stdout:6/691: creat d2/d1b/d1d/d5e/d6f/d7d/dd8/ffa x:0 0 0 2024-03-22T07:28:47.379 INFO:tasks.workunit.client.0.smithi134.stdout:5/843: fsync d1/d8/d20/d62/f69 0 2024-03-22T07:28:47.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/734: dwrite d4/d8/d45/f91 [0,4194304] 0 2024-03-22T07:28:47.382 INFO:tasks.workunit.client.0.smithi134.stdout:3/735: write d4/d10/d4b/f74 [974019,12497] 0 2024-03-22T07:28:47.382 INFO:tasks.workunit.client.0.smithi134.stdout:9/707: getdents d3/d9/d37/d6f 0 2024-03-22T07:28:47.382 INFO:tasks.workunit.client.0.smithi134.stdout:9/708: dread - d3/d9/d37/d5a/d7f/fd4 zero size 2024-03-22T07:28:47.382 INFO:tasks.workunit.client.0.smithi134.stdout:9/709: fsync d3/f22 0 2024-03-22T07:28:47.386 INFO:tasks.workunit.client.0.smithi134.stdout:1/813: dread d5/da/d13/d1e/d62/faf [0,4194304] 0 2024-03-22T07:28:47.387 INFO:tasks.workunit.client.0.smithi134.stdout:1/814: dread d5/d1d/d2d/fc6 [0,4194304] 0 2024-03-22T07:28:47.393 INFO:tasks.workunit.client.0.smithi134.stdout:6/692: creat d2/d1b/d1d/d5e/d6f/da8/dca/ffb x:0 0 0 2024-03-22T07:28:47.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/844: symlink d1/d8/d20/d62/d65/dac/dad/l118 0 2024-03-22T07:28:47.395 INFO:tasks.workunit.client.0.smithi134.stdout:5/845: chown d1/d8/l1f 1 1 2024-03-22T07:28:47.396 INFO:tasks.workunit.client.0.smithi134.stdout:8/953: dwrite d1/d15/d42/d76/d8f/dad/dfc/f132 [0,4194304] 0 2024-03-22T07:28:47.396 INFO:tasks.workunit.client.0.smithi134.stdout:8/954: readlink d1/d15/d42/d25/l33 0 2024-03-22T07:28:47.402 INFO:tasks.workunit.client.0.smithi134.stdout:3/736: mkdir d4/d8/d5c/de6 0 2024-03-22T07:28:47.407 INFO:tasks.workunit.client.0.smithi134.stdout:9/710: truncate d3/d9/df/d12/f2a 480148 0 2024-03-22T07:28:47.407 INFO:tasks.workunit.client.0.smithi134.stdout:9/711: chown d3/d9/f7c 122860183 1 2024-03-22T07:28:47.411 INFO:tasks.workunit.client.0.smithi134.stdout:1/815: mkdir d5/da/d128 0 2024-03-22T07:28:47.415 INFO:tasks.workunit.client.0.smithi134.stdout:6/693: getdents d2/d1b/d1d/d5e/d6f/da8/dc6 0 2024-03-22T07:28:47.417 INFO:tasks.workunit.client.0.smithi134.stdout:5/846: creat d1/d8/d20/d8a/d110/f119 x:0 0 0 2024-03-22T07:28:47.418 INFO:tasks.workunit.client.0.smithi134.stdout:3/737: dwrite d4/d8/d23/f99 [0,4194304] 0 2024-03-22T07:28:47.418 INFO:tasks.workunit.client.0.smithi134.stdout:9/712: write d3/d9/d37/d5a/d7f/d80/f87 [1410717,111775] 0 2024-03-22T07:28:47.418 INFO:tasks.workunit.client.0.smithi134.stdout:0/797: sync 2024-03-22T07:28:47.418 INFO:tasks.workunit.client.0.smithi134.stdout:2/805: sync 2024-03-22T07:28:47.418 INFO:tasks.workunit.client.0.smithi134.stdout:4/807: sync 2024-03-22T07:28:47.419 INFO:tasks.workunit.client.0.smithi134.stdout:3/738: write d4/f76 [281918,85673] 0 2024-03-22T07:28:47.420 INFO:tasks.workunit.client.0.smithi134.stdout:3/739: fdatasync d4/d10/d4b/f90 0 2024-03-22T07:28:47.428 INFO:tasks.workunit.client.0.smithi134.stdout:4/808: dread d2/fd [0,4194304] 0 2024-03-22T07:28:47.429 INFO:tasks.workunit.client.0.smithi134.stdout:4/809: chown d2/d2a/d80/ce3 495829 1 2024-03-22T07:28:47.429 INFO:tasks.workunit.client.0.smithi134.stdout:4/810: chown d2/d25/d74/dde/d76/f7c 0 1 2024-03-22T07:28:47.431 INFO:tasks.workunit.client.0.smithi134.stdout:8/955: truncate d1/d15/d42/d25/d6f/d11e/f52 4418769 0 2024-03-22T07:28:47.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/816: unlink d5/da/d13/d1e/l11a 0 2024-03-22T07:28:47.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/817: truncate d5/da/d61/f83 1318239 0 2024-03-22T07:28:47.438 INFO:tasks.workunit.client.0.smithi134.stdout:6/694: stat d2/d1b/d1d/d5e/d63/c81 0 2024-03-22T07:28:47.441 INFO:tasks.workunit.client.0.smithi134.stdout:5/847: mknod d1/d8/dc5/dd6/dfc/c11a 0 2024-03-22T07:28:47.441 INFO:tasks.workunit.client.0.smithi134.stdout:5/848: chown d1/d8/d20/d62/d68/d9c/l117 167116565 1 2024-03-22T07:28:47.442 INFO:tasks.workunit.client.0.smithi134.stdout:8/956: write d1/f2e [3304265,126442] 0 2024-03-22T07:28:47.444 INFO:tasks.workunit.client.0.smithi134.stdout:9/713: dwrite d3/d9/df/d57/d67/d5f/fb9 [0,4194304] 0 2024-03-22T07:28:47.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/798: dwrite dc/d18/d89/f99 [0,4194304] 0 2024-03-22T07:28:47.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/799: chown dc/d17/lcb 1715360 1 2024-03-22T07:28:47.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/800: dread - dc/de/d55/d65/fc2 zero size 2024-03-22T07:28:47.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/801: write dc/de/d55/fe5 [4448104,4018] 0 2024-03-22T07:28:47.448 INFO:tasks.workunit.client.0.smithi134.stdout:0/802: read dc/de/d55/f8c [2914131,118243] 0 2024-03-22T07:28:47.451 INFO:tasks.workunit.client.0.smithi134.stdout:2/806: link d2/d5/d8/d5d/d5f/d75/dfd/d60/fb3 d2/d5/d8/d5d/d5f/d75/dfd/d60/f108 0 2024-03-22T07:28:47.454 INFO:tasks.workunit.client.0.smithi134.stdout:8/957: write d1/d4/d117/d11a/d20/d41/f45 [732678,66603] 0 2024-03-22T07:28:47.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/695: dwrite d2/d1b/d1d/d5e/fde [0,4194304] 0 2024-03-22T07:28:47.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/696: creat d2/d1b/d4d/ffc x:0 0 0 2024-03-22T07:28:47.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/697: chown d2/d1b/d4d/da5/dec/d28/d97/fb5 28756200 1 2024-03-22T07:28:47.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/698: fdatasync d2/d1b/d1d/d5e/fde 0 2024-03-22T07:28:47.461 INFO:tasks.workunit.client.0.smithi134.stdout:1/818: symlink d5/d1d/d49/l129 0 2024-03-22T07:28:47.461 INFO:tasks.workunit.client.0.smithi134.stdout:1/819: fdatasync d5/da/d61/f11f 0 2024-03-22T07:28:47.461 INFO:tasks.workunit.client.0.smithi134.stdout:6/699: dread d2/f69 [0,4194304] 0 2024-03-22T07:28:47.461 INFO:tasks.workunit.client.0.smithi134.stdout:5/849: truncate d1/d8/d20/d62/f89 834045 0 2024-03-22T07:28:47.475 INFO:tasks.workunit.client.0.smithi134.stdout:8/958: dwrite d1/d15/d42/d49/f124 [0,4194304] 0 2024-03-22T07:28:47.478 INFO:tasks.workunit.client.0.smithi134.stdout:9/714: link d3/d9/d37/d6f/d54/fbf d3/d9/d37/d5a/d89/fed 0 2024-03-22T07:28:47.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/700: dwrite d2/d6e/fc3 [0,4194304] 0 2024-03-22T07:28:47.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/701: creat d2/d1b/d1d/d5e/d6f/da8/ffd x:0 0 0 2024-03-22T07:28:47.483 INFO:tasks.workunit.client.0.smithi134.stdout:0/803: chown dc/de/cba 1 1 2024-03-22T07:28:47.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/820: dwrite d5/da/d13/d1e/de7/fa2 [0,4194304] 0 2024-03-22T07:28:47.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/821: chown d5/da/d1b/c121 0 1 2024-03-22T07:28:47.484 INFO:tasks.workunit.client.0.smithi134.stdout:1/822: write d5/da/d13/d1e/d63/d9d/f101 [535868,75646] 0 2024-03-22T07:28:47.486 INFO:tasks.workunit.client.0.smithi134.stdout:2/807: symlink d2/d5/d8/d7e/l109 0 2024-03-22T07:28:47.488 INFO:tasks.workunit.client.0.smithi134.stdout:3/740: dwrite d4/d22/f25 [0,4194304] 0 2024-03-22T07:28:47.499 INFO:tasks.workunit.client.0.smithi134.stdout:5/850: creat d1/d8/f11b x:0 0 0 2024-03-22T07:28:47.500 INFO:tasks.workunit.client.0.smithi134.stdout:5/851: dread - d1/d8/d20/d62/d68/f9e zero size 2024-03-22T07:28:47.501 INFO:tasks.workunit.client.0.smithi134.stdout:8/959: mkdir d1/d46/d75/d10b/d13a 0 2024-03-22T07:28:47.505 INFO:tasks.workunit.client.0.smithi134.stdout:9/715: rename d3/d9/df/d57/d67/d5f/fb9 to d3/d9/df/d12/dd7/de7/fee 0 2024-03-22T07:28:47.514 INFO:tasks.workunit.client.0.smithi134.stdout:9/716: dread d3/f72 [0,4194304] 0 2024-03-22T07:28:47.525 INFO:tasks.workunit.client.0.smithi134.stdout:6/702: mknod d2/d1b/d1d/d5e/d84/cfe 0 2024-03-22T07:28:47.525 INFO:tasks.workunit.client.0.smithi134.stdout:6/703: write d2/d1b/d4d/da5/dec/f83 [777600,78571] 0 2024-03-22T07:28:47.525 INFO:tasks.workunit.client.0.smithi134.stdout:6/704: fdatasync d2/d1b/d4d/da5/dec/d28/d97/fcb 0 2024-03-22T07:28:47.527 INFO:tasks.workunit.client.0.smithi134.stdout:0/804: truncate dc/d18/f5e 3665842 0 2024-03-22T07:28:47.529 INFO:tasks.workunit.client.0.smithi134.stdout:6/705: dread d2/d1b/d1d/d5e/d63/f64 [0,4194304] 0 2024-03-22T07:28:47.530 INFO:tasks.workunit.client.0.smithi134.stdout:1/823: creat d5/da/f12a x:0 0 0 2024-03-22T07:28:47.532 INFO:tasks.workunit.client.0.smithi134.stdout:2/808: getdents d2/d5/d8/d5d/d5f/d75/dfd/d60 0 2024-03-22T07:28:47.535 INFO:tasks.workunit.client.0.smithi134.stdout:3/741: creat d4/d22/d29/d50/fe7 x:0 0 0 2024-03-22T07:28:47.547 INFO:tasks.workunit.client.0.smithi134.stdout:9/717: dread d3/d9/df/f61 [0,4194304] 0 2024-03-22T07:28:47.547 INFO:tasks.workunit.client.0.smithi134.stdout:6/706: rmdir d2 39 2024-03-22T07:28:47.547 INFO:tasks.workunit.client.0.smithi134.stdout:6/707: chown d2/c13 1 1 2024-03-22T07:28:47.548 INFO:tasks.workunit.client.0.smithi134.stdout:1/824: dwrite d5/d1d/f90 [0,4194304] 0 2024-03-22T07:28:47.550 INFO:tasks.workunit.client.0.smithi134.stdout:3/742: stat d4/d22/d3c/l7d 0 2024-03-22T07:28:47.552 INFO:tasks.workunit.client.0.smithi134.stdout:5/852: rename d1/d8/d20/d62/d65 to d1/d8/dc5/dd6/dfc/d11c 0 2024-03-22T07:28:47.555 INFO:tasks.workunit.client.0.smithi134.stdout:9/718: rmdir d3/d9/df/d12/dd7 39 2024-03-22T07:28:47.557 INFO:tasks.workunit.client.0.smithi134.stdout:6/708: truncate d2/d1b/d4d/da5/dec/f88 4342959 0 2024-03-22T07:28:47.557 INFO:tasks.workunit.client.0.smithi134.stdout:6/709: read - d2/d1b/d4d/da5/dec/fbb zero size 2024-03-22T07:28:47.560 INFO:tasks.workunit.client.0.smithi134.stdout:6/710: dread d2/d1b/d1d/d5e/d6f/d7d/f3a [0,4194304] 0 2024-03-22T07:28:47.560 INFO:tasks.workunit.client.0.smithi134.stdout:6/711: chown d2/l40 83 1 2024-03-22T07:28:47.561 INFO:tasks.workunit.client.0.smithi134.stdout:0/805: rename dc/d18/f66 to dc/d18/d89/ff9 0 2024-03-22T07:28:47.562 INFO:tasks.workunit.client.0.smithi134.stdout:5/853: creat d1/d8/d16/d4a/f11d x:0 0 0 2024-03-22T07:28:47.563 INFO:tasks.workunit.client.0.smithi134.stdout:1/825: getdents d5/d1d/d49/d92 0 2024-03-22T07:28:47.563 INFO:tasks.workunit.client.0.smithi134.stdout:1/826: dread - d5/da/d68/ff3 zero size 2024-03-22T07:28:47.564 INFO:tasks.workunit.client.0.smithi134.stdout:3/743: dwrite d4/d8/d5c/fb3 [0,4194304] 0 2024-03-22T07:28:47.567 INFO:tasks.workunit.client.0.smithi134.stdout:6/712: unlink d2/d1b/d4d/da5/dec/d28/d97/fcb 0 2024-03-22T07:28:47.569 INFO:tasks.workunit.client.0.smithi134.stdout:9/719: rename d3/d9/d37/d6f/d54/d9d/dc0/c66 to d3/d9/d37/d5a/d7f/cef 0 2024-03-22T07:28:47.572 INFO:tasks.workunit.client.0.smithi134.stdout:0/806: mknod dc/d17/da9/ddf/cfa 0 2024-03-22T07:28:47.576 INFO:tasks.workunit.client.0.smithi134.stdout:5/854: creat d1/d8/d16/dbd/f11e x:0 0 0 2024-03-22T07:28:47.576 INFO:tasks.workunit.client.0.smithi134.stdout:5/855: chown d1/d8/dc5/dd6/dfc/d11c/d95/l100 2096 1 2024-03-22T07:28:47.578 INFO:tasks.workunit.client.0.smithi134.stdout:1/827: mkdir d5/d1d/dd0/ddc/de3/df6/d12b 0 2024-03-22T07:28:47.578 INFO:tasks.workunit.client.0.smithi134.stdout:1/828: chown d5/da/d128 79074 1 2024-03-22T07:28:47.584 INFO:tasks.workunit.client.0.smithi134.stdout:0/807: truncate dc/d18/f1d 2051768 0 2024-03-22T07:28:47.586 INFO:tasks.workunit.client.0.smithi134.stdout:1/829: unlink d5/da/d13/d1e/c64 0 2024-03-22T07:28:47.587 INFO:tasks.workunit.client.0.smithi134.stdout:6/713: dwrite d2/d1b/d1d/d5e/d6f/d7d/f50 [0,4194304] 0 2024-03-22T07:28:47.590 INFO:tasks.workunit.client.0.smithi134.stdout:0/808: truncate dc/d18/f8e 3695115 0 2024-03-22T07:28:47.590 INFO:tasks.workunit.client.0.smithi134.stdout:0/809: chown dc/de/d55/f71 0 1 2024-03-22T07:28:47.592 INFO:tasks.workunit.client.0.smithi134.stdout:1/830: symlink d5/da/d68/da1/l12c 0 2024-03-22T07:28:47.594 INFO:tasks.workunit.client.0.smithi134.stdout:9/720: dwrite d3/d9/df/d57/fa9 [0,4194304] 0 2024-03-22T07:28:47.596 INFO:tasks.workunit.client.0.smithi134.stdout:3/744: dwrite d4/d22/d3c/f8a [0,4194304] 0 2024-03-22T07:28:47.598 INFO:tasks.workunit.client.0.smithi134.stdout:5/856: dwrite d1/d8/dc5/fd5 [0,4194304] 0 2024-03-22T07:28:47.602 INFO:tasks.workunit.client.0.smithi134.stdout:1/831: truncate d5/d1d/dd0/ddc/d113/fde 2972658 0 2024-03-22T07:28:47.612 INFO:tasks.workunit.client.0.smithi134.stdout:0/810: dwrite dc/de/f84 [0,4194304] 0 2024-03-22T07:28:47.620 INFO:tasks.workunit.client.0.smithi134.stdout:9/721: dwrite d3/d9/df/d12/f58 [0,4194304] 0 2024-03-22T07:28:47.620 INFO:tasks.workunit.client.0.smithi134.stdout:3/745: dwrite d4/d8/f49 [4194304,4194304] 0 2024-03-22T07:28:47.625 INFO:tasks.workunit.client.0.smithi134.stdout:5/857: symlink d1/l11f 0 2024-03-22T07:28:47.631 INFO:tasks.workunit.client.0.smithi134.stdout:1/832: symlink d5/d1d/dd0/ddc/d113/d39/da4/l12d 0 2024-03-22T07:28:47.635 INFO:tasks.workunit.client.0.smithi134.stdout:0/811: rename dc/d18/fa1 to dc/de/d55/d65/dbe/ffb 0 2024-03-22T07:28:47.638 INFO:tasks.workunit.client.0.smithi134.stdout:9/722: unlink d3/d9/d37/d6f/d54/d9d/dc0/f42 0 2024-03-22T07:28:47.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/746: rmdir d4/d22/d29/dad 39 2024-03-22T07:28:47.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/747: chown d4/d8/d23/cbd 124 1 2024-03-22T07:28:47.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/748: readlink d4/l6 0 2024-03-22T07:28:47.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/749: chown d4/l2d 236522 1 2024-03-22T07:28:47.643 INFO:tasks.workunit.client.0.smithi134.stdout:3/750: chown d4/d8/f49 183297514 1 2024-03-22T07:28:47.647 INFO:tasks.workunit.client.0.smithi134.stdout:1/833: rename d5/da/d13/c16 to d5/da/d68/da1/c12e 0 2024-03-22T07:28:47.647 INFO:tasks.workunit.client.0.smithi134.stdout:1/834: chown d5/da/f2a 3367 1 2024-03-22T07:28:47.647 INFO:tasks.workunit.client.0.smithi134.stdout:3/751: dread d4/d10/f36 [0,4194304] 0 2024-03-22T07:28:47.650 INFO:tasks.workunit.client.0.smithi134.stdout:6/714: dwrite d2/d1b/d1d/d5e/d6f/f98 [0,4194304] 0 2024-03-22T07:28:47.650 INFO:tasks.workunit.client.0.smithi134.stdout:6/715: truncate d2/f1c 9035185 0 2024-03-22T07:28:47.650 INFO:tasks.workunit.client.0.smithi134.stdout:6/716: creat d2/d1b/d4d/fff x:0 0 0 2024-03-22T07:28:47.650 INFO:tasks.workunit.client.0.smithi134.stdout:6/717: creat d2/d6e/f100 x:0 0 0 2024-03-22T07:28:47.662 INFO:tasks.workunit.client.0.smithi134.stdout:1/835: dwrite d5/da/f12a [0,4194304] 0 2024-03-22T07:28:47.662 INFO:tasks.workunit.client.0.smithi134.stdout:1/836: write d5/da/d68/da1/fa3 [497623,123955] 0 2024-03-22T07:28:47.663 INFO:tasks.workunit.client.0.smithi134.stdout:1/837: fdatasync d5/da/d1b/f1c 0 2024-03-22T07:28:47.722 INFO:tasks.workunit.client.0.smithi134.stdout:3/752: mknod d4/d8/d23/ce8 0 2024-03-22T07:28:47.730 INFO:tasks.workunit.client.0.smithi134.stdout:3/753: read d4/d10/f40 [5023223,127490] 0 2024-03-22T07:28:47.730 INFO:tasks.workunit.client.0.smithi134.stdout:3/754: chown d4/d22/d29/d50/f62 7062785 1 2024-03-22T07:28:47.743 INFO:tasks.workunit.client.0.smithi134.stdout:6/718: getdents d2/d1b/d4d/da5/dec/d28 0 2024-03-22T07:28:47.756 INFO:tasks.workunit.client.0.smithi134.stdout:3/755: dwrite d4/d22/d3c/f73 [0,4194304] 0 2024-03-22T07:28:47.757 INFO:tasks.workunit.client.0.smithi134.stdout:6/719: dread d2/d1b/d1d/d5e/f66 [0,4194304] 0 2024-03-22T07:28:47.757 INFO:tasks.workunit.client.0.smithi134.stdout:6/720: chown d2/d1b/d4d/da5/dec/d28/c36 17 1 2024-03-22T07:28:47.765 INFO:tasks.workunit.client.0.smithi134.stdout:3/756: mknod d4/d8/d7f/ce9 0 2024-03-22T07:28:47.765 INFO:tasks.workunit.client.0.smithi134.stdout:3/757: creat d4/d8/d5c/fea x:0 0 0 2024-03-22T07:28:47.771 INFO:tasks.workunit.client.0.smithi134.stdout:9/723: dwrite d3/d9/df/d12/f2a [0,4194304] 0 2024-03-22T07:28:47.773 INFO:tasks.workunit.client.0.smithi134.stdout:6/721: rmdir d2/d1b/d4d/da5 39 2024-03-22T07:28:47.778 INFO:tasks.workunit.client.0.smithi134.stdout:6/722: symlink d2/d1b/d1d/d5e/d84/l101 0 2024-03-22T07:28:47.779 INFO:tasks.workunit.client.0.smithi134.stdout:9/724: rmdir d3/d9/df/d57/d67/d5f 39 2024-03-22T07:28:47.790 INFO:tasks.workunit.client.0.smithi134.stdout:9/725: write d3/d9/d37/d5a/d7f/f98 [3630945,46774] 0 2024-03-22T07:28:47.794 INFO:tasks.workunit.client.0.smithi134.stdout:9/726: link d3/d9/d37/d6f/d54/fe0 d3/d9/d37/d5a/d7f/ff0 0 2024-03-22T07:28:47.812 INFO:tasks.workunit.client.0.smithi134.stdout:6/723: dwrite d2/d1b/d1d/d5e/d84/f79 [0,4194304] 0 2024-03-22T07:28:47.812 INFO:tasks.workunit.client.0.smithi134.stdout:9/727: dwrite d3/d9/d37/d3c/fc6 [4194304,4194304] 0 2024-03-22T07:28:47.812 INFO:tasks.workunit.client.0.smithi134.stdout:9/728: readlink d3/d9/d37/d3c/d71/l8b 0 2024-03-22T07:28:47.814 INFO:tasks.workunit.client.0.smithi134.stdout:6/724: getdents d2/d1b/daa/dc1 0 2024-03-22T07:28:47.814 INFO:tasks.workunit.client.0.smithi134.stdout:6/725: dread - d2/d1b/d1d/d5e/d6f/fe3 zero size 2024-03-22T07:28:47.819 INFO:tasks.workunit.client.0.smithi134.stdout:9/729: write d3/d9/df/f61 [747296,102413] 0 2024-03-22T07:28:47.836 INFO:tasks.workunit.client.0.smithi134.stdout:9/730: getdents d3/d9/df/d12/dd7 0 2024-03-22T07:28:47.839 INFO:tasks.workunit.client.0.smithi134.stdout:9/731: mknod d3/d9/df/d12/dd7/cf1 0 2024-03-22T07:28:47.842 INFO:tasks.workunit.client.0.smithi134.stdout:9/732: creat d3/d9/d37/d3c/d71/dc2/ff2 x:0 0 0 2024-03-22T07:28:47.842 INFO:tasks.workunit.client.0.smithi134.stdout:9/733: chown d3/d9/df/l11 1003 1 2024-03-22T07:28:47.846 INFO:tasks.workunit.client.0.smithi134.stdout:9/734: rename d3/d9/d37/f40 to d3/d9/df/ff3 0 2024-03-22T07:28:47.861 INFO:tasks.workunit.client.0.smithi134.stdout:9/735: dwrite d3/d9/d37/d5a/faa [0,4194304] 0 2024-03-22T07:28:47.862 INFO:tasks.workunit.client.0.smithi134.stdout:9/736: chown d3/d9/d37/d3c/d71/fe2 19290 1 2024-03-22T07:28:47.862 INFO:tasks.workunit.client.0.smithi134.stdout:9/737: stat d3/d9/df/d12/c64 0 2024-03-22T07:28:47.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/738: write d3/d9/d37/d5a/d89/fed [2831058,19483] 0 2024-03-22T07:28:47.873 INFO:tasks.workunit.client.0.smithi134.stdout:9/739: getdents d3/d9/d37/d6f/d54/d9d/dc0 0 2024-03-22T07:28:47.882 INFO:tasks.workunit.client.0.smithi134.stdout:9/740: symlink d3/lf4 0 2024-03-22T07:28:47.882 INFO:tasks.workunit.client.0.smithi134.stdout:9/741: dread - d3/d9/d37/d6f/d54/d9d/dc0/f50 zero size 2024-03-22T07:28:47.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/742: dwrite d3/d9/df/f26 [8388608,4194304] 0 2024-03-22T07:28:47.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/743: write d3/d9/df/d57/d67/d5f/f9a [1132272,127774] 0 2024-03-22T07:28:47.906 INFO:tasks.workunit.client.0.smithi134.stdout:9/744: chown d3/d9/d37/d70/fd9 738622238 1 2024-03-22T07:28:47.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/745: creat d3/d9/df/d57/ff5 x:0 0 0 2024-03-22T07:28:47.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/746: creat d3/d9/d37/d70/ff6 x:0 0 0 2024-03-22T07:28:47.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/747: dread - d3/d9/df/d57/d67/fc7 zero size 2024-03-22T07:28:47.908 INFO:tasks.workunit.client.0.smithi134.stdout:9/748: dread - d3/d9/fde zero size 2024-03-22T07:28:47.913 INFO:tasks.workunit.client.0.smithi134.stdout:9/749: symlink d3/d9/df/d57/d67/d5f/lf7 0 2024-03-22T07:28:47.913 INFO:tasks.workunit.client.0.smithi134.stdout:9/750: chown d3/d9/fde 583 1 2024-03-22T07:28:47.921 INFO:tasks.workunit.client.0.smithi134.stdout:9/751: dread d3/d9/d37/d6f/d54/d9d/dc0/fa2 [4194304,4194304] 0 2024-03-22T07:28:47.922 INFO:tasks.workunit.client.0.smithi134.stdout:9/752: creat d3/ff8 x:0 0 0 2024-03-22T07:28:47.922 INFO:tasks.workunit.client.0.smithi134.stdout:9/753: write d3/d9/d37/d6f/d54/d9d/dc0/fa2 [8571535,69950] 0 2024-03-22T07:28:47.923 INFO:tasks.workunit.client.0.smithi134.stdout:9/754: dread - d3/d9/d37/d5a/fdb zero size 2024-03-22T07:28:47.927 INFO:tasks.workunit.client.0.smithi134.stdout:9/755: dread d3/d9/df/d57/d67/d5f/f9a [0,4194304] 0 2024-03-22T07:28:47.927 INFO:tasks.workunit.client.0.smithi134.stdout:9/756: readlink d3/d9/d37/d3c/l8d 0 2024-03-22T07:28:48.060 INFO:tasks.workunit.client.0.smithi134.stdout:4/811: sync 2024-03-22T07:28:48.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/812: creat d2/d15/d35/da8/f11a x:0 0 0 2024-03-22T07:28:48.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/813: chown d2/d25/d48/l116 2899 1 2024-03-22T07:28:48.062 INFO:tasks.workunit.client.0.smithi134.stdout:4/814: write d2/d2a/d80/fd0 [2085099,22740] 0 2024-03-22T07:28:48.063 INFO:tasks.workunit.client.0.smithi134.stdout:4/815: read - d2/d25/d48/d6e/fea zero size 2024-03-22T07:28:48.063 INFO:tasks.workunit.client.0.smithi134.stdout:4/816: chown d2/d15 69074053 1 2024-03-22T07:28:48.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/817: creat d2/d15/d35/da8/dec/d119/f11b x:0 0 0 2024-03-22T07:28:48.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/818: rmdir d2/d25/dcf/dfc 0 2024-03-22T07:28:48.066 INFO:tasks.workunit.client.0.smithi134.stdout:4/819: write d2/fd [4975570,129214] 0 2024-03-22T07:28:48.087 INFO:tasks.workunit.client.0.smithi134.stdout:4/820: dwrite d2/d2a/f4d [0,4194304] 0 2024-03-22T07:28:48.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/821: write d2/d98/f113 [558424,17018] 0 2024-03-22T07:28:48.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/822: chown d2/d2a/d80/dd6/la6 14319250 1 2024-03-22T07:28:48.088 INFO:tasks.workunit.client.0.smithi134.stdout:4/823: fsync d2/d25/d48/d87/fa2 0 2024-03-22T07:28:48.097 INFO:tasks.workunit.client.0.smithi134.stdout:4/824: read d2/d25/d48/d87/fa0 [6610278,28599] 0 2024-03-22T07:28:48.112 INFO:tasks.workunit.client.0.smithi134.stdout:4/825: dwrite d2/d15/f1b [4194304,4194304] 0 2024-03-22T07:28:48.115 INFO:tasks.workunit.client.0.smithi134.stdout:4/826: rename d2/d2a/d80/dd6/f5e to d2/d25/d48/d6e/d7b/dd7/f11c 0 2024-03-22T07:28:48.119 INFO:tasks.workunit.client.0.smithi134.stdout:4/827: getdents d2/d25/d48/d6e/d7b 0 2024-03-22T07:28:48.128 INFO:tasks.workunit.client.0.smithi134.stdout:4/828: dread d2/d25/d74/dde/fdf [0,4194304] 0 2024-03-22T07:28:48.130 INFO:tasks.workunit.client.0.smithi134.stdout:4/829: mknod d2/d2a/c11d 0 2024-03-22T07:28:48.137 INFO:tasks.workunit.client.0.smithi134.stdout:4/830: write d2/fa1 [4628694,41256] 0 2024-03-22T07:28:48.245 INFO:tasks.workunit.client.0.smithi134.stdout:2/809: sync 2024-03-22T07:28:48.246 INFO:tasks.workunit.client.0.smithi134.stdout:8/960: sync 2024-03-22T07:28:48.249 INFO:tasks.workunit.client.0.smithi134.stdout:2/810: unlink d2/d5/d8/d5d/da1/f76 0 2024-03-22T07:28:48.249 INFO:tasks.workunit.client.0.smithi134.stdout:2/811: chown d2/d5/d8/d5d/d5f/d75/dfd/d60/c7a 13638 1 2024-03-22T07:28:48.249 INFO:tasks.workunit.client.0.smithi134.stdout:8/961: truncate d1/d4/d6e/fb8 1153829 0 2024-03-22T07:28:48.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/962: readlink d1/d15/d42/d76/dda/lec 0 2024-03-22T07:28:48.250 INFO:tasks.workunit.client.0.smithi134.stdout:8/963: write d1/d4/d117/d11a/d20/d41/f45 [2547935,53888] 0 2024-03-22T07:28:48.252 INFO:tasks.workunit.client.0.smithi134.stdout:8/964: dread d1/d15/fcc [0,4194304] 0 2024-03-22T07:28:48.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/812: unlink d2/d5/fb6 0 2024-03-22T07:28:48.252 INFO:tasks.workunit.client.0.smithi134.stdout:2/813: creat d2/d5/d8/d5d/d5f/d75/f10a x:0 0 0 2024-03-22T07:28:48.267 INFO:tasks.workunit.client.0.smithi134.stdout:2/814: dread d2/d5/d8/f33 [0,4194304] 0 2024-03-22T07:28:48.279 INFO:tasks.workunit.client.0.smithi134.stdout:8/965: dwrite d1/d4/d117/d11a/d20/f74 [0,4194304] 0 2024-03-22T07:28:48.281 INFO:tasks.workunit.client.0.smithi134.stdout:8/966: rmdir d1/d15/d5b/dfa 0 2024-03-22T07:28:48.289 INFO:tasks.workunit.client.0.smithi134.stdout:8/967: read d1/d15/d42/d76/d8f/dad/dae/fbc [1927945,25142] 0 2024-03-22T07:28:48.289 INFO:tasks.workunit.client.0.smithi134.stdout:8/968: chown d1/f67 111541964 1 2024-03-22T07:28:48.292 INFO:tasks.workunit.client.0.smithi134.stdout:8/969: symlink d1/d4/d117/l13b 0 2024-03-22T07:28:48.292 INFO:tasks.workunit.client.0.smithi134.stdout:8/970: creat d1/d46/d75/d8b/db4/d102/f13c x:0 0 0 2024-03-22T07:28:48.297 INFO:tasks.workunit.client.0.smithi134.stdout:8/971: symlink d1/d15/d42/d25/l13d 0 2024-03-22T07:28:48.298 INFO:tasks.workunit.client.0.smithi134.stdout:8/972: chown d1/d15/d57 2 1 2024-03-22T07:28:48.312 INFO:tasks.workunit.client.0.smithi134.stdout:8/973: dwrite d1/d15/f19 [0,4194304] 0 2024-03-22T07:28:48.313 INFO:tasks.workunit.client.0.smithi134.stdout:8/974: write d1/d15/d42/d76/d8f/fff [142808,118389] 0 2024-03-22T07:28:48.316 INFO:tasks.workunit.client.0.smithi134.stdout:8/975: mkdir d1/d15/d7b/d83/de3/da2/de6/d13e 0 2024-03-22T07:28:48.324 INFO:tasks.workunit.client.0.smithi134.stdout:8/976: dread d1/f4b [4194304,4194304] 0 2024-03-22T07:28:48.359 INFO:tasks.workunit.client.0.smithi134.stdout:5/858: sync 2024-03-22T07:28:48.360 INFO:tasks.workunit.client.0.smithi134.stdout:5/859: truncate d1/f10c 1033530 0 2024-03-22T07:28:48.367 INFO:tasks.workunit.client.0.smithi134.stdout:5/860: write d1/d8/d20/f39 [1075118,13732] 0 2024-03-22T07:28:48.387 INFO:tasks.workunit.client.0.smithi134.stdout:5/861: dwrite d1/d8/d16/dbd/dc0/fe7 [0,4194304] 0 2024-03-22T07:28:48.391 INFO:tasks.workunit.client.0.smithi134.stdout:5/862: unlink d1/d8/d16/d4a/fee 0 2024-03-22T07:28:48.394 INFO:tasks.workunit.client.0.smithi134.stdout:5/863: symlink d1/d8/d20/d62/l120 0 2024-03-22T07:28:48.396 INFO:tasks.workunit.client.0.smithi134.stdout:5/864: getdents d1/d8/dc5 0 2024-03-22T07:28:48.404 INFO:tasks.workunit.client.0.smithi134.stdout:5/865: dread d1/d8/dc5/dd6/dfc/d11c/fc9 [0,4194304] 0 2024-03-22T07:28:48.413 INFO:tasks.workunit.client.0.smithi134.stdout:5/866: write d1/d8/d20/d8a/ffe [3855276,85199] 0 2024-03-22T07:28:48.416 INFO:tasks.workunit.client.0.smithi134.stdout:5/867: rmdir d1/d8/dc5/da2 39 2024-03-22T07:28:48.418 INFO:tasks.workunit.client.0.smithi134.stdout:5/868: symlink d1/d8/d16/dbd/df1/l121 0 2024-03-22T07:28:48.418 INFO:tasks.workunit.client.0.smithi134.stdout:5/869: chown d1/d8/dc5/dd6/dfc 261304123 1 2024-03-22T07:28:48.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/870: truncate d1/d4/ff4 238445 0 2024-03-22T07:28:48.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/871: chown d1/d8/c24 16035 1 2024-03-22T07:28:48.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/872: getdents d1/d8/d20/d62/df2 0 2024-03-22T07:28:48.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/873: write d1/d8/d20/d62/d68/fc7 [487151,32934] 0 2024-03-22T07:28:48.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/874: readlink d1/d4/l5 0 2024-03-22T07:28:48.419 INFO:tasks.workunit.client.0.smithi134.stdout:5/875: unlink d1/d8/d20/d8a/f116 0 2024-03-22T07:28:48.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/876: dread d1/d8/dc5/dd6/dfc/d11c/f67 [0,4194304] 0 2024-03-22T07:28:48.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/877: chown d1/d8/d16/dbd/dc0/fe7 497179320 1 2024-03-22T07:28:48.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/878: fdatasync d1/d8/d16/d4a/f11d 0 2024-03-22T07:28:48.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/879: dwrite d1/d8/dc5/dd6/dfc/d11c/dac/dad/fd9 [0,4194304] 0 2024-03-22T07:28:48.490 INFO:tasks.workunit.client.0.smithi134.stdout:5/880: symlink d1/d8/d20/d62/l122 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:0/812: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:3/758: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/815: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:4/831: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/816: readlink d2/d5/d8/d5d/d5f/d75/dfd/d60/l9b 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:1/838: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:9/757: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:6/726: sync 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/817: mkdir d2/d5/d22/dbc/d104/d10b 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:1/839: rename d5/d1d/l5b to d5/da/d13/d1e/d62/dda/l12f 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:0/813: dread dc/de/d55/d65/d82/db7/fd5 [0,4194304] 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:6/727: symlink d2/d6e/l102 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:9/758: mknod d3/cf9 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:9/759: creat d3/d9/d37/d6f/d54/ffa x:0 0 0 2024-03-22T07:28:48.491 INFO:tasks.workunit.client.0.smithi134.stdout:2/818: dread d2/d5/d8/d5d/d5f/d75/dfd/f6c [0,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:2/819: fdatasync d2/d5/d8/d5d/fe2 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:2/820: chown d2/f87 1704 1 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:3/759: dread d4/f1a [0,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:5/881: dwrite d1/d8/dc5/dd6/dfc/d11c/f1e [4194304,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:3/760: chown d4/d22/d29/d50/f7b 1 1 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/840: dread d5/d1d/d2d/f6f [0,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/841: write d5/da/d61/f83 [1760802,12307] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/842: stat d5/d1d/d2d 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/843: dread d5/d1d/fa9 [0,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:0/814: unlink dc/de/d55/fde 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:3/761: dread d4/d22/d29/d82/f8e [0,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:6/728: symlink d2/d1b/d4d/da5/dec/d28/l103 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:6/729: chown d2/d1b/d1d/d5e/d6f/d7d/dd8 24590 1 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:2/821: dread d2/f4c [0,4194304] 0 2024-03-22T07:28:48.492 INFO:tasks.workunit.client.0.smithi134.stdout:1/844: mkdir d5/d1d/dd0/d130 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:1/845: read d5/d1d/d2d/fc6 [179899,36061] 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:1/846: fdatasync d5/d1d/dd0/ddc/d113/d39/f82 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:1/847: readlink d5/da/d13/db9/lee 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:0/815: mknod dc/de/d55/d65/cfc 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:0/816: creat dc/de/dc9/ffd x:0 0 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:0/817: readlink dc/de/d55/lef 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:0/818: write dc/d18/d85/f9d [882621,110128] 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:6/730: creat d2/d1b/f104 x:0 0 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:6/731: dread - d2/d1b/d1d/d5e/d6f/d7d/dd8/ff4 zero size 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:6/732: dread - d2/d1b/d1d/d5e/d6f/fe3 zero size 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:9/760: dwrite d3/d9/df/f86 [4194304,4194304] 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:3/762: write d4/d10/fb0 [4015329,25260] 0 2024-03-22T07:28:48.493 INFO:tasks.workunit.client.0.smithi134.stdout:2/822: creat d2/d5/d22/dbc/d104/f10c x:0 0 0 2024-03-22T07:28:48.494 INFO:tasks.workunit.client.0.smithi134.stdout:1/848: truncate d5/da/d13/d1e/d62/dda/f118 3437874 0 2024-03-22T07:28:48.497 INFO:tasks.workunit.client.0.smithi134.stdout:6/733: mkdir d2/d6e/d105 0 2024-03-22T07:28:48.497 INFO:tasks.workunit.client.0.smithi134.stdout:6/734: chown d2/d1b/d1d/d5e/d6f/fe3 1206211 1 2024-03-22T07:28:48.498 INFO:tasks.workunit.client.0.smithi134.stdout:9/761: creat d3/d9/d37/d5a/dc5/ffb x:0 0 0 2024-03-22T07:28:48.499 INFO:tasks.workunit.client.0.smithi134.stdout:3/763: symlink d4/d10/d4b/leb 0 2024-03-22T07:28:48.499 INFO:tasks.workunit.client.0.smithi134.stdout:3/764: stat d4/d8/d69/faa 0 2024-03-22T07:28:48.499 INFO:tasks.workunit.client.0.smithi134.stdout:3/765: truncate d4/d22/d3c/fbf 29685 0 2024-03-22T07:28:48.501 INFO:tasks.workunit.client.0.smithi134.stdout:1/849: mkdir d5/da/d13/dac/d131 0 2024-03-22T07:28:48.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/735: rename d2/d1b/d4d/fe2 to d2/d1b/d1d/f106 0 2024-03-22T07:28:48.503 INFO:tasks.workunit.client.0.smithi134.stdout:9/762: mkdir d3/d9/df/d12/dfc 0 2024-03-22T07:28:48.504 INFO:tasks.workunit.client.0.smithi134.stdout:1/850: mkdir d5/da/df8/d132 0 2024-03-22T07:28:48.504 INFO:tasks.workunit.client.0.smithi134.stdout:1/851: dread - d5/da/d1b/de5/f108 zero size 2024-03-22T07:28:48.505 INFO:tasks.workunit.client.0.smithi134.stdout:9/763: creat d3/d9/ffd x:0 0 0 2024-03-22T07:28:48.505 INFO:tasks.workunit.client.0.smithi134.stdout:9/764: write d3/d9/d37/d70/fdf [662132,22987] 0 2024-03-22T07:28:48.508 INFO:tasks.workunit.client.0.smithi134.stdout:1/852: unlink d5/d1d/d49/f9e 0 2024-03-22T07:28:48.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/766: dread d4/d8/f49 [0,4194304] 0 2024-03-22T07:28:48.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/767: chown d4/d8/d69/dd7 9390645 1 2024-03-22T07:28:48.508 INFO:tasks.workunit.client.0.smithi134.stdout:3/768: dread - d4/d22/d3c/d88/fd9 zero size 2024-03-22T07:28:48.514 INFO:tasks.workunit.client.0.smithi134.stdout:9/765: read d3/d9/f94 [1638019,26569] 0 2024-03-22T07:28:48.515 INFO:tasks.workunit.client.0.smithi134.stdout:2/823: dwrite d2/d5/d8/f42 [0,4194304] 0 2024-03-22T07:28:48.515 INFO:tasks.workunit.client.0.smithi134.stdout:0/819: dwrite dc/de/d55/d65/d82/fbc [0,4194304] 0 2024-03-22T07:28:48.515 INFO:tasks.workunit.client.0.smithi134.stdout:0/820: stat dc/c46 0 2024-03-22T07:28:48.517 INFO:tasks.workunit.client.0.smithi134.stdout:9/766: truncate d3/d9/d37/d3c/d71/fa8 4171611 0 2024-03-22T07:28:48.517 INFO:tasks.workunit.client.0.smithi134.stdout:9/767: dread - d3/d9/d37/d6f/d54/fe0 zero size 2024-03-22T07:28:48.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/769: dread d4/d10/d4b/fb7 [0,4194304] 0 2024-03-22T07:28:48.520 INFO:tasks.workunit.client.0.smithi134.stdout:3/770: stat d4/d22/d3c/fc8 0 2024-03-22T07:28:48.521 INFO:tasks.workunit.client.0.smithi134.stdout:9/768: write d3/d9/df/f7d [6406988,98946] 0 2024-03-22T07:28:48.524 INFO:tasks.workunit.client.0.smithi134.stdout:2/824: rename d2/d5/fa9 to d2/d5/d54/f10d 0 2024-03-22T07:28:48.536 INFO:tasks.workunit.client.0.smithi134.stdout:0/821: mknod dc/de/d55/d65/dd3/cfe 0 2024-03-22T07:28:48.540 INFO:tasks.workunit.client.0.smithi134.stdout:9/769: mknod d3/d9/d37/cfe 0 2024-03-22T07:28:48.540 INFO:tasks.workunit.client.0.smithi134.stdout:9/770: creat d3/d9/d37/d70/fff x:0 0 0 2024-03-22T07:28:48.543 INFO:tasks.workunit.client.0.smithi134.stdout:2/825: creat d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/f10e x:0 0 0 2024-03-22T07:28:48.543 INFO:tasks.workunit.client.0.smithi134.stdout:8/977: sync 2024-03-22T07:28:48.545 INFO:tasks.workunit.client.0.smithi134.stdout:3/771: getdents d4/d22/d29/d82 0 2024-03-22T07:28:48.550 INFO:tasks.workunit.client.0.smithi134.stdout:8/978: mknod d1/d4/d61/c13f 0 2024-03-22T07:28:48.550 INFO:tasks.workunit.client.0.smithi134.stdout:8/979: fdatasync d1/d15/d5b/f139 0 2024-03-22T07:28:48.550 INFO:tasks.workunit.client.0.smithi134.stdout:8/980: stat d1/d15/d42/d25/d6f/d11e/cee 0 2024-03-22T07:28:48.551 INFO:tasks.workunit.client.0.smithi134.stdout:8/981: dread d1/d4/d117/d11a/d2a/fe5 [0,4194304] 0 2024-03-22T07:28:48.608 INFO:tasks.workunit.client.0.smithi134.stdout:0/822: getdents dc/d18/d89/da0 0 2024-03-22T07:28:48.610 INFO:tasks.workunit.client.0.smithi134.stdout:9/771: rename d3/d9/df/d12/dd7/de7/fee to d3/d9/d37/d3c/d71/dc2/f100 0 2024-03-22T07:28:48.612 INFO:tasks.workunit.client.0.smithi134.stdout:2/826: getdents d2/d5/d8 0 2024-03-22T07:28:48.613 INFO:tasks.workunit.client.0.smithi134.stdout:2/827: stat d2/d5/d8/d31/faa 0 2024-03-22T07:28:48.615 INFO:tasks.workunit.client.0.smithi134.stdout:8/982: mkdir d1/d15/d42/d76/dda/df7/d140 0 2024-03-22T07:28:48.615 INFO:tasks.workunit.client.0.smithi134.stdout:8/983: fdatasync d1/d15/f5 0 2024-03-22T07:28:48.618 INFO:tasks.workunit.client.0.smithi134.stdout:9/772: link d3/d9/df/d57/d67/fc7 d3/d9/d37/d6f/d54/d9d/dc0/f101 0 2024-03-22T07:28:48.619 INFO:tasks.workunit.client.0.smithi134.stdout:8/984: rmdir d1/d46 39 2024-03-22T07:28:48.620 INFO:tasks.workunit.client.0.smithi134.stdout:2/828: write d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/fae [796028,121990] 0 2024-03-22T07:28:48.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/823: unlink dc/de/f50 0 2024-03-22T07:28:48.623 INFO:tasks.workunit.client.0.smithi134.stdout:0/824: dread - dc/de/d55/d65/fc6 zero size 2024-03-22T07:28:48.623 INFO:tasks.workunit.client.0.smithi134.stdout:9/773: dread f0 [0,4194304] 0 2024-03-22T07:28:48.632 INFO:tasks.workunit.client.0.smithi134.stdout:8/985: unlink d1/d4/d117/d11a/d20/d41/cf1 0 2024-03-22T07:28:48.632 INFO:tasks.workunit.client.0.smithi134.stdout:8/986: truncate d1/d4/d117/d11a/d2a/fe5 1424998 0 2024-03-22T07:28:48.634 INFO:tasks.workunit.client.0.smithi134.stdout:0/825: mknod dc/de/d55/d60/dee/cff 0 2024-03-22T07:28:48.636 INFO:tasks.workunit.client.0.smithi134.stdout:9/774: unlink d3/d9/d37/d3c/l3e 0 2024-03-22T07:28:48.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/826: mkdir dc/de/d55/d65/dbe/d100 0 2024-03-22T07:28:48.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/827: dread - dc/de/d55/d65/db8/f83 zero size 2024-03-22T07:28:48.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/828: truncate dc/de/d55/d65/fc2 365148 0 2024-03-22T07:28:48.638 INFO:tasks.workunit.client.0.smithi134.stdout:9/775: mknod d3/d9/d37/d3c/d71/d8c/c102 0 2024-03-22T07:28:48.639 INFO:tasks.workunit.client.0.smithi134.stdout:9/776: write d3/f73 [525181,112795] 0 2024-03-22T07:28:48.639 INFO:tasks.workunit.client.0.smithi134.stdout:9/777: read - d3/d9/d37/d5a/dc5/ffb zero size 2024-03-22T07:28:48.641 INFO:tasks.workunit.client.0.smithi134.stdout:9/778: rename d3/d9/d37/d70/ff6 to d3/d9/d37/d5a/d89/f103 0 2024-03-22T07:28:48.642 INFO:tasks.workunit.client.0.smithi134.stdout:9/779: creat d3/d9/d37/d3c/d71/d7a/f104 x:0 0 0 2024-03-22T07:28:48.670 INFO:tasks.workunit.client.0.smithi134.stdout:3/772: dwrite d4/d22/d3c/fbf [0,4194304] 0 2024-03-22T07:28:48.670 INFO:tasks.workunit.client.0.smithi134.stdout:3/773: chown d4/d8/d5c 170415 1 2024-03-22T07:28:48.671 INFO:tasks.workunit.client.0.smithi134.stdout:9/780: dread d3/d9/df/d57/d67/f8a [0,4194304] 0 2024-03-22T07:28:48.681 INFO:tasks.workunit.client.0.smithi134.stdout:2/829: dwrite d2/d5/d8/d5d/d5f/d75/dfd/d4f/fd8 [0,4194304] 0 2024-03-22T07:28:48.682 INFO:tasks.workunit.client.0.smithi134.stdout:2/830: chown d2/d5/d8/d5d/d5f/d75/dfd/l57 2407 1 2024-03-22T07:28:48.682 INFO:tasks.workunit.client.0.smithi134.stdout:2/831: write d2/d5/d22/dbc/d104/f10c [234372,81231] 0 2024-03-22T07:28:48.682 INFO:tasks.workunit.client.0.smithi134.stdout:2/832: truncate d2/d5/d22/dfa/f103 1016622 0 2024-03-22T07:28:48.682 INFO:tasks.workunit.client.0.smithi134.stdout:2/833: creat d2/d5/d8/d7e/dba/f10f x:0 0 0 2024-03-22T07:28:48.682 INFO:tasks.workunit.client.0.smithi134.stdout:3/774: getdents d4/d22/d29/d50 0 2024-03-22T07:28:48.688 INFO:tasks.workunit.client.0.smithi134.stdout:8/987: dwrite d1/d4/d117/d11a/d20/fe4 [0,4194304] 0 2024-03-22T07:28:48.692 INFO:tasks.workunit.client.0.smithi134.stdout:0/829: dwrite dc/d18/d89/da0/fe7 [0,4194304] 0 2024-03-22T07:28:48.693 INFO:tasks.workunit.client.0.smithi134.stdout:8/988: truncate d1/f2e 3376843 0 2024-03-22T07:28:48.693 INFO:tasks.workunit.client.0.smithi134.stdout:8/989: chown d1/d46/d75/d10b 27 1 2024-03-22T07:28:48.694 INFO:tasks.workunit.client.0.smithi134.stdout:9/781: read d3/f1a [1806938,14041] 0 2024-03-22T07:28:48.694 INFO:tasks.workunit.client.0.smithi134.stdout:9/782: fsync d3/d9/f62 0 2024-03-22T07:28:48.706 INFO:tasks.workunit.client.0.smithi134.stdout:3/775: dwrite d4/d10/f5d [0,4194304] 0 2024-03-22T07:28:48.706 INFO:tasks.workunit.client.0.smithi134.stdout:3/776: dread - d4/d22/d29/d50/fe7 zero size 2024-03-22T07:28:48.706 INFO:tasks.workunit.client.0.smithi134.stdout:2/834: dwrite d2/d5/d8/d5d/d5f/d75/dfd/d60/f108 [0,4194304] 0 2024-03-22T07:28:48.710 INFO:tasks.workunit.client.0.smithi134.stdout:8/990: dwrite d1/d4/d117/d11a/d2a/fc1 [0,4194304] 0 2024-03-22T07:28:48.711 INFO:tasks.workunit.client.0.smithi134.stdout:3/777: write f0 [1104069,126041] 0 2024-03-22T07:28:48.713 INFO:tasks.workunit.client.0.smithi134.stdout:2/835: rmdir d2/d5/d8/d7e/dba/dc6 39 2024-03-22T07:28:48.713 INFO:tasks.workunit.client.0.smithi134.stdout:0/830: dread dc/d18/f2f [0,4194304] 0 2024-03-22T07:28:48.715 INFO:tasks.workunit.client.0.smithi134.stdout:3/778: symlink d4/d8/d5c/de6/lec 0 2024-03-22T07:28:48.716 INFO:tasks.workunit.client.0.smithi134.stdout:2/836: dread d2/d5/d22/d99/fa6 [4194304,4194304] 0 2024-03-22T07:28:48.717 INFO:tasks.workunit.client.0.smithi134.stdout:3/779: rename d4/d10/d6c/ld6 to d4/d8/d69/dd7/led 0 2024-03-22T07:28:48.719 INFO:tasks.workunit.client.0.smithi134.stdout:2/837: creat d2/d5/d22/dbc/d104/d10b/f110 x:0 0 0 2024-03-22T07:28:48.719 INFO:tasks.workunit.client.0.smithi134.stdout:8/991: read d1/d4/d117/d11a/f37 [3666538,56510] 0 2024-03-22T07:28:48.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/780: truncate d4/d10/d4b/f74 109288 0 2024-03-22T07:28:48.722 INFO:tasks.workunit.client.0.smithi134.stdout:3/781: mknod d4/d22/d29/dad/cee 0 2024-03-22T07:28:48.724 INFO:tasks.workunit.client.0.smithi134.stdout:2/838: getdents d2/d5/d22/dfa 0 2024-03-22T07:28:48.724 INFO:tasks.workunit.client.0.smithi134.stdout:2/839: truncate d2/d5/d8/d7e/d83/fc7 286832 0 2024-03-22T07:28:48.725 INFO:tasks.workunit.client.0.smithi134.stdout:2/840: unlink d2/d5/d8/d5d/d5f/d75/dfd/d4f/deb/ff9 0 2024-03-22T07:28:48.732 INFO:tasks.workunit.client.0.smithi134.stdout:3/782: dread d4/f48 [0,4194304] 0 2024-03-22T07:28:48.747 INFO:tasks.workunit.client.0.smithi134.stdout:8/992: dwrite d1/d15/d42/d25/d6f/d11e/fac [0,4194304] 0 2024-03-22T07:28:48.751 INFO:tasks.workunit.client.0.smithi134.stdout:2/841: dwrite d2/d5/d8/d5d/f66 [0,4194304] 0 2024-03-22T07:28:48.757 INFO:tasks.workunit.client.0.smithi134.stdout:2/842: dread d2/d5/d22/f5e [0,4194304] 0 2024-03-22T07:28:48.760 INFO:tasks.workunit.client.0.smithi134.stdout:3/783: dwrite d4/d22/d29/f67 [4194304,4194304] 0 2024-03-22T07:28:48.760 INFO:tasks.workunit.client.0.smithi134.stdout:8/993: write d1/d4/d117/d11a/f35 [2883899,27513] 0 2024-03-22T07:28:48.764 INFO:tasks.workunit.client.0.smithi134.stdout:2/843: mknod d2/d5/d8/d31/dd5/c111 0 2024-03-22T07:28:48.770 INFO:tasks.workunit.client.0.smithi134.stdout:3/784: creat d4/d22/d29/d82/fef x:0 0 0 2024-03-22T07:28:48.771 INFO:tasks.workunit.client.0.smithi134.stdout:8/994: write d1/d15/d42/d25/d6f/d11e/f52 [3973173,69618] 0 2024-03-22T07:28:48.778 INFO:tasks.workunit.client.0.smithi134.stdout:2/844: creat d2/f112 x:0 0 0 2024-03-22T07:28:48.782 INFO:tasks.workunit.client.0.smithi134.stdout:3/785: creat d4/d8/ff0 x:0 0 0 2024-03-22T07:28:48.782 INFO:tasks.workunit.client.0.smithi134.stdout:3/786: dread - d4/d10/d6c/f84 zero size 2024-03-22T07:28:48.783 INFO:tasks.workunit.client.0.smithi134.stdout:3/787: dread d4/d8/d23/fbc [0,4194304] 0 2024-03-22T07:28:48.786 INFO:tasks.workunit.client.0.smithi134.stdout:8/995: creat d1/d15/d7b/d83/de3/da2/de6/d13e/f141 x:0 0 0 2024-03-22T07:28:48.788 INFO:tasks.workunit.client.0.smithi134.stdout:8/996: write d1/d46/d75/d8b/db4/fcd [4240828,49464] 0 2024-03-22T07:28:48.789 INFO:tasks.workunit.client.0.smithi134.stdout:2/845: mknod d2/d5/d8/d7e/dba/c113 0 2024-03-22T07:28:48.789 INFO:tasks.workunit.client.0.smithi134.stdout:3/788: symlink d4/d8/d5c/lf1 0 2024-03-22T07:28:48.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/997: symlink d1/d4/l142 0 2024-03-22T07:28:48.795 INFO:tasks.workunit.client.0.smithi134.stdout:8/998: creat d1/d4/d61/f143 x:0 0 0 2024-03-22T07:28:48.802 INFO:tasks.workunit.client.0.smithi134.stdout:3/789: rename d4/d10/d6c to d4/d8/d5c/de6/df2 0 2024-03-22T07:28:48.819 INFO:tasks.workunit.client.0.smithi134.stdout:8/999: dwrite d1/d15/d42/d76/de1/f115 [0,4194304] 0 2024-03-22T07:28:48.882 INFO:tasks.workunit.client.0.smithi134.stdout:3/790: mknod d4/d10/d4b/cf3 0 2024-03-22T07:28:48.882 INFO:tasks.workunit.client.0.smithi134.stdout:3/791: dread - d4/d8/d5c/fea zero size 2024-03-22T07:28:48.933 INFO:tasks.workunit.client.0.smithi134.stdout:4/832: sync 2024-03-22T07:28:48.947 INFO:tasks.workunit.client.0.smithi134.stdout:4/833: dwrite d2/d25/d48/d6e/d7b/dd7/fe2 [0,4194304] 0 2024-03-22T07:28:48.965 INFO:tasks.workunit.client.0.smithi134.stdout:4/834: dwrite d2/d25/d74/dde/dc0/de5/ffb [0,4194304] 0 2024-03-22T07:28:48.965 INFO:tasks.workunit.client.0.smithi134.stdout:4/835: truncate d2/d2a/d80/d85/f88 421795 0 2024-03-22T07:28:48.980 INFO:tasks.workunit.client.0.smithi134.stdout:4/836: dwrite d2/d15/d35/fb9 [0,4194304] 0 2024-03-22T07:28:48.980 INFO:tasks.workunit.client.0.smithi134.stdout:4/837: fsync d2/d2a/d93/f115 0 2024-03-22T07:28:48.992 INFO:tasks.workunit.client.0.smithi134.stdout:3/792: rmdir d4/d22 39 2024-03-22T07:28:49.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/838: truncate d2/f71 338868 0 2024-03-22T07:28:49.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/839: fsync d2/d2a/d93/f115 0 2024-03-22T07:28:49.002 INFO:tasks.workunit.client.0.smithi134.stdout:4/840: readlink d2/d25/d74/dde/l68 0 2024-03-22T07:28:49.094 INFO:tasks.workunit.client.0.smithi134.stdout:3/793: creat d4/d10/ff4 x:0 0 0 2024-03-22T07:28:49.095 INFO:tasks.workunit.client.0.smithi134.stdout:3/794: write d4/d8/d5c/fea [34746,58698] 0 2024-03-22T07:28:49.095 INFO:tasks.workunit.client.0.smithi134.stdout:3/795: chown d4/d22/d3c/ca7 18685 1 2024-03-22T07:28:49.095 INFO:tasks.workunit.client.0.smithi134.stdout:3/796: chown d4/d22/d29/f67 165 1 2024-03-22T07:28:49.095 INFO:tasks.workunit.client.0.smithi134.stdout:3/797: mknod d4/d8/d69/d6a/db8/cf5 0 2024-03-22T07:28:49.095 INFO:tasks.workunit.client.0.smithi134.stdout:3/798: rename d4/d8/d45/da9/lb5 to d4/d10/d4b/lf6 0 2024-03-22T07:28:49.102 INFO:tasks.workunit.client.0.smithi134.stdout:3/799: write d4/d22/d3c/f73 [3823790,28247] 0 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:2/846: sync 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:1/853: sync 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/831: sync 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:9/783: sync 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:6/736: sync 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:6/737: readlink d2/l40 0 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:0/832: creat dc/de/d55/d65/d82/db7/f101 x:0 0 0 2024-03-22T07:28:49.176 INFO:tasks.workunit.client.0.smithi134.stdout:5/882: sync 2024-03-22T07:28:49.179 INFO:tasks.workunit.client.0.smithi134.stdout:1/854: rename d5/d93/f114 to d5/f133 0 2024-03-22T07:28:49.179 INFO:tasks.workunit.client.0.smithi134.stdout:1/855: chown d5/da/d13/d1e/d45/lfb 6910 1 2024-03-22T07:28:49.183 INFO:tasks.workunit.client.0.smithi134.stdout:5/883: creat d1/d8/d20/d8a/f123 x:0 0 0 2024-03-22T07:28:49.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/738: rename d2/d1b/d4d/cc5 to d2/d1b/c107 0 2024-03-22T07:28:49.185 INFO:tasks.workunit.client.0.smithi134.stdout:6/739: chown d2/d1b/d4d/da5/dec/l51 3264 1 2024-03-22T07:28:49.190 INFO:tasks.workunit.client.0.smithi134.stdout:6/740: dread d2/d1b/d4d/da5/dec/d28/f20 [0,4194304] 0 2024-03-22T07:28:49.190 INFO:tasks.workunit.client.0.smithi134.stdout:0/833: symlink dc/de/l102 0 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:1/856: rmdir d5/da/d13/d1e/d62 39 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:1/857: fdatasync d5/d1d/dd0/ddc/d113/d39/da4/fb8 0 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:1/858: fsync d5/fe 0 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:1/859: truncate d5/da/d13/d1e/d63/f97 8513315 0 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:2/847: write d2/d5/d8/d7e/dba/fcf [3925128,48798] 0 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:9/784: dwrite f0 [0,4194304] 0 2024-03-22T07:28:49.192 INFO:tasks.workunit.client.0.smithi134.stdout:2/848: chown d2/d5/d8/d7e/dba/c113 105560031 1 2024-03-22T07:28:49.193 INFO:tasks.workunit.client.0.smithi134.stdout:1/860: creat d5/da/d13/d1e/d34/db5/f134 x:0 0 0 2024-03-22T07:28:49.194 INFO:tasks.workunit.client.0.smithi134.stdout:1/861: write d5/d1d/f90 [4550825,126893] 0 2024-03-22T07:28:49.194 INFO:tasks.workunit.client.0.smithi134.stdout:1/862: read d5/da/d13/d1e/d34/f59 [3323549,78167] 0 2024-03-22T07:28:49.197 INFO:tasks.workunit.client.0.smithi134.stdout:9/785: rename d3/d9/df/d12/c92 to d3/d9/df/db3/c105 0 2024-03-22T07:28:49.198 INFO:tasks.workunit.client.0.smithi134.stdout:1/863: creat d5/d1d/dd0/ddc/d113/d60/f135 x:0 0 0 2024-03-22T07:28:49.201 INFO:tasks.workunit.client.0.smithi134.stdout:9/786: link d3/d9/d37/d6f/d54/fbf d3/d9/df/d12/dd7/f106 0 2024-03-22T07:28:49.201 INFO:tasks.workunit.client.0.smithi134.stdout:9/787: write d3/fa3 [375130,27260] 0 2024-03-22T07:28:49.201 INFO:tasks.workunit.client.0.smithi134.stdout:9/788: chown d3/d9/d37/d3c/d71/fe2 0 1 2024-03-22T07:28:49.201 INFO:tasks.workunit.client.0.smithi134.stdout:9/789: chown d3/d9/df/d57 787 1 2024-03-22T07:28:49.204 INFO:tasks.workunit.client.0.smithi134.stdout:9/790: mkdir d3/d9/d37/d5a/d107 0 2024-03-22T07:28:49.204 INFO:tasks.workunit.client.0.smithi134.stdout:9/791: write d3/d9/d37/d70/fdf [1080739,70783] 0 2024-03-22T07:28:49.206 INFO:tasks.workunit.client.0.smithi134.stdout:1/864: dread d5/da/f86 [0,4194304] 0 2024-03-22T07:28:49.207 INFO:tasks.workunit.client.0.smithi134.stdout:1/865: write d5/da/d13/d1e/d9b/f9f [508048,70441] 0 2024-03-22T07:28:49.207 INFO:tasks.workunit.client.0.smithi134.stdout:1/866: write d5/da/d13/dac/ffa [740617,3943] 0 2024-03-22T07:28:49.208 INFO:tasks.workunit.client.0.smithi134.stdout:5/884: dwrite d1/d8/dc5/dd6/dfc/d11c/dac/fdd [0,4194304] 0 2024-03-22T07:28:49.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/885: creat d1/d8/dc5/dd6/dfc/d107/f124 x:0 0 0 2024-03-22T07:28:49.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/886: chown d1/d8/d20/d8a/ffe 3 1 2024-03-22T07:28:49.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/887: write d1/d8/da1/fc1 [104142,115956] 0 2024-03-22T07:28:49.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/888: chown d1 6100106 1 2024-03-22T07:28:49.214 INFO:tasks.workunit.client.0.smithi134.stdout:5/889: write d1/da0/fe9 [599819,43253] 0 2024-03-22T07:28:49.215 INFO:tasks.workunit.client.0.smithi134.stdout:5/890: creat d1/d8/f125 x:0 0 0 2024-03-22T07:28:49.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/849: dread d2/f58 [0,4194304] 0 2024-03-22T07:28:49.217 INFO:tasks.workunit.client.0.smithi134.stdout:2/850: link d2/d5/d8/d5d/d5f/d75/dfd/d60/fa7 d2/d5/d22/d99/f114 0 2024-03-22T07:28:49.218 INFO:tasks.workunit.client.0.smithi134.stdout:5/891: mknod d1/d8/d20/d62/c126 0 2024-03-22T07:28:49.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/851: mknod d2/de5/c115 0 2024-03-22T07:28:49.219 INFO:tasks.workunit.client.0.smithi134.stdout:5/892: creat d1/d8/d16/f127 x:0 0 0 2024-03-22T07:28:49.224 INFO:tasks.workunit.client.0.smithi134.stdout:9/792: write d3/d9/d37/d6f/f2e [3752444,122097] 0 2024-03-22T07:28:49.231 INFO:tasks.workunit.client.0.smithi134.stdout:9/793: dread d3/d9/df/d12/f1f [0,4194304] 0 2024-03-22T07:28:49.231 INFO:tasks.workunit.client.0.smithi134.stdout:9/794: write d3/d9/df/fc8 [1207591,107898] 0 2024-03-22T07:28:49.270 INFO:tasks.workunit.client.0.smithi134.stdout:2/852: mknod d2/d5/d8/d5d/d5f/d75/c116 0 2024-03-22T07:28:49.273 INFO:tasks.workunit.client.0.smithi134.stdout:5/893: symlink d1/d8/da1/db0/l128 0 2024-03-22T07:28:49.273 INFO:tasks.workunit.client.0.smithi134.stdout:5/894: chown d1/d8/dc5/dd6/dfc/d11c/f64 22451971 1 2024-03-22T07:28:49.277 INFO:tasks.workunit.client.0.smithi134.stdout:2/853: creat d2/de5/f117 x:0 0 0 2024-03-22T07:28:49.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:49 smithi134 ceph-mon[29057]: pgmap v10: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 224 MiB/s rd, 267 MiB/s wr, 398 op/s 2024-03-22T07:28:49.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:49 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:49.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:49 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:49.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:49 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:49.367 INFO:tasks.workunit.client.0.smithi134.stdout:6/741: dwrite d2/d1b/f104 [0,4194304] 0 2024-03-22T07:28:49.367 INFO:tasks.workunit.client.0.smithi134.stdout:6/742: stat d2/d1b/d1d/d5e/d63/fa2 0 2024-03-22T07:28:49.372 INFO:tasks.workunit.client.0.smithi134.stdout:6/743: creat d2/d1b/d4d/da5/f108 x:0 0 0 2024-03-22T07:28:49.377 INFO:tasks.workunit.client.0.smithi134.stdout:6/744: mknod d2/d1b/d1d/d5e/d84/c109 0 2024-03-22T07:28:49.377 INFO:tasks.workunit.client.0.smithi134.stdout:6/745: chown d2/d1b/d4d/da5/dec/d28/d97 1 1 2024-03-22T07:28:49.377 INFO:tasks.workunit.client.0.smithi134.stdout:6/746: stat d2/d1b/d4d/da5/dec/d28/fc4 0 2024-03-22T07:28:49.383 INFO:tasks.workunit.client.0.smithi134.stdout:0/834: dwrite dc/d17/f78 [0,4194304] 0 2024-03-22T07:28:49.383 INFO:tasks.workunit.client.0.smithi134.stdout:5/895: dwrite d1/d8/dc5/dd6/dfc/d11c/f43 [0,4194304] 0 2024-03-22T07:28:49.384 INFO:tasks.workunit.client.0.smithi134.stdout:1/867: dwrite d5/d1d/d49/f8a [0,4194304] 0 2024-03-22T07:28:49.384 INFO:tasks.workunit.client.0.smithi134.stdout:1/868: write d5/da/d13/d1e/d9b/f9f [36646,16825] 0 2024-03-22T07:28:49.384 INFO:tasks.workunit.client.0.smithi134.stdout:1/869: dread - d5/da/d13/d1e/d63/fad zero size 2024-03-22T07:28:49.384 INFO:tasks.workunit.client.0.smithi134.stdout:1/870: chown d5/da/d13/db9/fba 331252 1 2024-03-22T07:28:49.390 INFO:tasks.workunit.client.0.smithi134.stdout:0/835: creat dc/de/d55/d65/db8/f103 x:0 0 0 2024-03-22T07:28:49.391 INFO:tasks.workunit.client.0.smithi134.stdout:0/836: chown dc/d17/ce0 32036597 1 2024-03-22T07:28:49.391 INFO:tasks.workunit.client.0.smithi134.stdout:0/837: stat dc/d18/d89/da0/le3 0 2024-03-22T07:28:49.392 INFO:tasks.workunit.client.0.smithi134.stdout:5/896: rename d1/d8/dc5/da2/ca8 to d1/d8/d16/dbd/dc0/c129 0 2024-03-22T07:28:49.395 INFO:tasks.workunit.client.0.smithi134.stdout:1/871: read d5/da/f12a [207465,98123] 0 2024-03-22T07:28:49.396 INFO:tasks.workunit.client.0.smithi134.stdout:6/747: dwrite d2/d1b/d4d/da5/f108 [0,4194304] 0 2024-03-22T07:28:49.396 INFO:tasks.workunit.client.0.smithi134.stdout:0/838: truncate dc/de/d55/d60/fe2 745417 0 2024-03-22T07:28:49.401 INFO:tasks.workunit.client.0.smithi134.stdout:6/748: rename d2/d1b/d1d/d5e/d84/c109 to d2/d1b/daa/dc1/c10a 0 2024-03-22T07:28:49.402 INFO:tasks.workunit.client.0.smithi134.stdout:1/872: write d5/d1d/f76 [697707,81377] 0 2024-03-22T07:28:49.403 INFO:tasks.workunit.client.0.smithi134.stdout:0/839: mkdir dc/de/d55/de1/d104 0 2024-03-22T07:28:49.407 INFO:tasks.workunit.client.0.smithi134.stdout:6/749: dread d2/d1b/d4d/f90 [0,4194304] 0 2024-03-22T07:28:49.409 INFO:tasks.workunit.client.0.smithi134.stdout:1/873: creat d5/da/d1b/f136 x:0 0 0 2024-03-22T07:28:49.411 INFO:tasks.workunit.client.0.smithi134.stdout:0/840: rmdir dc/de/d55/de1/de8 0 2024-03-22T07:28:49.413 INFO:tasks.workunit.client.0.smithi134.stdout:1/874: stat d5/d1d/d2d/l5e 0 2024-03-22T07:28:49.413 INFO:tasks.workunit.client.0.smithi134.stdout:1/875: creat d5/da/d13/d1e/d9b/f137 x:0 0 0 2024-03-22T07:28:49.413 INFO:tasks.workunit.client.0.smithi134.stdout:1/876: chown d5/da/d13/d1e/d45/f7f 3 1 2024-03-22T07:28:49.417 INFO:tasks.workunit.client.0.smithi134.stdout:6/750: dread d2/f94 [0,4194304] 0 2024-03-22T07:28:49.417 INFO:tasks.workunit.client.0.smithi134.stdout:6/751: write d2/d1b/f6c [3006178,73845] 0 2024-03-22T07:28:49.418 INFO:tasks.workunit.client.0.smithi134.stdout:1/877: creat d5/d1d/dd0/ddc/de3/df6/d12b/f138 x:0 0 0 2024-03-22T07:28:49.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/878: chown d5/d1d/fa9 144848 1 2024-03-22T07:28:49.419 INFO:tasks.workunit.client.0.smithi134.stdout:1/879: readlink d5/da/d13/d1e/d45/lfb 0 2024-03-22T07:28:49.427 INFO:tasks.workunit.client.0.smithi134.stdout:6/752: dread d2/d1b/d1d/d5e/f70 [0,4194304] 0 2024-03-22T07:28:49.430 INFO:tasks.workunit.client.0.smithi134.stdout:6/753: mkdir d2/d6e/d105/d10b 0 2024-03-22T07:28:49.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/754: write d2/d1b/d1d/ff8 [161750,93954] 0 2024-03-22T07:28:49.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/755: chown d2/d1b/d1d/d5e/d6f/dd7/cb1 7148 1 2024-03-22T07:28:49.431 INFO:tasks.workunit.client.0.smithi134.stdout:6/756: mkdir d2/d6e/d105/d10c 0 2024-03-22T07:28:49.444 INFO:tasks.workunit.client.0.smithi134.stdout:1/880: dwrite d5/da/d13/d1e/d9b/f137 [0,4194304] 0 2024-03-22T07:28:49.444 INFO:tasks.workunit.client.0.smithi134.stdout:0/841: dwrite dc/de/d55/f63 [0,4194304] 0 2024-03-22T07:28:49.448 INFO:tasks.workunit.client.0.smithi134.stdout:1/881: link d5/da/d13/l4c d5/da/d13/d1e/d45/l139 0 2024-03-22T07:28:49.448 INFO:tasks.workunit.client.0.smithi134.stdout:1/882: fdatasync d5/d1d/d2d/f6f 0 2024-03-22T07:28:49.450 INFO:tasks.workunit.client.0.smithi134.stdout:6/757: dwrite d2/d1b/d4d/da5/dec/d28/f7e [4194304,4194304] 0 2024-03-22T07:28:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:49 smithi195 ceph-mon[36144]: pgmap v10: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 224 MiB/s rd, 267 MiB/s wr, 398 op/s 2024-03-22T07:28:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:49 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:49 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:49 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:28:49.455 INFO:tasks.workunit.client.0.smithi134.stdout:6/758: symlink d2/d6e/d105/l10d 0 2024-03-22T07:28:49.456 INFO:tasks.workunit.client.0.smithi134.stdout:0/842: dread dc/d18/d85/fb9 [0,4194304] 0 2024-03-22T07:28:49.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/759: stat d2/le 0 2024-03-22T07:28:49.460 INFO:tasks.workunit.client.0.smithi134.stdout:6/760: dread d2/d1b/d4d/f90 [0,4194304] 0 2024-03-22T07:28:49.460 INFO:tasks.workunit.client.0.smithi134.stdout:0/843: rename dc/de/d55/d65 to dc/d17/da7/d105 0 2024-03-22T07:28:49.460 INFO:tasks.workunit.client.0.smithi134.stdout:0/844: write dc/f8d [1404618,20001] 0 2024-03-22T07:28:49.465 INFO:tasks.workunit.client.0.smithi134.stdout:0/845: link dc/de/f4f dc/d17/da9/f106 0 2024-03-22T07:28:49.465 INFO:tasks.workunit.client.0.smithi134.stdout:0/846: dread - dc/d18/d85/fe9 zero size 2024-03-22T07:28:49.467 INFO:tasks.workunit.client.0.smithi134.stdout:6/761: write d2/d1b/d4d/da5/fe5 [103052,128354] 0 2024-03-22T07:28:49.467 INFO:tasks.workunit.client.0.smithi134.stdout:6/762: creat d2/d6e/f10e x:0 0 0 2024-03-22T07:28:49.468 INFO:tasks.workunit.client.0.smithi134.stdout:0/847: mkdir dc/d17/da7/d105/db8/d107 0 2024-03-22T07:28:49.473 INFO:tasks.workunit.client.0.smithi134.stdout:6/763: mknod d2/d1b/d4d/da5/dec/d28/d97/c10f 0 2024-03-22T07:28:49.476 INFO:tasks.workunit.client.0.smithi134.stdout:0/848: rename dc/c69 to dc/d17/da9/ddf/c108 0 2024-03-22T07:28:49.476 INFO:tasks.workunit.client.0.smithi134.stdout:0/849: truncate dc/d17/da7/d105/db8/fa2 4702812 0 2024-03-22T07:28:49.479 INFO:tasks.workunit.client.0.smithi134.stdout:0/850: mknod dc/de/d55/d60/c109 0 2024-03-22T07:28:49.481 INFO:tasks.workunit.client.0.smithi134.stdout:6/764: rmdir d2/d1b/d1d/d5e/d84 39 2024-03-22T07:28:49.482 INFO:tasks.workunit.client.0.smithi134.stdout:0/851: creat dc/d17/da7/d105/db8/f10a x:0 0 0 2024-03-22T07:28:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:6/765: creat d2/d1b/d1d/d5e/d84/f110 x:0 0 0 2024-03-22T07:28:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:6/766: readlink d2/d1b/l4a 0 2024-03-22T07:28:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:6/767: dread - d2/d1b/d1d/d5e/d84/fe6 zero size 2024-03-22T07:28:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:6/768: stat d2/d1b/d4d/f90 0 2024-03-22T07:28:49.486 INFO:tasks.workunit.client.0.smithi134.stdout:6/769: write d2/d1b/d1d/d5e/d84/fe6 [527001,10842] 0 2024-03-22T07:28:49.487 INFO:tasks.workunit.client.0.smithi134.stdout:0/852: mknod dc/de/d55/de1/c10b 0 2024-03-22T07:28:49.487 INFO:tasks.workunit.client.0.smithi134.stdout:6/770: rmdir d2/d6e/d105 39 2024-03-22T07:28:49.487 INFO:tasks.workunit.client.0.smithi134.stdout:6/771: write d2/d1b/d4d/fbd [1045360,68063] 0 2024-03-22T07:28:49.487 INFO:tasks.workunit.client.0.smithi134.stdout:6/772: readlink d2/d1b/d1d/d5e/d6f/da8/dca/ldc 0 2024-03-22T07:28:49.489 INFO:tasks.workunit.client.0.smithi134.stdout:0/853: rename dc/d17/da7/d105/dbe/fc0 to dc/de/d55/f10c 0 2024-03-22T07:28:49.489 INFO:tasks.workunit.client.0.smithi134.stdout:6/773: truncate d2/d1b/d4d/f74 3721604 0 2024-03-22T07:28:49.492 INFO:tasks.workunit.client.0.smithi134.stdout:6/774: creat d2/d1b/d8f/f111 x:0 0 0 2024-03-22T07:28:49.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/775: getdents d2/d1b/d1d/d5e/d84 0 2024-03-22T07:28:49.499 INFO:tasks.workunit.client.0.smithi134.stdout:6/776: readlink d2/d6e/d105/l10d 0 2024-03-22T07:28:49.509 INFO:tasks.workunit.client.0.smithi134.stdout:0/854: dwrite dc/d17/f7f [0,4194304] 0 2024-03-22T07:28:49.510 INFO:tasks.workunit.client.0.smithi134.stdout:6/777: read d2/d1b/d1d/d5e/d6f/da8/dca/fcf [3035127,116809] 0 2024-03-22T07:28:49.513 INFO:tasks.workunit.client.0.smithi134.stdout:0/855: mknod dc/d17/da7/d105/df3/c10d 0 2024-03-22T07:28:49.513 INFO:tasks.workunit.client.0.smithi134.stdout:0/856: fdatasync dc/d17/f7f 0 2024-03-22T07:28:49.514 INFO:tasks.workunit.client.0.smithi134.stdout:0/857: rename dc/d17/da7/d105/db8/f10a to dc/d17/da7/f10e 0 2024-03-22T07:28:49.517 INFO:tasks.workunit.client.0.smithi134.stdout:0/858: creat dc/d17/da7/f10f x:0 0 0 2024-03-22T07:28:49.519 INFO:tasks.workunit.client.0.smithi134.stdout:0/859: mknod dc/d17/da7/d105/dbe/d100/c110 0 2024-03-22T07:28:49.527 INFO:tasks.workunit.client.0.smithi134.stdout:0/860: dread dc/de/d55/f56 [0,4194304] 0 2024-03-22T07:28:49.528 INFO:tasks.workunit.client.0.smithi134.stdout:6/778: dwrite d2/d6e/fc8 [0,4194304] 0 2024-03-22T07:28:49.528 INFO:tasks.workunit.client.0.smithi134.stdout:0/861: mkdir dc/de/dc9/d111 0 2024-03-22T07:28:49.528 INFO:tasks.workunit.client.0.smithi134.stdout:0/862: fdatasync dc/d17/da7/d105/fc2 0 2024-03-22T07:28:49.533 INFO:tasks.workunit.client.0.smithi134.stdout:6/779: creat d2/d1b/d1d/d5e/d6f/d7d/f112 x:0 0 0 2024-03-22T07:28:49.538 INFO:tasks.workunit.client.0.smithi134.stdout:6/780: creat d2/d1b/d1d/d5e/d84/f113 x:0 0 0 2024-03-22T07:28:49.538 INFO:tasks.workunit.client.0.smithi134.stdout:6/781: readlink d2/d1b/d1d/d5e/d84/l101 0 2024-03-22T07:28:49.538 INFO:tasks.workunit.client.0.smithi134.stdout:6/782: chown d2/d1b/d1d/d5e/d63/l9a 101102577 1 2024-03-22T07:28:49.541 INFO:tasks.workunit.client.0.smithi134.stdout:6/783: mknod d2/d1b/d1d/d5e/d6f/da8/c114 0 2024-03-22T07:28:49.550 INFO:tasks.workunit.client.0.smithi134.stdout:0/863: dwrite dc/f34 [0,4194304] 0 2024-03-22T07:28:49.550 INFO:tasks.workunit.client.0.smithi134.stdout:0/864: fdatasync dc/d17/da7/d105/fa4 0 2024-03-22T07:28:49.558 INFO:tasks.workunit.client.0.smithi134.stdout:0/865: dread dc/f34 [0,4194304] 0 2024-03-22T07:28:49.560 INFO:tasks.workunit.client.0.smithi134.stdout:6/784: creat d2/d1b/d4d/d65/f115 x:0 0 0 2024-03-22T07:28:49.571 INFO:tasks.workunit.client.0.smithi134.stdout:0/866: symlink dc/d17/da7/d105/dbe/d100/l112 0 2024-03-22T07:28:49.571 INFO:tasks.workunit.client.0.smithi134.stdout:0/867: getdents dc/de/dc9/d111 0 2024-03-22T07:28:49.573 INFO:tasks.workunit.client.0.smithi134.stdout:6/785: mknod d2/d1b/d1d/d5e/d6f/d7d/c116 0 2024-03-22T07:28:49.573 INFO:tasks.workunit.client.0.smithi134.stdout:6/786: read - d2/d1b/d1d/f106 zero size 2024-03-22T07:28:49.575 INFO:tasks.workunit.client.0.smithi134.stdout:6/787: truncate d2/d1b/d4d/f90 1303417 0 2024-03-22T07:28:49.579 INFO:tasks.workunit.client.0.smithi134.stdout:0/868: read dc/de/d55/f9a [443371,89514] 0 2024-03-22T07:28:49.584 INFO:tasks.workunit.client.0.smithi134.stdout:6/788: dread d2/d1b/d4d/da5/f108 [0,4194304] 0 2024-03-22T07:28:49.585 INFO:tasks.workunit.client.0.smithi134.stdout:0/869: dread dc/d18/f1d [0,4194304] 0 2024-03-22T07:28:49.585 INFO:tasks.workunit.client.0.smithi134.stdout:0/870: truncate dc/d17/da7/d105/fc6 675841 0 2024-03-22T07:28:49.585 INFO:tasks.workunit.client.0.smithi134.stdout:0/871: stat dc/d17/da7/d105/d82/db7 0 2024-03-22T07:28:49.586 INFO:tasks.workunit.client.0.smithi134.stdout:6/789: creat d2/d1b/d1d/d5e/d6f/d7d/f117 x:0 0 0 2024-03-22T07:28:49.586 INFO:tasks.workunit.client.0.smithi134.stdout:6/790: creat d2/d1b/d1d/d5e/d6f/dd7/f118 x:0 0 0 2024-03-22T07:28:49.587 INFO:tasks.workunit.client.0.smithi134.stdout:0/872: mkdir dc/d17/da7/d105/dbe/d113 0 2024-03-22T07:28:49.591 INFO:tasks.workunit.client.0.smithi134.stdout:6/791: mknod d2/d1b/d8f/c119 0 2024-03-22T07:28:49.592 INFO:tasks.workunit.client.0.smithi134.stdout:6/792: read - d2/d1b/d1d/d5e/d6f/da8/ffd zero size 2024-03-22T07:28:49.594 INFO:tasks.workunit.client.0.smithi134.stdout:6/793: creat d2/d1b/d1d/d5e/d6f/da8/dca/f11a x:0 0 0 2024-03-22T07:28:49.595 INFO:tasks.workunit.client.0.smithi134.stdout:0/873: dread dc/d18/d89/f99 [0,4194304] 0 2024-03-22T07:28:49.598 INFO:tasks.workunit.client.0.smithi134.stdout:0/874: getdents dc/de/dc9/dd0/ddb 0 2024-03-22T07:28:49.600 INFO:tasks.workunit.client.0.smithi134.stdout:0/875: creat dc/d17/da7/d105/d82/f114 x:0 0 0 2024-03-22T07:28:49.601 INFO:tasks.workunit.client.0.smithi134.stdout:0/876: read f5 [1234562,66113] 0 2024-03-22T07:28:49.609 INFO:tasks.workunit.client.0.smithi134.stdout:6/794: dwrite d2/d1b/d4d/da5/dec/d28/fc4 [0,4194304] 0 2024-03-22T07:28:49.611 INFO:tasks.workunit.client.0.smithi134.stdout:6/795: dread d2/d1b/d4d/da5/fe0 [0,4194304] 0 2024-03-22T07:28:49.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/877: dwrite dc/d18/d89/f99 [0,4194304] 0 2024-03-22T07:28:49.620 INFO:tasks.workunit.client.0.smithi134.stdout:0/878: getdents dc 0 2024-03-22T07:28:49.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/879: getdents dc/de/d55/d60 0 2024-03-22T07:28:49.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/880: dread - dc/f6b zero size 2024-03-22T07:28:49.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/881: chown dc/d17/fb3 56626136 1 2024-03-22T07:28:49.622 INFO:tasks.workunit.client.0.smithi134.stdout:0/882: readlink dc/de/d55/lef 0 2024-03-22T07:28:49.623 INFO:tasks.workunit.client.0.smithi134.stdout:6/796: dread d2/f1c [4194304,4194304] 0 2024-03-22T07:28:49.623 INFO:tasks.workunit.client.0.smithi134.stdout:6/797: read d2/d1b/d4d/f90 [586456,129418] 0 2024-03-22T07:28:49.623 INFO:tasks.workunit.client.0.smithi134.stdout:0/883: symlink dc/de/d55/d60/dee/l115 0 2024-03-22T07:28:49.625 INFO:tasks.workunit.client.0.smithi134.stdout:6/798: creat d2/d1b/daa/dc1/f11b x:0 0 0 2024-03-22T07:28:49.627 INFO:tasks.workunit.client.0.smithi134.stdout:6/799: mknod d2/d1b/c11c 0 2024-03-22T07:28:49.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/884: write dc/de/dc9/fcf [7170304,104543] 0 2024-03-22T07:28:49.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/885: write dc/de/d55/f56 [5731982,20122] 0 2024-03-22T07:28:49.631 INFO:tasks.workunit.client.0.smithi134.stdout:0/886: readlink dc/de/d55/d60/dee/l115 0 2024-03-22T07:28:49.632 INFO:tasks.workunit.client.0.smithi134.stdout:0/887: dread dc/d17/da7/d105/db8/f7d [0,4194304] 0 2024-03-22T07:28:49.634 INFO:tasks.workunit.client.0.smithi134.stdout:0/888: unlink dc/l11 0 2024-03-22T07:28:49.635 INFO:tasks.workunit.client.0.smithi134.stdout:0/889: readlink dc/de/l4b 0 2024-03-22T07:28:49.635 INFO:tasks.workunit.client.0.smithi134.stdout:6/800: read d2/fdb [3376274,63516] 0 2024-03-22T07:28:49.637 INFO:tasks.workunit.client.0.smithi134.stdout:0/890: rename dc/d18/f8e to dc/de/d55/d60/f116 0 2024-03-22T07:28:49.637 INFO:tasks.workunit.client.0.smithi134.stdout:4/841: sync 2024-03-22T07:28:49.637 INFO:tasks.workunit.client.0.smithi134.stdout:4/842: creat d2/d2a/d93/f11e x:0 0 0 2024-03-22T07:28:49.638 INFO:tasks.workunit.client.0.smithi134.stdout:6/801: mknod d2/d1b/d1d/d5e/c11d 0 2024-03-22T07:28:49.642 INFO:tasks.workunit.client.0.smithi134.stdout:4/843: creat d2/d15/d35/da8/dec/f11f x:0 0 0 2024-03-22T07:28:49.643 INFO:tasks.workunit.client.0.smithi134.stdout:6/802: truncate d2/fb4 5625742 0 2024-03-22T07:28:49.645 INFO:tasks.workunit.client.0.smithi134.stdout:4/844: mkdir d2/d25/d74/dde/dc0/de5/d120 0 2024-03-22T07:28:49.646 INFO:tasks.workunit.client.0.smithi134.stdout:6/803: symlink d2/d6e/l11e 0 2024-03-22T07:28:49.648 INFO:tasks.workunit.client.0.smithi134.stdout:0/891: write dc/de/f23 [2384438,20635] 0 2024-03-22T07:28:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/845: creat d2/d2a/d80/d101/f121 x:0 0 0 2024-03-22T07:28:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/846: chown d2/d2a/d80/f94 3145 1 2024-03-22T07:28:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/847: readlink d2/d25/d74/dde/l5a 0 2024-03-22T07:28:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/848: rename d2 to d2/d25/d74/dde/dc0/de5/d120/d122 22 2024-03-22T07:28:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/849: fdatasync d2/d25/d48/dd3/f89 0 2024-03-22T07:28:49.649 INFO:tasks.workunit.client.0.smithi134.stdout:4/850: write d2/d2a/d50/f5c [3503946,87414] 0 2024-03-22T07:28:49.652 INFO:tasks.workunit.client.0.smithi134.stdout:0/892: creat dc/d17/da7/d105/db8/d107/f117 x:0 0 0 2024-03-22T07:28:49.657 INFO:tasks.workunit.client.0.smithi134.stdout:4/851: dread d2/d25/d48/dd3/fb7 [0,4194304] 0 2024-03-22T07:28:49.664 INFO:tasks.workunit.client.0.smithi134.stdout:4/852: unlink d2/d25/d48/l7a 0 2024-03-22T07:28:49.664 INFO:tasks.workunit.client.0.smithi134.stdout:6/804: dwrite d2/d1b/d1d/d5e/d63/f9b [0,4194304] 0 2024-03-22T07:28:49.664 INFO:tasks.workunit.client.0.smithi134.stdout:6/805: readlink d2/d1b/d4d/da5/dec/d28/l103 0 2024-03-22T07:28:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/806: mknod d2/c11f 0 2024-03-22T07:28:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/807: stat d2/d1b/daa/fc9 0 2024-03-22T07:28:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/808: dread - d2/d1b/d1d/d5e/d6f/d7d/fe1 zero size 2024-03-22T07:28:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/809: write d2/f4b [677987,119407] 0 2024-03-22T07:28:49.670 INFO:tasks.workunit.client.0.smithi134.stdout:6/810: write d2/d1b/d1d/d5e/d6f/da8/dca/f9f [25717,99059] 0 2024-03-22T07:28:49.671 INFO:tasks.workunit.client.0.smithi134.stdout:0/893: dwrite dc/f8d [0,4194304] 0 2024-03-22T07:28:49.680 INFO:tasks.workunit.client.0.smithi134.stdout:0/894: creat dc/d17/da7/d105/d82/db7/f118 x:0 0 0 2024-03-22T07:28:49.682 INFO:tasks.workunit.client.0.smithi134.stdout:4/853: dwrite d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:49.682 INFO:tasks.workunit.client.0.smithi134.stdout:4/854: dread - d2/d2a/d80/dd6/f91 zero size 2024-03-22T07:28:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/895: symlink dc/d17/da9/l119 0 2024-03-22T07:28:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/896: fdatasync dc/d18/d85/fe9 0 2024-03-22T07:28:49.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/897: truncate dc/d18/d89/da0/fc3 461073 0 2024-03-22T07:28:49.689 INFO:tasks.workunit.client.0.smithi134.stdout:6/811: dwrite d2/d1b/d1d/d5e/f8d [4194304,4194304] 0 2024-03-22T07:28:49.698 INFO:tasks.workunit.client.0.smithi134.stdout:6/812: dread d2/d1b/d4d/da5/dec/d28/f7e [4194304,4194304] 0 2024-03-22T07:28:49.699 INFO:tasks.workunit.client.0.smithi134.stdout:4/855: dwrite d2/d25/d74/f75 [0,4194304] 0 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/856: mkdir d2/d25/d74/dde/d123 0 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/857: dread - d2/d2a/d93/f11e zero size 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/858: stat d2/d15/d6f 0 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/859: truncate d2/d25/d74/dde/dc0/de5/ffb 4522067 0 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/860: chown d2/d2a/d93/f115 566609858 1 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/861: write d2/d2a/d93/f11e [295203,26349] 0 2024-03-22T07:28:49.705 INFO:tasks.workunit.client.0.smithi134.stdout:4/862: fdatasync d2/d25/d48/d87/fa2 0 2024-03-22T07:28:49.706 INFO:tasks.workunit.client.0.smithi134.stdout:3/800: sync 2024-03-22T07:28:49.707 INFO:tasks.workunit.client.0.smithi134.stdout:4/863: rename d2/d25/d48/fa5 to d2/d15/d35/da8/dec/def/d106/f124 0 2024-03-22T07:28:49.707 INFO:tasks.workunit.client.0.smithi134.stdout:4/864: read - d2/d2a/d50/fb8 zero size 2024-03-22T07:28:49.709 INFO:tasks.workunit.client.0.smithi134.stdout:4/865: mkdir d2/d25/d74/dde/d76/d125 0 2024-03-22T07:28:49.718 INFO:tasks.workunit.client.0.smithi134.stdout:4/866: write d2/d25/d48/d6e/f82 [3810222,12595] 0 2024-03-22T07:28:49.718 INFO:tasks.workunit.client.0.smithi134.stdout:5/897: sync 2024-03-22T07:28:49.719 INFO:tasks.workunit.client.0.smithi134.stdout:3/801: dread d4/fa8 [0,4194304] 0 2024-03-22T07:28:49.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/802: truncate d4/d8/d23/f55 4247827 0 2024-03-22T07:28:49.720 INFO:tasks.workunit.client.0.smithi134.stdout:3/803: fsync d4/d8/fa6 0 2024-03-22T07:28:49.723 INFO:tasks.workunit.client.0.smithi134.stdout:5/898: dread d1/d8/d16/fa9 [0,4194304] 0 2024-03-22T07:28:49.723 INFO:tasks.workunit.client.0.smithi134.stdout:3/804: link d4/d8/d23/ce8 d4/d8/cf7 0 2024-03-22T07:28:49.727 INFO:tasks.workunit.client.0.smithi134.stdout:5/899: unlink d1/d8/d20/d62/l122 0 2024-03-22T07:28:49.727 INFO:tasks.workunit.client.0.smithi134.stdout:0/898: dwrite dc/d17/da7/d105/db8/f7d [0,4194304] 0 2024-03-22T07:28:49.731 INFO:tasks.workunit.client.0.smithi134.stdout:5/900: mkdir d1/d8/da1/db0/df5/d12a 0 2024-03-22T07:28:49.731 INFO:tasks.workunit.client.0.smithi134.stdout:5/901: write d1/d8/d16/d4a/f9f [1043906,39184] 0 2024-03-22T07:28:49.738 INFO:tasks.workunit.client.0.smithi134.stdout:4/867: dwrite d2/d15/d35/fb9 [0,4194304] 0 2024-03-22T07:28:49.738 INFO:tasks.workunit.client.0.smithi134.stdout:4/868: creat d2/d2a/d80/d85/f126 x:0 0 0 2024-03-22T07:28:49.740 INFO:tasks.workunit.client.0.smithi134.stdout:5/902: dread d1/d4/f2b [0,4194304] 0 2024-03-22T07:28:49.742 INFO:tasks.workunit.client.0.smithi134.stdout:5/903: creat d1/d8/dc5/dd6/dfc/d11c/f12b x:0 0 0 2024-03-22T07:28:49.743 INFO:tasks.workunit.client.0.smithi134.stdout:3/805: dwrite d4/d10/fbe [4194304,4194304] 0 2024-03-22T07:28:49.745 INFO:tasks.workunit.client.0.smithi134.stdout:4/869: dread d2/d15/d35/f63 [0,4194304] 0 2024-03-22T07:28:49.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/904: dread d1/d8/dc5/fbc [0,4194304] 0 2024-03-22T07:28:49.745 INFO:tasks.workunit.client.0.smithi134.stdout:5/905: chown d1/d8/d20/d62/f89 6 1 2024-03-22T07:28:49.746 INFO:tasks.workunit.client.0.smithi134.stdout:0/899: dwrite dc/d18/f1d [0,4194304] 0 2024-03-22T07:28:49.746 INFO:tasks.workunit.client.0.smithi134.stdout:0/900: chown dc/d18/d89/fd4 90457 1 2024-03-22T07:28:49.750 INFO:tasks.workunit.client.0.smithi134.stdout:4/870: mknod d2/d2a/c127 0 2024-03-22T07:28:49.750 INFO:tasks.workunit.client.0.smithi134.stdout:4/871: chown d2/d25/d74/dde/fc3 1634042 1 2024-03-22T07:28:49.752 INFO:tasks.workunit.client.0.smithi134.stdout:3/806: write d4/d22/d3c/f98 [3601442,94772] 0 2024-03-22T07:28:49.752 INFO:tasks.workunit.client.0.smithi134.stdout:5/906: link d1/d8/dc5/dd6/dfc/d11c/f64 d1/d8/dc5/da2/f12c 0 2024-03-22T07:28:49.753 INFO:tasks.workunit.client.0.smithi134.stdout:3/807: rmdir d4/d8 39 2024-03-22T07:28:49.757 INFO:tasks.workunit.client.0.smithi134.stdout:5/907: link d1/d8/dc5/dd6/dfc/d11c/f77 d1/d8/d16/dbd/df1/f12d 0 2024-03-22T07:28:49.757 INFO:tasks.workunit.client.0.smithi134.stdout:5/908: chown d1/d8/dc5/dd6 12819324 1 2024-03-22T07:28:49.768 INFO:tasks.workunit.client.0.smithi134.stdout:0/901: dread dc/d17/da7/d105/d82/db7/fd5 [0,4194304] 0 2024-03-22T07:28:49.769 INFO:tasks.workunit.client.0.smithi134.stdout:4/872: dwrite d2/d25/d74/dde/dc0/fd9 [0,4194304] 0 2024-03-22T07:28:49.771 INFO:tasks.workunit.client.0.smithi134.stdout:4/873: truncate d2/d2a/d80/f94 706106 0 2024-03-22T07:28:49.773 INFO:tasks.workunit.client.0.smithi134.stdout:4/874: mkdir d2/d25/d48/d128 0 2024-03-22T07:28:49.774 INFO:tasks.workunit.client.0.smithi134.stdout:3/808: dwrite d4/d22/d29/f2e [8388608,4194304] 0 2024-03-22T07:28:49.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/875: rmdir d2/d98 39 2024-03-22T07:28:49.777 INFO:tasks.workunit.client.0.smithi134.stdout:4/876: truncate d2/d25/d48/fba 303698 0 2024-03-22T07:28:49.779 INFO:tasks.workunit.client.0.smithi134.stdout:4/877: mkdir d2/d25/d74/dde/dc0/de5/d129 0 2024-03-22T07:28:49.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/878: read d2/d2a/d80/dd6/f90 [106387,43104] 0 2024-03-22T07:28:49.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/879: dread - d2/d2a/d80/d101/f121 zero size 2024-03-22T07:28:49.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/880: chown d2/d2a/d93/lbb 11 1 2024-03-22T07:28:49.781 INFO:tasks.workunit.client.0.smithi134.stdout:4/881: chown d2/d25/d74/dde/d76/l84 386524 1 2024-03-22T07:28:49.788 INFO:tasks.workunit.client.0.smithi134.stdout:3/809: dwrite d4/d10/f36 [0,4194304] 0 2024-03-22T07:28:49.798 INFO:tasks.workunit.client.0.smithi134.stdout:4/882: rmdir d2 39 2024-03-22T07:28:49.798 INFO:tasks.workunit.client.0.smithi134.stdout:4/883: chown d2/d25/d48/d6e/d7b/dd7/l10c 87504 1 2024-03-22T07:28:49.802 INFO:tasks.workunit.client.0.smithi134.stdout:3/810: symlink d4/d10/d4b/lf8 0 2024-03-22T07:28:49.802 INFO:tasks.workunit.client.0.smithi134.stdout:3/811: dread - d4/d8/d45/da9/fde zero size 2024-03-22T07:28:49.809 INFO:tasks.workunit.client.0.smithi134.stdout:4/884: write d2/d15/f11 [1810016,106024] 0 2024-03-22T07:28:49.810 INFO:tasks.workunit.client.0.smithi134.stdout:4/885: mkdir d2/d2a/d80/d85/d12a 0 2024-03-22T07:28:49.811 INFO:tasks.workunit.client.0.smithi134.stdout:4/886: mknod d2/d25/d48/d6e/c12b 0 2024-03-22T07:28:49.811 INFO:tasks.workunit.client.0.smithi134.stdout:4/887: dread - d2/d15/d35/da8/dec/d119/f11b zero size 2024-03-22T07:28:49.812 INFO:tasks.workunit.client.0.smithi134.stdout:4/888: getdents d2/d25/d74 0 2024-03-22T07:28:49.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/889: truncate d2/d2a/d50/f5c 5033419 0 2024-03-22T07:28:49.813 INFO:tasks.workunit.client.0.smithi134.stdout:4/890: truncate d2/d15/d35/fb9 4956932 0 2024-03-22T07:28:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/891: getdents d2/d15 0 2024-03-22T07:28:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/892: fsync d2/d15/d35/da8/f11a 0 2024-03-22T07:28:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/893: chown d2/f46 1574625 1 2024-03-22T07:28:49.814 INFO:tasks.workunit.client.0.smithi134.stdout:4/894: chown d2/d2a/d93/f115 5 1 2024-03-22T07:28:49.817 INFO:tasks.workunit.client.0.smithi134.stdout:3/812: dwrite d4/d8/d23/fbc [0,4194304] 0 2024-03-22T07:28:49.817 INFO:tasks.workunit.client.0.smithi134.stdout:3/813: chown d4/d22/d29/f2e 0 1 2024-03-22T07:28:49.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/895: read d2/d25/dcf/fda [1931244,104664] 0 2024-03-22T07:28:49.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/896: write d2/d25/dcf/fda [3192159,66663] 0 2024-03-22T07:28:49.820 INFO:tasks.workunit.client.0.smithi134.stdout:4/897: readlink d2/d25/d74/dde/l67 0 2024-03-22T07:28:49.821 INFO:tasks.workunit.client.0.smithi134.stdout:3/814: mknod d4/d8/d45/cf9 0 2024-03-22T07:28:49.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/815: dwrite d4/d10/d4b/f74 [0,4194304] 0 2024-03-22T07:28:49.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/816: stat d4/d22/d29/d82/f8e 0 2024-03-22T07:28:49.840 INFO:tasks.workunit.client.0.smithi134.stdout:3/817: write d4/d8/d5c/fea [279668,66028] 0 2024-03-22T07:28:49.840 INFO:tasks.workunit.client.0.smithi134.stdout:4/898: dwrite d2/d2a/d50/fbf [0,4194304] 0 2024-03-22T07:28:49.840 INFO:tasks.workunit.client.0.smithi134.stdout:4/899: chown d2/d2a/d80/d85/f126 828 1 2024-03-22T07:28:49.841 INFO:tasks.workunit.client.0.smithi134.stdout:4/900: dread d2/d98/f113 [0,4194304] 0 2024-03-22T07:28:49.841 INFO:tasks.workunit.client.0.smithi134.stdout:4/901: fdatasync d2/d25/d74/dde/f8c 0 2024-03-22T07:28:49.848 INFO:tasks.workunit.client.0.smithi134.stdout:3/818: rmdir d4/d22/d29/d50 39 2024-03-22T07:28:49.852 INFO:tasks.workunit.client.0.smithi134.stdout:4/902: mkdir d2/d25/d74/dde/dc0/de5/d12c 0 2024-03-22T07:28:49.860 INFO:tasks.workunit.client.0.smithi134.stdout:4/903: dread d2/d25/d48/d6e/d7b/f8e [0,4194304] 0 2024-03-22T07:28:49.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/819: rename d4/d22/d3c/f8a to d4/d22/d29/d50/ffa 0 2024-03-22T07:28:49.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/820: readlink d4/d10/d4b/lf8 0 2024-03-22T07:28:49.862 INFO:tasks.workunit.client.0.smithi134.stdout:3/821: stat d4/d22/d29/f2e 0 2024-03-22T07:28:49.863 INFO:tasks.workunit.client.0.smithi134.stdout:3/822: creat d4/d22/d3c/ffb x:0 0 0 2024-03-22T07:28:49.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/823: creat d4/d8/ffc x:0 0 0 2024-03-22T07:28:49.864 INFO:tasks.workunit.client.0.smithi134.stdout:3/824: creat d4/d8/d7f/d9c/db9/ffd x:0 0 0 2024-03-22T07:28:49.868 INFO:tasks.workunit.client.0.smithi134.stdout:4/904: read d2/d25/d48/d6e/d7b/dd7/fe2 [2063558,107579] 0 2024-03-22T07:28:49.868 INFO:tasks.workunit.client.0.smithi134.stdout:4/905: chown d2/fd 7 1 2024-03-22T07:28:49.868 INFO:tasks.workunit.client.0.smithi134.stdout:4/906: fsync d2/d25/d74/dde/d76/d9a/f114 0 2024-03-22T07:28:49.868 INFO:tasks.workunit.client.0.smithi134.stdout:4/907: chown d2/d25/d48/d87/lc5 15246 1 2024-03-22T07:28:49.869 INFO:tasks.workunit.client.0.smithi134.stdout:4/908: rmdir d2/d25/d48 39 2024-03-22T07:28:49.871 INFO:tasks.workunit.client.0.smithi134.stdout:4/909: symlink d2/d25/d74/dde/d76/l12d 0 2024-03-22T07:28:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:4/910: write d2/d2a/d80/fd0 [1175414,64457] 0 2024-03-22T07:28:49.872 INFO:tasks.workunit.client.0.smithi134.stdout:4/911: write d2/d25/d48/dd3/fb7 [4985411,116674] 0 2024-03-22T07:28:49.873 INFO:tasks.workunit.client.0.smithi134.stdout:4/912: fdatasync d2/d25/d74/dde/dc0/de5/ff9 0 2024-03-22T07:28:49.876 INFO:tasks.workunit.client.0.smithi134.stdout:4/913: creat d2/d25/dcf/f12e x:0 0 0 2024-03-22T07:28:49.879 INFO:tasks.workunit.client.0.smithi134.stdout:4/914: rename d2/d25/d74/f75 to d2/d25/d48/f12f 0 2024-03-22T07:28:49.886 INFO:tasks.workunit.client.0.smithi134.stdout:4/915: symlink d2/d15/d35/da8/l130 0 2024-03-22T07:28:49.888 INFO:tasks.workunit.client.0.smithi134.stdout:4/916: unlink d2/d25/fe9 0 2024-03-22T07:28:49.890 INFO:tasks.workunit.client.0.smithi134.stdout:4/917: rename d2/d2a/d50/fbf to d2/d15/d35/da8/dec/f131 0 2024-03-22T07:28:49.892 INFO:tasks.workunit.client.0.smithi134.stdout:3/825: dwrite d4/d22/d29/f97 [0,4194304] 0 2024-03-22T07:28:49.892 INFO:tasks.workunit.client.0.smithi134.stdout:4/918: dread d2/d25/d48/fba [0,4194304] 0 2024-03-22T07:28:49.899 INFO:tasks.workunit.client.0.smithi134.stdout:4/919: rename d2/d25/d48/dd3/l6b to d2/d2a/d80/d85/d12a/l132 0 2024-03-22T07:28:49.900 INFO:tasks.workunit.client.0.smithi134.stdout:3/826: dread d4/d22/d29/d50/f62 [0,4194304] 0 2024-03-22T07:28:49.908 INFO:tasks.workunit.client.0.smithi134.stdout:4/920: write d2/d2a/d80/dd6/f24 [505390,40759] 0 2024-03-22T07:28:49.909 INFO:tasks.workunit.client.0.smithi134.stdout:4/921: dread d2/f46 [4194304,4194304] 0 2024-03-22T07:28:49.912 INFO:tasks.workunit.client.0.smithi134.stdout:3/827: read d4/d22/d29/d50/f62 [680672,106171] 0 2024-03-22T07:28:49.912 INFO:tasks.workunit.client.0.smithi134.stdout:3/828: creat d4/d8/d69/dd7/ffe x:0 0 0 2024-03-22T07:28:49.912 INFO:tasks.workunit.client.0.smithi134.stdout:4/922: dread d2/d15/d35/f5d [0,4194304] 0 2024-03-22T07:28:49.914 INFO:tasks.workunit.client.0.smithi134.stdout:3/829: mknod d4/dab/cff 0 2024-03-22T07:28:49.917 INFO:tasks.workunit.client.0.smithi134.stdout:3/830: rename d4/d22/d29/l47 to d4/d22/d29/l100 0 2024-03-22T07:28:49.917 INFO:tasks.workunit.client.0.smithi134.stdout:3/831: truncate d4/d22/d29/d50/fe7 774984 0 2024-03-22T07:28:49.920 INFO:tasks.workunit.client.0.smithi134.stdout:4/923: write d2/d25/f1c [2903635,34246] 0 2024-03-22T07:28:49.921 INFO:tasks.workunit.client.0.smithi134.stdout:3/832: link d4/d10/c44 d4/d8/c101 0 2024-03-22T07:28:49.944 INFO:tasks.workunit.client.0.smithi134.stdout:3/833: dwrite d4/d22/d3c/ffb [0,4194304] 0 2024-03-22T07:28:49.945 INFO:tasks.workunit.client.0.smithi134.stdout:4/924: dwrite d2/d25/d74/fb6 [0,4194304] 0 2024-03-22T07:28:49.945 INFO:tasks.workunit.client.0.smithi134.stdout:4/925: readlink d2/d15/d35/lb3 0 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:1/883: sync 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:9/795: sync 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:2/854: sync 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:2/855: creat d2/d5/d8/d7e/dba/f118 x:0 0 0 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:9/796: write d3/f25 [2003740,36434] 0 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:9/797: truncate d3/d9/d37/d3c/d71/fa8 4341111 0 2024-03-22T07:28:49.949 INFO:tasks.workunit.client.0.smithi134.stdout:9/798: chown d3/d9/d37/d5a/dc5 2 1 2024-03-22T07:28:49.950 INFO:tasks.workunit.client.0.smithi134.stdout:9/799: chown d3/d9/d37/d6f/d54/d9d/dc0/f101 9 1 2024-03-22T07:28:49.950 INFO:tasks.workunit.client.0.smithi134.stdout:3/834: rename d4/d10/f4a to d4/d10/d4b/f102 0 2024-03-22T07:28:49.950 INFO:tasks.workunit.client.0.smithi134.stdout:3/835: truncate d4/dab/fca 396343 0 2024-03-22T07:28:49.951 INFO:tasks.workunit.client.0.smithi134.stdout:2/856: dread d2/d5/d8/d5d/d5f/d75/dfd/d60/f72 [0,4194304] 0 2024-03-22T07:28:49.952 INFO:tasks.workunit.client.0.smithi134.stdout:4/926: dread d2/d25/d74/dde/fdf [0,4194304] 0 2024-03-22T07:28:49.953 INFO:tasks.workunit.client.0.smithi134.stdout:4/927: write d2/f102 [448690,36324] 0 2024-03-22T07:28:49.957 INFO:tasks.workunit.client.0.smithi134.stdout:1/884: creat d5/d1d/f13a x:0 0 0 2024-03-22T07:28:49.961 INFO:tasks.workunit.client.0.smithi134.stdout:4/928: dread d2/d15/f61 [0,4194304] 0 2024-03-22T07:28:49.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/800: unlink d3/d9/d37/d5a/d89/fed 0 2024-03-22T07:28:49.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/801: creat d3/d9/d37/d3c/d71/dc2/f108 x:0 0 0 2024-03-22T07:28:49.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/802: dread - d3/d9/df/d57/d67/d5f/fe8 zero size 2024-03-22T07:28:49.966 INFO:tasks.workunit.client.0.smithi134.stdout:2/857: dwrite d2/d5/d8/d31/f46 [0,4194304] 0 2024-03-22T07:28:49.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/929: truncate d2/d25/d48/f57 115034 0 2024-03-22T07:28:49.967 INFO:tasks.workunit.client.0.smithi134.stdout:4/930: dread - d2/d25/d48/d6e/d7b/dd7/ff1 zero size 2024-03-22T07:28:49.969 INFO:tasks.workunit.client.0.smithi134.stdout:4/931: dread d2/d25/d74/dde/dc0/de5/ff9 [0,4194304] 0 2024-03-22T07:28:49.970 INFO:tasks.workunit.client.0.smithi134.stdout:9/803: mkdir d3/d9/d37/d3c/d71/d7a/d109 0 2024-03-22T07:28:49.971 INFO:tasks.workunit.client.0.smithi134.stdout:3/836: truncate d4/d8/d23/f3a 1143270 0 2024-03-22T07:28:49.976 INFO:tasks.workunit.client.0.smithi134.stdout:9/804: rmdir d3/d9/d37/d3c/d71/d8c 39 2024-03-22T07:28:49.976 INFO:tasks.workunit.client.0.smithi134.stdout:9/805: dread - d3/d9/d37/d5a/f9e zero size 2024-03-22T07:28:49.976 INFO:tasks.workunit.client.0.smithi134.stdout:1/885: write d5/fb [1069520,97368] 0 2024-03-22T07:28:49.980 INFO:tasks.workunit.client.0.smithi134.stdout:4/932: dread d2/d25/d48/dd3/f89 [0,4194304] 0 2024-03-22T07:28:49.980 INFO:tasks.workunit.client.0.smithi134.stdout:4/933: chown d2/d25/d48/d6e/d7b/dd7/f10a 235 1 2024-03-22T07:28:49.984 INFO:tasks.workunit.client.0.smithi134.stdout:2/858: dwrite d2/d5/d22/dbc/d104/f10c [0,4194304] 0 2024-03-22T07:28:49.985 INFO:tasks.workunit.client.0.smithi134.stdout:3/837: dread d4/d8/d5c/f85 [0,4194304] 0 2024-03-22T07:28:49.992 INFO:tasks.workunit.client.0.smithi134.stdout:9/806: dread d3/d9/d37/fcf [4194304,4194304] 0 2024-03-22T07:28:49.993 INFO:tasks.workunit.client.0.smithi134.stdout:2/859: dread d2/d5/d8/d5d/d5f/d75/fd7 [0,4194304] 0 2024-03-22T07:28:49.995 INFO:tasks.workunit.client.0.smithi134.stdout:3/838: link d4/d8/d69/d6a/f9b d4/d10/f103 0 2024-03-22T07:28:49.995 INFO:tasks.workunit.client.0.smithi134.stdout:3/839: chown d4/d10/fb4 116005145 1 2024-03-22T07:28:49.997 INFO:tasks.workunit.client.0.smithi134.stdout:9/807: symlink d3/d9/d37/d5a/d89/l10a 0 2024-03-22T07:28:50.000 INFO:tasks.workunit.client.0.smithi134.stdout:1/886: dwrite d5/da/d13/db9/fba [0,4194304] 0 2024-03-22T07:28:50.000 INFO:tasks.workunit.client.0.smithi134.stdout:1/887: truncate d5/d1d/d49/f52 8679497 0 2024-03-22T07:28:50.000 INFO:tasks.workunit.client.0.smithi134.stdout:3/840: mknod d4/d8/d23/c104 0 2024-03-22T07:28:50.000 INFO:tasks.workunit.client.0.smithi134.stdout:3/841: chown d4/d8/d69/d6a/l89 987594030 1 2024-03-22T07:28:50.002 INFO:tasks.workunit.client.0.smithi134.stdout:9/808: truncate d3/d9/d37/d6f/d54/d9d/fb0 187626 0 2024-03-22T07:28:50.003 INFO:tasks.workunit.client.0.smithi134.stdout:9/809: write d3/d9/d37/d5a/f9e [174753,63584] 0 2024-03-22T07:28:50.003 INFO:tasks.workunit.client.0.smithi134.stdout:9/810: chown d3/d9/f94 24107 1 2024-03-22T07:28:50.004 INFO:tasks.workunit.client.0.smithi134.stdout:1/888: symlink d5/d93/l13b 0 2024-03-22T07:28:50.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/811: mkdir d3/d9/d37/d5a/dc5/d10b 0 2024-03-22T07:28:50.005 INFO:tasks.workunit.client.0.smithi134.stdout:9/812: chown d3/d9/d37/d5a/d89/f103 6 1 2024-03-22T07:28:50.008 INFO:tasks.workunit.client.0.smithi134.stdout:9/813: mkdir d3/d9/d37/d3c/d71/d10c 0 2024-03-22T07:28:50.008 INFO:tasks.workunit.client.0.smithi134.stdout:9/814: write d3/d9/df/d57/d67/fb5 [2198032,70390] 0 2024-03-22T07:28:50.008 INFO:tasks.workunit.client.0.smithi134.stdout:9/815: write d3/d9/df/f7d [2624471,38517] 0 2024-03-22T07:28:50.008 INFO:tasks.workunit.client.0.smithi134.stdout:9/816: chown d3/d9/d37/d5a/d89/f103 798069790 1 2024-03-22T07:28:50.015 INFO:tasks.workunit.client.0.smithi134.stdout:9/817: rmdir d3/d9/d37/d6f/d54/d9d 39 2024-03-22T07:28:50.015 INFO:tasks.workunit.client.0.smithi134.stdout:6/813: sync 2024-03-22T07:28:50.015 INFO:tasks.workunit.client.0.smithi134.stdout:3/842: dread d4/d8/f12 [0,4194304] 0 2024-03-22T07:28:50.015 INFO:tasks.workunit.client.0.smithi134.stdout:2/860: dwrite d2/d5/d8/d5d/d5f/d75/dfd/d60/fa7 [0,4194304] 0 2024-03-22T07:28:50.016 INFO:tasks.workunit.client.0.smithi134.stdout:4/934: dwrite d2/d2a/d50/f5c [0,4194304] 0 2024-03-22T07:28:50.016 INFO:tasks.workunit.client.0.smithi134.stdout:4/935: chown d2/d2a/l6c 960196 1 2024-03-22T07:28:50.017 INFO:tasks.workunit.client.0.smithi134.stdout:5/909: sync 2024-03-22T07:28:50.017 INFO:tasks.workunit.client.0.smithi134.stdout:5/910: chown d1/d4/f2b 5 1 2024-03-22T07:28:50.017 INFO:tasks.workunit.client.0.smithi134.stdout:5/911: chown d1/d8/d16/dbd/fff 0 1 2024-03-22T07:28:50.021 INFO:tasks.workunit.client.0.smithi134.stdout:2/861: dread d2/d5/d8/d5d/d5f/f6f [0,4194304] 0 2024-03-22T07:28:50.023 INFO:tasks.workunit.client.0.smithi134.stdout:6/814: dread d2/d1b/d1d/d5e/fde [0,4194304] 0 2024-03-22T07:28:50.028 INFO:tasks.workunit.client.0.smithi134.stdout:3/843: read d4/d10/f11 [45629,13611] 0 2024-03-22T07:28:50.028 INFO:tasks.workunit.client.0.smithi134.stdout:3/844: readlink d4/d22/d3c/d88/ld3 0 2024-03-22T07:28:50.028 INFO:tasks.workunit.client.0.smithi134.stdout:3/845: write d4/d8/d23/f60 [5701750,36031] 0 2024-03-22T07:28:50.032 INFO:tasks.workunit.client.0.smithi134.stdout:4/936: creat d2/d25/d48/dd3/f133 x:0 0 0 2024-03-22T07:28:50.032 INFO:tasks.workunit.client.0.smithi134.stdout:4/937: chown d2/d2a/d80/f9c 41 1 2024-03-22T07:28:50.034 INFO:tasks.workunit.client.0.smithi134.stdout:2/862: write d2/d5/d8/d5d/d5f/d75/dfd/f69 [3360122,81753] 0 2024-03-22T07:28:50.034 INFO:tasks.workunit.client.0.smithi134.stdout:9/818: dwrite d3/d9/d37/d6f/d54/d9d/dc0/f6e [0,4194304] 0 2024-03-22T07:28:50.034 INFO:tasks.workunit.client.0.smithi134.stdout:2/863: dread - d2/d5/d8/d7e/d83/fef zero size 2024-03-22T07:28:50.034 INFO:tasks.workunit.client.0.smithi134.stdout:9/819: read d3/d9/df/f7d [64166,28070] 0 2024-03-22T07:28:50.035 INFO:tasks.workunit.client.0.smithi134.stdout:5/912: rename d1/da0/fe9 to d1/d8/d16/dbd/df1/f12e 0 2024-03-22T07:28:50.036 INFO:tasks.workunit.client.0.smithi134.stdout:3/846: mknod d4/d22/d29/dad/c105 0 2024-03-22T07:28:50.036 INFO:tasks.workunit.client.0.smithi134.stdout:3/847: creat d4/d8/d5c/f106 x:0 0 0 2024-03-22T07:28:50.036 INFO:tasks.workunit.client.0.smithi134.stdout:3/848: write d4/d8/d23/f70 [3638413,616] 0 2024-03-22T07:28:50.041 INFO:tasks.workunit.client.0.smithi134.stdout:4/938: dread d2/d2a/d93/fcd [0,4194304] 0 2024-03-22T07:28:50.042 INFO:tasks.workunit.client.0.smithi134.stdout:0/902: sync 2024-03-22T07:28:50.044 INFO:tasks.workunit.client.0.smithi134.stdout:2/864: mknod d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/c119 0 2024-03-22T07:28:50.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/820: symlink d3/d9/d37/d5a/d89/l10d 0 2024-03-22T07:28:50.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/821: chown d3/d9/df/d12/c64 1042911 1 2024-03-22T07:28:50.044 INFO:tasks.workunit.client.0.smithi134.stdout:9/822: chown d3/d9/d37/d6f/d54/d9d/dc0/f50 650 1 2024-03-22T07:28:50.046 INFO:tasks.workunit.client.0.smithi134.stdout:5/913: link d1/d8/d16/dbd/fff d1/d8/d16/dbd/dc0/f12f 0 2024-03-22T07:28:50.046 INFO:tasks.workunit.client.0.smithi134.stdout:5/914: readlink d1/d8/d16/d4a/lb5 0 2024-03-22T07:28:50.048 INFO:tasks.workunit.client.0.smithi134.stdout:9/823: dread d3/d9/d37/d3c/d71/d8e/fbc [0,4194304] 0 2024-03-22T07:28:50.049 INFO:tasks.workunit.client.0.smithi134.stdout:6/815: dwrite d2/d1b/d4d/da5/dec/f8b [0,4194304] 0 2024-03-22T07:28:50.049 INFO:tasks.workunit.client.0.smithi134.stdout:3/849: symlink d4/d8/d5c/l107 0 2024-03-22T07:28:50.049 INFO:tasks.workunit.client.0.smithi134.stdout:3/850: readlink d4/d22/d3c/d88/la1 0 2024-03-22T07:28:50.050 INFO:tasks.workunit.client.0.smithi134.stdout:2/865: symlink d2/d5/d8/d5d/d5f/d75/l11a 0 2024-03-22T07:28:50.051 INFO:tasks.workunit.client.0.smithi134.stdout:4/939: dread d2/d25/d48/dd3/fb7 [0,4194304] 0 2024-03-22T07:28:50.054 INFO:tasks.workunit.client.0.smithi134.stdout:6/816: dread d2/d1b/d1d/d5e/d63/f64 [0,4194304] 0 2024-03-22T07:28:50.055 INFO:tasks.workunit.client.0.smithi134.stdout:5/915: rename d1/d8/d20/l7b to d1/d8/d16/d4a/dce/l130 0 2024-03-22T07:28:50.056 INFO:tasks.workunit.client.0.smithi134.stdout:9/824: mkdir d3/d9/d37/d5a/dc5/d10b/d10e 0 2024-03-22T07:28:50.057 INFO:tasks.workunit.client.0.smithi134.stdout:9/825: dread - d3/d9/d37/d70/fd1 zero size 2024-03-22T07:28:50.066 INFO:tasks.workunit.client.0.smithi134.stdout:3/851: mkdir d4/d22/d3c/d88/d108 0 2024-03-22T07:28:50.068 INFO:tasks.workunit.client.0.smithi134.stdout:2/866: mknod d2/d5/d22/d99/df6/c11b 0 2024-03-22T07:28:50.068 INFO:tasks.workunit.client.0.smithi134.stdout:2/867: stat d2/d5/d8/d7e/dba/c113 0 2024-03-22T07:28:50.069 INFO:tasks.workunit.client.0.smithi134.stdout:4/940: creat d2/d2a/d80/d85/f134 x:0 0 0 2024-03-22T07:28:50.076 INFO:tasks.workunit.client.0.smithi134.stdout:5/916: creat d1/d8/d20/f131 x:0 0 0 2024-03-22T07:28:50.079 INFO:tasks.workunit.client.0.smithi134.stdout:9/826: link d3/d9/df/db3/c105 d3/d9/d37/d5a/dc5/c10f 0 2024-03-22T07:28:50.084 INFO:tasks.workunit.client.0.smithi134.stdout:4/941: dwrite d2/d25/d74/dde/d76/d9a/ff4 [0,4194304] 0 2024-03-22T07:28:50.088 INFO:tasks.workunit.client.0.smithi134.stdout:2/868: truncate d2/d5/d54/f63 3122084 0 2024-03-22T07:28:50.089 INFO:tasks.workunit.client.0.smithi134.stdout:2/869: fdatasync d2/d5/d8/d5d/da1/f4b 0 2024-03-22T07:28:50.090 INFO:tasks.workunit.client.0.smithi134.stdout:6/817: rmdir d2/d1b/d1d/d5e/d6f/d7d/dd8 39 2024-03-22T07:28:50.092 INFO:tasks.workunit.client.0.smithi134.stdout:6/818: dread d2/d1b/d1d/d5e/d6f/dd7/f9d [0,4194304] 0 2024-03-22T07:28:50.092 INFO:tasks.workunit.client.0.smithi134.stdout:5/917: creat d1/d8/da1/db0/f132 x:0 0 0 2024-03-22T07:28:50.094 INFO:tasks.workunit.client.0.smithi134.stdout:9/827: unlink d3/d9/d37/d6f/d54/f68 0 2024-03-22T07:28:50.094 INFO:tasks.workunit.client.0.smithi134.stdout:9/828: chown d3/d9/df/d12/dd7/de7 5401 1 2024-03-22T07:28:50.094 INFO:tasks.workunit.client.0.smithi134.stdout:4/942: read d2/d2a/d80/dd6/fc2 [476859,111101] 0 2024-03-22T07:28:50.094 INFO:tasks.workunit.client.0.smithi134.stdout:9/829: creat d3/d9/d37/d70/f110 x:0 0 0 2024-03-22T07:28:50.094 INFO:tasks.workunit.client.0.smithi134.stdout:4/943: truncate d2/d2a/d80/d85/faa 4565911 0 2024-03-22T07:28:50.094 INFO:tasks.workunit.client.0.smithi134.stdout:4/944: chown d2/f71 414 1 2024-03-22T07:28:50.097 INFO:tasks.workunit.client.0.smithi134.stdout:0/903: dwrite dc/de/d55/d60/fe2 [0,4194304] 0 2024-03-22T07:28:50.098 INFO:tasks.workunit.client.0.smithi134.stdout:4/945: dread d2/d15/d35/f63 [0,4194304] 0 2024-03-22T07:28:50.098 INFO:tasks.workunit.client.0.smithi134.stdout:6/819: mkdir d2/d120 0 2024-03-22T07:28:50.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/918: link d1/d8/d16/dbd/dc0/dfb/l111 d1/d8/dc5/dd6/dfc/d107/l133 0 2024-03-22T07:28:50.100 INFO:tasks.workunit.client.0.smithi134.stdout:5/919: chown d1/d8/d83/ca3 10 1 2024-03-22T07:28:50.105 INFO:tasks.workunit.client.0.smithi134.stdout:9/830: link d3/d9/d37/d6f/d54/d9d/dc0/f50 d3/d9/d37/d3c/d71/f111 0 2024-03-22T07:28:50.106 INFO:tasks.workunit.client.0.smithi134.stdout:2/870: write d2/d5/d54/f63 [3756515,36124] 0 2024-03-22T07:28:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/946: write d2/d25/d74/dde/dc0/de5/ffb [3545889,7936] 0 2024-03-22T07:28:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/947: chown d2/d25/d48/l104 1440553806 1 2024-03-22T07:28:50.107 INFO:tasks.workunit.client.0.smithi134.stdout:4/948: getdents d2/d25/d74/dde/d123 0 2024-03-22T07:28:50.110 INFO:tasks.workunit.client.0.smithi134.stdout:5/920: dread d1/d8/d16/dbd/dc0/ff3 [0,4194304] 0 2024-03-22T07:28:50.112 INFO:tasks.workunit.client.0.smithi134.stdout:6/820: dwrite d2/d1b/d4d/ffc [0,4194304] 0 2024-03-22T07:28:50.112 INFO:tasks.workunit.client.0.smithi134.stdout:0/904: creat dc/de/dc9/f11a x:0 0 0 2024-03-22T07:28:50.117 INFO:tasks.workunit.client.0.smithi134.stdout:9/831: link d3/d9/d37/d5a/d7f/d80/cbb d3/d9/df/d57/c112 0 2024-03-22T07:28:50.125 INFO:tasks.workunit.client.0.smithi134.stdout:4/949: read d2/d25/d48/d87/faf [388299,15356] 0 2024-03-22T07:28:50.129 INFO:tasks.workunit.client.0.smithi134.stdout:5/921: truncate d1/d8/f63 4115168 0 2024-03-22T07:28:50.134 INFO:tasks.workunit.client.0.smithi134.stdout:6/821: mknod d2/d6e/d105/d10c/c121 0 2024-03-22T07:28:50.136 INFO:tasks.workunit.client.0.smithi134.stdout:0/905: dwrite dc/de/d55/f64 [0,4194304] 0 2024-03-22T07:28:50.137 INFO:tasks.workunit.client.0.smithi134.stdout:0/906: chown dc/d17/da7/d105/d82/db7/fd5 9490 1 2024-03-22T07:28:50.139 INFO:tasks.workunit.client.0.smithi134.stdout:4/950: mkdir d2/d25/d74/dde/d76/d135 0 2024-03-22T07:28:50.143 INFO:tasks.workunit.client.0.smithi134.stdout:5/922: mkdir d1/d8/dc5/d134 0 2024-03-22T07:28:50.144 INFO:tasks.workunit.client.0.smithi134.stdout:5/923: truncate d1/da0/fe3 795189 0 2024-03-22T07:28:50.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/951: dread d2/d15/d35/f63 [0,4194304] 0 2024-03-22T07:28:50.144 INFO:tasks.workunit.client.0.smithi134.stdout:4/952: chown d2/d15/d35/da8/cd1 135150863 1 2024-03-22T07:28:50.144 INFO:tasks.workunit.client.0.smithi134.stdout:0/907: dread dc/d17/da7/d105/d82/db7/fd5 [0,4194304] 0 2024-03-22T07:28:50.145 INFO:tasks.workunit.client.0.smithi134.stdout:6/822: symlink d2/d6e/l122 0 2024-03-22T07:28:50.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/823: dread d2/d1b/d1d/d5e/d6f/dd7/f9d [0,4194304] 0 2024-03-22T07:28:50.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/824: creat d2/d1b/d1d/d5e/d84/f123 x:0 0 0 2024-03-22T07:28:50.149 INFO:tasks.workunit.client.0.smithi134.stdout:6/825: write d2/d1b/d1d/d5e/d6f/d7d/f117 [612211,65526] 0 2024-03-22T07:28:50.149 INFO:tasks.workunit.client.0.smithi134.stdout:4/953: mkdir d2/d15/d35/da8/dec/def/d106/d136 0 2024-03-22T07:28:50.152 INFO:tasks.workunit.client.0.smithi134.stdout:2/871: rmdir d2/d5/d8/d5d/d5f/d75/dfd/d4f/deb 0 2024-03-22T07:28:50.155 INFO:tasks.workunit.client.0.smithi134.stdout:2/872: symlink d2/d5/d8/l11c 0 2024-03-22T07:28:50.155 INFO:tasks.workunit.client.0.smithi134.stdout:2/873: write d2/d5/d8/d5d/da1/fb8 [5153441,124224] 0 2024-03-22T07:28:50.158 INFO:tasks.workunit.client.0.smithi134.stdout:0/908: read dc/d17/f7f [3311299,105468] 0 2024-03-22T07:28:50.158 INFO:tasks.workunit.client.0.smithi134.stdout:0/909: chown dc/d18/f5e 3232 1 2024-03-22T07:28:50.158 INFO:tasks.workunit.client.0.smithi134.stdout:0/910: readlink dc/d18/d85/lad 0 2024-03-22T07:28:50.158 INFO:tasks.workunit.client.0.smithi134.stdout:0/911: fdatasync dc/d17/da7/d105/fac 0 2024-03-22T07:28:50.158 INFO:tasks.workunit.client.0.smithi134.stdout:0/912: write dc/de/dc9/dd0/fea [780747,125282] 0 2024-03-22T07:28:50.161 INFO:tasks.workunit.client.0.smithi134.stdout:2/874: link d2/d5/d8/f2f d2/d5/d8/d7e/dba/f11d 0 2024-03-22T07:28:50.161 INFO:tasks.workunit.client.0.smithi134.stdout:2/875: dread - d2/f8f zero size 2024-03-22T07:28:50.161 INFO:tasks.workunit.client.0.smithi134.stdout:2/876: creat d2/d5/d22/d99/f11e x:0 0 0 2024-03-22T07:28:50.162 INFO:tasks.workunit.client.0.smithi134.stdout:2/877: stat d2/d5/d8/d5d/d5f/ffe 0 2024-03-22T07:28:50.171 INFO:tasks.workunit.client.0.smithi134.stdout:2/878: dread d2/f87 [0,4194304] 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:2/879: fdatasync d2/f1a 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:2/880: fsync d2/d5/d8/d5d/d5f/d75/dfd/f47 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:2/881: creat d2/d5/d8/d7e/f11f x:0 0 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/924: dwrite d1/d4/f2b [4194304,4194304] 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/925: readlink d1/d8/d20/l5e 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/926: write d1/d8/d16/dbd/f108 [4407592,11305] 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/927: dread - d1/d8/fdb zero size 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:5/928: readlink d1/d8/dc5/dd6/dfc/d11c/l10e 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:6/826: dwrite d2/d1b/d1d/d5e/d84/fe6 [0,4194304] 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:6/827: truncate d2/d1b/d4d/da5/dec/fbb 640311 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:6/828: creat d2/d1b/d4d/f124 x:0 0 0 2024-03-22T07:28:50.172 INFO:tasks.workunit.client.0.smithi134.stdout:6/829: chown d2/d1b/d4d/da5/dec/f8b 109 1 2024-03-22T07:28:50.177 INFO:tasks.workunit.client.0.smithi134.stdout:5/929: dread d1/d8/d20/fae [0,4194304] 0 2024-03-22T07:28:50.184 INFO:tasks.workunit.client.0.smithi134.stdout:5/930: getdents d1/d8/dc5/dd6/dfc/d11c/dac/dad 0 2024-03-22T07:28:50.188 INFO:tasks.workunit.client.0.smithi134.stdout:2/882: dwrite d2/d5/d8/d7e/dba/f11d [8388608,4194304] 0 2024-03-22T07:28:50.191 INFO:tasks.workunit.client.0.smithi134.stdout:6/830: dwrite d2/d6e/fc3 [0,4194304] 0 2024-03-22T07:28:50.195 INFO:tasks.workunit.client.0.smithi134.stdout:6/831: rename d2/d1b/d4d/da5/dec/fbb to d2/d1b/d1d/d5e/d6f/da8/dca/f125 0 2024-03-22T07:28:50.206 INFO:tasks.workunit.client.0.smithi134.stdout:5/931: dwrite d1/d8/d16/dbd/fde [0,4194304] 0 2024-03-22T07:28:50.210 INFO:tasks.workunit.client.0.smithi134.stdout:2/883: dwrite d2/d5/d22/dbe/fdf [0,4194304] 0 2024-03-22T07:28:50.210 INFO:tasks.workunit.client.0.smithi134.stdout:2/884: dread - d2/d5/d22/fce zero size 2024-03-22T07:28:50.210 INFO:tasks.workunit.client.0.smithi134.stdout:2/885: write d2/d5/d22/f101 [327044,50170] 0 2024-03-22T07:28:50.210 INFO:tasks.workunit.client.0.smithi134.stdout:5/932: rmdir d1/d8/dc5/dd6/d112 0 2024-03-22T07:28:50.213 INFO:tasks.workunit.client.0.smithi134.stdout:2/886: symlink d2/d5/d8/d5d/da1/l120 0 2024-03-22T07:28:50.214 INFO:tasks.workunit.client.0.smithi134.stdout:2/887: stat d2/d5/d8/d5d/da1/ca0 0 2024-03-22T07:28:50.214 INFO:tasks.workunit.client.0.smithi134.stdout:2/888: chown d2/d5/d8/f5a 6 1 2024-03-22T07:28:50.214 INFO:tasks.workunit.client.0.smithi134.stdout:6/832: dwrite d2/d1b/d4d/ffc [4194304,4194304] 0 2024-03-22T07:28:50.220 INFO:tasks.workunit.client.0.smithi134.stdout:2/889: dread d2/d5/d8/d5d/d5f/d75/fd7 [0,4194304] 0 2024-03-22T07:28:50.223 INFO:tasks.workunit.client.0.smithi134.stdout:6/833: symlink d2/d1b/d1d/d5e/d6f/de7/l126 0 2024-03-22T07:28:50.224 INFO:tasks.workunit.client.0.smithi134.stdout:2/890: unlink d2/f3b 0 2024-03-22T07:28:50.224 INFO:tasks.workunit.client.0.smithi134.stdout:2/891: chown d2/d5/d22/l9f 4059 1 2024-03-22T07:28:50.224 INFO:tasks.workunit.client.0.smithi134.stdout:2/892: readlink d2/d5/d8/d31/l85 0 2024-03-22T07:28:50.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/834: creat d2/d6e/d105/f127 x:0 0 0 2024-03-22T07:28:50.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/835: write d2/d1b/d4d/d65/fa0 [3559489,97091] 0 2024-03-22T07:28:50.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/836: symlink d2/d1b/d4d/l128 0 2024-03-22T07:28:50.231 INFO:tasks.workunit.client.0.smithi134.stdout:5/933: dwrite d1/d8/dc5/da2/f12c [0,4194304] 0 2024-03-22T07:28:50.239 INFO:tasks.workunit.client.0.smithi134.stdout:2/893: dwrite d2/f1a [0,4194304] 0 2024-03-22T07:28:50.248 INFO:tasks.workunit.client.0.smithi134.stdout:5/934: symlink d1/d8/dc5/dd6/dfc/d107/l135 0 2024-03-22T07:28:50.248 INFO:tasks.workunit.client.0.smithi134.stdout:5/935: stat d1/d8/dc5/dd6/dfc/d107/f124 0 2024-03-22T07:28:50.250 INFO:tasks.workunit.client.0.smithi134.stdout:2/894: symlink d2/d5/d8/d7e/dba/dc6/l121 0 2024-03-22T07:28:50.253 INFO:tasks.workunit.client.0.smithi134.stdout:6/837: rmdir d2/d6e 39 2024-03-22T07:28:50.253 INFO:tasks.workunit.client.0.smithi134.stdout:6/838: truncate d2/d1b/d4d/d65/f115 1007649 0 2024-03-22T07:28:50.254 INFO:tasks.workunit.client.0.smithi134.stdout:5/936: mkdir d1/d8/dc5/dd6/dfc/d11c/dac/dad/d136 0 2024-03-22T07:28:50.255 INFO:tasks.workunit.client.0.smithi134.stdout:2/895: mkdir d2/d5/d22/d99/df6/d122 0 2024-03-22T07:28:50.256 INFO:tasks.workunit.client.0.smithi134.stdout:2/896: dread - d2/d5/d8/d7e/d83/fef zero size 2024-03-22T07:28:50.256 INFO:tasks.workunit.client.0.smithi134.stdout:2/897: write d2/d5/d22/f101 [474765,112577] 0 2024-03-22T07:28:50.256 INFO:tasks.workunit.client.0.smithi134.stdout:6/839: creat d2/d1b/d1d/d5e/d6f/d7d/f129 x:0 0 0 2024-03-22T07:28:50.257 INFO:tasks.workunit.client.0.smithi134.stdout:6/840: chown d2/d1b/d1d/d5e/d84/l75 28 1 2024-03-22T07:28:50.259 INFO:tasks.workunit.client.0.smithi134.stdout:2/898: symlink d2/de5/l123 0 2024-03-22T07:28:50.262 INFO:tasks.workunit.client.0.smithi134.stdout:6/841: mknod d2/d6e/d105/c12a 0 2024-03-22T07:28:50.270 INFO:tasks.workunit.client.0.smithi134.stdout:6/842: getdents d2/d1b/d1d/d5e/d84 0 2024-03-22T07:28:50.270 INFO:tasks.workunit.client.0.smithi134.stdout:6/843: truncate d2/d1b/d4d/fff 631602 0 2024-03-22T07:28:50.273 INFO:tasks.workunit.client.0.smithi134.stdout:6/844: unlink d2/l3b 0 2024-03-22T07:28:50.273 INFO:tasks.workunit.client.0.smithi134.stdout:6/845: fsync d2/d1b/d1d/d5e/d6f/d7d/f112 0 2024-03-22T07:28:50.273 INFO:tasks.workunit.client.0.smithi134.stdout:6/846: chown d2/d1b/d1d/d5e/d6f/d7d/dd8/ff4 14 1 2024-03-22T07:28:50.273 INFO:tasks.workunit.client.0.smithi134.stdout:6/847: fsync d2/fb4 0 2024-03-22T07:28:50.274 INFO:tasks.workunit.client.0.smithi134.stdout:6/848: rmdir d2/d1b 39 2024-03-22T07:28:50.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/849: read d2/d6e/fee [50847,86076] 0 2024-03-22T07:28:50.277 INFO:tasks.workunit.client.0.smithi134.stdout:2/899: dwrite d2/d5/d8/d7e/f11f [0,4194304] 0 2024-03-22T07:28:50.277 INFO:tasks.workunit.client.0.smithi134.stdout:2/900: write d2/f28 [2844555,127182] 0 2024-03-22T07:28:50.277 INFO:tasks.workunit.client.0.smithi134.stdout:2/901: dread - d2/d5/d8/d7e/dba/f10f zero size 2024-03-22T07:28:50.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/850: getdents d2/d1b/d1d/d5e 0 2024-03-22T07:28:50.279 INFO:tasks.workunit.client.0.smithi134.stdout:6/851: dread - d2/d1b/d4d/da5/dec/d28/d97/ff6 zero size 2024-03-22T07:28:50.279 INFO:tasks.workunit.client.0.smithi134.stdout:6/852: dread - d2/d6e/f10e zero size 2024-03-22T07:28:50.282 INFO:tasks.workunit.client.0.smithi134.stdout:2/902: read - d2/f84 zero size 2024-03-22T07:28:50.283 INFO:tasks.workunit.client.0.smithi134.stdout:2/903: mkdir d2/d5/dde/d124 0 2024-03-22T07:28:50.285 INFO:tasks.workunit.client.0.smithi134.stdout:2/904: symlink d2/d5/d8/d31/l125 0 2024-03-22T07:28:50.286 INFO:tasks.workunit.client.0.smithi134.stdout:2/905: write d2/d5/d8/f2f [4284126,128589] 0 2024-03-22T07:28:50.287 INFO:tasks.workunit.client.0.smithi134.stdout:5/937: dwrite d1/d8/d16/f40 [0,4194304] 0 2024-03-22T07:28:50.290 INFO:tasks.workunit.client.0.smithi134.stdout:5/938: rename d1/d8/d20/d8a/d75/fab to d1/d8/d16/f137 0 2024-03-22T07:28:50.290 INFO:tasks.workunit.client.0.smithi134.stdout:5/939: chown d1/d8/dc5/dd6/dfc/d11c/d95 345 1 2024-03-22T07:28:50.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/940: link d1/d8/dc5/dd6/dfc/d107/f124 d1/d8/d16/d4a/dce/f138 0 2024-03-22T07:28:50.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/941: chown d1/d8/dc5/dd6/dfc/d11c/dac/dad 34660 1 2024-03-22T07:28:50.292 INFO:tasks.workunit.client.0.smithi134.stdout:5/942: chown d1/d8/d16/fa9 12339 1 2024-03-22T07:28:50.295 INFO:tasks.workunit.client.0.smithi134.stdout:6/853: dwrite d2/d1b/d1d/d5e/f8d [8388608,4194304] 0 2024-03-22T07:28:50.296 INFO:tasks.workunit.client.0.smithi134.stdout:5/943: rmdir d1/d8/d20/d62 39 2024-03-22T07:28:50.296 INFO:tasks.workunit.client.0.smithi134.stdout:1/889: sync 2024-03-22T07:28:50.297 INFO:tasks.workunit.client.0.smithi134.stdout:2/906: dread d2/d5/d8/d31/f46 [0,4194304] 0 2024-03-22T07:28:50.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/854: unlink d2/d1b/d1d/d5e/d6f/f98 0 2024-03-22T07:28:50.303 INFO:tasks.workunit.client.0.smithi134.stdout:1/890: truncate d5/f4d 2053844 0 2024-03-22T07:28:50.305 INFO:tasks.workunit.client.0.smithi134.stdout:1/891: read d5/d1d/dd0/ddc/d113/dae/f123 [120944,62522] 0 2024-03-22T07:28:50.305 INFO:tasks.workunit.client.0.smithi134.stdout:5/944: dread d1/d8/d16/f137 [0,4194304] 0 2024-03-22T07:28:50.305 INFO:tasks.workunit.client.0.smithi134.stdout:5/945: fdatasync d1/d8/d20/d62/d68/f97 0 2024-03-22T07:28:50.305 INFO:tasks.workunit.client.0.smithi134.stdout:5/946: write d1/d8/d16/f74 [2508413,63582] 0 2024-03-22T07:28:50.305 INFO:tasks.workunit.client.0.smithi134.stdout:5/947: write d1/d8/dc5/dd6/dfc/d11c/dac/ff6 [358196,90719] 0 2024-03-22T07:28:50.306 INFO:tasks.workunit.client.0.smithi134.stdout:2/907: dread d2/d5/d22/d99/fa6 [0,4194304] 0 2024-03-22T07:28:50.306 INFO:tasks.workunit.client.0.smithi134.stdout:2/908: stat d2/d5/d8/d7e/dba/c113 0 2024-03-22T07:28:50.309 INFO:tasks.workunit.client.0.smithi134.stdout:6/855: dread d2/d1b/d4d/d65/fa0 [0,4194304] 0 2024-03-22T07:28:50.309 INFO:tasks.workunit.client.0.smithi134.stdout:6/856: creat d2/d1b/d4d/da5/f12b x:0 0 0 2024-03-22T07:28:50.310 INFO:tasks.workunit.client.0.smithi134.stdout:5/948: rename d1/d8/dc5/dd6/dfc/d11c/dac/fbe to d1/d8/dc5/dd6/dfc/d11c/dac/f139 0 2024-03-22T07:28:50.323 INFO:tasks.workunit.client.0.smithi134.stdout:2/909: symlink d2/d5/d22/d99/df6/d122/l126 0 2024-03-22T07:28:50.329 INFO:tasks.workunit.client.0.smithi134.stdout:6/857: mknod d2/d6e/c12c 0 2024-03-22T07:28:50.330 INFO:tasks.workunit.client.0.smithi134.stdout:5/949: mknod d1/d8/da1/db0/df5/d12a/c13a 0 2024-03-22T07:28:50.330 INFO:tasks.workunit.client.0.smithi134.stdout:5/950: dread - d1/d8/dc5/dd6/dfc/d11c/dac/dad/f115 zero size 2024-03-22T07:28:50.330 INFO:tasks.workunit.client.0.smithi134.stdout:5/951: write d1/d8/d16/d4a/dce/f138 [955319,72495] 0 2024-03-22T07:28:50.330 INFO:tasks.workunit.client.0.smithi134.stdout:2/910: unlink d2/d5/d8/d5d/d5f/d75/dfd/c48 0 2024-03-22T07:28:50.331 INFO:tasks.workunit.client.0.smithi134.stdout:1/892: dwrite d5/f23 [4194304,4194304] 0 2024-03-22T07:28:50.332 INFO:tasks.workunit.client.0.smithi134.stdout:1/893: chown d5/d1d/d49/fed 0 1 2024-03-22T07:28:50.332 INFO:tasks.workunit.client.0.smithi134.stdout:6/858: link d2/d1b/d4d/da5/dec/c87 d2/d1b/d4d/d65/c12d 0 2024-03-22T07:28:50.334 INFO:tasks.workunit.client.0.smithi134.stdout:5/952: unlink d1/d8/dc5/c99 0 2024-03-22T07:28:50.336 INFO:tasks.workunit.client.0.smithi134.stdout:1/894: rmdir d5/d1d/dd0/ddc/d113/d119 0 2024-03-22T07:28:50.336 INFO:tasks.workunit.client.0.smithi134.stdout:1/895: creat d5/d1d/dd0/ddc/d113/d39/da4/f13c x:0 0 0 2024-03-22T07:28:50.337 INFO:tasks.workunit.client.0.smithi134.stdout:1/896: chown d5/d1d/d49/l11c 5926 1 2024-03-22T07:28:50.337 INFO:tasks.workunit.client.0.smithi134.stdout:5/953: dread d1/d8/d20/d62/f69 [0,4194304] 0 2024-03-22T07:28:50.338 INFO:tasks.workunit.client.0.smithi134.stdout:6/859: mknod d2/d1b/daa/dc1/c12e 0 2024-03-22T07:28:50.338 INFO:tasks.workunit.client.0.smithi134.stdout:6/860: truncate d2/d1b/d4d/f74 4418134 0 2024-03-22T07:28:50.343 INFO:tasks.workunit.client.0.smithi134.stdout:1/897: getdents d5/d1d/dd0 0 2024-03-22T07:28:50.346 INFO:tasks.workunit.client.0.smithi134.stdout:1/898: unlink d5/d1d/dd0/ddc/d113/d60/leb 0 2024-03-22T07:28:50.346 INFO:tasks.workunit.client.0.smithi134.stdout:1/899: read - d5/da/d13/d1e/d63/fad zero size 2024-03-22T07:28:50.350 INFO:tasks.workunit.client.0.smithi134.stdout:1/900: rmdir d5/d1d/dd0/ddc/de3/df6 39 2024-03-22T07:28:50.351 INFO:tasks.workunit.client.0.smithi134.stdout:1/901: rmdir d5/da/df8 39 2024-03-22T07:28:50.358 INFO:tasks.workunit.client.0.smithi134.stdout:5/954: dwrite d1/d8/d16/dbd/df1/f12e [0,4194304] 0 2024-03-22T07:28:50.358 INFO:tasks.workunit.client.0.smithi134.stdout:6/861: dwrite d2/d1b/d4d/f124 [0,4194304] 0 2024-03-22T07:28:50.363 INFO:tasks.workunit.client.0.smithi134.stdout:5/955: dread d1/d4/f2b [0,4194304] 0 2024-03-22T07:28:50.363 INFO:tasks.workunit.client.0.smithi134.stdout:5/956: write d1/f10c [2035107,1030] 0 2024-03-22T07:28:50.365 INFO:tasks.workunit.client.0.smithi134.stdout:6/862: getdents d2/d1b/d4d/d65 0 2024-03-22T07:28:50.366 INFO:tasks.workunit.client.0.smithi134.stdout:5/957: rename d1/d4/l5 to d1/d8/d16/d4a/dce/de0/l13b 0 2024-03-22T07:28:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:6/863: rmdir d2/d1b/d1d/d5e/d63 39 2024-03-22T07:28:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:6/864: creat d2/d1b/d8f/f12f x:0 0 0 2024-03-22T07:28:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:6/865: read - d2/d1b/d1d/d5e/d6f/d7d/f129 zero size 2024-03-22T07:28:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/902: dwrite d5/d1d/dd0/ddc/d113/d60/d72/fb3 [0,4194304] 0 2024-03-22T07:28:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/903: fsync d5/d1d/dd0/ddc/fe0 0 2024-03-22T07:28:50.368 INFO:tasks.workunit.client.0.smithi134.stdout:1/904: chown d5/da/d1b/f36 97727 1 2024-03-22T07:28:50.374 INFO:tasks.workunit.client.0.smithi134.stdout:5/958: symlink d1/d8/d20/d62/l13c 0 2024-03-22T07:28:50.378 INFO:tasks.workunit.client.0.smithi134.stdout:5/959: write d1/d8/f66 [435557,63090] 0 2024-03-22T07:28:50.378 INFO:tasks.workunit.client.0.smithi134.stdout:1/905: dread d5/da/d13/d1e/d63/f97 [4194304,4194304] 0 2024-03-22T07:28:50.381 INFO:tasks.workunit.client.0.smithi134.stdout:6/866: dwrite d2/d1b/d4d/da5/dec/d28/d97/ff0 [0,4194304] 0 2024-03-22T07:28:50.381 INFO:tasks.workunit.client.0.smithi134.stdout:5/960: mkdir d1/d8/d16/d4a/dce/d13d 0 2024-03-22T07:28:50.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/867: symlink d2/d1b/d4d/l130 0 2024-03-22T07:28:50.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/868: read d2/d1b/d4d/fff [301480,27848] 0 2024-03-22T07:28:50.386 INFO:tasks.workunit.client.0.smithi134.stdout:6/869: write d2/f69 [1494665,39819] 0 2024-03-22T07:28:50.387 INFO:tasks.workunit.client.0.smithi134.stdout:5/961: truncate d1/d8/d16/dbd/fde 3161773 0 2024-03-22T07:28:50.389 INFO:tasks.workunit.client.0.smithi134.stdout:1/906: rmdir d5/da/d13/dac 39 2024-03-22T07:28:50.391 INFO:tasks.workunit.client.0.smithi134.stdout:6/870: creat d2/d1b/d1d/dcc/f131 x:0 0 0 2024-03-22T07:28:50.396 INFO:tasks.workunit.client.0.smithi134.stdout:6/871: rmdir d2/d1b/d8f 39 2024-03-22T07:28:50.401 INFO:tasks.workunit.client.0.smithi134.stdout:1/907: read d5/f20 [2260282,84372] 0 2024-03-22T07:28:50.401 INFO:tasks.workunit.client.0.smithi134.stdout:6/872: mknod d2/d1b/d1d/d5e/d6f/da8/c132 0 2024-03-22T07:28:50.401 INFO:tasks.workunit.client.0.smithi134.stdout:6/873: creat d2/d1b/d1d/dcc/f133 x:0 0 0 2024-03-22T07:28:50.403 INFO:tasks.workunit.client.0.smithi134.stdout:1/908: mkdir d5/da/d13/dac/d13d 0 2024-03-22T07:28:50.403 INFO:tasks.workunit.client.0.smithi134.stdout:1/909: chown d5/c1a 341 1 2024-03-22T07:28:50.404 INFO:tasks.workunit.client.0.smithi134.stdout:5/962: dwrite d1/d8/d16/f74 [0,4194304] 0 2024-03-22T07:28:50.405 INFO:tasks.workunit.client.0.smithi134.stdout:6/874: mknod d2/d1b/d1d/d5e/d6f/c134 0 2024-03-22T07:28:50.409 INFO:tasks.workunit.client.0.smithi134.stdout:1/910: write d5/da/d13/d1e/d62/faf [4187960,14668] 0 2024-03-22T07:28:50.410 INFO:tasks.workunit.client.0.smithi134.stdout:1/911: read d5/fb [645199,68429] 0 2024-03-22T07:28:50.411 INFO:tasks.workunit.client.0.smithi134.stdout:5/963: creat d1/d8/d16/d4a/dce/d13d/f13e x:0 0 0 2024-03-22T07:28:50.415 INFO:tasks.workunit.client.0.smithi134.stdout:5/964: getdents d1/d8/d20/d62 0 2024-03-22T07:28:50.418 INFO:tasks.workunit.client.0.smithi134.stdout:1/912: write d5/da/d13/d1e/d9b/f137 [1328378,117057] 0 2024-03-22T07:28:50.421 INFO:tasks.workunit.client.0.smithi134.stdout:1/913: write d5/da/d61/f83 [1649706,74602] 0 2024-03-22T07:28:50.421 INFO:tasks.workunit.client.0.smithi134.stdout:1/914: chown d5/da/d13/c4a 0 1 2024-03-22T07:28:50.421 INFO:tasks.workunit.client.0.smithi134.stdout:1/915: fdatasync d5/da/d68/da1/fbd 0 2024-03-22T07:28:50.421 INFO:tasks.workunit.client.0.smithi134.stdout:1/916: truncate d5/d1d/dd0/ddc/d113/d60/f135 30580 0 2024-03-22T07:28:50.422 INFO:tasks.workunit.client.0.smithi134.stdout:1/917: readlink d5/da/d13/d1e/d45/l103 0 2024-03-22T07:28:50.430 INFO:tasks.workunit.client.0.smithi134.stdout:5/965: dwrite d1/d8/dc5/dd6/dfc/d11c/f12b [0,4194304] 0 2024-03-22T07:28:50.430 INFO:tasks.workunit.client.0.smithi134.stdout:6/875: dwrite d2/d1b/f104 [0,4194304] 0 2024-03-22T07:28:50.431 INFO:tasks.workunit.client.0.smithi134.stdout:1/918: dread d5/da/f26 [0,4194304] 0 2024-03-22T07:28:50.437 INFO:tasks.workunit.client.0.smithi134.stdout:1/919: getdents d5/da/df8 0 2024-03-22T07:28:50.438 INFO:tasks.workunit.client.0.smithi134.stdout:6/876: mkdir d2/d1b/d1d/d5e/d6f/d7d/d135 0 2024-03-22T07:28:50.439 INFO:tasks.workunit.client.0.smithi134.stdout:1/920: truncate d5/d1d/d49/f52 1027171 0 2024-03-22T07:28:50.440 INFO:tasks.workunit.client.0.smithi134.stdout:6/877: mknod d2/d1b/d4d/da5/dec/d28/db0/c136 0 2024-03-22T07:28:50.440 INFO:tasks.workunit.client.0.smithi134.stdout:6/878: dread - d2/d6e/f100 zero size 2024-03-22T07:28:50.443 INFO:tasks.workunit.client.0.smithi134.stdout:1/921: link d5/da/d13/d1e/d63/d9d/le9 d5/d1d/dd0/ddc/de3/df6/d12b/l13e 0 2024-03-22T07:28:50.443 INFO:tasks.workunit.client.0.smithi134.stdout:5/966: dwrite d1/d8/d20/d62/d68/fc7 [0,4194304] 0 2024-03-22T07:28:50.444 INFO:tasks.workunit.client.0.smithi134.stdout:5/967: write d1/d8/d16/dbd/f108 [2287840,15652] 0 2024-03-22T07:28:50.444 INFO:tasks.workunit.client.0.smithi134.stdout:5/968: write d1/d8/d20/fae [19204,117509] 0 2024-03-22T07:28:50.444 INFO:tasks.workunit.client.0.smithi134.stdout:5/969: truncate d1/d8/dc5/dd6/dfc/d11c/fc9 4468368 0 2024-03-22T07:28:50.445 INFO:tasks.workunit.client.0.smithi134.stdout:1/922: creat d5/da/d68/d10d/f13f x:0 0 0 2024-03-22T07:28:50.452 INFO:tasks.workunit.client.0.smithi134.stdout:5/970: unlink d1/d8/da1/db0/l128 0 2024-03-22T07:28:50.452 INFO:tasks.workunit.client.0.smithi134.stdout:5/971: readlink d1/d8/d16/d4a/dce/de0/l13b 0 2024-03-22T07:28:50.452 INFO:tasks.workunit.client.0.smithi134.stdout:5/972: fdatasync d1/d8/d16/f59 0 2024-03-22T07:28:50.452 INFO:tasks.workunit.client.0.smithi134.stdout:5/973: readlink d1/d8/dc5/dd6/dfc/d11c/d95/l100 0 2024-03-22T07:28:50.454 INFO:tasks.workunit.client.0.smithi134.stdout:6/879: dwrite d2/d1b/d1d/dcc/f133 [0,4194304] 0 2024-03-22T07:28:50.454 INFO:tasks.workunit.client.0.smithi134.stdout:6/880: fsync d2/d1b/f2f 0 2024-03-22T07:28:50.456 INFO:tasks.workunit.client.0.smithi134.stdout:1/923: truncate d5/d1d/dd0/ddc/d113/d60/d72/f7d 167420 0 2024-03-22T07:28:50.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/881: write d2/d1b/d4d/fbd [1019758,11032] 0 2024-03-22T07:28:50.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/882: write d2/d1b/d4d/da5/f12b [729097,13097] 0 2024-03-22T07:28:50.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/883: chown d2/d1b/c11c 1522 1 2024-03-22T07:28:50.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/884: dread - d2/d6e/fa6 zero size 2024-03-22T07:28:50.457 INFO:tasks.workunit.client.0.smithi134.stdout:5/974: mkdir d1/d8/d20/d62/d68/d13f 0 2024-03-22T07:28:50.464 INFO:tasks.workunit.client.0.smithi134.stdout:1/924: dread d5/d1d/dd0/f10c [0,4194304] 0 2024-03-22T07:28:50.467 INFO:tasks.workunit.client.0.smithi134.stdout:1/925: dread d5/fb [0,4194304] 0 2024-03-22T07:28:50.473 INFO:tasks.workunit.client.0.smithi134.stdout:6/885: getdents d2/d1b/d1d 0 2024-03-22T07:28:50.475 INFO:tasks.workunit.client.0.smithi134.stdout:5/975: unlink d1/d8/d20/l8d 0 2024-03-22T07:28:50.480 INFO:tasks.workunit.client.0.smithi134.stdout:1/926: dwrite d5/da/d1b/de5/f108 [0,4194304] 0 2024-03-22T07:28:50.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/886: rmdir d2/d1b/d1d/d5e/d6f/d7d/d135 0 2024-03-22T07:28:50.480 INFO:tasks.workunit.client.0.smithi134.stdout:6/887: stat d2/d6e/fc8 0 2024-03-22T07:28:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:9/832: sync 2024-03-22T07:28:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/852: sync 2024-03-22T07:28:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:0/913: sync 2024-03-22T07:28:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:4/954: sync 2024-03-22T07:28:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:2/911: sync 2024-03-22T07:28:50.484 INFO:tasks.workunit.client.0.smithi134.stdout:2/912: readlink d2/d5/d8/d31/l55 0 2024-03-22T07:28:50.489 INFO:tasks.workunit.client.0.smithi134.stdout:1/927: symlink d5/da/d13/d1e/d63/d9d/l140 0 2024-03-22T07:28:50.492 INFO:tasks.workunit.client.0.smithi134.stdout:6/888: dread d2/d1b/d1d/d5e/d6f/dd7/f8e [0,4194304] 0 2024-03-22T07:28:50.493 INFO:tasks.workunit.client.0.smithi134.stdout:4/955: mknod d2/d2a/d80/c137 0 2024-03-22T07:28:50.494 INFO:tasks.workunit.client.0.smithi134.stdout:0/914: mkdir dc/d17/da7/d105/dbe/d11b 0 2024-03-22T07:28:50.497 INFO:tasks.workunit.client.0.smithi134.stdout:2/913: mkdir d2/d5/d22/dbc/d127 0 2024-03-22T07:28:50.501 INFO:tasks.workunit.client.0.smithi134.stdout:6/889: creat d2/d1b/d1d/d5e/d6f/da8/dc6/f137 x:0 0 0 2024-03-22T07:28:50.503 INFO:tasks.workunit.client.0.smithi134.stdout:4/956: rename d2/cf7 to d2/d25/d48/d6e/d7b/c138 0 2024-03-22T07:28:50.504 INFO:tasks.workunit.client.0.smithi134.stdout:3/853: dwrite d4/d10/d4b/f90 [0,4194304] 0 2024-03-22T07:28:50.507 INFO:tasks.workunit.client.0.smithi134.stdout:2/914: mknod d2/d5/d22/d99/c128 0 2024-03-22T07:28:50.509 INFO:tasks.workunit.client.0.smithi134.stdout:6/890: mknod d2/d1b/d1d/d5e/d6f/da8/dca/c138 0 2024-03-22T07:28:50.511 INFO:tasks.workunit.client.0.smithi134.stdout:0/915: rename dc/d17/da7/f10f to dc/d17/da7/d105/db8/d107/f11c 0 2024-03-22T07:28:50.514 INFO:tasks.workunit.client.0.smithi134.stdout:3/854: mkdir d4/d22/d29/d50/d109 0 2024-03-22T07:28:50.515 INFO:tasks.workunit.client.0.smithi134.stdout:2/915: mknod d2/d5/d22/c129 0 2024-03-22T07:28:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:3/855: write d4/d22/f32 [2712616,71457] 0 2024-03-22T07:28:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:3/856: chown d4/d10/f35 17791 1 2024-03-22T07:28:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:3/857: write d4/d8/fa6 [5130339,14815] 0 2024-03-22T07:28:50.518 INFO:tasks.workunit.client.0.smithi134.stdout:6/891: rename d2/d1b/d1d/f55 to d2/d1b/d4d/da5/dec/d28/d97/f139 0 2024-03-22T07:28:50.520 INFO:tasks.workunit.client.0.smithi134.stdout:0/916: write dc/d18/d89/da0/fe7 [3268184,63335] 0 2024-03-22T07:28:50.521 INFO:tasks.workunit.client.0.smithi134.stdout:2/916: rmdir d2/de5 39 2024-03-22T07:28:50.524 INFO:tasks.workunit.client.0.smithi134.stdout:3/858: link d4/d10/d4b/f90 d4/dab/f10a 0 2024-03-22T07:28:50.526 INFO:tasks.workunit.client.0.smithi134.stdout:0/917: symlink dc/de/d55/de1/l11d 0 2024-03-22T07:28:50.530 INFO:tasks.workunit.client.0.smithi134.stdout:2/917: truncate d2/d5/d8/d5d/d5f/d75/dfd/d60/fa7 3950014 0 2024-03-22T07:28:50.530 INFO:tasks.workunit.client.0.smithi134.stdout:1/928: dwrite d5/d1d/d49/f8a [0,4194304] 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/892: dread d2/d1b/d4d/da5/dec/d28/f7e [4194304,4194304] 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/893: stat d2/d1b/d4d/da5/dec/fb8 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/894: stat d2/l40 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/895: readlink d2/l2a 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:3/859: getdents d4/d8/d7f/d9c 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:3/860: truncate d4/d8/d7f/d9c/db9/ffd 829137 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/896: write d2/d1b/d1d/d5e/d63/f64 [3974627,108461] 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/897: write d2/d1b/d4d/da5/dec/d28/d97/ff6 [105092,47987] 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:6/898: dread - d2/d1b/d1d/d5e/d6f/dd7/f118 zero size 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:0/918: rmdir dc/d18/d89 39 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:5/976: dwrite d1/d8/d20/d62/f92 [0,4194304] 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:4/957: dwrite d2/d25/d74/fdd [0,4194304] 0 2024-03-22T07:28:50.531 INFO:tasks.workunit.client.0.smithi134.stdout:4/958: truncate d2/d15/d35/da8/dec/def/d106/f124 803494 0 2024-03-22T07:28:50.532 INFO:tasks.workunit.client.0.smithi134.stdout:4/959: truncate d2/d2a/d50/fb8 599401 0 2024-03-22T07:28:50.532 INFO:tasks.workunit.client.0.smithi134.stdout:2/918: creat d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/f12a x:0 0 0 2024-03-22T07:28:50.536 INFO:tasks.workunit.client.0.smithi134.stdout:3/861: getdents d4/d8/d7f 0 2024-03-22T07:28:50.538 INFO:tasks.workunit.client.0.smithi134.stdout:0/919: rmdir dc/de/d55/d60/dee 39 2024-03-22T07:28:50.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/899: write d2/d1b/d1d/d5e/d84/faf [3281189,114982] 0 2024-03-22T07:28:50.539 INFO:tasks.workunit.client.0.smithi134.stdout:6/900: chown d2/d1b/d1d/d5e/d63/l9a 308302 1 2024-03-22T07:28:50.541 INFO:tasks.workunit.client.0.smithi134.stdout:5/977: truncate d1/f57 600439 0 2024-03-22T07:28:50.545 INFO:tasks.workunit.client.0.smithi134.stdout:4/960: creat d2/d25/d74/dde/dc0/de5/d129/f139 x:0 0 0 2024-03-22T07:28:50.549 INFO:tasks.workunit.client.0.smithi134.stdout:0/920: link dc/d17/da7/d105/dbe/d100/c110 dc/d17/da7/d105/c11e 0 2024-03-22T07:28:50.557 INFO:tasks.workunit.client.0.smithi134.stdout:5/978: mknod d1/d8/d20/d62/df2/c140 0 2024-03-22T07:28:50.561 INFO:tasks.workunit.client.0.smithi134.stdout:4/961: getdents d2/d98 0 2024-03-22T07:28:50.563 INFO:tasks.workunit.client.0.smithi134.stdout:5/979: symlink d1/d8/d16/dbd/l141 0 2024-03-22T07:28:50.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/962: rename d2/d25/d48/d6e/d7b/dd7/f11c to d2/d25/d74/dde/d76/d125/f13a 0 2024-03-22T07:28:50.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/963: dread - d2/d15/d35/da8/dec/f11f zero size 2024-03-22T07:28:50.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/964: fsync d2/d25/d74/dde/dc0/fd9 0 2024-03-22T07:28:50.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/965: chown d2/d25/d74/dde/f8c 3926536 1 2024-03-22T07:28:50.566 INFO:tasks.workunit.client.0.smithi134.stdout:4/966: chown d2/d25/d48/f57 6765 1 2024-03-22T07:28:50.567 INFO:tasks.workunit.client.0.smithi134.stdout:4/967: link d2/d98/f113 d2/f13b 0 2024-03-22T07:28:50.567 INFO:tasks.workunit.client.0.smithi134.stdout:4/968: stat d2/d15/d35/da8/l130 0 2024-03-22T07:28:50.584 INFO:tasks.workunit.client.0.smithi134.stdout:5/980: dwrite d1/d8/d16/dbd/fde [0,4194304] 0 2024-03-22T07:28:50.584 INFO:tasks.workunit.client.0.smithi134.stdout:5/981: chown d1/f57 19755 1 2024-03-22T07:28:50.584 INFO:tasks.workunit.client.0.smithi134.stdout:5/982: creat d1/f142 x:0 0 0 2024-03-22T07:28:50.607 INFO:tasks.workunit.client.0.smithi134.stdout:3/862: dread d4/d8/d23/f60 [0,4194304] 0 2024-03-22T07:28:50.607 INFO:tasks.workunit.client.0.smithi134.stdout:3/863: fdatasync d4/d22/f3e 0 2024-03-22T07:28:50.607 INFO:tasks.workunit.client.0.smithi134.stdout:4/969: dwrite d2/d25/d48/d6e/d7b/dd7/fe2 [0,4194304] 0 2024-03-22T07:28:50.607 INFO:tasks.workunit.client.0.smithi134.stdout:4/970: dread - d2/d25/d48/dd3/f133 zero size 2024-03-22T07:28:50.608 INFO:tasks.workunit.client.0.smithi134.stdout:5/983: creat d1/d8/dc5/dd6/dfc/d11c/dac/f143 x:0 0 0 2024-03-22T07:28:50.608 INFO:tasks.workunit.client.0.smithi134.stdout:3/864: symlink d4/d8/d5c/l10b 0 2024-03-22T07:28:50.612 INFO:tasks.workunit.client.0.smithi134.stdout:4/971: truncate d2/d15/f1b 3100545 0 2024-03-22T07:28:50.612 INFO:tasks.workunit.client.0.smithi134.stdout:1/929: dwrite d5/da/d13/d1e/d62/dda/f118 [0,4194304] 0 2024-03-22T07:28:50.615 INFO:tasks.workunit.client.0.smithi134.stdout:5/984: mknod d1/d8/d16/c144 0 2024-03-22T07:28:50.615 INFO:tasks.workunit.client.0.smithi134.stdout:5/985: creat d1/d8/d20/d8a/d110/f145 x:0 0 0 2024-03-22T07:28:50.616 INFO:tasks.workunit.client.0.smithi134.stdout:1/930: dread d5/fb [0,4194304] 0 2024-03-22T07:28:50.619 INFO:tasks.workunit.client.0.smithi134.stdout:4/972: link d2/d25/d74/dde/dc0/ce1 d2/d15/d35/da8/dec/def/d106/c13c 0 2024-03-22T07:28:50.619 INFO:tasks.workunit.client.0.smithi134.stdout:4/973: fsync d2/d2a/d80/d85/f88 0 2024-03-22T07:28:50.623 INFO:tasks.workunit.client.0.smithi134.stdout:3/865: dwrite d4/fe4 [0,4194304] 0 2024-03-22T07:28:50.623 INFO:tasks.workunit.client.0.smithi134.stdout:3/866: write d4/fdd [2495002,40913] 0 2024-03-22T07:28:50.623 INFO:tasks.workunit.client.0.smithi134.stdout:5/986: getdents d1/d8/d20/d62/df2 0 2024-03-22T07:28:50.625 INFO:tasks.workunit.client.0.smithi134.stdout:1/931: link d5/da/d13/d1e/de7/fa2 d5/da/d13/dac/f141 0 2024-03-22T07:28:50.628 INFO:tasks.workunit.client.0.smithi134.stdout:4/974: symlink d2/d25/d74/dde/dc0/de5/l13d 0 2024-03-22T07:28:50.639 INFO:tasks.workunit.client.0.smithi134.stdout:3/867: symlink d4/d8/d5c/de6/df2/l10c 0 2024-03-22T07:28:50.640 INFO:tasks.workunit.client.0.smithi134.stdout:3/868: write d4/d8/d5c/de6/df2/f78 [16841,45546] 0 2024-03-22T07:28:50.640 INFO:tasks.workunit.client.0.smithi134.stdout:3/869: fsync d4/d8/d5c/de6/df2/f84 0 2024-03-22T07:28:50.640 INFO:tasks.workunit.client.0.smithi134.stdout:3/870: chown d4/d22/d3c/f98 12782 1 2024-03-22T07:28:50.641 INFO:tasks.workunit.client.0.smithi134.stdout:5/987: symlink d1/d8/dc5/l146 0 2024-03-22T07:28:50.641 INFO:tasks.workunit.client.0.smithi134.stdout:5/988: readlink d1/d8/dc5/lf7 0 2024-03-22T07:28:50.642 INFO:tasks.workunit.client.0.smithi134.stdout:1/932: rmdir d5/d1d/d49/d92 39 2024-03-22T07:28:50.642 INFO:tasks.workunit.client.0.smithi134.stdout:1/933: stat d5/da/d13/d1e/d62 0 2024-03-22T07:28:50.642 INFO:tasks.workunit.client.0.smithi134.stdout:1/934: write d5/f133 [909150,68376] 0 2024-03-22T07:28:50.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/975: creat d2/d15/d6f/f13e x:0 0 0 2024-03-22T07:28:50.644 INFO:tasks.workunit.client.0.smithi134.stdout:4/976: truncate d2/d25/d74/dde/dc0/de5/d129/f139 88513 0 2024-03-22T07:28:50.646 INFO:tasks.workunit.client.0.smithi134.stdout:5/989: rmdir d1/d8/dc5/dd6/dfc/d11c/d95 39 2024-03-22T07:28:50.648 INFO:tasks.workunit.client.0.smithi134.stdout:3/871: read d4/d22/d29/f67 [5509222,1706] 0 2024-03-22T07:28:50.648 INFO:tasks.workunit.client.0.smithi134.stdout:4/977: mkdir d2/d15/d35/da8/dec/def/d106/d13f 0 2024-03-22T07:28:50.650 INFO:tasks.workunit.client.0.smithi134.stdout:4/978: getdents d2/d25/d74 0 2024-03-22T07:28:50.654 INFO:tasks.workunit.client.0.smithi134.stdout:4/979: rename d2/d2a/d80/dd6/f90 to d2/d2a/d80/d101/f140 0 2024-03-22T07:28:50.657 INFO:tasks.workunit.client.0.smithi134.stdout:3/872: write d4/d8/d45/f91 [3844076,126238] 0 2024-03-22T07:28:50.657 INFO:tasks.workunit.client.0.smithi134.stdout:3/873: creat d4/d8/d7f/d9c/db9/f10d x:0 0 0 2024-03-22T07:28:50.658 INFO:tasks.workunit.client.0.smithi134.stdout:3/874: stat d4/d22/d29/d50/f62 0 2024-03-22T07:28:50.658 INFO:tasks.workunit.client.0.smithi134.stdout:3/875: chown d4/d10/c1f 403501 1 2024-03-22T07:28:50.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/876: mkdir d4/d22/d3c/d88/d10e 0 2024-03-22T07:28:50.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/877: fsync d4/d8/d5c/de6/df2/f86 0 2024-03-22T07:28:50.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/878: readlink d4/d8/d7f/d9c/ldc 0 2024-03-22T07:28:50.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/879: chown d4/d22/d29 51198618 1 2024-03-22T07:28:50.664 INFO:tasks.workunit.client.0.smithi134.stdout:3/880: chown d4/d8/d5c/cd2 313691912 1 2024-03-22T07:28:50.665 INFO:tasks.workunit.client.0.smithi134.stdout:1/935: dwrite d5/d1d/dd0/ddc/fe0 [0,4194304] 0 2024-03-22T07:28:50.665 INFO:tasks.workunit.client.0.smithi134.stdout:4/980: dread d2/fa1 [0,4194304] 0 2024-03-22T07:28:50.665 INFO:tasks.workunit.client.0.smithi134.stdout:4/981: dread - d2/d15/d35/da8/f11a zero size 2024-03-22T07:28:50.667 INFO:tasks.workunit.client.0.smithi134.stdout:1/936: unlink d5/d1d/dd0/ddc/d113/d39/l100 0 2024-03-22T07:28:50.670 INFO:tasks.workunit.client.0.smithi134.stdout:4/982: unlink d2/d25/d48/d6e/fea 0 2024-03-22T07:28:50.671 INFO:tasks.workunit.client.0.smithi134.stdout:4/983: write d2/d25/f1c [1458861,56162] 0 2024-03-22T07:28:50.677 INFO:tasks.workunit.client.0.smithi134.stdout:4/984: read d2/d25/d48/dd3/fb7 [2900133,117315] 0 2024-03-22T07:28:50.677 INFO:tasks.workunit.client.0.smithi134.stdout:4/985: chown d2/d25/l100 1240 1 2024-03-22T07:28:50.677 INFO:tasks.workunit.client.0.smithi134.stdout:1/937: dread d5/da/d13/f3f [0,4194304] 0 2024-03-22T07:28:50.678 INFO:tasks.workunit.client.0.smithi134.stdout:4/986: link d2/d25/d74/dde/dc0/de5/ff9 d2/d25/d48/d128/f141 0 2024-03-22T07:28:50.679 INFO:tasks.workunit.client.0.smithi134.stdout:4/987: readlink d2/l49 0 2024-03-22T07:28:50.679 INFO:tasks.workunit.client.0.smithi134.stdout:1/938: truncate d5/d1d/dd0/ddc/d113/d39/da4/fb8 2230867 0 2024-03-22T07:28:50.681 INFO:tasks.workunit.client.0.smithi134.stdout:1/939: mknod d5/da/df8/c142 0 2024-03-22T07:28:50.683 INFO:tasks.workunit.client.0.smithi134.stdout:4/988: dread d2/fa1 [4194304,4194304] 0 2024-03-22T07:28:50.685 INFO:tasks.workunit.client.0.smithi134.stdout:4/989: creat d2/d25/d48/d87/f142 x:0 0 0 2024-03-22T07:28:50.685 INFO:tasks.workunit.client.0.smithi134.stdout:4/990: write d2/d25/fe7 [390062,121378] 0 2024-03-22T07:28:50.691 INFO:tasks.workunit.client.0.smithi134.stdout:3/881: rename d4/d22/d3c/d88 to d4/d8/d69/d6a/d10f 0 2024-03-22T07:28:50.692 INFO:tasks.workunit.client.0.smithi134.stdout:4/991: rename d2/d2a/d80/dd6/c21 to d2/d15/d6f/c143 0 2024-03-22T07:28:50.692 INFO:tasks.workunit.client.0.smithi134.stdout:4/992: write d2/d15/d35/fb9 [5970224,112632] 0 2024-03-22T07:28:50.694 INFO:tasks.workunit.client.0.smithi134.stdout:3/882: rename d4/d10/f36 to d4/d22/d29/d82/f110 0 2024-03-22T07:28:50.695 INFO:tasks.workunit.client.0.smithi134.stdout:3/883: stat d4/d22/c68 0 2024-03-22T07:28:50.699 INFO:tasks.workunit.client.0.smithi134.stdout:1/940: dwrite d5/d1d/dd0/ddc/d113/d60/f124 [0,4194304] 0 2024-03-22T07:28:50.706 INFO:tasks.workunit.client.0.smithi134.stdout:4/993: dread d2/d2a/d50/fa9 [0,4194304] 0 2024-03-22T07:28:50.708 INFO:tasks.workunit.client.0.smithi134.stdout:4/994: creat d2/d15/d35/da8/dfa/f144 x:0 0 0 2024-03-22T07:28:50.711 INFO:tasks.workunit.client.0.smithi134.stdout:4/995: symlink d2/d25/d74/dde/dc0/de5/d129/l145 0 2024-03-22T07:28:50.714 INFO:tasks.workunit.client.0.smithi134.stdout:3/884: dwrite d4/d10/fbe [8388608,4194304] 0 2024-03-22T07:28:50.715 INFO:tasks.workunit.client.0.smithi134.stdout:3/885: readlink d4/d22/d29/l31 0 2024-03-22T07:28:50.715 INFO:tasks.workunit.client.0.smithi134.stdout:4/996: mkdir d2/d15/d6f/d146 0 2024-03-22T07:28:50.719 INFO:tasks.workunit.client.0.smithi134.stdout:1/941: dwrite d5/da/d13/d1e/d34/f3e [0,4194304] 0 2024-03-22T07:28:50.729 INFO:tasks.workunit.client.0.smithi134.stdout:4/997: getdents d2/d25/d74/dde/dc0/de5 0 2024-03-22T07:28:50.729 INFO:tasks.workunit.client.0.smithi134.stdout:4/998: write d2/d2a/d80/dd6/f24 [3023785,114757] 0 2024-03-22T07:28:50.729 INFO:tasks.workunit.client.0.smithi134.stdout:4/999: fdatasync d2/d15/d6f/fd5 0 2024-03-22T07:28:50.729 INFO:tasks.workunit.client.0.smithi134.stdout:3/886: getdents d4/d8/d7f/d9c/db9 0 2024-03-22T07:28:50.736 INFO:tasks.workunit.client.0.smithi134.stdout:3/887: fsync d4/d22/d29/d82/f110 0 2024-03-22T07:28:50.739 INFO:tasks.workunit.client.0.smithi134.stdout:1/942: rmdir d5/d1d/dd0/ddc/d113/d60/d72 39 2024-03-22T07:28:50.742 INFO:tasks.workunit.client.0.smithi134.stdout:1/943: symlink d5/da/d13/dac/d13d/l143 0 2024-03-22T07:28:50.742 INFO:tasks.workunit.client.0.smithi134.stdout:1/944: chown d5/da/d13/dac/ffa 69361159 1 2024-03-22T07:28:50.744 INFO:tasks.workunit.client.0.smithi134.stdout:1/945: truncate d5/da/d13/db9/fba 3028733 0 2024-03-22T07:28:50.746 INFO:tasks.workunit.client.0.smithi134.stdout:1/946: creat d5/da/d13/dac/f144 x:0 0 0 2024-03-22T07:28:50.748 INFO:tasks.workunit.client.0.smithi134.stdout:1/947: symlink d5/d1d/d49/l145 0 2024-03-22T07:28:50.751 INFO:tasks.workunit.client.0.smithi134.stdout:1/948: dread d5/da/d13/d1e/f44 [0,4194304] 0 2024-03-22T07:28:50.753 INFO:tasks.workunit.client.0.smithi134.stdout:1/949: symlink d5/da/d13/d1e/d45/l146 0 2024-03-22T07:28:50.756 INFO:tasks.workunit.client.0.smithi134.stdout:1/950: symlink d5/da/d68/l147 0 2024-03-22T07:28:50.756 INFO:tasks.workunit.client.0.smithi134.stdout:1/951: stat d5/d1d/dd0/ddc/d113/dae/l10a 0 2024-03-22T07:28:50.757 INFO:tasks.workunit.client.0.smithi134.stdout:1/952: symlink d5/da/d13/dac/d13d/l148 0 2024-03-22T07:28:50.759 INFO:tasks.workunit.client.0.smithi134.stdout:1/953: mkdir d5/da/d68/d149 0 2024-03-22T07:28:50.759 INFO:tasks.workunit.client.0.smithi134.stdout:1/954: creat d5/da/d68/d10d/f14a x:0 0 0 2024-03-22T07:28:50.761 INFO:tasks.workunit.client.0.smithi134.stdout:3/888: dwrite d4/d8/d69/d6a/f9b [0,4194304] 0 2024-03-22T07:28:50.797 INFO:tasks.workunit.client.0.smithi134.stdout:1/955: rmdir d5/da/d1b/de5 39 2024-03-22T07:28:50.800 INFO:tasks.workunit.client.0.smithi134.stdout:3/889: truncate d4/f1a 1689829 0 2024-03-22T07:28:50.800 INFO:tasks.workunit.client.0.smithi134.stdout:3/890: fsync d4/f1e 0 2024-03-22T07:28:50.800 INFO:tasks.workunit.client.0.smithi134.stdout:3/891: write d4/d10/fb0 [429448,73322] 0 2024-03-22T07:28:50.800 INFO:tasks.workunit.client.0.smithi134.stdout:3/892: creat d4/f111 x:0 0 0 2024-03-22T07:28:50.802 INFO:tasks.workunit.client.0.smithi134.stdout:1/956: mknod d5/d1d/dd0/ddc/c14b 0 2024-03-22T07:28:50.805 INFO:tasks.workunit.client.0.smithi134.stdout:1/957: symlink d5/d1d/dd0/ddc/d113/l14c 0 2024-03-22T07:28:50.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/893: write d4/d10/fbe [11792415,63289] 0 2024-03-22T07:28:50.809 INFO:tasks.workunit.client.0.smithi134.stdout:3/894: fdatasync d4/d10/d4b/fb7 0 2024-03-22T07:28:50.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/895: creat d4/d10/f112 x:0 0 0 2024-03-22T07:28:50.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/896: readlink d4/d8/d45/laf 0 2024-03-22T07:28:50.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/897: fsync d4/d22/d29/d82/fef 0 2024-03-22T07:28:50.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/898: chown d4/d22/f7c 247 1 2024-03-22T07:28:50.810 INFO:tasks.workunit.client.0.smithi134.stdout:3/899: chown d4/d10/fb0 29 1 2024-03-22T07:28:50.815 INFO:tasks.workunit.client.0.smithi134.stdout:3/900: dread d4/d8/d45/f91 [0,4194304] 0 2024-03-22T07:28:50.815 INFO:tasks.workunit.client.0.smithi134.stdout:3/901: chown d4/d22/d29/l100 137298 1 2024-03-22T07:28:50.821 INFO:tasks.workunit.client.0.smithi134.stdout:1/958: dwrite d5/da/d68/da1/fa3 [0,4194304] 0 2024-03-22T07:28:50.825 INFO:tasks.workunit.client.0.smithi134.stdout:1/959: creat d5/d1d/dd0/ddc/d113/f14d x:0 0 0 2024-03-22T07:28:50.841 INFO:tasks.workunit.client.0.smithi134.stdout:1/960: dwrite d5/d1d/f13a [0,4194304] 0 2024-03-22T07:28:50.844 INFO:tasks.workunit.client.0.smithi134.stdout:1/961: symlink d5/da/d13/d1e/l14e 0 2024-03-22T07:28:50.848 INFO:tasks.workunit.client.0.smithi134.stdout:1/962: link d5/d1d/dd0/ddc/d113/dae/cbf d5/da/df8/c14f 0 2024-03-22T07:28:50.849 INFO:tasks.workunit.client.0.smithi134.stdout:1/963: symlink d5/da/d1b/de5/l150 0 2024-03-22T07:28:50.850 INFO:tasks.workunit.client.0.smithi134.stdout:1/964: mknod d5/da/d1b/c151 0 2024-03-22T07:28:50.852 INFO:tasks.workunit.client.0.smithi134.stdout:1/965: creat d5/da/d13/dac/d10b/f152 x:0 0 0 2024-03-22T07:28:50.857 INFO:tasks.workunit.client.0.smithi134.stdout:1/966: dread d5/d1d/d2d/f57 [0,4194304] 0 2024-03-22T07:28:50.860 INFO:tasks.workunit.client.0.smithi134.stdout:1/967: link d5/d1d/dd0/ddc/de3/df6/f107 d5/d1d/dd0/ddc/d113/d60/d72/d117/f153 0 2024-03-22T07:28:50.860 INFO:tasks.workunit.client.0.smithi134.stdout:1/968: write d5/da/d13/d1e/d34/f59 [4390285,114214] 0 2024-03-22T07:28:50.861 INFO:tasks.workunit.client.0.smithi134.stdout:3/902: write f0 [1030684,130689] 0 2024-03-22T07:28:50.879 INFO:tasks.workunit.client.0.smithi134.stdout:1/969: write d5/da/d13/d1e/d34/f3e [2278483,11590] 0 2024-03-22T07:28:50.891 INFO:tasks.workunit.client.0.smithi134.stdout:3/903: dwrite d4/d22/d29/d82/fc1 [0,4194304] 0 2024-03-22T07:28:50.901 INFO:tasks.workunit.client.0.smithi134.stdout:1/970: dwrite d5/da/d68/da1/fbd [0,4194304] 0 2024-03-22T07:28:50.901 INFO:tasks.workunit.client.0.smithi134.stdout:1/971: read - d5/da/d61/f11f zero size 2024-03-22T07:28:50.902 INFO:tasks.workunit.client.0.smithi134.stdout:1/972: getdents d5/d1d/dd0/d130 0 2024-03-22T07:28:50.908 INFO:tasks.workunit.client.0.smithi134.stdout:3/904: write d4/d8/d5c/fb3 [3641865,74079] 0 2024-03-22T07:28:50.908 INFO:tasks.workunit.client.0.smithi134.stdout:1/973: mknod d5/da/c154 0 2024-03-22T07:28:50.912 INFO:tasks.workunit.client.0.smithi134.stdout:3/905: rename d4/d8/d69/d6a/d10f/ld3 to d4/d8/d69/l113 0 2024-03-22T07:28:50.915 INFO:tasks.workunit.client.0.smithi134.stdout:9/833: sync 2024-03-22T07:28:50.918 INFO:tasks.workunit.client.0.smithi134.stdout:3/906: getdents d4/d8/d45 0 2024-03-22T07:28:50.919 INFO:tasks.workunit.client.0.smithi134.stdout:1/974: symlink d5/d1d/dd0/ddc/d113/d39/l155 0 2024-03-22T07:28:50.921 INFO:tasks.workunit.client.0.smithi134.stdout:9/834: unlink d3/d9/d37/d3c/d71/dc2/ff2 0 2024-03-22T07:28:50.921 INFO:tasks.workunit.client.0.smithi134.stdout:9/835: fdatasync d3/d9/d37/d6f/f5d 0 2024-03-22T07:28:50.922 INFO:tasks.workunit.client.0.smithi134.stdout:3/907: creat d4/d22/d29/dad/f114 x:0 0 0 2024-03-22T07:28:50.924 INFO:tasks.workunit.client.0.smithi134.stdout:1/975: creat d5/d1d/dd0/ddc/de3/df6/f156 x:0 0 0 2024-03-22T07:28:50.925 INFO:tasks.workunit.client.0.smithi134.stdout:3/908: symlink d4/d8/d69/d6a/l115 0 2024-03-22T07:28:50.925 INFO:tasks.workunit.client.0.smithi134.stdout:3/909: chown d4/d8/d69/d6a/f9b 47722 1 2024-03-22T07:28:50.926 INFO:tasks.workunit.client.0.smithi134.stdout:3/910: chown d4/d8/d69/dd7/led 5573285 1 2024-03-22T07:28:50.926 INFO:tasks.workunit.client.0.smithi134.stdout:1/976: truncate d5/da/d13/d1e/de7/fa2 2461395 0 2024-03-22T07:28:50.928 INFO:tasks.workunit.client.0.smithi134.stdout:9/836: write d3/d9/d37/d6f/f29 [36406,63485] 0 2024-03-22T07:28:50.928 INFO:tasks.workunit.client.0.smithi134.stdout:3/911: symlink d4/d8/l116 0 2024-03-22T07:28:50.928 INFO:tasks.workunit.client.0.smithi134.stdout:3/912: creat d4/d8/f117 x:0 0 0 2024-03-22T07:28:50.931 INFO:tasks.workunit.client.0.smithi134.stdout:9/837: link d3/d9/d37/d6f/d54/d9d/lc4 d3/d9/df/d12/dfc/l113 0 2024-03-22T07:28:50.932 INFO:tasks.workunit.client.0.smithi134.stdout:3/913: mknod d4/d8/d45/c118 0 2024-03-22T07:28:50.934 INFO:tasks.workunit.client.0.smithi134.stdout:1/977: getdents d5/da/d13/dac 0 2024-03-22T07:28:50.938 INFO:tasks.workunit.client.0.smithi134.stdout:9/838: symlink d3/d9/d37/d5a/d7f/d80/l114 0 2024-03-22T07:28:50.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/839: mkdir d3/d9/d37/d3c/d71/d8c/d115 0 2024-03-22T07:28:50.942 INFO:tasks.workunit.client.0.smithi134.stdout:9/840: chown d3/d9 0 1 2024-03-22T07:28:50.944 INFO:tasks.workunit.client.0.smithi134.stdout:9/841: rename d3/d9/d37/d5a/d7f/d80/f95 to d3/d9/df/d12/dfc/f116 0 2024-03-22T07:28:50.944 INFO:tasks.workunit.client.0.smithi134.stdout:9/842: truncate d3/d9/d37/d3c/d71/fe2 644138 0 2024-03-22T07:28:50.944 INFO:tasks.workunit.client.0.smithi134.stdout:1/978: write d5/da/d13/d1e/d34/f5f [143698,80167] 0 2024-03-22T07:28:50.945 INFO:tasks.workunit.client.0.smithi134.stdout:9/843: mknod d3/d9/d37/d6f/c117 0 2024-03-22T07:28:50.946 INFO:tasks.workunit.client.0.smithi134.stdout:1/979: creat d5/da/d68/da1/f157 x:0 0 0 2024-03-22T07:28:50.947 INFO:tasks.workunit.client.0.smithi134.stdout:3/914: dwrite d4/d22/d3c/fc8 [0,4194304] 0 2024-03-22T07:28:50.948 INFO:tasks.workunit.client.0.smithi134.stdout:9/844: mknod d3/d9/d37/d3c/d71/c118 0 2024-03-22T07:28:50.949 INFO:tasks.workunit.client.0.smithi134.stdout:1/980: getdents d5/da/d13/d1e/de7 0 2024-03-22T07:28:50.954 INFO:tasks.workunit.client.0.smithi134.stdout:9/845: mknod d3/d9/d37/d3c/c119 0 2024-03-22T07:28:50.955 INFO:tasks.workunit.client.0.smithi134.stdout:1/981: mkdir d5/d1d/d158 0 2024-03-22T07:28:50.955 INFO:tasks.workunit.client.0.smithi134.stdout:3/915: write d4/d8/d69/faa [187305,15433] 0 2024-03-22T07:28:50.956 INFO:tasks.workunit.client.0.smithi134.stdout:3/916: write d4/d22/d29/d50/f62 [3818388,42508] 0 2024-03-22T07:28:50.956 INFO:tasks.workunit.client.0.smithi134.stdout:9/846: mknod d3/d9/d37/c11a 0 2024-03-22T07:28:50.956 INFO:tasks.workunit.client.0.smithi134.stdout:9/847: write d3/d9/df/d12/f4c [1725912,37207] 0 2024-03-22T07:28:50.959 INFO:tasks.workunit.client.0.smithi134.stdout:3/917: mknod d4/d8/d7f/d9c/c119 0 2024-03-22T07:28:50.960 INFO:tasks.workunit.client.0.smithi134.stdout:9/848: symlink d3/d9/df/d57/l11b 0 2024-03-22T07:28:50.965 INFO:tasks.workunit.client.0.smithi134.stdout:9/849: read d3/d9/d37/d6f/d54/f83 [1742874,50012] 0 2024-03-22T07:28:50.966 INFO:tasks.workunit.client.0.smithi134.stdout:9/850: getdents d3/d9/d37/d3c/dcb 0 2024-03-22T07:28:50.968 INFO:tasks.workunit.client.0.smithi134.stdout:9/851: symlink d3/d9/d37/d6f/d54/d9d/l11c 0 2024-03-22T07:28:50.968 INFO:tasks.workunit.client.0.smithi134.stdout:9/852: fsync d3/d9/d37/d5a/faa 0 2024-03-22T07:28:50.971 INFO:tasks.workunit.client.0.smithi134.stdout:9/853: creat d3/d9/d37/d3c/d71/f11d x:0 0 0 2024-03-22T07:28:50.972 INFO:tasks.workunit.client.0.smithi134.stdout:9/854: stat d3/d9/df/l23 0 2024-03-22T07:28:50.974 INFO:tasks.workunit.client.0.smithi134.stdout:9/855: mknod d3/d9/d37/d3c/d71/d10c/c11e 0 2024-03-22T07:28:50.975 INFO:tasks.workunit.client.0.smithi134.stdout:3/918: dwrite d4/d8/d7f/d9c/db9/f10d [0,4194304] 0 2024-03-22T07:28:50.976 INFO:tasks.workunit.client.0.smithi134.stdout:9/856: unlink d3/d9/df/l23 0 2024-03-22T07:28:50.977 INFO:tasks.workunit.client.0.smithi134.stdout:1/982: dwrite d5/da/f21 [0,4194304] 0 2024-03-22T07:28:50.977 INFO:tasks.workunit.client.0.smithi134.stdout:9/857: write d3/d9/d37/fcf [9162822,37385] 0 2024-03-22T07:28:50.977 INFO:tasks.workunit.client.0.smithi134.stdout:1/983: write d5/d1d/dd0/ddc/d113/d39/f82 [1014001,9437] 0 2024-03-22T07:28:50.978 INFO:tasks.workunit.client.0.smithi134.stdout:3/919: symlink d4/d22/d29/d50/l11a 0 2024-03-22T07:28:50.978 INFO:tasks.workunit.client.0.smithi134.stdout:3/920: chown d4/d8/d69/d6a/d10f/d108 234681 1 2024-03-22T07:28:50.980 INFO:tasks.workunit.client.0.smithi134.stdout:9/858: creat d3/d9/d37/d5a/dc5/d10b/d10e/f11f x:0 0 0 2024-03-22T07:28:50.980 INFO:tasks.workunit.client.0.smithi134.stdout:1/984: mkdir d5/da/df8/d159 0 2024-03-22T07:28:50.981 INFO:tasks.workunit.client.0.smithi134.stdout:3/921: creat d4/d10/d4b/dcc/f11b x:0 0 0 2024-03-22T07:28:50.982 INFO:tasks.workunit.client.0.smithi134.stdout:3/922: readlink d4/d8/d7f/d9c/ldc 0 2024-03-22T07:28:50.983 INFO:tasks.workunit.client.0.smithi134.stdout:1/985: creat d5/d1d/dd0/f15a x:0 0 0 2024-03-22T07:28:50.984 INFO:tasks.workunit.client.0.smithi134.stdout:3/923: symlink d4/d8/d23/l11c 0 2024-03-22T07:28:50.984 INFO:tasks.workunit.client.0.smithi134.stdout:3/924: fdatasync d4/d22/d3c/fbf 0 2024-03-22T07:28:50.989 INFO:tasks.workunit.client.0.smithi134.stdout:9/859: dread d3/d9/df/f26 [8388608,4194304] 0 2024-03-22T07:28:50.989 INFO:tasks.workunit.client.0.smithi134.stdout:9/860: dread - d3/d9/d37/d5a/d7f/ff0 zero size 2024-03-22T07:28:50.989 INFO:tasks.workunit.client.0.smithi134.stdout:9/861: truncate d3/d9/ffd 640320 0 2024-03-22T07:28:50.997 INFO:tasks.workunit.client.0.smithi134.stdout:3/925: dwrite d4/d22/f3e [0,4194304] 0 2024-03-22T07:28:50.997 INFO:tasks.workunit.client.0.smithi134.stdout:3/926: stat d4/d22/d29/d82 0 2024-03-22T07:28:50.998 INFO:tasks.workunit.client.0.smithi134.stdout:1/986: unlink d5/da/d13/d1e/l14e 0 2024-03-22T07:28:50.998 INFO:tasks.workunit.client.0.smithi134.stdout:9/862: symlink d3/d9/d37/d5a/d7f/l120 0 2024-03-22T07:28:51.006 INFO:tasks.workunit.client.0.smithi134.stdout:1/987: dread d5/d1d/d49/f8a [0,4194304] 0 2024-03-22T07:28:51.007 INFO:tasks.workunit.client.0.smithi134.stdout:3/927: symlink d4/d8/d69/d6a/d10f/d108/l11d 0 2024-03-22T07:28:51.007 INFO:tasks.workunit.client.0.smithi134.stdout:9/863: creat d3/d9/d37/d70/f121 x:0 0 0 2024-03-22T07:28:51.014 INFO:tasks.workunit.client.0.smithi134.stdout:1/988: creat d5/d1d/dd0/ddc/de3/f15b x:0 0 0 2024-03-22T07:28:51.015 INFO:tasks.workunit.client.0.smithi134.stdout:3/928: creat d4/d10/dcd/f11e x:0 0 0 2024-03-22T07:28:51.016 INFO:tasks.workunit.client.0.smithi134.stdout:1/989: dread d5/da/fb0 [0,4194304] 0 2024-03-22T07:28:51.019 INFO:tasks.workunit.client.0.smithi134.stdout:2/919: sync 2024-03-22T07:28:51.019 INFO:tasks.workunit.client.0.smithi134.stdout:0/921: sync 2024-03-22T07:28:51.019 INFO:tasks.workunit.client.0.smithi134.stdout:5/990: sync 2024-03-22T07:28:51.020 INFO:tasks.workunit.client.0.smithi134.stdout:6/901: sync 2024-03-22T07:28:51.020 INFO:tasks.workunit.client.0.smithi134.stdout:6/902: dread - d2/d6e/fa6 zero size 2024-03-22T07:28:51.020 INFO:tasks.workunit.client.0.smithi134.stdout:3/929: creat d4/d8/d7f/d9c/db9/ddf/f11f x:0 0 0 2024-03-22T07:28:51.022 INFO:tasks.workunit.client.0.smithi134.stdout:1/990: rename d5/d1d/dd0/ddc/de3/df6/f102 to d5/d1d/d49/d92/f15c 0 2024-03-22T07:28:51.022 INFO:tasks.workunit.client.0.smithi134.stdout:1/991: write d5/d1d/d2d/f57 [1583329,129149] 0 2024-03-22T07:28:51.025 INFO:tasks.workunit.client.0.smithi134.stdout:2/920: link d2/d5/d8/d5d/d5f/fab d2/d5/d22/dbc/d104/d10b/f12b 0 2024-03-22T07:28:51.025 INFO:tasks.workunit.client.0.smithi134.stdout:9/864: symlink d3/d9/d37/d3c/d71/d8c/d115/l122 0 2024-03-22T07:28:51.027 INFO:tasks.workunit.client.0.smithi134.stdout:5/991: creat d1/d8/d16/d4a/dce/f147 x:0 0 0 2024-03-22T07:28:51.027 INFO:tasks.workunit.client.0.smithi134.stdout:5/992: chown d1/d8/dc5/dd6/dfc/f109 21 1 2024-03-22T07:28:51.027 INFO:tasks.workunit.client.0.smithi134.stdout:6/903: mknod d2/d6e/c13a 0 2024-03-22T07:28:51.029 INFO:tasks.workunit.client.0.smithi134.stdout:0/922: rename dc/d17/da7/cec to dc/d17/da7/d105/db8/d107/c11f 0 2024-03-22T07:28:51.030 INFO:tasks.workunit.client.0.smithi134.stdout:0/923: fsync dc/de/f23 0 2024-03-22T07:28:51.030 INFO:tasks.workunit.client.0.smithi134.stdout:5/993: dread d1/d8/dc5/dd6/dfc/d11c/f67 [0,4194304] 0 2024-03-22T07:28:51.031 INFO:tasks.workunit.client.0.smithi134.stdout:1/992: read d5/d1d/dd0/ddc/d113/d60/d72/f7d [93240,49400] 0 2024-03-22T07:28:51.034 INFO:tasks.workunit.client.0.smithi134.stdout:1/993: dread d5/d1d/d49/f52 [0,4194304] 0 2024-03-22T07:28:51.035 INFO:tasks.workunit.client.0.smithi134.stdout:1/994: truncate d5/da/d13/d1e/d63/d9d/fb2 397936 0 2024-03-22T07:28:51.035 INFO:tasks.workunit.client.0.smithi134.stdout:9/865: creat d3/d9/d37/f123 x:0 0 0 2024-03-22T07:28:51.036 INFO:tasks.workunit.client.0.smithi134.stdout:0/924: rename dc/d17/da7/d105/fac to dc/d17/da7/d105/dc1/f120 0 2024-03-22T07:28:51.038 INFO:tasks.workunit.client.0.smithi134.stdout:5/994: creat d1/d8/d20/d62/d68/d13f/f148 x:0 0 0 2024-03-22T07:28:51.039 INFO:tasks.workunit.client.0.smithi134.stdout:5/995: fdatasync d1/d8/f21 0 2024-03-22T07:28:51.039 INFO:tasks.workunit.client.0.smithi134.stdout:3/930: dwrite d4/d8/f117 [0,4194304] 0 2024-03-22T07:28:51.039 INFO:tasks.workunit.client.0.smithi134.stdout:1/995: mknod d5/d1d/dd0/ddc/d113/d39/da4/c15d 0 2024-03-22T07:28:51.041 INFO:tasks.workunit.client.0.smithi134.stdout:5/996: mkdir d1/d8/d16/d4a/dce/de0/d149 0 2024-03-22T07:28:51.041 INFO:tasks.workunit.client.0.smithi134.stdout:5/997: chown d1/d8/dc5/dd6/dfc/d11c/dac/dad/d136 424705 1 2024-03-22T07:28:51.041 INFO:tasks.workunit.client.0.smithi134.stdout:5/998: chown d1/d8/d20/f39 988527 1 2024-03-22T07:28:51.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/904: write d2/d1b/d1d/d5e/d6f/d7d/f85 [584738,107924] 0 2024-03-22T07:28:51.042 INFO:tasks.workunit.client.0.smithi134.stdout:6/905: creat d2/d1b/d1d/d5e/d6f/da8/dca/f13b x:0 0 0 2024-03-22T07:28:51.045 INFO:tasks.workunit.client.0.smithi134.stdout:2/921: dwrite d2/d5/d54/f10d [0,4194304] 0 2024-03-22T07:28:51.050 INFO:tasks.workunit.client.0.smithi134.stdout:3/931: link d4/d8/d69/d6a/d10f/cd4 d4/c120 0 2024-03-22T07:28:51.053 INFO:tasks.workunit.client.0.smithi134.stdout:1/996: rmdir d5/da/d128 0 2024-03-22T07:28:51.055 INFO:tasks.workunit.client.0.smithi134.stdout:6/906: creat d2/d1b/d1d/f13c x:0 0 0 2024-03-22T07:28:51.055 INFO:tasks.workunit.client.0.smithi134.stdout:6/907: chown d2/f1c 14 1 2024-03-22T07:28:51.058 INFO:tasks.workunit.client.0.smithi134.stdout:6/908: mkdir d2/d1b/d8f/d13d 0 2024-03-22T07:28:51.058 INFO:tasks.workunit.client.0.smithi134.stdout:6/909: truncate d2/d1b/d1d/ff8 511381 0 2024-03-22T07:28:51.058 INFO:tasks.workunit.client.0.smithi134.stdout:6/910: readlink d2/d1b/d1d/d5e/l6a 0 2024-03-22T07:28:51.058 INFO:tasks.workunit.client.0.smithi134.stdout:6/911: dread d2/d1b/d4d/d65/f115 [0,4194304] 0 2024-03-22T07:28:51.059 INFO:tasks.workunit.client.0.smithi134.stdout:6/912: creat d2/d6e/d105/f13e x:0 0 0 2024-03-22T07:28:51.060 INFO:tasks.workunit.client.0.smithi134.stdout:6/913: mknod d2/d1b/d1d/d5e/d84/c13f 0 2024-03-22T07:28:51.060 INFO:tasks.workunit.client.0.smithi134.stdout:6/914: chown d2/d6e/l11e 0 1 2024-03-22T07:28:51.062 INFO:tasks.workunit.client.0.smithi134.stdout:6/915: rename d2/d1b/d1d/d5e/d63/fa2 to d2/d1b/d4d/da5/dec/d28/d97/f140 0 2024-03-22T07:28:51.064 INFO:tasks.workunit.client.0.smithi134.stdout:6/916: symlink d2/d1b/d1d/d5e/l141 0 2024-03-22T07:28:51.064 INFO:tasks.workunit.client.0.smithi134.stdout:1/997: write d5/d1d/f77 [4095674,46690] 0 2024-03-22T07:28:51.065 INFO:tasks.workunit.client.0.smithi134.stdout:1/998: dread d5/da/d13/d1e/d63/d9d/fb2 [0,4194304] 0 2024-03-22T07:28:51.066 INFO:tasks.workunit.client.0.smithi134.stdout:6/917: truncate d2/d1b/d4d/da5/dec/d28/d97/f140 4344208 0 2024-03-22T07:28:51.066 INFO:tasks.workunit.client.0.smithi134.stdout:1/999: getdents d5/d1d/dd0/ddc/de3/df6/d12b 0 2024-03-22T07:28:51.069 INFO:tasks.workunit.client.0.smithi134.stdout:5/999: dwrite d1/d8/d16/d4a/f9f [0,4194304] 0 2024-03-22T07:28:51.069 INFO:tasks.workunit.client.0.smithi134.stdout:0/925: dwrite dc/d17/da7/d105/db8/d107/f11c [0,4194304] 0 2024-03-22T07:28:51.082 INFO:tasks.workunit.client.0.smithi134.stdout:9/866: dwrite d3/d9/df/d12/f4c [0,4194304] 0 2024-03-22T07:28:51.083 INFO:tasks.workunit.client.0.smithi134.stdout:2/922: dwrite d2/d5/d8/d7e/d83/f105 [0,4194304] 0 2024-03-22T07:28:51.084 INFO:tasks.workunit.client.0.smithi134.stdout:3/932: dwrite d4/f56 [0,4194304] 0 2024-03-22T07:28:51.085 INFO:tasks.workunit.client.0.smithi134.stdout:6/918: dread d2/d1b/d1d/d5e/f8d [4194304,4194304] 0 2024-03-22T07:28:51.087 INFO:tasks.workunit.client.0.smithi134.stdout:0/926: read dc/d17/da7/d105/db8/f7d [178286,28110] 0 2024-03-22T07:28:51.088 INFO:tasks.workunit.client.0.smithi134.stdout:2/923: rename d2/d5/d8/d5d/fac to d2/de5/f12c 0 2024-03-22T07:28:51.088 INFO:tasks.workunit.client.0.smithi134.stdout:0/927: dread dc/d17/f2b [0,4194304] 0 2024-03-22T07:28:51.088 INFO:tasks.workunit.client.0.smithi134.stdout:0/928: fsync dc/de/dc9/fcf 0 2024-03-22T07:28:51.089 INFO:tasks.workunit.client.0.smithi134.stdout:9/867: mkdir d3/d9/d37/d5a/d7f/daf/d124 0 2024-03-22T07:28:51.089 INFO:tasks.workunit.client.0.smithi134.stdout:9/868: read - d3/d9/df/d57/d67/d5f/fe8 zero size 2024-03-22T07:28:51.089 INFO:tasks.workunit.client.0.smithi134.stdout:9/869: stat d3/d9/df/d12/dfc 0 2024-03-22T07:28:51.089 INFO:tasks.workunit.client.0.smithi134.stdout:9/870: dread - d3/d9/df/fb4 zero size 2024-03-22T07:28:51.090 INFO:tasks.workunit.client.0.smithi134.stdout:9/871: dread - d3/d9/df/d57/d67/d5f/fec zero size 2024-03-22T07:28:51.090 INFO:tasks.workunit.client.0.smithi134.stdout:9/872: stat d3/d9/df/d57/l11b 0 2024-03-22T07:28:51.090 INFO:tasks.workunit.client.0.smithi134.stdout:9/873: chown d3/d9/df/d57/ff5 8831091 1 2024-03-22T07:28:51.092 INFO:tasks.workunit.client.0.smithi134.stdout:6/919: dread d2/d1b/fa3 [0,4194304] 0 2024-03-22T07:28:51.092 INFO:tasks.workunit.client.0.smithi134.stdout:6/920: fsync d2/d1b/d4d/ffc 0 2024-03-22T07:28:51.092 INFO:tasks.workunit.client.0.smithi134.stdout:6/921: write d2/d6e/ff7 [754987,2979] 0 2024-03-22T07:28:51.096 INFO:tasks.workunit.client.0.smithi134.stdout:2/924: unlink d2/d5/d22/c36 0 2024-03-22T07:28:51.098 INFO:tasks.workunit.client.0.smithi134.stdout:0/929: creat dc/d17/f121 x:0 0 0 2024-03-22T07:28:51.099 INFO:tasks.workunit.client.0.smithi134.stdout:9/874: creat d3/d9/df/d12/dfc/f125 x:0 0 0 2024-03-22T07:28:51.099 INFO:tasks.workunit.client.0.smithi134.stdout:9/875: stat d3/d9/d37/d3c/d71/d8e 0 2024-03-22T07:28:51.100 INFO:tasks.workunit.client.0.smithi134.stdout:9/876: write d3/f22 [839398,35134] 0 2024-03-22T07:28:51.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/933: rmdir d4/dab 39 2024-03-22T07:28:51.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/934: readlink d4/d8/d69/d6a/d10f/la1 0 2024-03-22T07:28:51.100 INFO:tasks.workunit.client.0.smithi134.stdout:3/935: creat d4/d8/d5c/f121 x:0 0 0 2024-03-22T07:28:51.101 INFO:tasks.workunit.client.0.smithi134.stdout:9/877: mkdir d3/d9/d37/d3c/dcb/d126 0 2024-03-22T07:28:51.102 INFO:tasks.workunit.client.0.smithi134.stdout:9/878: creat d3/d9/d37/d5a/dc5/d10b/d10e/f127 x:0 0 0 2024-03-22T07:28:51.102 INFO:tasks.workunit.client.0.smithi134.stdout:9/879: fdatasync d3/fa3 0 2024-03-22T07:28:51.103 INFO:tasks.workunit.client.0.smithi134.stdout:3/936: mkdir d4/d8/d45/da9/d122 0 2024-03-22T07:28:51.105 INFO:tasks.workunit.client.0.smithi134.stdout:6/922: dwrite d2/d1b/d4d/fc7 [0,4194304] 0 2024-03-22T07:28:51.106 INFO:tasks.workunit.client.0.smithi134.stdout:2/925: dread d2/d5/d8/d5d/d5f/d75/dfd/f47 [0,4194304] 0 2024-03-22T07:28:51.107 INFO:tasks.workunit.client.0.smithi134.stdout:9/880: fsync d3/d9/d37/d6f/fe3 0 2024-03-22T07:28:51.109 INFO:tasks.workunit.client.0.smithi134.stdout:3/937: mkdir d4/d8/d5c/de6/df2/d123 0 2024-03-22T07:28:51.109 INFO:tasks.workunit.client.0.smithi134.stdout:3/938: read - d4/d8/d69/dd7/fda zero size 2024-03-22T07:28:51.114 INFO:tasks.workunit.client.0.smithi134.stdout:0/930: dread dc/de/d55/d60/f7a [0,4194304] 0 2024-03-22T07:28:51.115 INFO:tasks.workunit.client.0.smithi134.stdout:0/931: fdatasync dc/de/f23 0 2024-03-22T07:28:51.115 INFO:tasks.workunit.client.0.smithi134.stdout:0/932: creat dc/de/dc9/f122 x:0 0 0 2024-03-22T07:28:51.115 INFO:tasks.workunit.client.0.smithi134.stdout:0/933: fdatasync dc/d18/f2e 0 2024-03-22T07:28:51.115 INFO:tasks.workunit.client.0.smithi134.stdout:0/934: dread - dc/de/dc9/dd0/ddb/fed zero size 2024-03-22T07:28:51.120 INFO:tasks.workunit.client.0.smithi134.stdout:3/939: dread d4/d8/f96 [0,4194304] 0 2024-03-22T07:28:51.126 INFO:tasks.workunit.client.0.smithi134.stdout:3/940: symlink d4/d8/d69/d6a/db8/l124 0 2024-03-22T07:28:51.126 INFO:tasks.workunit.client.0.smithi134.stdout:3/941: read d4/d8/d7f/d9c/db9/ffd [112575,105421] 0 2024-03-22T07:28:51.128 INFO:tasks.workunit.client.0.smithi134.stdout:2/926: dwrite d2/d5/d8/d5d/d5f/fe6 [0,4194304] 0 2024-03-22T07:28:51.128 INFO:tasks.workunit.client.0.smithi134.stdout:2/927: truncate d2/d5/d22/d99/f11e 633485 0 2024-03-22T07:28:51.137 INFO:tasks.workunit.client.0.smithi134.stdout:9/881: dwrite d3/d9/d37/d3c/d71/d8e/fd5 [0,4194304] 0 2024-03-22T07:28:51.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/923: dwrite d2/d1b/d4d/da5/dec/f83 [0,4194304] 0 2024-03-22T07:28:51.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/924: fdatasync d2/d1b/d4d/da5/dec/d28/d97/ff0 0 2024-03-22T07:28:51.138 INFO:tasks.workunit.client.0.smithi134.stdout:6/925: readlink d2/l10 0 2024-03-22T07:28:51.138 INFO:tasks.workunit.client.0.smithi134.stdout:0/935: dwrite dc/d18/f2e [0,4194304] 0 2024-03-22T07:28:51.140 INFO:tasks.workunit.client.0.smithi134.stdout:2/928: dread d2/d5/d8/d5d/d5f/d75/dfd/d60/fa7 [0,4194304] 0 2024-03-22T07:28:51.142 INFO:tasks.workunit.client.0.smithi134.stdout:9/882: mknod d3/d9/d37/d3c/d71/d10c/c128 0 2024-03-22T07:28:51.145 INFO:tasks.workunit.client.0.smithi134.stdout:3/942: dwrite d4/f1a [0,4194304] 0 2024-03-22T07:28:51.145 INFO:tasks.workunit.client.0.smithi134.stdout:6/926: mknod d2/d1b/d1d/d5e/d6f/d7d/dd8/c142 0 2024-03-22T07:28:51.149 INFO:tasks.workunit.client.0.smithi134.stdout:2/929: creat d2/d5/d22/dbc/f12d x:0 0 0 2024-03-22T07:28:51.150 INFO:tasks.workunit.client.0.smithi134.stdout:9/883: dread d3/d9/d37/d6f/d54/d9d/dc0/fa2 [4194304,4194304] 0 2024-03-22T07:28:51.151 INFO:tasks.workunit.client.0.smithi134.stdout:3/943: truncate d4/d10/fb0 2892687 0 2024-03-22T07:28:51.152 INFO:tasks.workunit.client.0.smithi134.stdout:6/927: truncate d2/d1b/fa3 5954252 0 2024-03-22T07:28:51.153 INFO:tasks.workunit.client.0.smithi134.stdout:0/936: write dc/de/f84 [39051,48657] 0 2024-03-22T07:28:51.154 INFO:tasks.workunit.client.0.smithi134.stdout:2/930: rename d2/d5/d22/dbc/fc8 to d2/d5/d22/d99/df6/f12e 0 2024-03-22T07:28:51.155 INFO:tasks.workunit.client.0.smithi134.stdout:9/884: mkdir d3/d9/d129 0 2024-03-22T07:28:51.160 INFO:tasks.workunit.client.0.smithi134.stdout:6/928: rename d2/d1b/d1d/d5e/d6f/d7d/f85 to d2/d1b/d8f/f143 0 2024-03-22T07:28:51.160 INFO:tasks.workunit.client.0.smithi134.stdout:3/944: dread d4/d22/d29/d82/fc1 [0,4194304] 0 2024-03-22T07:28:51.162 INFO:tasks.workunit.client.0.smithi134.stdout:2/931: mkdir d2/d5/d8/d5d/d5f/d75/dfd/d12f 0 2024-03-22T07:28:51.164 INFO:tasks.workunit.client.0.smithi134.stdout:9/885: mknod d3/d9/d37/d5a/d7f/daf/d124/c12a 0 2024-03-22T07:28:51.171 INFO:tasks.workunit.client.0.smithi134.stdout:3/945: symlink d4/d8/d69/dd7/l125 0 2024-03-22T07:28:51.173 INFO:tasks.workunit.client.0.smithi134.stdout:6/929: dread d2/d1b/d4d/da5/dec/f61 [0,4194304] 0 2024-03-22T07:28:51.176 INFO:tasks.workunit.client.0.smithi134.stdout:2/932: rename d2/d5/d8/d5d/d5f/d75/dfd/l57 to d2/d5/d8/d5d/d5f/d75/dfd/l130 0 2024-03-22T07:28:51.184 INFO:tasks.workunit.client.0.smithi134.stdout:3/946: symlink d4/d8/d45/l126 0 2024-03-22T07:28:51.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/933: mkdir d2/d5/d22/dbe/d131 0 2024-03-22T07:28:51.185 INFO:tasks.workunit.client.0.smithi134.stdout:2/934: fdatasync d2/d5/d8/d5d/d5f/d75/dfd/f89 0 2024-03-22T07:28:51.185 INFO:tasks.workunit.client.0.smithi134.stdout:3/947: read d4/d8/d23/f3b [898602,80855] 0 2024-03-22T07:28:51.186 INFO:tasks.workunit.client.0.smithi134.stdout:9/886: link d3/d9/f36 d3/d9/df/d12/dd7/f12b 0 2024-03-22T07:28:51.187 INFO:tasks.workunit.client.0.smithi134.stdout:2/935: unlink d2/d5/d8/d5d/da1/ca0 0 2024-03-22T07:28:51.190 INFO:tasks.workunit.client.0.smithi134.stdout:6/930: dwrite d2/d1b/d4d/f90 [0,4194304] 0 2024-03-22T07:28:51.190 INFO:tasks.workunit.client.0.smithi134.stdout:6/931: chown d2/fb4 103229 1 2024-03-22T07:28:51.190 INFO:tasks.workunit.client.0.smithi134.stdout:3/948: mkdir d4/d10/d4b/dcc/d127 0 2024-03-22T07:28:51.193 INFO:tasks.workunit.client.0.smithi134.stdout:9/887: rename d3/d9/d37/d3c/d71/d7a/f104 to d3/d9/d37/d5a/d89/f12c 0 2024-03-22T07:28:51.198 INFO:tasks.workunit.client.0.smithi134.stdout:6/932: unlink d2/d1b/d4d/da5/dec/f83 0 2024-03-22T07:28:51.199 INFO:tasks.workunit.client.0.smithi134.stdout:3/949: write d4/d8/d23/f55 [1652897,15846] 0 2024-03-22T07:28:51.202 INFO:tasks.workunit.client.0.smithi134.stdout:3/950: mkdir d4/dab/d128 0 2024-03-22T07:28:51.202 INFO:tasks.workunit.client.0.smithi134.stdout:3/951: truncate d4/fc5 202133 0 2024-03-22T07:28:51.202 INFO:tasks.workunit.client.0.smithi134.stdout:3/952: write d4/d22/d29/dad/f114 [681776,26260] 0 2024-03-22T07:28:51.202 INFO:tasks.workunit.client.0.smithi134.stdout:9/888: write f1 [1493927,128704] 0 2024-03-22T07:28:51.202 INFO:tasks.workunit.client.0.smithi134.stdout:9/889: stat d3/d9/df/d57/d67/c75 0 2024-03-22T07:28:51.205 INFO:tasks.workunit.client.0.smithi134.stdout:6/933: getdents d2/d1b/d1d/d5e/d6f/da8/dc6 0 2024-03-22T07:28:51.205 INFO:tasks.workunit.client.0.smithi134.stdout:6/934: dread - d2/d6e/f100 zero size 2024-03-22T07:28:51.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:51 smithi195 ceph-mon[36144]: pgmap v11: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 240 MiB/s rd, 282 MiB/s wr, 413 op/s 2024-03-22T07:28:51.205 INFO:tasks.workunit.client.0.smithi134.stdout:2/936: dwrite d2/d5/d8/f2f [0,4194304] 0 2024-03-22T07:28:51.212 INFO:tasks.workunit.client.0.smithi134.stdout:2/937: rename d2/d5/d8/d5d/da1/de3 to d2/d5/d22/dbc/d132 0 2024-03-22T07:28:51.215 INFO:tasks.workunit.client.0.smithi134.stdout:2/938: rename d2/d5/d22/dbe/le9 to d2/d5/d22/dbc/d127/l133 0 2024-03-22T07:28:51.216 INFO:tasks.workunit.client.0.smithi134.stdout:2/939: mknod d2/d5/d22/dbc/d132/c134 0 2024-03-22T07:28:51.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/940: mknod d2/d5/d22/dfa/c135 0 2024-03-22T07:28:51.218 INFO:tasks.workunit.client.0.smithi134.stdout:2/941: dread - d2/d5/d22/dbc/f12d zero size 2024-03-22T07:28:51.223 INFO:tasks.workunit.client.0.smithi134.stdout:3/953: dwrite d4/d22/f6d [0,4194304] 0 2024-03-22T07:28:51.225 INFO:tasks.workunit.client.0.smithi134.stdout:6/935: dwrite d2/d1b/fbe [0,4194304] 0 2024-03-22T07:28:51.225 INFO:tasks.workunit.client.0.smithi134.stdout:6/936: chown d2/d6e/fa6 955 1 2024-03-22T07:28:51.226 INFO:tasks.workunit.client.0.smithi134.stdout:6/937: write d2/d1b/d4d/da5/dec/d28/d97/ff6 [499074,49575] 0 2024-03-22T07:28:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:2/942: dread d2/f58 [0,4194304] 0 2024-03-22T07:28:51.227 INFO:tasks.workunit.client.0.smithi134.stdout:2/943: write d2/fa3 [523390,44319] 0 2024-03-22T07:28:51.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/938: symlink d2/d1b/d4d/l144 0 2024-03-22T07:28:51.228 INFO:tasks.workunit.client.0.smithi134.stdout:6/939: creat d2/d1b/d4d/da5/f145 x:0 0 0 2024-03-22T07:28:51.229 INFO:tasks.workunit.client.0.smithi134.stdout:6/940: creat d2/d1b/daa/dc1/f146 x:0 0 0 2024-03-22T07:28:51.234 INFO:tasks.workunit.client.0.smithi134.stdout:3/954: read d4/d10/f103 [146215,8227] 0 2024-03-22T07:28:51.236 INFO:tasks.workunit.client.0.smithi134.stdout:6/941: mknod d2/d1b/d4d/c147 0 2024-03-22T07:28:51.237 INFO:tasks.workunit.client.0.smithi134.stdout:3/955: mkdir d4/d129 0 2024-03-22T07:28:51.237 INFO:tasks.workunit.client.0.smithi134.stdout:3/956: stat d4/d8/d69/d6a/d10f/la1 0 2024-03-22T07:28:51.237 INFO:tasks.workunit.client.0.smithi134.stdout:3/957: readlink d4/d8/d5c/l10b 0 2024-03-22T07:28:51.240 INFO:tasks.workunit.client.0.smithi134.stdout:3/958: symlink d4/d22/d3c/l12a 0 2024-03-22T07:28:51.241 INFO:tasks.workunit.client.0.smithi134.stdout:6/942: write d2/d1b/d1d/d5e/d63/f64 [2393629,20554] 0 2024-03-22T07:28:51.242 INFO:tasks.workunit.client.0.smithi134.stdout:3/959: rename d4/d8/c9 to d4/d22/d3c/c12b 0 2024-03-22T07:28:51.245 INFO:tasks.workunit.client.0.smithi134.stdout:2/944: dwrite d2/d5/d8/d5d/d5f/d75/dfd/d60/d7c/ff4 [0,4194304] 0 2024-03-22T07:28:51.247 INFO:tasks.workunit.client.0.smithi134.stdout:3/960: dread d4/d8/f12 [0,4194304] 0 2024-03-22T07:28:51.250 INFO:tasks.workunit.client.0.smithi134.stdout:6/943: dread d2/d1b/d1d/d5e/d63/f64 [0,4194304] 0 2024-03-22T07:28:51.251 INFO:tasks.workunit.client.0.smithi134.stdout:2/945: mkdir d2/d5/d8/d7e/dba/dc6/d136 0 2024-03-22T07:28:51.251 INFO:tasks.workunit.client.0.smithi134.stdout:3/961: mknod d4/d22/d29/dad/c12c 0 2024-03-22T07:28:51.253 INFO:tasks.workunit.client.0.smithi134.stdout:2/946: unlink d2/d5/d8/d5d/d5f/d75/c116 0 2024-03-22T07:28:51.254 INFO:tasks.workunit.client.0.smithi134.stdout:2/947: dread d2/d5/d8/d7e/d83/fc7 [0,4194304] 0 2024-03-22T07:28:51.255 INFO:tasks.workunit.client.0.smithi134.stdout:3/962: mkdir d4/d22/d12d 0 2024-03-22T07:28:51.255 INFO:tasks.workunit.client.0.smithi134.stdout:3/963: chown d4/d8/d23/l79 24 1 2024-03-22T07:28:51.255 INFO:tasks.workunit.client.0.smithi134.stdout:6/944: getdents d2/d1b/d4d/da5 0 2024-03-22T07:28:51.257 INFO:tasks.workunit.client.0.smithi134.stdout:2/948: symlink d2/d5/d8/d31/l137 0 2024-03-22T07:28:51.258 INFO:tasks.workunit.client.0.smithi134.stdout:3/964: rename d4/d8/d7f/d9c/lc2 to d4/d8/d5c/de6/df2/d123/l12e 0 2024-03-22T07:28:51.262 INFO:tasks.workunit.client.0.smithi134.stdout:6/945: mknod d2/d1b/d4d/c148 0 2024-03-22T07:28:51.262 INFO:tasks.workunit.client.0.smithi134.stdout:6/946: truncate d2/fdb 4766926 0 2024-03-22T07:28:51.267 INFO:tasks.workunit.client.0.smithi134.stdout:6/947: rename d2/d1b/d4d/da5/dec/d28/l58 to d2/d1b/d4d/d65/l149 0 2024-03-22T07:28:51.273 INFO:tasks.workunit.client.0.smithi134.stdout:6/948: write d2/d1b/d1d/d5e/fde [4111186,126442] 0 2024-03-22T07:28:51.274 INFO:tasks.workunit.client.0.smithi134.stdout:6/949: getdents d2/d1b/d4d/da5 0 2024-03-22T07:28:51.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/950: creat d2/d1b/d1d/d5e/d6f/d7d/f14a x:0 0 0 2024-03-22T07:28:51.275 INFO:tasks.workunit.client.0.smithi134.stdout:6/951: truncate d2/d1b/d4d/da5/dec/d28/d97/ff6 741491 0 2024-03-22T07:28:51.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/952: mkdir d2/d1b/d1d/d5e/d6f/dd7/d14b 0 2024-03-22T07:28:51.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/953: write d2/d1b/d8f/f143 [3642976,64153] 0 2024-03-22T07:28:51.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/954: fsync d2/d6e/d105/f127 0 2024-03-22T07:28:51.277 INFO:tasks.workunit.client.0.smithi134.stdout:6/955: readlink d2/l11 0 2024-03-22T07:28:51.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/956: symlink d2/d1b/d1d/d5e/d84/l14c 0 2024-03-22T07:28:51.278 INFO:tasks.workunit.client.0.smithi134.stdout:6/957: readlink d2/d1b/d4d/da5/dec/d28/l96 0 2024-03-22T07:28:51.279 INFO:tasks.workunit.client.0.smithi134.stdout:6/958: mknod d2/d1b/d4d/da5/dec/d28/d97/c14d 0 2024-03-22T07:28:51.280 INFO:tasks.workunit.client.0.smithi134.stdout:2/949: dwrite d2/d5/d22/f2a [0,4194304] 0 2024-03-22T07:28:51.280 INFO:tasks.workunit.client.0.smithi134.stdout:3/965: dwrite d4/d8/d5c/fb3 [0,4194304] 0 2024-03-22T07:28:51.289 INFO:tasks.workunit.client.0.smithi134.stdout:2/950: dread d2/d5/d8/d5d/d5f/d75/fd7 [0,4194304] 0 2024-03-22T07:28:51.292 INFO:tasks.workunit.client.0.smithi134.stdout:6/959: dread d2/d1b/d1d/d5e/d84/fe6 [0,4194304] 0 2024-03-22T07:28:51.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:51 smithi134 ceph-mon[29057]: pgmap v11: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 240 MiB/s rd, 282 MiB/s wr, 413 op/s 2024-03-22T07:28:51.295 INFO:tasks.workunit.client.0.smithi134.stdout:2/951: rmdir d2/d5/d22/d99 39 2024-03-22T07:28:51.299 INFO:tasks.workunit.client.0.smithi134.stdout:2/952: symlink d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/l138 0 2024-03-22T07:28:51.300 INFO:tasks.workunit.client.0.smithi134.stdout:2/953: chown d2/d5/d22 5101 1 2024-03-22T07:28:51.300 INFO:tasks.workunit.client.0.smithi134.stdout:6/960: dread d2/fdb [0,4194304] 0 2024-03-22T07:28:51.303 INFO:tasks.workunit.client.0.smithi134.stdout:6/961: mkdir d2/d1b/d1d/d5e/d6f/dd7/d14e 0 2024-03-22T07:28:51.306 INFO:tasks.workunit.client.0.smithi134.stdout:3/966: write d4/dab/fca [516290,29498] 0 2024-03-22T07:28:51.308 INFO:tasks.workunit.client.0.smithi134.stdout:6/962: rename d2/d1b/d1d/d5e/d6f/d7d/dd8/c142 to d2/d1b/d4d/d65/c14f 0 2024-03-22T07:28:51.316 INFO:tasks.workunit.client.0.smithi134.stdout:2/954: dwrite d2/d5/d8/d7e/d83/fef [0,4194304] 0 2024-03-22T07:28:51.316 INFO:tasks.workunit.client.0.smithi134.stdout:2/955: dread - d2/d5/d8/d7e/dba/f106 zero size 2024-03-22T07:28:51.316 INFO:tasks.workunit.client.0.smithi134.stdout:2/956: write d2/f8f [86829,54571] 0 2024-03-22T07:28:51.317 INFO:tasks.workunit.client.0.smithi134.stdout:2/957: readlink d2/d5/d8/d5d/d5f/d75/dfd/d60/l9b 0 2024-03-22T07:28:51.337 INFO:tasks.workunit.client.0.smithi134.stdout:2/958: dwrite d2/d5/d8/d5d/d5f/d75/dfd/fc4 [4194304,4194304] 0 2024-03-22T07:28:51.337 INFO:tasks.workunit.client.0.smithi134.stdout:3/967: dwrite d4/d8/f117 [0,4194304] 0 2024-03-22T07:28:51.337 INFO:tasks.workunit.client.0.smithi134.stdout:3/968: truncate d4/dab/f10a 4340575 0 2024-03-22T07:28:51.337 INFO:tasks.workunit.client.0.smithi134.stdout:2/959: truncate d2/d5/d22/dbc/d104/d10b/f12b 4540919 0 2024-03-22T07:28:51.337 INFO:tasks.workunit.client.0.smithi134.stdout:6/963: dwrite d2/d6e/fc3 [0,4194304] 0 2024-03-22T07:28:51.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/960: rmdir d2/d5/d22/d99/df6/d122 39 2024-03-22T07:28:51.338 INFO:tasks.workunit.client.0.smithi134.stdout:2/961: stat d2/f80 0 2024-03-22T07:28:51.340 INFO:tasks.workunit.client.0.smithi134.stdout:6/964: symlink d2/d1b/l150 0 2024-03-22T07:28:51.341 INFO:tasks.workunit.client.0.smithi134.stdout:3/969: dread d4/d8/d69/faa [0,4194304] 0 2024-03-22T07:28:51.342 INFO:tasks.workunit.client.0.smithi134.stdout:2/962: unlink d2/d5/d8/d5d/da1/f4b 0 2024-03-22T07:28:51.343 INFO:tasks.workunit.client.0.smithi134.stdout:2/963: dread d2/d5/d8/d7e/ff7 [0,4194304] 0 2024-03-22T07:28:51.343 INFO:tasks.workunit.client.0.smithi134.stdout:6/965: rename d2/d1b/daa/dc1/cdd to d2/d1b/d4d/da5/dec/d28/d97/c151 0 2024-03-22T07:28:51.345 INFO:tasks.workunit.client.0.smithi134.stdout:3/970: creat d4/d22/d29/d50/f12f x:0 0 0 2024-03-22T07:28:51.345 INFO:tasks.workunit.client.0.smithi134.stdout:3/971: readlink d4/l54 0 2024-03-22T07:28:51.345 INFO:tasks.workunit.client.0.smithi134.stdout:3/972: write d4/d10/ff4 [930509,53527] 0 2024-03-22T07:28:51.346 INFO:tasks.workunit.client.0.smithi134.stdout:2/964: link d2/d5/d8/d7e/dba/f118 d2/d5/d22/dbc/d127/f139 0 2024-03-22T07:28:51.346 INFO:tasks.workunit.client.0.smithi134.stdout:2/965: chown d2/d5/d22/c129 23 1 2024-03-22T07:28:51.347 INFO:tasks.workunit.client.0.smithi134.stdout:3/973: symlink d4/d22/d29/d50/d109/l130 0 2024-03-22T07:28:51.349 INFO:tasks.workunit.client.0.smithi134.stdout:3/974: fsync d4/d10/ff4 0 2024-03-22T07:28:51.351 INFO:tasks.workunit.client.0.smithi134.stdout:6/966: dread d2/d1b/fa3 [0,4194304] 0 2024-03-22T07:28:51.351 INFO:tasks.workunit.client.0.smithi134.stdout:6/967: read d2/f1c [167529,77720] 0 2024-03-22T07:28:51.354 INFO:tasks.workunit.client.0.smithi134.stdout:2/966: dread d2/d5/d22/f5e [0,4194304] 0 2024-03-22T07:28:51.356 INFO:tasks.workunit.client.0.smithi134.stdout:6/968: rename d2/d1b/d8f to d2/d1b/d152 0 2024-03-22T07:28:51.378 INFO:tasks.workunit.client.0.smithi134.stdout:3/975: dwrite d4/d8/d23/fbc [0,4194304] 0 2024-03-22T07:28:51.379 INFO:tasks.workunit.client.0.smithi134.stdout:2/967: dwrite d2/d5/d8/d5d/d5f/ffe [0,4194304] 0 2024-03-22T07:28:51.380 INFO:tasks.workunit.client.0.smithi134.stdout:6/969: dwrite d2/d1b/d4d/da5/f108 [4194304,4194304] 0 2024-03-22T07:28:51.380 INFO:tasks.workunit.client.0.smithi134.stdout:3/976: rmdir d4/d129 0 2024-03-22T07:28:51.384 INFO:tasks.workunit.client.0.smithi134.stdout:3/977: dread d4/f2b [0,4194304] 0 2024-03-22T07:28:51.384 INFO:tasks.workunit.client.0.smithi134.stdout:2/968: symlink d2/d5/d22/dbc/d104/l13a 0 2024-03-22T07:28:51.391 INFO:tasks.workunit.client.0.smithi134.stdout:2/969: dread d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/ff1 [0,4194304] 0 2024-03-22T07:28:51.406 INFO:tasks.workunit.client.0.smithi134.stdout:2/970: dwrite d2/d5/d22/dbc/d104/d10b/f110 [0,4194304] 0 2024-03-22T07:28:51.418 INFO:tasks.workunit.client.0.smithi134.stdout:6/970: creat d2/d6e/d105/d10b/f153 x:0 0 0 2024-03-22T07:28:51.430 INFO:tasks.workunit.client.0.smithi134.stdout:6/971: dwrite d2/d1b/d4d/fbd [0,4194304] 0 2024-03-22T07:28:51.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/978: rename d4/dab/fca to d4/d8/d69/d6a/db8/f131 0 2024-03-22T07:28:51.437 INFO:tasks.workunit.client.0.smithi134.stdout:3/979: fdatasync d4/d8/d7f/d9c/db9/fc4 0 2024-03-22T07:28:51.440 INFO:tasks.workunit.client.0.smithi134.stdout:2/971: creat d2/d5/d8/d5d/d5f/d75/dfd/f13b x:0 0 0 2024-03-22T07:28:51.445 INFO:tasks.workunit.client.0.smithi134.stdout:6/972: mkdir d2/d1b/d4d/da5/dec/d28/db0/d154 0 2024-03-22T07:28:51.446 INFO:tasks.workunit.client.0.smithi134.stdout:3/980: dread d4/f48 [0,4194304] 0 2024-03-22T07:28:51.446 INFO:tasks.workunit.client.0.smithi134.stdout:3/981: readlink d4/d8/d5c/de6/df2/l10c 0 2024-03-22T07:28:51.448 INFO:tasks.workunit.client.0.smithi134.stdout:2/972: mkdir d2/d5/d22/dfa/d13c 0 2024-03-22T07:28:51.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/982: mkdir d4/d8/d69/d6a/d10f/d108/d132 0 2024-03-22T07:28:51.449 INFO:tasks.workunit.client.0.smithi134.stdout:3/983: readlink d4/d8/d69/l113 0 2024-03-22T07:28:51.454 INFO:tasks.workunit.client.0.smithi134.stdout:6/973: dread d2/d1b/d4d/da5/dec/d28/d97/f140 [0,4194304] 0 2024-03-22T07:28:51.456 INFO:tasks.workunit.client.0.smithi134.stdout:6/974: creat d2/d1b/d1d/d5e/d6f/dd7/d14e/f155 x:0 0 0 2024-03-22T07:28:51.462 INFO:tasks.workunit.client.0.smithi134.stdout:3/984: dwrite d4/d8/ffc [0,4194304] 0 2024-03-22T07:28:51.462 INFO:tasks.workunit.client.0.smithi134.stdout:3/985: fdatasync d4/d10/d4b/f90 0 2024-03-22T07:28:51.469 INFO:tasks.workunit.client.0.smithi134.stdout:3/986: dread d4/d22/d29/d82/f110 [0,4194304] 0 2024-03-22T07:28:51.484 INFO:tasks.workunit.client.0.smithi134.stdout:3/987: dwrite d4/d8/d5c/f106 [0,4194304] 0 2024-03-22T07:28:51.493 INFO:tasks.workunit.client.0.smithi134.stdout:3/988: rename d4/d10/f40 to d4/d8/d7f/dd5/f133 0 2024-03-22T07:28:51.497 INFO:tasks.workunit.client.0.smithi134.stdout:3/989: unlink d4/d10/c1f 0 2024-03-22T07:28:51.514 INFO:tasks.workunit.client.0.smithi134.stdout:3/990: dwrite d4/d10/d4b/fb7 [4194304,4194304] 0 2024-03-22T07:28:51.517 INFO:tasks.workunit.client.0.smithi134.stdout:3/991: dread d4/d8/fa6 [0,4194304] 0 2024-03-22T07:28:51.519 INFO:tasks.workunit.client.0.smithi134.stdout:3/992: mkdir d4/d22/dce/d134 0 2024-03-22T07:28:51.520 INFO:tasks.workunit.client.0.smithi134.stdout:3/993: creat d4/d22/dce/f135 x:0 0 0 2024-03-22T07:28:51.522 INFO:tasks.workunit.client.0.smithi134.stdout:3/994: symlink d4/dab/l136 0 2024-03-22T07:28:51.522 INFO:tasks.workunit.client.0.smithi134.stdout:3/995: truncate f0 4952664 0 2024-03-22T07:28:51.522 INFO:tasks.workunit.client.0.smithi134.stdout:3/996: stat d4/d8/d5c/de6/df2/f78 0 2024-03-22T07:28:51.523 INFO:tasks.workunit.client.0.smithi134.stdout:3/997: getdents d4/d22/d29 0 2024-03-22T07:28:51.526 INFO:tasks.workunit.client.0.smithi134.stdout:3/998: rename d4/d22/d3c/f73 to d4/d22/dce/f137 0 2024-03-22T07:28:51.526 INFO:tasks.workunit.client.0.smithi134.stdout:3/999: chown d4/dab/cbb 71 1 2024-03-22T07:28:51.618 INFO:tasks.workunit.client.0.smithi134.stdout:0/937: sync 2024-03-22T07:28:51.626 INFO:tasks.workunit.client.0.smithi134.stdout:0/938: dread dc/de/d55/f10c [0,4194304] 0 2024-03-22T07:28:51.629 INFO:tasks.workunit.client.0.smithi134.stdout:0/939: unlink dc/d18/d89/da0/fd8 0 2024-03-22T07:28:51.653 INFO:tasks.workunit.client.0.smithi134.stdout:0/940: dwrite dc/d17/f7f [0,4194304] 0 2024-03-22T07:28:51.653 INFO:tasks.workunit.client.0.smithi134.stdout:0/941: getdents dc/d17/da7/d105/dbe/df1 0 2024-03-22T07:28:51.655 INFO:tasks.workunit.client.0.smithi134.stdout:0/942: symlink dc/de/d55/dd9/l123 0 2024-03-22T07:28:51.659 INFO:tasks.workunit.client.0.smithi134.stdout:0/943: rmdir dc/d17/da7/d105/d82 39 2024-03-22T07:28:51.660 INFO:tasks.workunit.client.0.smithi134.stdout:0/944: mkdir dc/d17/da9/d124 0 2024-03-22T07:28:51.662 INFO:tasks.workunit.client.0.smithi134.stdout:0/945: mknod dc/d17/c125 0 2024-03-22T07:28:51.664 INFO:tasks.workunit.client.0.smithi134.stdout:0/946: creat dc/de/d55/d60/dee/f126 x:0 0 0 2024-03-22T07:28:51.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/947: dwrite dc/de/d55/f9a [0,4194304] 0 2024-03-22T07:28:51.681 INFO:tasks.workunit.client.0.smithi134.stdout:0/948: chown dc/de/d55/dd9/l123 75188586 1 2024-03-22T07:28:51.682 INFO:tasks.workunit.client.0.smithi134.stdout:0/949: symlink dc/de/d55/d60/l127 0 2024-03-22T07:28:51.683 INFO:tasks.workunit.client.0.smithi134.stdout:0/950: mkdir dc/d17/da7/d105/dbe/d128 0 2024-03-22T07:28:51.686 INFO:tasks.workunit.client.0.smithi134.stdout:0/951: rename dc/de/d55/fe5 to dc/d17/f129 0 2024-03-22T07:28:51.687 INFO:tasks.workunit.client.0.smithi134.stdout:0/952: symlink dc/de/d55/d60/dee/l12a 0 2024-03-22T07:28:51.688 INFO:tasks.workunit.client.0.smithi134.stdout:0/953: dread dc/d17/f2b [0,4194304] 0 2024-03-22T07:28:51.688 INFO:tasks.workunit.client.0.smithi134.stdout:0/954: write dc/de/dc9/f11a [286406,37987] 0 2024-03-22T07:28:51.688 INFO:tasks.workunit.client.0.smithi134.stdout:0/955: readlink dc/d17/lcb 0 2024-03-22T07:28:51.688 INFO:tasks.workunit.client.0.smithi134.stdout:0/956: creat dc/d18/d85/f12b x:0 0 0 2024-03-22T07:28:51.688 INFO:tasks.workunit.client.0.smithi134.stdout:0/957: readlink dc/de/d55/d60/dee/l12a 0 2024-03-22T07:28:51.690 INFO:tasks.workunit.client.0.smithi134.stdout:0/958: unlink dc/de/c54 0 2024-03-22T07:28:51.690 INFO:tasks.workunit.client.0.smithi134.stdout:0/959: chown dc/de/d55/f56 46752938 1 2024-03-22T07:28:51.698 INFO:tasks.workunit.client.0.smithi134.stdout:0/960: read dc/de/d55/d60/f116 [662078,74611] 0 2024-03-22T07:28:51.705 INFO:tasks.workunit.client.0.smithi134.stdout:0/961: dread dc/d17/da9/f106 [4194304,4194304] 0 2024-03-22T07:28:51.706 INFO:tasks.workunit.client.0.smithi134.stdout:0/962: dread dc/d17/f2b [0,4194304] 0 2024-03-22T07:28:51.713 INFO:tasks.workunit.client.0.smithi134.stdout:0/963: dread dc/de/dc9/dd0/fd1 [0,4194304] 0 2024-03-22T07:28:51.715 INFO:tasks.workunit.client.0.smithi134.stdout:0/964: symlink dc/de/d55/d60/dee/l12c 0 2024-03-22T07:28:51.716 INFO:tasks.workunit.client.0.smithi134.stdout:0/965: creat dc/d17/da7/d105/dbe/d113/f12d x:0 0 0 2024-03-22T07:28:51.717 INFO:tasks.workunit.client.0.smithi134.stdout:0/966: mknod dc/d18/d85/c12e 0 2024-03-22T07:28:51.732 INFO:tasks.workunit.client.0.smithi134.stdout:0/967: dwrite dc/d18/d89/da0/fab [0,4194304] 0 2024-03-22T07:28:51.741 INFO:tasks.workunit.client.0.smithi134.stdout:0/968: mknod dc/d18/d85/c12f 0 2024-03-22T07:28:51.741 INFO:tasks.workunit.client.0.smithi134.stdout:0/969: chown dc/f29 2787 1 2024-03-22T07:28:51.742 INFO:tasks.workunit.client.0.smithi134.stdout:0/970: symlink dc/d17/da9/l130 0 2024-03-22T07:28:51.746 INFO:tasks.workunit.client.0.smithi134.stdout:0/971: symlink dc/d18/d89/l131 0 2024-03-22T07:28:51.749 INFO:tasks.workunit.client.0.smithi134.stdout:0/972: truncate dc/d17/da9/f106 4068341 0 2024-03-22T07:28:51.749 INFO:tasks.workunit.client.0.smithi134.stdout:0/973: stat dc/d17/da9/d124 0 2024-03-22T07:28:51.749 INFO:tasks.workunit.client.0.smithi134.stdout:0/974: write dc/de/dc9/fcc [81849,76233] 0 2024-03-22T07:28:51.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/975: dread dc/d17/da7/d105/d82/fbc [0,4194304] 0 2024-03-22T07:28:51.758 INFO:tasks.workunit.client.0.smithi134.stdout:0/976: write dc/de/dc9/f11a [1166527,17531] 0 2024-03-22T07:28:51.773 INFO:tasks.workunit.client.0.smithi134.stdout:0/977: creat dc/d17/da7/d105/f132 x:0 0 0 2024-03-22T07:28:51.776 INFO:tasks.workunit.client.0.smithi134.stdout:0/978: getdents dc/de/d55/dd9 0 2024-03-22T07:28:51.779 INFO:tasks.workunit.client.0.smithi134.stdout:0/979: getdents dc/d17/da7/d105/dd3 0 2024-03-22T07:28:51.783 INFO:tasks.workunit.client.0.smithi134.stdout:0/980: mkdir dc/d17/da7/d105/d82/d133 0 2024-03-22T07:28:51.785 INFO:tasks.workunit.client.0.smithi134.stdout:0/981: link dc/de/f84 dc/d18/d89/da0/f134 0 2024-03-22T07:28:51.785 INFO:tasks.workunit.client.0.smithi134.stdout:9/890: sync 2024-03-22T07:28:51.785 INFO:tasks.workunit.client.0.smithi134.stdout:9/891: readlink d3/d9/d37/d6f/l1e 0 2024-03-22T07:28:51.786 INFO:tasks.workunit.client.0.smithi134.stdout:9/892: dread - d3/d9/d37/d6f/d54/fb6 zero size 2024-03-22T07:28:51.786 INFO:tasks.workunit.client.0.smithi134.stdout:0/982: rmdir dc/de/d55/dd9 39 2024-03-22T07:28:51.786 INFO:tasks.workunit.client.0.smithi134.stdout:0/983: mknod dc/d17/da9/ddf/c135 0 2024-03-22T07:28:51.789 INFO:tasks.workunit.client.0.smithi134.stdout:0/984: unlink dc/d18/d89/l131 0 2024-03-22T07:28:51.789 INFO:tasks.workunit.client.0.smithi134.stdout:0/985: read dc/de/f84 [752073,27046] 0 2024-03-22T07:28:51.793 INFO:tasks.workunit.client.0.smithi134.stdout:0/986: mkdir dc/d17/da7/d105/df3/d136 0 2024-03-22T07:28:51.793 INFO:tasks.workunit.client.0.smithi134.stdout:0/987: truncate dc/d17/da7/d105/db8/f103 1047847 0 2024-03-22T07:28:51.795 INFO:tasks.workunit.client.0.smithi134.stdout:0/988: rmdir dc/d17/da7/d105/dd3 39 2024-03-22T07:28:51.797 INFO:tasks.workunit.client.0.smithi134.stdout:0/989: write dc/d17/da7/d105/d82/db7/f101 [4351,86486] 0 2024-03-22T07:28:51.800 INFO:tasks.workunit.client.0.smithi134.stdout:0/990: truncate dc/f8d 2302484 0 2024-03-22T07:28:51.800 INFO:tasks.workunit.client.0.smithi134.stdout:0/991: write dc/d18/d85/ff6 [779609,123574] 0 2024-03-22T07:28:51.800 INFO:tasks.workunit.client.0.smithi134.stdout:0/992: chown dc/d18/f74 115 1 2024-03-22T07:28:51.800 INFO:tasks.workunit.client.0.smithi134.stdout:0/993: fdatasync f5 0 2024-03-22T07:28:51.800 INFO:tasks.workunit.client.0.smithi134.stdout:0/994: readlink dc/de/l4b 0 2024-03-22T07:28:51.813 INFO:tasks.workunit.client.0.smithi134.stdout:9/893: dwrite d3/d9/df/d12/f16 [8388608,4194304] 0 2024-03-22T07:28:51.824 INFO:tasks.workunit.client.0.smithi134.stdout:9/894: write d3/d9/d37/d3c/d71/dc2/f100 [3453794,75413] 0 2024-03-22T07:28:51.827 INFO:tasks.workunit.client.0.smithi134.stdout:9/895: rename d3/d9/d37/d6f/d54/d9d/fb0 to d3/d9/d37/d5a/dc5/d10b/d10e/f12d 0 2024-03-22T07:28:51.827 INFO:tasks.workunit.client.0.smithi134.stdout:9/896: write d3/d9/d37/d6f/d54/fb6 [823293,73544] 0 2024-03-22T07:28:51.827 INFO:tasks.workunit.client.0.smithi134.stdout:9/897: write d3/d9/df/d57/ff5 [803032,115311] 0 2024-03-22T07:28:51.828 INFO:tasks.workunit.client.0.smithi134.stdout:9/898: mknod d3/d9/d37/d6f/d54/d9d/c12e 0 2024-03-22T07:28:51.828 INFO:tasks.workunit.client.0.smithi134.stdout:9/899: fsync d3/d9/d37/d5a/d7f/d80/fab 0 2024-03-22T07:28:51.830 INFO:tasks.workunit.client.0.smithi134.stdout:9/900: rename d3/d9/d37/d6f/fe3 to d3/d9/d37/d3c/dcb/f12f 0 2024-03-22T07:28:51.838 INFO:tasks.workunit.client.0.smithi134.stdout:9/901: read d3/d9/d37/d6f/f5d [68642,120372] 0 2024-03-22T07:28:51.839 INFO:tasks.workunit.client.0.smithi134.stdout:9/902: symlink d3/d9/df/d57/d67/l130 0 2024-03-22T07:28:51.840 INFO:tasks.workunit.client.0.smithi134.stdout:9/903: read d3/d9/d37/d5a/d7f/f98 [3078026,80303] 0 2024-03-22T07:28:51.854 INFO:tasks.workunit.client.0.smithi134.stdout:9/904: dwrite d3/d9/d37/d70/fd1 [0,4194304] 0 2024-03-22T07:28:51.854 INFO:tasks.workunit.client.0.smithi134.stdout:9/905: chown d3/d9/d37/d3c/d71/f11d 8840 1 2024-03-22T07:28:51.854 INFO:tasks.workunit.client.0.smithi134.stdout:9/906: chown d3/d9/d37/d5a/d7f/daf/fbd 1557 1 2024-03-22T07:28:51.856 INFO:tasks.workunit.client.0.smithi134.stdout:9/907: creat d3/d9/df/d12/f131 x:0 0 0 2024-03-22T07:28:51.857 INFO:tasks.workunit.client.0.smithi134.stdout:9/908: getdents d3/d9/df/d12/dd7/de7 0 2024-03-22T07:28:51.858 INFO:tasks.workunit.client.0.smithi134.stdout:9/909: chown d3/d9/d37/d3c/d71/dc2/f108 1 1 2024-03-22T07:28:51.866 INFO:tasks.workunit.client.0.smithi134.stdout:9/910: creat d3/d9/d37/d3c/d71/d8c/d115/f132 x:0 0 0 2024-03-22T07:28:51.869 INFO:tasks.workunit.client.0.smithi134.stdout:9/911: mkdir d3/d9/df/db3/d133 0 2024-03-22T07:28:51.869 INFO:tasks.workunit.client.0.smithi134.stdout:9/912: write d3/d9/df/fb2 [428417,29079] 0 2024-03-22T07:28:51.870 INFO:tasks.workunit.client.0.smithi134.stdout:9/913: symlink d3/d9/df/d12/l134 0 2024-03-22T07:28:51.871 INFO:tasks.workunit.client.0.smithi134.stdout:6/975: sync 2024-03-22T07:28:51.871 INFO:tasks.workunit.client.0.smithi134.stdout:2/973: sync 2024-03-22T07:28:51.871 INFO:tasks.workunit.client.0.smithi134.stdout:2/974: creat d2/d5/d22/dbc/f13d x:0 0 0 2024-03-22T07:28:51.873 INFO:tasks.workunit.client.0.smithi134.stdout:6/976: truncate d2/d1b/d4d/f90 3322230 0 2024-03-22T07:28:51.873 INFO:tasks.workunit.client.0.smithi134.stdout:6/977: creat d2/d1b/d1d/d5e/d6f/dd7/d14e/f156 x:0 0 0 2024-03-22T07:28:51.875 INFO:tasks.workunit.client.0.smithi134.stdout:2/975: mkdir d2/d5/d22/d99/df6/d122/d13e 0 2024-03-22T07:28:51.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/978: mkdir d2/d6e/d105/d10b/d157 0 2024-03-22T07:28:51.878 INFO:tasks.workunit.client.0.smithi134.stdout:6/979: chown d2/d1b/d1d/d5e/d6f/fe3 54 1 2024-03-22T07:28:51.881 INFO:tasks.workunit.client.0.smithi134.stdout:2/976: symlink d2/d5/d22/dbc/d132/l13f 0 2024-03-22T07:28:51.881 INFO:tasks.workunit.client.0.smithi134.stdout:2/977: truncate d2/f112 905054 0 2024-03-22T07:28:51.883 INFO:tasks.workunit.client.0.smithi134.stdout:9/914: dwrite d3/d9/df/d57/d67/d5f/fec [0,4194304] 0 2024-03-22T07:28:51.883 INFO:tasks.workunit.client.0.smithi134.stdout:9/915: stat d3/d9/df/d57/l77 0 2024-03-22T07:28:51.884 INFO:tasks.workunit.client.0.smithi134.stdout:2/978: dread d2/d5/d8/d5d/fc1 [0,4194304] 0 2024-03-22T07:28:51.885 INFO:tasks.workunit.client.0.smithi134.stdout:9/916: rmdir d3/d9/d37/d5a/dc5/d10b 39 2024-03-22T07:28:51.885 INFO:tasks.workunit.client.0.smithi134.stdout:2/979: mkdir d2/d5/d8/d31/dd5/d140 0 2024-03-22T07:28:51.893 INFO:tasks.workunit.client.0.smithi134.stdout:6/980: truncate d2/d1b/d4d/f90 662376 0 2024-03-22T07:28:51.894 INFO:tasks.workunit.client.0.smithi134.stdout:2/980: write d2/d5/d8/d7e/d83/fef [3465859,19404] 0 2024-03-22T07:28:51.894 INFO:tasks.workunit.client.0.smithi134.stdout:2/981: write d2/d5/d8/fc3 [107516,44987] 0 2024-03-22T07:28:51.904 INFO:tasks.workunit.client.0.smithi134.stdout:9/917: dwrite d3/d9/d37/d3c/d71/dc2/f108 [0,4194304] 0 2024-03-22T07:28:51.911 INFO:tasks.workunit.client.0.smithi134.stdout:9/918: symlink d3/d9/d37/d3c/dcb/l135 0 2024-03-22T07:28:51.912 INFO:tasks.workunit.client.0.smithi134.stdout:6/981: dwrite d2/d1b/d1d/d5e/d6f/da8/dca/fcf [4194304,4194304] 0 2024-03-22T07:28:51.915 INFO:tasks.workunit.client.0.smithi134.stdout:6/982: link d2/d1b/d1d/d5e/l6a d2/d1b/d1d/d5e/d84/l158 0 2024-03-22T07:28:51.928 INFO:tasks.workunit.client.0.smithi134.stdout:9/919: dwrite d3/d9/df/fc8 [0,4194304] 0 2024-03-22T07:28:51.929 INFO:tasks.workunit.client.0.smithi134.stdout:6/983: dwrite d2/d1b/d1d/d5e/f66 [4194304,4194304] 0 2024-03-22T07:28:51.936 INFO:tasks.workunit.client.0.smithi134.stdout:9/920: link d3/d9/d37/f123 d3/f136 0 2024-03-22T07:28:51.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/921: dwrite d3/d9/d37/d3c/d71/fa8 [4194304,4194304] 0 2024-03-22T07:28:51.952 INFO:tasks.workunit.client.0.smithi134.stdout:9/922: truncate d3/d9/df/d57/d67/f6c 935668 0 2024-03-22T07:28:51.955 INFO:tasks.workunit.client.0.smithi134.stdout:9/923: getdents d3/d9/d37/d5a 0 2024-03-22T07:28:51.961 INFO:tasks.workunit.client.0.smithi134.stdout:9/924: dread d3/d9/df/f7d [4194304,4194304] 0 2024-03-22T07:28:51.962 INFO:tasks.workunit.client.0.smithi134.stdout:9/925: symlink d3/d9/d37/d3c/d71/d10c/l137 0 2024-03-22T07:28:51.963 INFO:tasks.workunit.client.0.smithi134.stdout:9/926: rename d3/d9/d37/d3c/d71/dc2/f108 to d3/d9/d37/d3c/d71/d10c/f138 0 2024-03-22T07:28:51.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/927: chown d3/d9/df/d12/dd7/f106 290 1 2024-03-22T07:28:51.964 INFO:tasks.workunit.client.0.smithi134.stdout:9/928: truncate d3/d9/df/d57/d67/fc7 102859 0 2024-03-22T07:28:52.213 INFO:tasks.workunit.client.0.smithi134.stdout:0/995: sync 2024-03-22T07:28:52.238 INFO:tasks.workunit.client.0.smithi134.stdout:0/996: dwrite dc/d18/f5e [0,4194304] 0 2024-03-22T07:28:52.238 INFO:tasks.workunit.client.0.smithi134.stdout:0/997: creat dc/d17/da7/d105/db8/d107/f137 x:0 0 0 2024-03-22T07:28:52.240 INFO:tasks.workunit.client.0.smithi134.stdout:0/998: creat dc/d17/da7/d105/dbe/d11b/f138 x:0 0 0 2024-03-22T07:28:52.253 INFO:tasks.workunit.client.0.smithi134.stdout:0/999: rmdir dc 39 2024-03-22T07:28:52.297 INFO:tasks.workunit.client.0.smithi134.stdout:2/982: sync 2024-03-22T07:28:52.298 INFO:tasks.workunit.client.0.smithi134.stdout:6/984: sync 2024-03-22T07:28:52.298 INFO:tasks.workunit.client.0.smithi134.stdout:9/929: sync 2024-03-22T07:28:52.298 INFO:tasks.workunit.client.0.smithi134.stdout:2/983: creat d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/d9e/f141 x:0 0 0 2024-03-22T07:28:52.300 INFO:tasks.workunit.client.0.smithi134.stdout:9/930: mkdir d3/d9/d37/d6f/d54/d139 0 2024-03-22T07:28:52.306 INFO:tasks.workunit.client.0.smithi134.stdout:6/985: dread d2/d1b/d4d/da5/dec/d28/d97/f139 [0,4194304] 0 2024-03-22T07:28:52.309 INFO:tasks.workunit.client.0.smithi134.stdout:9/931: mknod d3/c13a 0 2024-03-22T07:28:52.310 INFO:tasks.workunit.client.0.smithi134.stdout:9/932: symlink d3/d9/d37/d5a/d7f/daf/l13b 0 2024-03-22T07:28:52.313 INFO:tasks.workunit.client.0.smithi134.stdout:2/984: dwrite d2/d5/d8/f2f [4194304,4194304] 0 2024-03-22T07:28:52.315 INFO:tasks.workunit.client.0.smithi134.stdout:2/985: unlink d2/l34 0 2024-03-22T07:28:52.318 INFO:tasks.workunit.client.0.smithi134.stdout:2/986: rmdir d2/d5/d22/dbc/d104/d10b 39 2024-03-22T07:28:52.318 INFO:tasks.workunit.client.0.smithi134.stdout:9/933: write d3/d9/df/d57/fa9 [1715826,28834] 0 2024-03-22T07:28:52.322 INFO:tasks.workunit.client.0.smithi134.stdout:2/987: dread d2/d5/d8/d5d/d5f/d75/dfd/d60/fa7 [0,4194304] 0 2024-03-22T07:28:52.323 INFO:tasks.workunit.client.0.smithi134.stdout:9/934: unlink d3/d9/df/d57/d67/d5f/l65 0 2024-03-22T07:28:52.323 INFO:tasks.workunit.client.0.smithi134.stdout:9/935: chown d3/d9/d37/d3c/d71/dc2 6 1 2024-03-22T07:28:52.323 INFO:tasks.workunit.client.0.smithi134.stdout:9/936: chown d3/d9/d37/d6f/f32 355345031 1 2024-03-22T07:28:52.324 INFO:tasks.workunit.client.0.smithi134.stdout:9/937: chown d3/l5 299976712 1 2024-03-22T07:28:52.324 INFO:tasks.workunit.client.0.smithi134.stdout:9/938: dread - d3/d9/df/d12/f60 zero size 2024-03-22T07:28:52.325 INFO:tasks.workunit.client.0.smithi134.stdout:9/939: truncate d3/d9/df/d57/d67/f6c 767726 0 2024-03-22T07:28:52.325 INFO:tasks.workunit.client.0.smithi134.stdout:9/940: write d3/d9/df/d57/d67/fc7 [403389,61286] 0 2024-03-22T07:28:52.326 INFO:tasks.workunit.client.0.smithi134.stdout:9/941: write d3/d9/d37/d5a/fe9 [630080,88283] 0 2024-03-22T07:28:52.326 INFO:tasks.workunit.client.0.smithi134.stdout:9/942: readlink d3/d9/df/d12/l81 0 2024-03-22T07:28:52.326 INFO:tasks.workunit.client.0.smithi134.stdout:9/943: write d3/d9/d37/d6f/d54/d9d/dc0/f101 [957735,279] 0 2024-03-22T07:28:52.329 INFO:tasks.workunit.client.0.smithi134.stdout:2/988: dread d2/d5/d8/f2f [4194304,4194304] 0 2024-03-22T07:28:52.329 INFO:tasks.workunit.client.0.smithi134.stdout:9/944: dread d3/d9/df/fb2 [0,4194304] 0 2024-03-22T07:28:52.331 INFO:tasks.workunit.client.0.smithi134.stdout:9/945: dread d3/f73 [0,4194304] 0 2024-03-22T07:28:52.332 INFO:tasks.workunit.client.0.smithi134.stdout:2/989: mkdir d2/d5/dde/d124/d142 0 2024-03-22T07:28:52.340 INFO:tasks.workunit.client.0.smithi134.stdout:2/990: dread d2/d5/d8/d31/f46 [0,4194304] 0 2024-03-22T07:28:52.341 INFO:tasks.workunit.client.0.smithi134.stdout:2/991: getdents d2/d5/d8/d5d/d5f 0 2024-03-22T07:28:52.342 INFO:tasks.workunit.client.0.smithi134.stdout:2/992: creat d2/d5/d22/dbc/d104/d10b/f143 x:0 0 0 2024-03-22T07:28:52.343 INFO:tasks.workunit.client.0.smithi134.stdout:2/993: symlink d2/de5/l144 0 2024-03-22T07:28:52.344 INFO:tasks.workunit.client.0.smithi134.stdout:2/994: chown d2/d5/d22/f101 70138 1 2024-03-22T07:28:52.344 INFO:tasks.workunit.client.0.smithi134.stdout:2/995: write d2/d5/d8/d5d/d5f/d75/dfd/d4f/d6e/fae [382603,80474] 0 2024-03-22T07:28:52.344 INFO:tasks.workunit.client.0.smithi134.stdout:2/996: stat d2/d5/d8/c5c 0 2024-03-22T07:28:52.344 INFO:tasks.workunit.client.0.smithi134.stdout:9/946: dwrite d3/d9/df/d12/dfc/f125 [0,4194304] 0 2024-03-22T07:28:52.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/997: write d2/d5/d8/d31/f46 [2816076,24328] 0 2024-03-22T07:28:52.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/998: readlink d2/d5/d8/d5d/d5f/d75/dfd/lf2 0 2024-03-22T07:28:52.347 INFO:tasks.workunit.client.0.smithi134.stdout:2/999: write d2/de5/f117 [574773,112380] 0 2024-03-22T07:28:52.365 INFO:tasks.workunit.client.0.smithi134.stdout:9/947: dwrite d3/d9/df/d57/d67/f8a [4194304,4194304] 0 2024-03-22T07:28:52.366 INFO:tasks.workunit.client.0.smithi134.stdout:9/948: dread d3/d9/d37/d5a/dc5/d10b/d10e/f12d [0,4194304] 0 2024-03-22T07:28:52.367 INFO:tasks.workunit.client.0.smithi134.stdout:9/949: mkdir d3/d9/df/d12/dd7/de7/d13c 0 2024-03-22T07:28:52.369 INFO:tasks.workunit.client.0.smithi134.stdout:9/950: creat d3/d9/d129/f13d x:0 0 0 2024-03-22T07:28:52.387 INFO:tasks.workunit.client.0.smithi134.stdout:9/951: dwrite d3/d9/df/d57/d67/fc7 [0,4194304] 0 2024-03-22T07:28:52.388 INFO:tasks.workunit.client.0.smithi134.stdout:9/952: chown d3/d9/d37/f47 2 1 2024-03-22T07:28:52.395 INFO:tasks.workunit.client.0.smithi134.stdout:9/953: write d3/d9/d37/d5a/d7f/d80/fab [2221332,31084] 0 2024-03-22T07:28:52.404 INFO:tasks.workunit.client.0.smithi134.stdout:9/954: dread d3/d9/df/d57/d67/fb5 [0,4194304] 0 2024-03-22T07:28:52.414 INFO:tasks.workunit.client.0.smithi134.stdout:9/955: dread d3/d9/d37/d6f/d54/fbf [0,4194304] 0 2024-03-22T07:28:52.417 INFO:tasks.workunit.client.0.smithi134.stdout:9/956: dread d3/f22 [0,4194304] 0 2024-03-22T07:28:52.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/957: rename d3/d9/df/f49 to d3/d9/d37/d6f/d54/d9d/f13e 0 2024-03-22T07:28:52.419 INFO:tasks.workunit.client.0.smithi134.stdout:9/958: dread - d3/f136 zero size 2024-03-22T07:28:52.421 INFO:tasks.workunit.client.0.smithi134.stdout:9/959: symlink d3/d9/d37/d3c/d71/d8c/l13f 0 2024-03-22T07:28:52.421 INFO:tasks.workunit.client.0.smithi134.stdout:9/960: dread - d3/d9/d37/d3c/d71/f111 zero size 2024-03-22T07:28:52.421 INFO:tasks.workunit.client.0.smithi134.stdout:9/961: write d3/d9/d37/d70/fac [8919,81255] 0 2024-03-22T07:28:52.422 INFO:tasks.workunit.client.0.smithi134.stdout:9/962: truncate d3/d9/d37/d3c/d71/dc2/f100 2760568 0 2024-03-22T07:28:52.423 INFO:tasks.workunit.client.0.smithi134.stdout:9/963: symlink d3/d9/d37/d3c/l140 0 2024-03-22T07:28:52.426 INFO:tasks.workunit.client.0.smithi134.stdout:9/964: rename d3/d9/df/d12/dd7/de7/d13c to d3/d9/d37/d5a/d7f/daf/d124/d141 0 2024-03-22T07:28:52.429 INFO:tasks.workunit.client.0.smithi134.stdout:9/965: link d3/d9/d37/d3c/l8d d3/d9/df/d12/dfc/l142 0 2024-03-22T07:28:52.447 INFO:tasks.workunit.client.0.smithi134.stdout:9/966: dwrite d3/d9/d37/d6f/d54/fb6 [0,4194304] 0 2024-03-22T07:28:52.449 INFO:tasks.workunit.client.0.smithi134.stdout:9/967: stat d3/d9/df/d12/l81 0 2024-03-22T07:28:52.452 INFO:tasks.workunit.client.0.smithi134.stdout:9/968: mknod d3/d9/d37/d6f/d54/d139/c143 0 2024-03-22T07:28:52.454 INFO:tasks.workunit.client.0.smithi134.stdout:9/969: mkdir d3/d9/df/d57/d67/d5f/d144 0 2024-03-22T07:28:52.454 INFO:tasks.workunit.client.0.smithi134.stdout:9/970: fdatasync d3/d9/df/fc8 0 2024-03-22T07:28:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:9/971: symlink d3/d9/d37/d5a/l145 0 2024-03-22T07:28:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:9/972: write d3/d9/df/fb4 [513917,29930] 0 2024-03-22T07:28:52.456 INFO:tasks.workunit.client.0.smithi134.stdout:9/973: dread d3/d9/df/d57/f7e [0,4194304] 0 2024-03-22T07:28:52.458 INFO:tasks.workunit.client.0.smithi134.stdout:9/974: creat d3/d9/d37/d3c/d71/d10c/f146 x:0 0 0 2024-03-22T07:28:52.465 INFO:tasks.workunit.client.0.smithi134.stdout:9/975: symlink d3/d9/d37/d6f/d54/l147 0 2024-03-22T07:28:52.466 INFO:tasks.workunit.client.0.smithi134.stdout:9/976: symlink d3/d9/d37/d5a/d7f/daf/d124/d141/l148 0 2024-03-22T07:28:52.467 INFO:tasks.workunit.client.0.smithi134.stdout:9/977: mkdir d3/d9/d37/d3c/d71/d8c/d115/d149 0 2024-03-22T07:28:52.468 INFO:tasks.workunit.client.0.smithi134.stdout:9/978: creat d3/d9/d37/d3c/dcb/f14a x:0 0 0 2024-03-22T07:28:52.468 INFO:tasks.workunit.client.0.smithi134.stdout:9/979: creat d3/d9/d37/d3c/dcb/f14b x:0 0 0 2024-03-22T07:28:52.471 INFO:tasks.workunit.client.0.smithi134.stdout:9/980: mknod d3/d9/d37/d5a/dc5/d10b/d10e/c14c 0 2024-03-22T07:28:52.472 INFO:tasks.workunit.client.0.smithi134.stdout:9/981: rmdir d3/d9/df/d12/dd7 39 2024-03-22T07:28:52.474 INFO:tasks.workunit.client.0.smithi134.stdout:9/982: rename d3/d9/d37/d6f/d54/d9d/dc0/c84 to d3/d9/d37/d3c/d71/dc2/c14d 0 2024-03-22T07:28:52.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/983: dwrite d3/d9/fde [0,4194304] 0 2024-03-22T07:28:52.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/984: stat d3/f14 0 2024-03-22T07:28:52.489 INFO:tasks.workunit.client.0.smithi134.stdout:9/985: creat d3/d9/d129/f14e x:0 0 0 2024-03-22T07:28:52.503 INFO:tasks.workunit.client.0.smithi134.stdout:9/986: dwrite d3/d9/df/d57/d67/d5f/f9a [0,4194304] 0 2024-03-22T07:28:52.513 INFO:tasks.workunit.client.0.smithi134.stdout:9/987: dread d3/d9/d37/d6f/f32 [0,4194304] 0 2024-03-22T07:28:52.513 INFO:tasks.workunit.client.0.smithi134.stdout:9/988: creat d3/d9/d37/d6f/d54/d9d/dc0/f14f x:0 0 0 2024-03-22T07:28:52.514 INFO:tasks.workunit.client.0.smithi134.stdout:9/989: creat d3/d9/d37/d6f/d54/d9d/f150 x:0 0 0 2024-03-22T07:28:52.514 INFO:tasks.workunit.client.0.smithi134.stdout:9/990: fsync d3/d9/d37/d70/fd1 0 2024-03-22T07:28:52.515 INFO:tasks.workunit.client.0.smithi134.stdout:6/986: sync 2024-03-22T07:28:52.516 INFO:tasks.workunit.client.0.smithi134.stdout:9/991: unlink d3/d9/f36 0 2024-03-22T07:28:52.516 INFO:tasks.workunit.client.0.smithi134.stdout:9/992: write d3/f136 [287207,31497] 0 2024-03-22T07:28:52.517 INFO:tasks.workunit.client.0.smithi134.stdout:6/987: rename d2/d1b/d1d/d5e/d84/f123 to d2/d1b/d4d/d65/f159 0 2024-03-22T07:28:52.522 INFO:tasks.workunit.client.0.smithi134.stdout:6/988: dread d2/f1c [0,4194304] 0 2024-03-22T07:28:52.523 INFO:tasks.workunit.client.0.smithi134.stdout:9/993: dread d3/d9/d37/d6f/d54/d9d/dc0/fa1 [0,4194304] 0 2024-03-22T07:28:52.524 INFO:tasks.workunit.client.0.smithi134.stdout:9/994: write d3/d9/d37/f123 [696000,68965] 0 2024-03-22T07:28:52.524 INFO:tasks.workunit.client.0.smithi134.stdout:9/995: stat d3/d9/df/d12/f1f 0 2024-03-22T07:28:52.525 INFO:tasks.workunit.client.0.smithi134.stdout:6/989: link d2/d1b/d4d/da5/dec/d28/d97/c151 d2/d6e/d105/d10b/d157/c15a 0 2024-03-22T07:28:52.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/990: dread d2/d1b/d4d/fff [0,4194304] 0 2024-03-22T07:28:52.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/991: rename d2/d1b to d2/d1b/d1d/d5e/d15b 22 2024-03-22T07:28:52.526 INFO:tasks.workunit.client.0.smithi134.stdout:6/992: write d2/d1b/d1d/d5e/d6f/da8/dca/f11a [822170,62362] 0 2024-03-22T07:28:52.587 INFO:tasks.workunit.client.0.smithi134.stdout:6/993: truncate d2/d1b/d1d/d5e/d6f/da8/dca/f11a 108709 0 2024-03-22T07:28:52.589 INFO:tasks.workunit.client.0.smithi134.stdout:6/994: dread d2/f69 [0,4194304] 0 2024-03-22T07:28:52.593 INFO:tasks.workunit.client.0.smithi134.stdout:6/995: mkdir d2/d1b/d1d/dcc/d15c 0 2024-03-22T07:28:52.593 INFO:tasks.workunit.client.0.smithi134.stdout:6/996: write d2/d1b/d4d/da5/dec/fb8 [4723520,21473] 0 2024-03-22T07:28:52.593 INFO:tasks.workunit.client.0.smithi134.stdout:6/997: dread d2/d1b/d4d/da5/fe0 [0,4194304] 0 2024-03-22T07:28:52.595 INFO:tasks.workunit.client.0.smithi134.stdout:6/998: unlink d2/d1b/d1d/d5e/c11d 0 2024-03-22T07:28:52.595 INFO:tasks.workunit.client.0.smithi134.stdout:6/999: write d2/d1b/d1d/d5e/d84/f79 [1960613,11887] 0 2024-03-22T07:28:52.883 INFO:tasks.workunit.client.0.smithi134.stdout:9/996: sync 2024-03-22T07:28:52.887 INFO:tasks.workunit.client.0.smithi134.stdout:9/997: mknod d3/d9/df/d12/dd7/de7/c151 0 2024-03-22T07:28:52.887 INFO:tasks.workunit.client.0.smithi134.stdout:9/998: dread - d3/d9/d37/d3c/d71/f11d zero size 2024-03-22T07:28:52.893 INFO:tasks.workunit.client.0.smithi134.stdout:9/999: dread d3/d9/d37/f47 [0,4194304] 0 2024-03-22T07:28:52.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -rf -- ./tmp.vZ6hQWMGAz 2024-03-22T07:28:53.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: pgmap v12: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 254 MiB/s rd, 308 MiB/s wr, 501 op/s 2024-03-22T07:28:53.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:53.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:53.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:53 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: pgmap v12: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 254 MiB/s rd, 308 MiB/s wr, 501 op/s 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:53.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:53 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:54 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi195 to 2581M 2024-03-22T07:28:54.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:54 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi195 to 2581M 2024-03-22T07:28:55.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:55 smithi134 ceph-mon[29057]: pgmap v13: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 175 MiB/s rd, 218 MiB/s wr, 340 op/s 2024-03-22T07:28:55.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:55 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:55.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:55 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:55.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:55 smithi195 ceph-mon[36144]: pgmap v13: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 175 MiB/s rd, 218 MiB/s wr, 340 op/s 2024-03-22T07:28:55.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:55 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:55.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:55 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: pgmap v14: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 219 MiB/s rd, 260 MiB/s wr, 458 op/s 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:28:57.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:57 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:28:57.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: pgmap v14: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 219 MiB/s rd, 260 MiB/s wr, 458 op/s 2024-03-22T07:28:57.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-22T07:28:57.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:57.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:28:57.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:57 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:28:58.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Adjusting osd_memory_target on smithi134 to 1557M 2024-03-22T07:28:58.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:58 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Adjusting osd_memory_target on smithi134 to 1557M 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:58.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:58 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:28:59.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:59 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:28:59.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:59 smithi134 ceph-mon[29057]: Reconfiguring node-exporter.smithi134 (dependencies changed)... 2024-03-22T07:28:59.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:59 smithi134 ceph-mon[29057]: Reconfiguring daemon node-exporter.smithi134 on smithi134 2024-03-22T07:28:59.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:28:59 smithi134 ceph-mon[29057]: pgmap v15: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 117 MiB/s rd, 132 MiB/s wr, 262 op/s 2024-03-22T07:28:59.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:59 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:28:59.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:59 smithi195 ceph-mon[36144]: Reconfiguring node-exporter.smithi134 (dependencies changed)... 2024-03-22T07:28:59.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:59 smithi195 ceph-mon[36144]: Reconfiguring daemon node-exporter.smithi134 on smithi134 2024-03-22T07:28:59.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:28:59 smithi195 ceph-mon[36144]: pgmap v15: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 117 MiB/s rd, 132 MiB/s wr, 262 op/s 2024-03-22T07:29:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:01 smithi134 ceph-mon[29057]: pgmap v16: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 117 MiB/s rd, 132 MiB/s wr, 293 op/s 2024-03-22T07:29:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:01 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:01.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:01 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:01.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:01 smithi195 ceph-mon[36144]: pgmap v16: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 117 MiB/s rd, 132 MiB/s wr, 293 op/s 2024-03-22T07:29:01.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:01 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:01.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:01 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:02.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:02 smithi195 ceph-mon[36144]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-03-22T07:29:02.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:02 smithi195 ceph-mon[36144]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-03-22T07:29:02.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:02 smithi134 ceph-mon[29057]: Reconfiguring alertmanager.smithi134 (dependencies changed)... 2024-03-22T07:29:02.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:02 smithi134 ceph-mon[29057]: Reconfiguring daemon alertmanager.smithi134 on smithi134 2024-03-22T07:29:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:03 smithi134 ceph-mon[29057]: pgmap v17: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 117 MiB/s wr, 328 op/s 2024-03-22T07:29:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:03 smithi195 ceph-mon[36144]: pgmap v17: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 117 MiB/s wr, 328 op/s 2024-03-22T07:29:03.789 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-22T07:29:03.789 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-03-22T07:29:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:04 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:04 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:05.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:05 smithi134 ceph-mon[29057]: pgmap v18: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 44 MiB/s rd, 42 MiB/s wr, 198 op/s 2024-03-22T07:29:05.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:05 smithi195 ceph-mon[36144]: pgmap v18: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 44 MiB/s rd, 42 MiB/s wr, 198 op/s 2024-03-22T07:29:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:07 smithi195 ceph-mon[36144]: pgmap v19: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 44 MiB/s rd, 43 MiB/s wr, 283 op/s 2024-03-22T07:29:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:07 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:07 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:07.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:07 smithi134 ceph-mon[29057]: pgmap v19: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 44 MiB/s rd, 43 MiB/s wr, 283 op/s 2024-03-22T07:29:07.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:07 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:07.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:07 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:08.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:08 smithi195 ceph-mon[36144]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-03-22T07:29:08.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:08 smithi195 ceph-mon[36144]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-03-22T07:29:08.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:08 smithi134 ceph-mon[29057]: Reconfiguring grafana.smithi134 (dependencies changed)... 2024-03-22T07:29:08.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:08 smithi134 ceph-mon[29057]: Reconfiguring daemon grafana.smithi134 on smithi134 2024-03-22T07:29:08.957 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-22T07:29:08.957 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-22T07:29:09.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:09 smithi134 ceph-mon[29057]: pgmap v20: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-03-22T07:29:09.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:09 smithi195 ceph-mon[36144]: pgmap v20: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 165 op/s 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 -- 172.21.15.134:0/2913111675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fe4c0 msgr2=0x7fba9c0fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/2913111675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fe8d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fba90004940 tx=0x7fba90009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 -- 172.21.15.134:0/2913111675 shutdown_connections 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/2913111675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fee10 0x7fba9c0faf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/2913111675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fe8d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 -- 172.21.15.134:0/2913111675 >> 172.21.15.134:0/2913111675 conn(0x7fba9c0f6ba0 msgr2=0x7fba9c0f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 -- 172.21.15.134:0/2913111675 shutdown_connections 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.783+0000 7fbaa2bea700 1 -- 172.21.15.134:0/2913111675 wait complete. 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa2bea700 1 Processor -- start 2024-03-22T07:29:09.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa2bea700 1 -- start start 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa2bea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa2bea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fee10 0x7fba9c0fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa2bea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0fc730 con 0x7fba9c0fee10 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa2bea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0fc8a0 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa0986700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa0986700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:54972/0 (socket says 172.21.15.134:54972) 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.784+0000 7fbaa0986700 1 -- 172.21.15.134:0/797529017 learned_addr learned my addr 172.21.15.134:0/797529017 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fba9bfff700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fee10 0x7fba9c0fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fbaa0986700 1 -- 172.21.15.134:0/797529017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fee10 msgr2=0x7fba9c0fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fbaa0986700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fee10 0x7fba9c0fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fbaa0986700 1 -- 172.21.15.134:0/797529017 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90005040 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fba9bfff700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fee10 0x7fba9c0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fbaa0986700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fdcb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba90009150 tx=0x7fba90009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9000e040 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba9000bcc0 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c0fcb20 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba9001c630 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.785+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c1159e0 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.786+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c05f5f0 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.787+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7fba90026440 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.787+0000 7fba997fa700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fba8c06b0b0 0x7fba8c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:09.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.788+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fba9008a850 con 0x7fba9c0fe4c0 2024-03-22T07:29:09.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.788+0000 7fba9bfff700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fba8c06b0b0 0x7fba8c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:09.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.788+0000 7fba9bfff700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fba8c06b0b0 0x7fba8c06d560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba880095c0 tx=0x7fba88007ab0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:09.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:09.792+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fba90054b40 con 0x7fba9c0fe4c0 2024-03-22T07:29:10.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.082+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba9c102590 con 0x7fba8c06b0b0 2024-03-22T07:29:10.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.084+0000 7fba997fa700 1 -- 172.21.15.134:0/797529017 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fba9c102590 con 0x7fba8c06b0b0 2024-03-22T07:29:10.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fba8c06b0b0 msgr2=0x7fba8c06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fba8c06b0b0 0x7fba8c06d560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba880095c0 tx=0x7fba88007ab0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 msgr2=0x7fba9c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fdcb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba90009150 tx=0x7fba90009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 shutdown_connections 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba9c0fe4c0 0x7fba9c0fdcb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fba8c06b0b0 0x7fba8c06d560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 --2- 172.21.15.134:0/797529017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba9c0fee10 0x7fba9c0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 >> 172.21.15.134:0/797529017 conn(0x7fba9c0f6ba0 msgr2=0x7fba9c0f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 shutdown_connections 2024-03-22T07:29:10.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.092+0000 7fbaa2bea700 1 -- 172.21.15.134:0/797529017 wait complete. 2024-03-22T07:29:10.113 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:29:10.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.267+0000 7f46298a2700 1 -- 172.21.15.134:0/3446116399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4624104500 msgr2=0x7f4624104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.267 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.267+0000 7f46298a2700 1 --2- 172.21.15.134:0/3446116399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4624104500 0x7f4624104970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4618004940 tx=0x7f4618009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.267+0000 7f46298a2700 1 -- 172.21.15.134:0/3446116399 shutdown_connections 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.267+0000 7f46298a2700 1 --2- 172.21.15.134:0/3446116399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4624104500 0x7f4624104970 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4618004940 tx=0x7f4618009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.267+0000 7f46298a2700 1 --2- 172.21.15.134:0/3446116399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f4624103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.267+0000 7f46298a2700 1 -- 172.21.15.134:0/3446116399 >> 172.21.15.134:0/3446116399 conn(0x7f4624072530 msgr2=0x7f4624074960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.268+0000 7f46298a2700 1 -- 172.21.15.134:0/3446116399 shutdown_connections 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.268+0000 7f46298a2700 1 -- 172.21.15.134:0/3446116399 wait complete. 2024-03-22T07:29:10.268 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.268+0000 7f46298a2700 1 Processor -- start 2024-03-22T07:29:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.268+0000 7f46298a2700 1 -- start start 2024-03-22T07:29:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46298a2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f462411ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46298a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f462411cfc0 0x7f462411db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:10.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46298a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462411d4a0 con 0x7f462411cfc0 2024-03-22T07:29:10.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46298a2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462411d610 con 0x7f4624103250 2024-03-22T07:29:10.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f4623fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f462411cfc0 0x7f462411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:10.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46288a0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f462411ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:10.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46288a0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f462411ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:54980/0 (socket says 172.21.15.134:54980) 2024-03-22T07:29:10.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.269+0000 7f46288a0700 1 -- 172.21.15.134:0/1452395030 learned_addr learned my addr 172.21.15.134:0/1452395030 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.270+0000 7f46288a0700 1 -- 172.21.15.134:0/1452395030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f462411cfc0 msgr2=0x7f462411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.270+0000 7f46288a0700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f462411cfc0 0x7f462411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.270+0000 7f46288a0700 1 -- 172.21.15.134:0/1452395030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4618005040 con 0x7f4624103250 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.270+0000 7f46288a0700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f462411ca80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f461c00cac0 tx=0x7f461c007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.270+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461c00a980 con 0x7f4624103250 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.270+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f461c012440 con 0x7f4624103250 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.271+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462411e1c0 con 0x7f4624103250 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.271+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461c0115e0 con 0x7f4624103250 2024-03-22T07:29:10.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.271+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462411e6f0 con 0x7f4624103250 2024-03-22T07:29:10.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.273+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46240775d0 con 0x7f4624103250 2024-03-22T07:29:10.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.273+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f461c011850 con 0x7f4624103250 2024-03-22T07:29:10.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.273+0000 7f46217fa700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f460c06b190 0x7f460c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:10.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.274+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f461c08a130 con 0x7f4624103250 2024-03-22T07:29:10.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.274+0000 7f4623fff700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f460c06b190 0x7f460c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:10.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.275+0000 7f4623fff700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f460c06b190 0x7f460c06d640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f461800b970 tx=0x7f4618009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:10.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.281+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f461c057f40 con 0x7f4624103250 2024-03-22T07:29:10.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.611+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4624076f70 con 0x7f460c06b190 2024-03-22T07:29:10.612 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.612+0000 7f46217fa700 1 -- 172.21.15.134:0/1452395030 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4618009710 con 0x7f460c06b190 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.615+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f460c06b190 msgr2=0x7f460c06d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.615+0000 7f46298a2700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f460c06b190 0x7f460c06d640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f461800b970 tx=0x7f4618009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.615+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 msgr2=0x7f462411ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.615+0000 7f46298a2700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f462411ca80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f461c00cac0 tx=0x7f461c007ee0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 shutdown_connections 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4624103250 0x7f462411ca80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f460c06b190 0x7f460c06d640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 --2- 172.21.15.134:0/1452395030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f462411cfc0 0x7f462411db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.616 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 >> 172.21.15.134:0/1452395030 conn(0x7f4624072530 msgr2=0x7f4624074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 shutdown_connections 2024-03-22T07:29:10.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.616+0000 7f46298a2700 1 -- 172.21.15.134:0/1452395030 wait complete. 2024-03-22T07:29:10.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 -- 172.21.15.134:0/3819282349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 msgr2=0x7fa2500fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3819282349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa2500fb850 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa240004a50 tx=0x7fa24000af40 comp rx=0 tx=0).stop 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 -- 172.21.15.134:0/3819282349 shutdown_connections 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3819282349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2500fc6f0 0x7fa2500fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3819282349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa2500fb850 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 -- 172.21.15.134:0/3819282349 >> 172.21.15.134:0/3819282349 conn(0x7fa2500f6ba0 msgr2=0x7fa2500f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 -- 172.21.15.134:0/3819282349 shutdown_connections 2024-03-22T07:29:10.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.770+0000 7fa2556a1700 1 -- 172.21.15.134:0/3819282349 wait complete. 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa2556a1700 1 Processor -- start 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa2556a1700 1 -- start start 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa2556a1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa25010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa2556a1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2500fc6f0 0x7fa25010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa2556a1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25010e570 con 0x7fa2500fb440 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa2556a1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25010edc0 con 0x7fa2500fc6f0 2024-03-22T07:29:10.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa24effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa25010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa24effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa25010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58786/0 (socket says 172.21.15.134:58786) 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.771+0000 7fa24effd700 1 -- 172.21.15.134:0/3394551211 learned_addr learned my addr 172.21.15.134:0/3394551211 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa24effd700 1 -- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2500fc6f0 msgr2=0x7fa25010df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa24effd700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2500fc6f0 0x7fa25010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa24effd700 1 -- 172.21.15.134:0/3394551211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240005040 con 0x7fa2500fb440 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa24effd700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa25010da30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa240000c00 tx=0x7fa24000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24000f070 con 0x7fa2500fb440 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25010f040 con 0x7fa2500fb440 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa24001c8f0 con 0x7fa2500fb440 2024-03-22T07:29:10.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25010f520 con 0x7fa2500fb440 2024-03-22T07:29:10.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.772+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2400148f0 con 0x7fa2500fb440 2024-03-22T07:29:10.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.773+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0052e0 con 0x7fa2500fb440 2024-03-22T07:29:10.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.775+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7fa24001ca60 con 0x7fa2500fb440 2024-03-22T07:29:10.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.776+0000 7fa2377fe700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa23806b100 0x7fa23806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:10.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.776+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa24008bd90 con 0x7fa2500fb440 2024-03-22T07:29:10.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.776+0000 7fa24e7fc700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa23806b100 0x7fa23806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:10.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.777+0000 7fa24e7fc700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa23806b100 0x7fa23806d5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa244009fd0 tx=0x7fa24400b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:10.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:10.780+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa240059b10 con 0x7fa2500fb440 2024-03-22T07:29:11.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.188+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa23c000bf0 con 0x7fa23806b100 2024-03-22T07:29:11.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.205+0000 7fa2377fe700 1 -- 172.21.15.134:0/3394551211 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fa23c000bf0 con 0x7fa23806b100 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 starting - - - - 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (8m) 16s ago 8m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (7m) 24s ago 7m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 16s ago 8m 83.7M - 9.4.7 954c08fa6188 8cd534e3bc25 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (3m) 16s ago 3m 216M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (3m) 16s ago 3m 11.7M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (3m) 24s ago 3m 13.4M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (3m) 24s ago 2m 12.3M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (9m) 16s ago 9m 335M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (59s) 24s ago 7m 489M - 19.0.0-1667-gdb0330b1 4f325f8440e9 06db0bc1a216 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (9m) 16s ago 9m 50.8M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:29:11.206 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (7m) 24s ago 7m 37.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (7m) 24s ago 7m 16.9M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (6m) 16s ago 6m 234M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 16s ago 6m 243M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 16s ago 5m 198M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (5m) 24s ago 5m 272M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (5m) 24s ago 5m 238M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (4m) 24s ago 4m 266M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:29:11.207 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 16s ago 8m 56.7M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:29:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa23806b100 msgr2=0x7fa23806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa23806b100 0x7fa23806d5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa244009fd0 tx=0x7fa24400b040 comp rx=0 tx=0).stop 2024-03-22T07:29:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 msgr2=0x7fa25010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa25010da30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa240000c00 tx=0x7fa24000af40 comp rx=0 tx=0).stop 2024-03-22T07:29:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 shutdown_connections 2024-03-22T07:29:11.210 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa23806b100 0x7fa23806d5b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2500fb440 0x7fa25010da30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 --2- 172.21.15.134:0/3394551211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2500fc6f0 0x7fa25010df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.210+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 >> 172.21.15.134:0/3394551211 conn(0x7fa2500f6ba0 msgr2=0x7fa2500f82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.211+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 shutdown_connections 2024-03-22T07:29:11.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.211+0000 7fa2556a1700 1 -- 172.21.15.134:0/3394551211 wait complete. 2024-03-22T07:29:11.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.365+0000 7f3fbdc95700 1 -- 172.21.15.134:0/326453776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb80fff30 msgr2=0x7f3fb8102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:11.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.365+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/326453776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb80fff30 0x7f3fb8102350 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3fac004940 tx=0x7f3fac009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:11.366 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:11 smithi134 ceph-mon[29057]: pgmap v21: 65 pgs: 65 active+clean; 1.1 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 181 op/s 2024-03-22T07:29:11.366 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:11 smithi134 ceph-mon[29057]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.366+0000 7f3fbdc95700 1 -- 172.21.15.134:0/326453776 shutdown_connections 2024-03-22T07:29:11.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.366+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/326453776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb80fff30 0x7f3fb8102350 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.366+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/326453776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb8066ef0 0x7f3fb80ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.366+0000 7f3fbdc95700 1 -- 172.21.15.134:0/326453776 >> 172.21.15.134:0/326453776 conn(0x7f3fb80f7440 msgr2=0x7f3fb80f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.366+0000 7f3fbdc95700 1 -- 172.21.15.134:0/326453776 shutdown_connections 2024-03-22T07:29:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.367+0000 7f3fbdc95700 1 -- 172.21.15.134:0/326453776 wait complete. 2024-03-22T07:29:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.367+0000 7f3fbdc95700 1 Processor -- start 2024-03-22T07:29:11.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fbdc95700 1 -- start start 2024-03-22T07:29:11.369 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fbdc95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb8066ef0 0x7f3fb810d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fbdc95700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb80fff30 0x7f3fb810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fbdc95700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb810e520 con 0x7f3fb8066ef0 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fbdc95700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8112ec0 con 0x7f3fb80fff30 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fb77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb8066ef0 0x7f3fb810d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fb6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb80fff30 0x7f3fb810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fb77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb8066ef0 0x7f3fb810d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58806/0 (socket says 172.21.15.134:58806) 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.368+0000 7f3fb77fe700 1 -- 172.21.15.134:0/3831088074 learned_addr learned my addr 172.21.15.134:0/3831088074 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3fb6ffd700 1 -- 172.21.15.134:0/3831088074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb8066ef0 msgr2=0x7f3fb810d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3fb6ffd700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb8066ef0 0x7f3fb810d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3fb6ffd700 1 -- 172.21.15.134:0/3831088074 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac005040 con 0x7f3fb80fff30 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3fb6ffd700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb80fff30 0x7f3fb810de90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fac00e040 con 0x7f3fb80fff30 2024-03-22T07:29:11.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fac00bbf0 con 0x7f3fb80fff30 2024-03-22T07:29:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb81130c0 con 0x7f3fb80fff30 2024-03-22T07:29:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fac01c650 con 0x7f3fb80fff30 2024-03-22T07:29:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.369+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb8113630 con 0x7f3fb80fff30 2024-03-22T07:29:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.371+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb804c710 con 0x7f3fb80fff30 2024-03-22T07:29:11.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.372+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f3fac013420 con 0x7f3fb80fff30 2024-03-22T07:29:11.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.372+0000 7f3f9ffff700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3fa006b0c0 0x7f3fa006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:11.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.372+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3fac08ade0 con 0x7f3fb80fff30 2024-03-22T07:29:11.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.372+0000 7f3fb77fe700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3fa006b0c0 0x7f3fa006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:11.373 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.373+0000 7f3fb77fe700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3fa006b0c0 0x7f3fa006d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009c70 tx=0x7f3fa8009220 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:11.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.377+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3fac058b60 con 0x7f3fb80fff30 2024-03-22T07:29:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:11 smithi195 ceph-mon[36144]: pgmap v21: 65 pgs: 65 active+clean; 1.1 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 181 op/s 2024-03-22T07:29:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:11 smithi195 ceph-mon[36144]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:11.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.938+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3fb8105980 con 0x7f3fb80fff30 2024-03-22T07:29:11.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.938+0000 7f3f9ffff700 1 -- 172.21.15.134:0/3831088074 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f3fac0586f0 con 0x7f3fb80fff30 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:29:11.939 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 13, 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:29:11.940 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:29:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.941+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3fa006b0c0 msgr2=0x7f3fa006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.941+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3fa006b0c0 0x7f3fa006d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009c70 tx=0x7f3fa8009220 comp rx=0 tx=0).stop 2024-03-22T07:29:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.941+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb80fff30 msgr2=0x7f3fb810de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.941+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb80fff30 0x7f3fb810de90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 shutdown_connections 2024-03-22T07:29:11.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3fa006b0c0 0x7f3fa006d570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fb8066ef0 0x7f3fb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 --2- 172.21.15.134:0/3831088074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fb80fff30 0x7f3fb810de90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 >> 172.21.15.134:0/3831088074 conn(0x7f3fb80f7440 msgr2=0x7f3fb80f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 shutdown_connections 2024-03-22T07:29:11.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:11.942+0000 7f3fbdc95700 1 -- 172.21.15.134:0/3831088074 wait complete. 2024-03-22T07:29:12.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 -- 172.21.15.134:0/3145674153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 msgr2=0x7f6ba4101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/3145674153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba4101eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6b94004940 tx=0x7f6b94009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 -- 172.21.15.134:0/3145674153 shutdown_connections 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/3145674153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba41023f0 0x7f6ba41047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/3145674153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba4101eb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 -- 172.21.15.134:0/3145674153 >> 172.21.15.134:0/3145674153 conn(0x7f6ba40f74e0 msgr2=0x7f6ba40f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 -- 172.21.15.134:0/3145674153 shutdown_connections 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 -- 172.21.15.134:0/3145674153 wait complete. 2024-03-22T07:29:12.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.073+0000 7f6baa1e3700 1 Processor -- start 2024-03-22T07:29:12.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6baa1e3700 1 -- start start 2024-03-22T07:29:12.075 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6baa1e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba410fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6baa1e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba41023f0 0x7f6ba41101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6baa1e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba41107a0 con 0x7f6ba4066b10 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6baa1e3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4110fa0 con 0x7f6ba41023f0 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba410fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba410fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58828/0 (socket says 172.21.15.134:58828) 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba37fe700 1 -- 172.21.15.134:0/1259487799 learned_addr learned my addr 172.21.15.134:0/1259487799 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba2ffd700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba41023f0 0x7f6ba41101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba37fe700 1 -- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba41023f0 msgr2=0x7f6ba41101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba37fe700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba41023f0 0x7f6ba41101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.074+0000 7f6ba37fe700 1 -- 172.21.15.134:0/1259487799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94005040 con 0x7f6ba4066b10 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.075+0000 7f6ba37fe700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba410fc60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b94000c00 tx=0x7f6b94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.075+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9400e030 con 0x7f6ba4066b10 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.075+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b94013de0 con 0x7f6ba4066b10 2024-03-22T07:29:12.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.075+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba4111220 con 0x7f6ba4066b10 2024-03-22T07:29:12.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.075+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9401ce50 con 0x7f6ba4066b10 2024-03-22T07:29:12.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.075+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba4111760 con 0x7f6ba4066b10 2024-03-22T07:29:12.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.076+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba405f5f0 con 0x7f6ba4066b10 2024-03-22T07:29:12.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.077+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f6b9401c400 con 0x7f6ba4066b10 2024-03-22T07:29:12.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.078+0000 7f6b8bfff700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b8c06b0b0 0x7f6b8c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:12.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.078+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6b9408b3e0 con 0x7f6ba4066b10 2024-03-22T07:29:12.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.078+0000 7f6ba2ffd700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b8c06b0b0 0x7f6b8c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:12.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.079+0000 7f6ba2ffd700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b8c06b0b0 0x7f6b8c06d560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009b80 tx=0x7f6b9800b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:12.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.083+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6b94059280 con 0x7f6ba4066b10 2024-03-22T07:29:12.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:12 smithi134 ceph-mon[29057]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:12.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:12 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3831088074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:29:12.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:12 smithi195 ceph-mon[36144]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:12.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:12 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3831088074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:29:12.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.499+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ba4111a40 con 0x7f6ba4066b10 2024-03-22T07:29:12.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.499+0000 7f6b8bfff700 1 -- 172.21.15.134:0/1259487799 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f6b94058e10 con 0x7f6ba4066b10 2024-03-22T07:29:12.499 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:29:12.499 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:29:12.499 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:29:12.500 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:12.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:12.502 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:12.502 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:29:12.502 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:12.502 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:12.502 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:12.502 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b8c06b0b0 msgr2=0x7f6b8c06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b8c06b0b0 0x7f6b8c06d560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009b80 tx=0x7f6b9800b040 comp rx=0 tx=0).stop 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 msgr2=0x7f6ba410fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba410fc60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b94000c00 tx=0x7f6b94009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 shutdown_connections 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b8c06b0b0 0x7f6b8c06d560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ba4066b10 0x7f6ba410fc60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 --2- 172.21.15.134:0/1259487799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ba41023f0 0x7f6ba41101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 >> 172.21.15.134:0/1259487799 conn(0x7f6ba40f74e0 msgr2=0x7f6ba40f78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 shutdown_connections 2024-03-22T07:29:12.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.502+0000 7f6baa1e3700 1 -- 172.21.15.134:0/1259487799 wait complete. 2024-03-22T07:29:12.504 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:29:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.664+0000 7f7436fa0700 1 -- 172.21.15.134:0/4156533100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 msgr2=0x7f74300fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.664+0000 7f7436fa0700 1 --2- 172.21.15.134:0/4156533100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f74300fe340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7420004940 tx=0x7f7420009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.664+0000 7f7436fa0700 1 -- 172.21.15.134:0/4156533100 shutdown_connections 2024-03-22T07:29:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.664+0000 7f7436fa0700 1 --2- 172.21.15.134:0/4156533100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f74300fe340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.664+0000 7f7436fa0700 1 --2- 172.21.15.134:0/4156533100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 0x7f74300fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.664+0000 7f7436fa0700 1 -- 172.21.15.134:0/4156533100 >> 172.21.15.134:0/4156533100 conn(0x7f74300f83a0 msgr2=0x7f74300fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.665+0000 7f7436fa0700 1 -- 172.21.15.134:0/4156533100 shutdown_connections 2024-03-22T07:29:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.665+0000 7f7436fa0700 1 -- 172.21.15.134:0/4156533100 wait complete. 2024-03-22T07:29:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.665+0000 7f7436fa0700 1 Processor -- start 2024-03-22T07:29:12.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.665+0000 7f7436fa0700 1 -- start start 2024-03-22T07:29:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f7436fa0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 0x7f743010d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f7436fa0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f743010dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f7436fa0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743010e2f0 con 0x7f74300fded0 2024-03-22T07:29:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f7436fa0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743010eb40 con 0x7f74300fcc20 2024-03-22T07:29:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f743010dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:12.667 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f743010dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58842/0 (socket says 172.21.15.134:58842) 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 -- 172.21.15.134:0/2089510828 learned_addr learned my addr 172.21.15.134:0/2089510828 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f7435f9e700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 0x7f743010d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 -- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 msgr2=0x7f743010d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 0x7f743010d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 -- 172.21.15.134:0/2089510828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7420005040 con 0x7f74300fded0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f7435f9e700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 0x7f743010d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.666+0000 7f743579d700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f743010dcf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7420009150 tx=0x7f7420009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.667+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742000e040 con 0x7f74300fded0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.667+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f742000bcc0 con 0x7f74300fded0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.667+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743010edc0 con 0x7f74300fded0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.667+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742001c630 con 0x7f74300fded0 2024-03-22T07:29:12.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.667+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743010f300 con 0x7f74300fded0 2024-03-22T07:29:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.668+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743005f5f0 con 0x7f74300fded0 2024-03-22T07:29:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.668+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f7420013420 con 0x7f74300fded0 2024-03-22T07:29:12.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.669+0000 7f74267fc700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f741c06b0b0 0x7f741c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:12.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.669+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f742008a6c0 con 0x7f74300fded0 2024-03-22T07:29:12.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.670+0000 7f7435f9e700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f741c06b0b0 0x7f741c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:12.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.670+0000 7f7435f9e700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f741c06b0b0 0x7f741c06d560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f742c007fd0 tx=0x7f742c009f60 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:12.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.674+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f7420058620 con 0x7f74300fded0 2024-03-22T07:29:12.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.974+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f743010f5d0 con 0x7f741c06b0b0 2024-03-22T07:29:12.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.976+0000 7f74267fc700 1 -- 172.21.15.134:0/2089510828 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f743010f5d0 con 0x7f741c06b0b0 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/21 daemons upgraded", 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:29:12.976 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:29:12.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f741c06b0b0 msgr2=0x7f741c06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f741c06b0b0 0x7f741c06d560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f742c007fd0 tx=0x7f742c009f60 comp rx=0 tx=0).stop 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 msgr2=0x7f743010dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f743010dcf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7420009150 tx=0x7f7420009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 shutdown_connections 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74300fcc20 0x7f743010d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f741c06b0b0 0x7f741c06d560 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 --2- 172.21.15.134:0/2089510828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74300fded0 0x7f743010dcf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 >> 172.21.15.134:0/2089510828 conn(0x7f74300f83a0 msgr2=0x7f74300f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 shutdown_connections 2024-03-22T07:29:12.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:12.978+0000 7f7436fa0700 1 -- 172.21.15.134:0/2089510828 wait complete. 2024-03-22T07:29:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 -- 172.21.15.134:0/1797612863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 msgr2=0x7f9224102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 --2- 172.21.15.134:0/1797612863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f9224102330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9218004940 tx=0x7f9218009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:13.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 -- 172.21.15.134:0/1797612863 shutdown_connections 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 --2- 172.21.15.134:0/1797612863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f9224102330 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 --2- 172.21.15.134:0/1797612863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f92240ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 -- 172.21.15.134:0/1797612863 >> 172.21.15.134:0/1797612863 conn(0x7f92240f7440 msgr2=0x7f92240f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 -- 172.21.15.134:0/1797612863 shutdown_connections 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.111+0000 7f92292db700 1 -- 172.21.15.134:0/1797612863 wait complete. 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92292db700 1 Processor -- start 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92292db700 1 -- start start 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92292db700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f922406e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92292db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f922406e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92292db700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9224070090 con 0x7f92240fff10 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92292db700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922406eed0 con 0x7f9224066b70 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f922406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92227fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f922406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f922406e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:55066/0 (socket says 172.21.15.134:55066) 2024-03-22T07:29:13.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f92227fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f922406e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58872/0 (socket says 172.21.15.134:58872) 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.112+0000 7f9222ffd700 1 -- 172.21.15.134:0/1070196118 learned_addr learned my addr 172.21.15.134:0/1070196118 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f9222ffd700 1 -- 172.21.15.134:0/1070196118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 msgr2=0x7f922406e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f9222ffd700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f922406e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f9222ffd700 1 -- 172.21.15.134:0/1070196118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218005040 con 0x7f9224066b70 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f92227fc700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f922406e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f9222ffd700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f922406e450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9214002a50 tx=0x7f9214004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9214007cc0 con 0x7f9224066b70 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f921400f040 con 0x7f9224066b70 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f921400d9c0 con 0x7f9224066b70 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922406f1b0 con 0x7f9224066b70 2024-03-22T07:29:13.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.113+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92240fbb00 con 0x7f9224066b70 2024-03-22T07:29:13.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.115+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f921400db40 con 0x7f9224066b70 2024-03-22T07:29:13.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.115+0000 7f920b7fe700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f920c06b0b0 0x7f920c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:13.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.115+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f92140897f0 con 0x7f9224066b70 2024-03-22T07:29:13.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.115+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922405f5f0 con 0x7f9224066b70 2024-03-22T07:29:13.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.117+0000 7f92227fc700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f920c06b0b0 0x7f920c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:13.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.118+0000 7f92227fc700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f920c06b0b0 0x7f920c06d560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f921800b970 tx=0x7f9218009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:13.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.126+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9214053a40 con 0x7f9224066b70 2024-03-22T07:29:13.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:13 smithi134 ceph-mon[29057]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:13.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:13 smithi134 ceph-mon[29057]: pgmap v22: 65 pgs: 65 active+clean; 452 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 247 op/s 2024-03-22T07:29:13.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:13 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1259487799' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:29:13.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:13 smithi195 ceph-mon[36144]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:13.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:13 smithi195 ceph-mon[36144]: pgmap v22: 65 pgs: 65 active+clean; 452 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 247 op/s 2024-03-22T07:29:13.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:13 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1259487799' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:29:13.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.567+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f92241058e0 con 0x7f9224066b70 2024-03-22T07:29:13.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.568+0000 7f920b7fe700 1 -- 172.21.15.134:0/1070196118 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9214057100 con 0x7f9224066b70 2024-03-22T07:29:13.568 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f920c06b0b0 msgr2=0x7f920c06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f920c06b0b0 0x7f920c06d560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f921800b970 tx=0x7f9218009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 msgr2=0x7f922406e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f922406e450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9214002a50 tx=0x7f9214004600 comp rx=0 tx=0).stop 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 shutdown_connections 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9224066b70 0x7f922406e450 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9214002a50 tx=0x7f9214004600 comp rx=0 tx=0).stop 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f920c06b0b0 0x7f920c06d560 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 --2- 172.21.15.134:0/1070196118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92240fff10 0x7f922406e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 >> 172.21.15.134:0/1070196118 conn(0x7f92240f7440 msgr2=0x7f92240f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.570+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 shutdown_connections 2024-03-22T07:29:13.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:13.571+0000 7f92292db700 1 -- 172.21.15.134:0/1070196118 wait complete. 2024-03-22T07:29:14.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:14 smithi195 ceph-mon[36144]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:14.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:14 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1070196118' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:29:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:14 smithi134 ceph-mon[29057]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:14 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1070196118' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:29:15.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:15 smithi195 ceph-mon[36144]: pgmap v23: 65 pgs: 65 active+clean; 452 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 197 op/s 2024-03-22T07:29:15.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:15 smithi134 ceph-mon[29057]: pgmap v23: 65 pgs: 65 active+clean; 452 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 197 op/s 2024-03-22T07:29:17.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:17 smithi195 ceph-mon[36144]: pgmap v24: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-03-22T07:29:17.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:17 smithi134 ceph-mon[29057]: pgmap v24: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 340 op/s 2024-03-22T07:29:19.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:19 smithi195 ceph-mon[36144]: pgmap v25: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 256 op/s 2024-03-22T07:29:19.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:19 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:19 smithi134 ceph-mon[29057]: pgmap v25: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 256 op/s 2024-03-22T07:29:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:19 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:21.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:21 smithi195 ceph-mon[36144]: pgmap v26: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 277 op/s 2024-03-22T07:29:21.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:21 smithi134 ceph-mon[29057]: pgmap v26: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 277 op/s 2024-03-22T07:29:23.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:23 smithi195 ceph-mon[36144]: pgmap v27: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 373 op/s 2024-03-22T07:29:23.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:23 smithi134 ceph-mon[29057]: pgmap v27: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 373 op/s 2024-03-22T07:29:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:25 smithi195 ceph-mon[36144]: pgmap v28: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 275 op/s 2024-03-22T07:29:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:25 smithi134 ceph-mon[29057]: pgmap v28: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 275 op/s 2024-03-22T07:29:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:27 smithi195 ceph-mon[36144]: pgmap v29: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.4 MiB/s wr, 290 op/s 2024-03-22T07:29:27.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:27 smithi134 ceph-mon[29057]: pgmap v29: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.4 MiB/s wr, 290 op/s 2024-03-22T07:29:29.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:29 smithi195 ceph-mon[36144]: pgmap v30: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 147 op/s 2024-03-22T07:29:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:29 smithi134 ceph-mon[29057]: pgmap v30: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 147 op/s 2024-03-22T07:29:31.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:31 smithi195 ceph-mon[36144]: pgmap v31: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 154 op/s 2024-03-22T07:29:31.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:31 smithi134 ceph-mon[29057]: pgmap v31: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 14 KiB/s rd, 1.8 MiB/s wr, 154 op/s 2024-03-22T07:29:33.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:33 smithi195 ceph-mon[36144]: pgmap v32: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 2.8 MiB/s wr, 191 op/s 2024-03-22T07:29:33.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:33 smithi134 ceph-mon[29057]: pgmap v32: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 2.8 MiB/s wr, 191 op/s 2024-03-22T07:29:34.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:34.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:35.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:35 smithi195 ceph-mon[36144]: pgmap v33: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.2 KiB/s rd, 2.2 MiB/s wr, 79 op/s 2024-03-22T07:29:35.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:35 smithi134 ceph-mon[29057]: pgmap v33: 65 pgs: 65 active+clean; 312 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 6.2 KiB/s rd, 2.2 MiB/s wr, 79 op/s 2024-03-22T07:29:37.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:37 smithi195 ceph-mon[36144]: pgmap v34: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-03-22T07:29:37.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:37 smithi134 ceph-mon[29057]: pgmap v34: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 2.9 MiB/s wr, 228 op/s 2024-03-22T07:29:39.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:39 smithi134 ceph-mon[29057]: pgmap v35: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 213 op/s 2024-03-22T07:29:39.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:39 smithi195 ceph-mon[36144]: pgmap v35: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 213 op/s 2024-03-22T07:29:41.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:41 smithi134 ceph-mon[29057]: pgmap v36: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 242 op/s 2024-03-22T07:29:41.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:41 smithi195 ceph-mon[36144]: pgmap v36: 65 pgs: 65 active+clean; 313 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 242 op/s 2024-03-22T07:29:42.688 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:42 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:42.689 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:42 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:42.689 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:42 smithi134 ceph-mon[29057]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-22T07:29:42.689 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:42 smithi134 ceph-mon[29057]: pgmap v37: 65 pgs: 65 active+clean; 316 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.5 MiB/s wr, 376 op/s 2024-03-22T07:29:42.689 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:42 smithi134 ceph-mon[29057]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-22T07:29:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:42 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:42 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:29:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:42 smithi195 ceph-mon[36144]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-22T07:29:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:42 smithi195 ceph-mon[36144]: pgmap v37: 65 pgs: 65 active+clean; 316 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.5 MiB/s wr, 376 op/s 2024-03-22T07:29:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:42 smithi195 ceph-mon[36144]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/707456067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 msgr2=0x7fa1f80fd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/707456067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f80fd6d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8004940 tx=0x7fa1e8009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/707456067 shutdown_connections 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/707456067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 0x7fa1f80fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/707456067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f80fd6d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/707456067 >> 172.21.15.134:0/707456067 conn(0x7fa1f80f6ba0 msgr2=0x7fa1f80f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:43.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/707456067 shutdown_connections 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/707456067 wait complete. 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.730+0000 7fa1fdcc9700 1 Processor -- start 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1fdcc9700 1 -- start start 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1fdcc9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f810fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1fdcc9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 0x7fa1f8110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1fdcc9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8110790 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1fdcc9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8110fe0 con 0x7fa1f80fdc10 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f810fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f810fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50756/0 (socket says 172.21.15.134:50756) 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f77fe700 1 -- 172.21.15.134:0/1382803630 learned_addr learned my addr 172.21.15.134:0/1382803630 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f6ffd700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 0x7fa1f8110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f77fe700 1 -- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 msgr2=0x7fa1f8110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f77fe700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 0x7fa1f8110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f77fe700 1 -- 172.21.15.134:0/1382803630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec005040 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.731+0000 7fa1f6ffd700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 0x7fa1f8110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:29:43.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.732+0000 7fa1f77fe700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f810fc50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8013870 tx=0x7fa1e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:43.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.732+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e8021070 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.732+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e8005040 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.732+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1e801c400 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.732+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1e800e070 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.732+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f8111610 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.733+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f81019c0 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.734+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7fa1e801ca20 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.734+0000 7fa1dffff700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa1e006b0b0 0x7fa1e006d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:43.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.735+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa1e808ad10 con 0x7fa1f80fd2c0 2024-03-22T07:29:43.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.735+0000 7fa1f6ffd700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa1e006b0b0 0x7fa1e006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:43.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.735+0000 7fa1f6ffd700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa1e006b0b0 0x7fa1e006d560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80655d0 tx=0x7fa1ec009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:43.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:43.740+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa1e8058c70 con 0x7fa1f80fd2c0 2024-03-22T07:29:44.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.002+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1f8104950 con 0x7fa1e006b0b0 2024-03-22T07:29:44.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.005+0000 7fa1dffff700 1 -- 172.21.15.134:0/1382803630 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa1f8104950 con 0x7fa1e006b0b0 2024-03-22T07:29:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa1e006b0b0 msgr2=0x7fa1e006d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa1e006b0b0 0x7fa1e006d560 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80655d0 tx=0x7fa1ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 msgr2=0x7fa1f810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f810fc50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8013870 tx=0x7fa1e8009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 shutdown_connections 2024-03-22T07:29:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fa1e006b0b0 0x7fa1e006d560 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80655d0 tx=0x7fa1ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1f80fd2c0 0x7fa1f810fc50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 --2- 172.21.15.134:0/1382803630 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1f80fdc10 0x7fa1f8110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.014+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 >> 172.21.15.134:0/1382803630 conn(0x7fa1f80f6ba0 msgr2=0x7fa1f80f7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:44.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.015+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 shutdown_connections 2024-03-22T07:29:44.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.018+0000 7fa1fdcc9700 1 -- 172.21.15.134:0/1382803630 wait complete. 2024-03-22T07:29:44.040 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:29:44.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.212+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/178364787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb406f9d0 msgr2=0x7fcdb406e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.212+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/178364787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb406f9d0 0x7fcdb406e460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00049c0 tx=0x7fcdb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.213+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/178364787 shutdown_connections 2024-03-22T07:29:44.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.213+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/178364787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb406ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.213+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/178364787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb406f9d0 0x7fcdb406e460 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00049c0 tx=0x7fcdb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.213+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/178364787 >> 172.21.15.134:0/178364787 conn(0x7fcdb4069de0 msgr2=0x7fcdb406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:44.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.214+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/178364787 shutdown_connections 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.220+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/178364787 wait complete. 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.220+0000 7fcdbb5e4700 1 Processor -- start 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.220+0000 7fcdbb5e4700 1 -- start start 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.221+0000 7fcdbb5e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb4113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.221+0000 7fcdbb5e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb4114530 0x7fcdb413b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.221+0000 7fcdbb5e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4114a10 con 0x7fcdb4114530 2024-03-22T07:29:44.221 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.221+0000 7fcdbb5e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb4114b80 con 0x7fcdb406e9a0 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb4113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb4113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:40292/0 (socket says 172.21.15.134:40292) 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 -- 172.21.15.134:0/3326313827 learned_addr learned my addr 172.21.15.134:0/3326313827 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb8b7f700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb4114530 0x7fcdb413b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 -- 172.21.15.134:0/3326313827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb4114530 msgr2=0x7fcdb413b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb4114530 0x7fcdb413b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 -- 172.21.15.134:0/3326313827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0005040 con 0x7fcdb406e9a0 2024-03-22T07:29:44.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.222+0000 7fcdb9380700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb4113ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0000c00 tx=0x7fcdb0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:44.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.227+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb00094c0 con 0x7fcdb406e9a0 2024-03-22T07:29:44.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.227+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb413ba80 con 0x7fcdb406e9a0 2024-03-22T07:29:44.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.227+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb413bfb0 con 0x7fcdb406e9a0 2024-03-22T07:29:44.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.227+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdb0004290 con 0x7fcdb406e9a0 2024-03-22T07:29:44.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.227+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb0024e00 con 0x7fcdb406e9a0 2024-03-22T07:29:44.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.230+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb404c710 con 0x7fcdb406e9a0 2024-03-22T07:29:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.236+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7fcdb0021030 con 0x7fcdb406e9a0 2024-03-22T07:29:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.236+0000 7fcda9ffb700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fcda006b290 0x7fcda006d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.236+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcdb008a9a0 con 0x7fcdb406e9a0 2024-03-22T07:29:44.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.237+0000 7fcdb8b7f700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fcda006b290 0x7fcda006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:44.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.242+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcdb0054d00 con 0x7fcdb406e9a0 2024-03-22T07:29:44.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.244+0000 7fcdb8b7f700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fcda006b290 0x7fcda006d740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcda4007fd0 tx=0x7fcda4009f60 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:44.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.655+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdb41081f0 con 0x7fcda006b290 2024-03-22T07:29:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.660+0000 7fcda9ffb700 1 -- 172.21.15.134:0/3326313827 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fcdb41081f0 con 0x7fcda006b290 2024-03-22T07:29:44.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.665+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fcda006b290 msgr2=0x7fcda006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.665+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fcda006b290 0x7fcda006d740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcda4007fd0 tx=0x7fcda4009f60 comp rx=0 tx=0).stop 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.665+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 msgr2=0x7fcdb4113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.665+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb4113ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0000c00 tx=0x7fcdb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.666+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 shutdown_connections 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.666+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdb406e9a0 0x7fcdb4113ff0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0000c00 tx=0x7fcdb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.666+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fcda006b290 0x7fcda006d740 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcda4007fd0 tx=0x7fcda4009f60 comp rx=0 tx=0).stop 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.666+0000 7fcdbb5e4700 1 --2- 172.21.15.134:0/3326313827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb4114530 0x7fcdb413b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.666+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 >> 172.21.15.134:0/3326313827 conn(0x7fcdb4069de0 msgr2=0x7fcdb406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:44.670 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.670+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 shutdown_connections 2024-03-22T07:29:44.671 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.671+0000 7fcdbb5e4700 1 -- 172.21.15.134:0/3326313827 wait complete. 2024-03-22T07:29:44.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.862+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/1583074097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b280fcf80 msgr2=0x7f6b280fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.862+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/1583074097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b280fcf80 0x7f6b280fd3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b18004880 tx=0x7f6b18009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.862+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/1583074097 shutdown_connections 2024-03-22T07:29:44.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.862+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/1583074097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b280fcf80 0x7f6b280fd3f0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b18004880 tx=0x7f6b18009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:44.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.862+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/1583074097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b280fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.862+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/1583074097 >> 172.21.15.134:0/1583074097 conn(0x7f6b280f7430 msgr2=0x7f6b280f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:44.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.866+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/1583074097 shutdown_connections 2024-03-22T07:29:44.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.867+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/1583074097 wait complete. 2024-03-22T07:29:44.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.868+0000 7f6b2d6fe700 1 Processor -- start 2024-03-22T07:29:44.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.868+0000 7f6b2d6fe700 1 -- start start 2024-03-22T07:29:44.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.868+0000 7f6b2d6fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b2810b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:44.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.868+0000 7f6b2d6fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b2810be70 0x7f6b2810cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:44.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.868+0000 7f6b2d6fe700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2810c330 con 0x7f6b280fbcd0 2024-03-22T07:29:44.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.868+0000 7f6b2d6fe700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2810c4a0 con 0x7f6b2810be70 2024-03-22T07:29:44.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.873+0000 7f6b267fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b2810be70 0x7f6b2810cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:44.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.875+0000 7f6b26ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b2810b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:44.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.875+0000 7f6b26ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b2810b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50788/0 (socket says 172.21.15.134:50788) 2024-03-22T07:29:44.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.875+0000 7f6b26ffd700 1 -- 172.21.15.134:0/895532453 learned_addr learned my addr 172.21.15.134:0/895532453 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:44.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.877+0000 7f6b26ffd700 1 -- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b2810be70 msgr2=0x7f6b2810cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:44.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.877+0000 7f6b26ffd700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b2810be70 0x7f6b2810cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:44.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.877+0000 7f6b26ffd700 1 -- 172.21.15.134:0/895532453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18005040 con 0x7f6b280fbcd0 2024-03-22T07:29:44.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.880+0000 7f6b26ffd700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b2810b930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0041d0 tx=0x7f6b1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:44.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.884+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b1c007cc0 con 0x7f6b280fbcd0 2024-03-22T07:29:44.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.884+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b1c00f040 con 0x7f6b280fbcd0 2024-03-22T07:29:44.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.884+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b1c00ca50 con 0x7f6b280fbcd0 2024-03-22T07:29:44.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.885+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2810d310 con 0x7f6b280fbcd0 2024-03-22T07:29:44.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.885+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2810d850 con 0x7f6b280fbcd0 2024-03-22T07:29:44.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.888+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b140052e0 con 0x7f6b280fbcd0 2024-03-22T07:29:44.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.889+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f6b1c009730 con 0x7f6b280fbcd0 2024-03-22T07:29:44.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.889+0000 7f6b0f7fe700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b1006b1c0 0x7f6b1006d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:44.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.889+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6b1c057a00 con 0x7f6b280fbcd0 2024-03-22T07:29:44.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.890+0000 7f6b267fc700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b1006b1c0 0x7f6b1006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:44.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.893+0000 7f6b267fc700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b1006b1c0 0x7f6b1006d670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009040 tx=0x7f6b18009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:44.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:44.897+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6b1c053d30 con 0x7f6b280fbcd0 2024-03-22T07:29:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:44 smithi134 ceph-mon[29057]: pgmap v38: 65 pgs: 65 active+clean; 316 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-03-22T07:29:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:44 smithi134 ceph-mon[29057]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:44 smithi195 ceph-mon[36144]: pgmap v38: 65 pgs: 65 active+clean; 316 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-03-22T07:29:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:44 smithi195 ceph-mon[36144]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:45.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.280+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b14000bf0 con 0x7f6b1006b1c0 2024-03-22T07:29:45.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.295+0000 7f6b0f7fe700 1 -- 172.21.15.134:0/895532453 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6b14000bf0 con 0x7f6b1006b1c0 2024-03-22T07:29:45.295 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:29:45.295 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 starting - - - - 2024-03-22T07:29:45.295 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (9m) 50s ago 9m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (8m) 58s ago 8m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 starting - - - - 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (3m) 50s ago 3m 216M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (3m) 50s ago 3m 11.7M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (3m) 58s ago 3m 13.4M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (3m) 58s ago 3m 12.3M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:9283 running (10m) 50s ago 10m 335M - 17.2.7-726-g9c4e0c34 837124da804f ec604b1de097 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (93s) 58s ago 8m 489M - 19.0.0-1667-gdb0330b1 4f325f8440e9 06db0bc1a216 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (10m) 50s ago 10m 50.8M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (8m) 58s ago 8m 37.7M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (8m) 58s ago 8m 16.9M - 1.5.0 0da6a335fe13 629d6f28b2cd 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 50s ago 7m 234M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 50s ago 6m 243M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:29:45.296 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (6m) 50s ago 6m 198M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:29:45.297 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (6m) 58s ago 5m 272M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:29:45.297 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (5m) 58s ago 5m 238M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:29:45.297 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (5m) 58s ago 5m 266M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:29:45.297 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 50s ago 8m 56.7M - 2.43.0 a07b618ecd1d 62c7a6c70a50 2024-03-22T07:29:45.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b1006b1c0 msgr2=0x7f6b1006d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b1006b1c0 0x7f6b1006d670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009040 tx=0x7f6b18009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:45.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 msgr2=0x7f6b2810b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b2810b930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0041d0 tx=0x7f6b1c00b040 comp rx=0 tx=0).stop 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 shutdown_connections 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f6b1006b1c0 0x7f6b1006d670 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b280fbcd0 0x7f6b2810b930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 --2- 172.21.15.134:0/895532453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b2810be70 0x7f6b2810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.299+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 >> 172.21.15.134:0/895532453 conn(0x7f6b280f7430 msgr2=0x7f6b280f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.300+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 shutdown_connections 2024-03-22T07:29:45.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.300+0000 7f6b2d6fe700 1 -- 172.21.15.134:0/895532453 wait complete. 2024-03-22T07:29:45.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 -- 172.21.15.134:0/216560608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006f9d0 msgr2=0x7fe7d006e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 --2- 172.21.15.134:0/216560608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006f9d0 0x7fe7d006e460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc004880 tx=0x7fe7cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:45.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 -- 172.21.15.134:0/216560608 shutdown_connections 2024-03-22T07:29:45.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 --2- 172.21.15.134:0/216560608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006e9a0 0x7fe7d006ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 --2- 172.21.15.134:0/216560608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006f9d0 0x7fe7d006e460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 -- 172.21.15.134:0/216560608 >> 172.21.15.134:0/216560608 conn(0x7fe7d0069de0 msgr2=0x7fe7d006c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:45.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 -- 172.21.15.134:0/216560608 shutdown_connections 2024-03-22T07:29:45.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.440+0000 7fe7d794c700 1 -- 172.21.15.134:0/216560608 wait complete. 2024-03-22T07:29:45.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.441+0000 7fe7d794c700 1 Processor -- start 2024-03-22T07:29:45.443 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.441+0000 7fe7d794c700 1 -- start start 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.441+0000 7fe7d794c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006e9a0 0x7fe7d0112d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.441+0000 7fe7d794c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 0x7fe7d01132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.441+0000 7fe7d794c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d010f800 con 0x7fe7d006f9d0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.441+0000 7fe7d794c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d010f970 con 0x7fe7d006e9a0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 0x7fe7d01132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 0x7fe7d01132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50806/0 (socket says 172.21.15.134:50806) 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 -- 172.21.15.134:0/3015319976 learned_addr learned my addr 172.21.15.134:0/3015319976 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d56e8700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006e9a0 0x7fe7d0112d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 -- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006e9a0 msgr2=0x7fe7d0112d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006e9a0 0x7fe7d0112d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 -- 172.21.15.134:0/3015319976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc005040 con 0x7fe7d006f9d0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.442+0000 7fe7d4ee7700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 0x7fe7d01132a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4002a50 tx=0x7fe7c4004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.443+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7c4007cc0 con 0x7fe7d006f9d0 2024-03-22T07:29:45.444 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.443+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7c400f040 con 0x7fe7d006f9d0 2024-03-22T07:29:45.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.443+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7c400db30 con 0x7fe7d006f9d0 2024-03-22T07:29:45.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.443+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d010fc00 con 0x7fe7d006f9d0 2024-03-22T07:29:45.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.444+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d01101c0 con 0x7fe7d006f9d0 2024-03-22T07:29:45.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.445+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d01097f0 con 0x7fe7d006f9d0 2024-03-22T07:29:45.445 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.446+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7fe7c400dc90 con 0x7fe7d006f9d0 2024-03-22T07:29:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.446+0000 7fe7c1ffb700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fe7bc06b240 0x7fe7bc06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.446+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe7c4089180 con 0x7fe7d006f9d0 2024-03-22T07:29:45.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.447+0000 7fe7d56e8700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fe7bc06b240 0x7fe7bc06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:45.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.447+0000 7fe7d56e8700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fe7bc06b240 0x7fe7bc06d6f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc013870 tx=0x7fe7cc009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:45.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.451+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe7c404e620 con 0x7fe7d006f9d0 2024-03-22T07:29:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.844+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7d004c710 con 0x7fe7d006f9d0 2024-03-22T07:29:45.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.845+0000 7fe7c1ffb700 1 -- 172.21.15.134:0/3015319976 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fe7c4056f00 con 0x7fe7d006f9d0 2024-03-22T07:29:45.845 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:29:45.845 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:29:45.845 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:29:45.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 13, 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:29:45.846 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fe7bc06b240 msgr2=0x7fe7bc06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fe7bc06b240 0x7fe7bc06d6f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc013870 tx=0x7fe7cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 msgr2=0x7fe7d01132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 0x7fe7d01132a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4002a50 tx=0x7fe7c4004630 comp rx=0 tx=0).stop 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 shutdown_connections 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006e9a0 0x7fe7d0112d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fe7bc06b240 0x7fe7bc06d6f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 --2- 172.21.15.134:0/3015319976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7d006f9d0 0x7fe7d01132a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 >> 172.21.15.134:0/3015319976 conn(0x7fe7d0069de0 msgr2=0x7fe7d006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 shutdown_connections 2024-03-22T07:29:45.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.848+0000 7fe7d794c700 1 -- 172.21.15.134:0/3015319976 wait complete. 2024-03-22T07:29:45.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 -- 172.21.15.134:0/27170596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fe070 msgr2=0x7f4e400fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 --2- 172.21.15.134:0/27170596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fe070 0x7f4e400fe4e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e34004880 tx=0x7f4e34009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:45.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 -- 172.21.15.134:0/27170596 shutdown_connections 2024-03-22T07:29:45.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 --2- 172.21.15.134:0/27170596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fe070 0x7f4e400fe4e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 --2- 172.21.15.134:0/27170596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fcf00 0x7f4e400fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 -- 172.21.15.134:0/27170596 >> 172.21.15.134:0/27170596 conn(0x7f4e400f85a0 msgr2=0x7f4e400fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:45.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 -- 172.21.15.134:0/27170596 shutdown_connections 2024-03-22T07:29:45.964 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.963+0000 7f4e450b7700 1 -- 172.21.15.134:0/27170596 wait complete. 2024-03-22T07:29:45.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e450b7700 1 Processor -- start 2024-03-22T07:29:45.965 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e450b7700 1 -- start start 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e450b7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 0x7f4e40071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e450b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 0x7f4e40070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e450b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400708c0 con 0x7f4e400fe070 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e450b7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40070a30 con 0x7f4e400fcf00 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e3e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 0x7f4e40070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e3ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 0x7f4e40071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e3e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 0x7f4e40070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50820/0 (socket says 172.21.15.134:50820) 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e3ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 0x7f4e40071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:40358/0 (socket says 172.21.15.134:40358) 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.964+0000 7f4e3e59c700 1 -- 172.21.15.134:0/2519339161 learned_addr learned my addr 172.21.15.134:0/2519339161 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e3ed9d700 1 -- 172.21.15.134:0/2519339161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 msgr2=0x7f4e40070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e3ed9d700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 0x7f4e40070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e3ed9d700 1 -- 172.21.15.134:0/2519339161 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34005040 con 0x7f4e400fcf00 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e3e59c700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 0x7f4e40070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:29:45.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e3ed9d700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 0x7f4e40071e40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009fd0 tx=0x7f4e3000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:45.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e30007cc0 con 0x7f4e400fcf00 2024-03-22T07:29:45.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e3000f040 con 0x7f4e400fcf00 2024-03-22T07:29:45.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3000ca50 con 0x7f4e400fcf00 2024-03-22T07:29:45.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e40070cb0 con 0x7f4e400fcf00 2024-03-22T07:29:45.967 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.965+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e40115a80 con 0x7f4e400fcf00 2024-03-22T07:29:45.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.966+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4005f5f0 con 0x7f4e400fcf00 2024-03-22T07:29:45.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.967+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f4e3000cbb0 con 0x7f4e400fcf00 2024-03-22T07:29:45.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.967+0000 7f4e277fe700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f4e2806b0b0 0x7f4e2806d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:45.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.967+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4e30089560 con 0x7f4e400fcf00 2024-03-22T07:29:45.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.967+0000 7f4e3e59c700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f4e2806b0b0 0x7f4e2806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:45.968 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.968+0000 7f4e3e59c700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f4e2806b0b0 0x7f4e2806d560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000c00 tx=0x7f4e34009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:45.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:45.972+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4e3004f620 con 0x7f4e400fcf00 2024-03-22T07:29:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:45 smithi134 ceph-mon[29057]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:46.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:45 smithi195 ceph-mon[36144]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:46.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.260+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e401058f0 con 0x7f4e400fcf00 2024-03-22T07:29:46.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.260+0000 7f4e277fe700 1 -- 172.21.15.134:0/2519339161 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f4e300537a0 con 0x7f4e400fcf00 2024-03-22T07:29:46.260 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:29:46.260 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:29:46.261 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:29:46.262 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:46.263 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.262+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f4e2806b0b0 msgr2=0x7f4e2806d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.262+0000 7f4e450b7700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f4e2806b0b0 0x7f4e2806d560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e34000c00 tx=0x7f4e34009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 msgr2=0x7f4e40071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 0x7f4e40071e40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009fd0 tx=0x7f4e3000b040 comp rx=0 tx=0).stop 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 shutdown_connections 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e400fcf00 0x7f4e40071e40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f4e2806b0b0 0x7f4e2806d560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 --2- 172.21.15.134:0/2519339161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e400fe070 0x7f4e40070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 >> 172.21.15.134:0/2519339161 conn(0x7f4e400f85a0 msgr2=0x7f4e400f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:46.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 shutdown_connections 2024-03-22T07:29:46.265 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.263+0000 7f4e450b7700 1 -- 172.21.15.134:0/2519339161 wait complete. 2024-03-22T07:29:46.265 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 -- 172.21.15.134:0/4151697878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fcc30 msgr2=0x7f91c80fd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 --2- 172.21.15.134:0/4151697878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fcc30 0x7f91c80fd040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f91c4004940 tx=0x7f91c4009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 -- 172.21.15.134:0/4151697878 shutdown_connections 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 --2- 172.21.15.134:0/4151697878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fdee0 0x7f91c80fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 --2- 172.21.15.134:0/4151697878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fcc30 0x7f91c80fd040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 -- 172.21.15.134:0/4151697878 >> 172.21.15.134:0/4151697878 conn(0x7f91c80f83d0 msgr2=0x7f91c80fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 -- 172.21.15.134:0/4151697878 shutdown_connections 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.384+0000 7f91ced2b700 1 -- 172.21.15.134:0/4151697878 wait complete. 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91ced2b700 1 Processor -- start 2024-03-22T07:29:46.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91ced2b700 1 -- start start 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91ced2b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 0x7f91c8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91ced2b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 0x7f91c8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91ced2b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8070950 con 0x7f91c80fdee0 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91ced2b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8070ac0 con 0x7f91c80fcc30 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cd528700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 0x7f91c8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cdd29700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 0x7f91c8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cdd29700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 0x7f91c8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:40370/0 (socket says 172.21.15.134:40370) 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cd528700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 0x7f91c8070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50850/0 (socket says 172.21.15.134:50850) 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cdd29700 1 -- 172.21.15.134:0/3640761939 learned_addr learned my addr 172.21.15.134:0/3640761939 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cd528700 1 -- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 msgr2=0x7f91c8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cd528700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 0x7f91c8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cd528700 1 -- 172.21.15.134:0/3640761939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4005040 con 0x7f91c80fdee0 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.385+0000 7f91cdd29700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 0x7f91c8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.386+0000 7f91cd528700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 0x7f91c8070310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91b800b580 tx=0x7f91b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.386+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b800f6f0 con 0x7f91c80fdee0 2024-03-22T07:29:46.387 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.386+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91b800fd20 con 0x7f91c80fdee0 2024-03-22T07:29:46.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.386+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c8070da0 con 0x7f91c80fdee0 2024-03-22T07:29:46.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.386+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b80103a0 con 0x7f91c80fdee0 2024-03-22T07:29:46.388 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.386+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c8115920 con 0x7f91c80fdee0 2024-03-22T07:29:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.387+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c805f5f0 con 0x7f91c80fdee0 2024-03-22T07:29:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.387+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f91b8011400 con 0x7f91c80fdee0 2024-03-22T07:29:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.388+0000 7f91be7fc700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f91b406b0b0 0x7f91b406d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.388+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f91b8089750 con 0x7f91c80fdee0 2024-03-22T07:29:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.388+0000 7f91cdd29700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f91b406b0b0 0x7f91b406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:46.389 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.388+0000 7f91cdd29700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f91b406b0b0 0x7f91b406d560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91c400b3b0 tx=0x7f91c4009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:46.392 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.392+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f91b8053ab0 con 0x7f91c80fdee0 2024-03-22T07:29:46.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.683+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91c8102200 con 0x7f91b406b0b0 2024-03-22T07:29:46.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.685+0000 7f91be7fc700 1 -- 172.21.15.134:0/3640761939 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f91c8102200 con 0x7f91b406b0b0 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "1/21 daemons upgraded", 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:29:46.686 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f91b406b0b0 msgr2=0x7f91b406d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f91b406b0b0 0x7f91b406d560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91c400b3b0 tx=0x7f91c4009e30 comp rx=0 tx=0).stop 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 msgr2=0x7f91c8070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 0x7f91c8070310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91b800b580 tx=0x7f91b80091a0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 shutdown_connections 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c80fcc30 0x7f91c8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f91b406b0b0 0x7f91b406d560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 --2- 172.21.15.134:0/3640761939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91c80fdee0 0x7f91c8070310 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.689+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 >> 172.21.15.134:0/3640761939 conn(0x7f91c80f83d0 msgr2=0x7f91c80f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:46.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.690+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 shutdown_connections 2024-03-22T07:29:46.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.690+0000 7f91ced2b700 1 -- 172.21.15.134:0/3640761939 wait complete. 2024-03-22T07:29:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 -- 172.21.15.134:0/1980278463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 msgr2=0x7f8de00fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.817 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 --2- 172.21.15.134:0/1980278463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de00fd310 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009ce0 tx=0x7f8dd8004d10 comp rx=0 tx=0).stop 2024-03-22T07:29:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 -- 172.21.15.134:0/1980278463 shutdown_connections 2024-03-22T07:29:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 --2- 172.21.15.134:0/1980278463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8de00fe0d0 0x7f8de00fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 --2- 172.21.15.134:0/1980278463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de00fd310 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 -- 172.21.15.134:0/1980278463 >> 172.21.15.134:0/1980278463 conn(0x7f8de00f8560 msgr2=0x7f8de00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 -- 172.21.15.134:0/1980278463 shutdown_connections 2024-03-22T07:29:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 -- 172.21.15.134:0/1980278463 wait complete. 2024-03-22T07:29:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 Processor -- start 2024-03-22T07:29:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.814+0000 7f8de7adc700 1 -- start start 2024-03-22T07:29:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de7adc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de010dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de7adc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8de00fe0d0 0x7f8de010e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de7adc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de010e790 con 0x7f8de00fcee0 2024-03-22T07:29:46.819 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de7adc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de010ef80 con 0x7f8de00fe0d0 2024-03-22T07:29:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de010dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de010dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50864/0 (socket says 172.21.15.134:50864) 2024-03-22T07:29:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 -- 172.21.15.134:0/3094577313 learned_addr learned my addr 172.21.15.134:0/3094577313 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:29:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5077700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8de00fe0d0 0x7f8de010e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 -- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8de00fe0d0 msgr2=0x7f8de010e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:46.820 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8de00fe0d0 0x7f8de010e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 -- 172.21.15.134:0/3094577313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8009940 con 0x7f8de00fcee0 2024-03-22T07:29:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8de5878700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de010dbc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80095d0 tx=0x7f8dd8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dd800e040 con 0x7f8de00fcee0 2024-03-22T07:29:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8dd80128e0 con 0x7f8de00fcee0 2024-03-22T07:29:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.815+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dd801ca10 con 0x7f8de00fcee0 2024-03-22T07:29:46.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.816+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de010f200 con 0x7f8de00fcee0 2024-03-22T07:29:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.816+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de010f7c0 con 0x7f8de00fcee0 2024-03-22T07:29:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.817+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de005f5f0 con 0x7f8de00fcee0 2024-03-22T07:29:46.822 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.817+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88855+0+0 (secure 0 0 0) 0x7f8dd8012a50 con 0x7f8de00fcee0 2024-03-22T07:29:46.823 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.818+0000 7f8dd67fc700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8dcc06b0b0 0x7f8dcc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:29:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.818+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8dd808b770 con 0x7f8de00fcee0 2024-03-22T07:29:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.818+0000 7f8de5077700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8dcc06b0b0 0x7f8dcc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:29:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.818+0000 7f8de5077700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8dcc06b0b0 0x7f8dcc06d560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0006fd0 tx=0x7f8dd0008040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:29:46.824 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:46.823+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8dd80594f0 con 0x7f8de00fcee0 2024-03-22T07:29:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:46 smithi134 ceph-mon[29057]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:46 smithi134 ceph-mon[29057]: pgmap v39: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.4 MiB/s wr, 1.00k op/s 2024-03-22T07:29:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:46 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3015319976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:29:47.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:46 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2519339161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:29:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:46 smithi195 ceph-mon[36144]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:46 smithi195 ceph-mon[36144]: pgmap v39: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.4 MiB/s wr, 1.00k op/s 2024-03-22T07:29:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:46 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3015319976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:29:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:46 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2519339161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:29:47.208 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:29:47.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.208+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8de004bed0 con 0x7f8de00fcee0 2024-03-22T07:29:47.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.208+0000 7f8dd67fc700 1 -- 172.21.15.134:0/3094577313 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8dd8004e10 con 0x7f8de00fcee0 2024-03-22T07:29:47.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.210+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8dcc06b0b0 msgr2=0x7f8dcc06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:47.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8dcc06b0b0 0x7f8dcc06d560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0006fd0 tx=0x7f8dd0008040 comp rx=0 tx=0).stop 2024-03-22T07:29:47.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 msgr2=0x7f8de010dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:29:47.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de010dbc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80095d0 tx=0x7f8dd8004d10 comp rx=0 tx=0).stop 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 shutdown_connections 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f8dcc06b0b0 0x7f8dcc06d560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8de00fcee0 0x7f8de010dbc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 --2- 172.21.15.134:0/3094577313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8de00fe0d0 0x7f8de010e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 >> 172.21.15.134:0/3094577313 conn(0x7f8de00f8560 msgr2=0x7f8de00f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 shutdown_connections 2024-03-22T07:29:47.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:29:47.211+0000 7f8de7adc700 1 -- 172.21.15.134:0/3094577313 wait complete. 2024-03-22T07:29:48.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:47 smithi134 ceph-mon[29057]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:48.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:47 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3094577313' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:29:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:47 smithi195 ceph-mon[36144]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:29:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:47 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3094577313' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:29:49.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:48 smithi134 ceph-mon[29057]: pgmap v40: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 854 op/s 2024-03-22T07:29:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:48 smithi195 ceph-mon[36144]: pgmap v40: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 854 op/s 2024-03-22T07:29:50.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:49 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:50.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:49 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:29:51.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:50 smithi134 ceph-mon[29057]: pgmap v41: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 854 op/s 2024-03-22T07:29:51.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:50 smithi195 ceph-mon[36144]: pgmap v41: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 854 op/s 2024-03-22T07:29:53.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:52 smithi134 ceph-mon[29057]: pgmap v42: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 1.28k op/s 2024-03-22T07:29:53.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:52 smithi195 ceph-mon[36144]: pgmap v42: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 1.28k op/s 2024-03-22T07:29:55.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:54 smithi134 ceph-mon[29057]: pgmap v43: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 1.14k op/s 2024-03-22T07:29:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:54 smithi195 ceph-mon[36144]: pgmap v43: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.6 MiB/s wr, 1.14k op/s 2024-03-22T07:29:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:56 smithi134 ceph-mon[29057]: pgmap v44: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.4 MiB/s wr, 1.31k op/s 2024-03-22T07:29:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:56 smithi195 ceph-mon[36144]: pgmap v44: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.4 MiB/s wr, 1.31k op/s 2024-03-22T07:29:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:29:58 smithi134 ceph-mon[29057]: pgmap v45: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 624 op/s 2024-03-22T07:29:59.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:29:58 smithi195 ceph-mon[36144]: pgmap v45: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 624 op/s 2024-03-22T07:30:00.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:00 smithi195 ceph-mon[36144]: pgmap v46: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 624 op/s 2024-03-22T07:30:00.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:00 smithi195 ceph-mon[36144]: overall HEALTH_OK 2024-03-22T07:30:00.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:00 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:00.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:00 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:00.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:00 smithi195 ceph-mon[36144]: Reconfiguring node-exporter.smithi195 (dependencies changed)... 2024-03-22T07:30:00.943 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:00 smithi195 ceph-mon[36144]: Reconfiguring daemon node-exporter.smithi195 on smithi195 2024-03-22T07:30:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:00 smithi134 ceph-mon[29057]: pgmap v46: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 624 op/s 2024-03-22T07:30:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:00 smithi134 ceph-mon[29057]: overall HEALTH_OK 2024-03-22T07:30:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:00 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:00 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:00 smithi134 ceph-mon[29057]: Reconfiguring node-exporter.smithi195 (dependencies changed)... 2024-03-22T07:30:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:00 smithi134 ceph-mon[29057]: Reconfiguring daemon node-exporter.smithi195 on smithi195 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: pgmap v47: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 844 op/s 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:02 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: pgmap v47: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 844 op/s 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:02 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:03 smithi134 ceph-mon[29057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:30:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:03 smithi134 ceph-mon[29057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:30:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:03 smithi134 ceph-mon[29057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:03 smithi134 ceph-mon[29057]: Upgrade: Need to upgrade myself (mgr.smithi195.jxfsnc) 2024-03-22T07:30:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:03 smithi134 ceph-mon[29057]: Upgrade: Need to upgrade myself (mgr.smithi195.jxfsnc) 2024-03-22T07:30:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:03 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:03 smithi195 ceph-mon[36144]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:30:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:03 smithi195 ceph-mon[36144]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:30:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:03 smithi195 ceph-mon[36144]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:03 smithi195 ceph-mon[36144]: Upgrade: Need to upgrade myself (mgr.smithi195.jxfsnc) 2024-03-22T07:30:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:03 smithi195 ceph-mon[36144]: Upgrade: Need to upgrade myself (mgr.smithi195.jxfsnc) 2024-03-22T07:30:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:03 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:04 smithi134 ceph-mon[29057]: pgmap v48: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 387 op/s 2024-03-22T07:30:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:04 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:04 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:30:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:04 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:30:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:04 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:30:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:04 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:04 smithi195 ceph-mon[36144]: pgmap v48: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 387 op/s 2024-03-22T07:30:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:04 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:04 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:30:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:04 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:30:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:04 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:30:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:04 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:05 smithi134 ceph-mon[29057]: Upgrade: Updating mgr.smithi134.wtwqre 2024-03-22T07:30:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:05 smithi134 ceph-mon[29057]: Deploying daemon mgr.smithi134.wtwqre on smithi134 2024-03-22T07:30:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:05 smithi195 ceph-mon[36144]: Upgrade: Updating mgr.smithi134.wtwqre 2024-03-22T07:30:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:05 smithi195 ceph-mon[36144]: Deploying daemon mgr.smithi134.wtwqre on smithi134 2024-03-22T07:30:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:06 smithi134 ceph-mon[29057]: pgmap v49: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 859 op/s 2024-03-22T07:30:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:06 smithi134 ceph-mon[29057]: mgrmap e26: smithi195.jxfsnc(active, since 92s), standbys: smithi134.wtwqre 2024-03-22T07:30:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:06 smithi195 ceph-mon[36144]: pgmap v49: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 859 op/s 2024-03-22T07:30:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:06 smithi195 ceph-mon[36144]: mgrmap e26: smithi195.jxfsnc(active, since 92s), standbys: smithi134.wtwqre 2024-03-22T07:30:08.887 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:08 smithi134 ceph-mon[29057]: pgmap v50: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 692 op/s 2024-03-22T07:30:09.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:08 smithi195 ceph-mon[36144]: pgmap v50: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 692 op/s 2024-03-22T07:30:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:10 smithi195 ceph-mon[36144]: pgmap v51: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 692 op/s 2024-03-22T07:30:10.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:10 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:10.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:10 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:10.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:10 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:10.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:10 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:10.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:10 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:10 smithi134 ceph-mon[29057]: pgmap v51: 65 pgs: 65 active+clean; 268 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 692 op/s 2024-03-22T07:30:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:10 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:10 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:10 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:10 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:11.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:10 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:13.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:12 smithi134 ceph-mon[29057]: pgmap v52: 65 pgs: 65 active+clean; 259 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 1.03k op/s 2024-03-22T07:30:13.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:12 smithi195 ceph-mon[36144]: pgmap v52: 65 pgs: 65 active+clean; 259 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.2 MiB/s wr, 1.03k op/s 2024-03-22T07:30:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:14 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:14 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:14.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:14 smithi134 ceph-mon[29057]: pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 810 op/s 2024-03-22T07:30:14.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:14 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:14.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:14 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:14.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:14 smithi195 ceph-mon[36144]: pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.5 MiB/s wr, 810 op/s 2024-03-22T07:30:17.049 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:16 smithi134 ceph-mon[29057]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 1.45k op/s 2024-03-22T07:30:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:16 smithi195 ceph-mon[36144]: pgmap v54: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 1.45k op/s 2024-03-22T07:30:17.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.355+0000 7f36b39d2700 1 -- 172.21.15.134:0/413052963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fbce0 msgr2=0x7f36ac0fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:17.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.355+0000 7f36b39d2700 1 --2- 172.21.15.134:0/413052963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fbce0 0x7f36ac0fc0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36a80049c0 tx=0x7f36a8009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:17.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.356+0000 7f36b39d2700 1 -- 172.21.15.134:0/413052963 shutdown_connections 2024-03-22T07:30:17.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.356+0000 7f36b39d2700 1 --2- 172.21.15.134:0/413052963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fcf90 0x7f36ac0fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.356+0000 7f36b39d2700 1 --2- 172.21.15.134:0/413052963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fbce0 0x7f36ac0fc0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.356+0000 7f36b39d2700 1 -- 172.21.15.134:0/413052963 >> 172.21.15.134:0/413052963 conn(0x7f36ac0f7440 msgr2=0x7f36ac0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:17.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.356+0000 7f36b39d2700 1 -- 172.21.15.134:0/413052963 shutdown_connections 2024-03-22T07:30:17.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.356+0000 7f36b39d2700 1 -- 172.21.15.134:0/413052963 wait complete. 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.357+0000 7f36b39d2700 1 Processor -- start 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.357+0000 7f36b39d2700 1 -- start start 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.357+0000 7f36b39d2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fbce0 0x7f36ac10b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b39d2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fcf90 0x7f36ac10bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b39d2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac10c410 con 0x7f36ac0fbce0 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b39d2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac10cc00 con 0x7f36ac0fcf90 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b176e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fbce0 0x7f36ac10b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:17.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b0f6d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fcf90 0x7f36ac10bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:17.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b0f6d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fcf90 0x7f36ac10bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:50706/0 (socket says 172.21.15.134:50706) 2024-03-22T07:30:17.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b0f6d700 1 -- 172.21.15.134:0/1937010686 learned_addr learned my addr 172.21.15.134:0/1937010686 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b176e700 1 -- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fcf90 msgr2=0x7f36ac10bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b176e700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fcf90 0x7f36ac10bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.358+0000 7f36b176e700 1 -- 172.21.15.134:0/1937010686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8005040 con 0x7f36ac0fbce0 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.359+0000 7f36b176e700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fbce0 0x7f36ac10b840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f36a8012a90 tx=0x7f36a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.359+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a8004290 con 0x7f36ac0fbce0 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.359+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36a800ded0 con 0x7f36ac0fbce0 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.359+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a801c6a0 con 0x7f36ac0fbce0 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.359+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac10ce80 con 0x7f36ac0fbce0 2024-03-22T07:30:17.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.359+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac10d320 con 0x7f36ac0fbce0 2024-03-22T07:30:17.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.361+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac05f5f0 con 0x7f36ac0fbce0 2024-03-22T07:30:17.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.361+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 26) v1 ==== 88753+0+0 (secure 0 0 0) 0x7f36a80094b0 con 0x7f36ac0fbce0 2024-03-22T07:30:17.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.362+0000 7f36a1ffb700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3698073790 0x7f3698075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:17.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.362+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f36a808b2a0 con 0x7f36ac0fbce0 2024-03-22T07:30:17.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.362+0000 7f36b0f6d700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3698073790 0x7f3698075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:17.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.363+0000 7f36b0f6d700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3698073790 0x7f3698075c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f369c009ca0 tx=0x7f369c009250 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:17.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.367+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f36a8059300 con 0x7f36ac0fbce0 2024-03-22T07:30:17.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.783+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36ac10d660 con 0x7f3698073790 2024-03-22T07:30:17.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.784+0000 7f36a1ffb700 1 -- 172.21.15.134:0/1937010686 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f36ac10d660 con 0x7f3698073790 2024-03-22T07:30:17.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.787+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3698073790 msgr2=0x7f3698075c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.787+0000 7f36b39d2700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3698073790 0x7f3698075c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f369c009ca0 tx=0x7f369c009250 comp rx=0 tx=0).stop 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.787+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fbce0 msgr2=0x7f36ac10b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.787+0000 7f36b39d2700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fbce0 0x7f36ac10b840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f36a8012a90 tx=0x7f36a800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.787+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 shutdown_connections 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.788+0000 7f36b39d2700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f3698073790 0x7f3698075c40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.788+0000 7f36b39d2700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36ac0fbce0 0x7f36ac10b840 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.788+0000 7f36b39d2700 1 --2- 172.21.15.134:0/1937010686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36ac0fcf90 0x7f36ac10bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.788+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 >> 172.21.15.134:0/1937010686 conn(0x7f36ac0f7440 msgr2=0x7f36ac0f8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.788+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 shutdown_connections 2024-03-22T07:30:17.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.788+0000 7f36b39d2700 1 -- 172.21.15.134:0/1937010686 wait complete. 2024-03-22T07:30:17.804 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:30:17.970 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.969+0000 7fb8398f7700 1 -- 172.21.15.134:0/617736930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc130 msgr2=0x7fb8340fc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:17.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.969+0000 7fb8398f7700 1 --2- 172.21.15.134:0/617736930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc130 0x7fb8340fc540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009ce0 tx=0x7fb82c004d10 comp rx=0 tx=0).stop 2024-03-22T07:30:17.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.969+0000 7fb8398f7700 1 -- 172.21.15.134:0/617736930 shutdown_connections 2024-03-22T07:30:17.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.969+0000 7fb8398f7700 1 --2- 172.21.15.134:0/617736930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8340fca80 0x7fb8340fae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.969+0000 7fb8398f7700 1 --2- 172.21.15.134:0/617736930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fc130 0x7fb8340fc540 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009ce0 tx=0x7fb82c004d10 comp rx=0 tx=0).stop 2024-03-22T07:30:17.971 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.969+0000 7fb8398f7700 1 -- 172.21.15.134:0/617736930 >> 172.21.15.134:0/617736930 conn(0x7fb8340f6ba0 msgr2=0x7fb8340f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:17.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.973+0000 7fb8398f7700 1 -- 172.21.15.134:0/617736930 shutdown_connections 2024-03-22T07:30:17.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.974+0000 7fb8398f7700 1 -- 172.21.15.134:0/617736930 wait complete. 2024-03-22T07:30:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.974+0000 7fb8398f7700 1 Processor -- start 2024-03-22T07:30:17.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb8398f7700 1 -- start start 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb8398f7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 0x7fb8341142d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb8398f7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb834114810 0x7fb834115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb8398f7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb834114d60 con 0x7fb834114810 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb8398f7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb834114ea0 con 0x7fb8340fca80 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb832ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 0x7fb8341142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb832ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 0x7fb8341142d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:50722/0 (socket says 172.21.15.134:50722) 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb832ffd700 1 -- 172.21.15.134:0/3153295134 learned_addr learned my addr 172.21.15.134:0/3153295134 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb8327fc700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb834114810 0x7fb834115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.975+0000 7fb832ffd700 1 -- 172.21.15.134:0/3153295134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb834114810 msgr2=0x7fb834115660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.976+0000 7fb832ffd700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb834114810 0x7fb834115660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:17.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.976+0000 7fb832ffd700 1 -- 172.21.15.134:0/3153295134 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c009940 con 0x7fb8340fca80 2024-03-22T07:30:17.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.976+0000 7fb832ffd700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 0x7fb8341142d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb82c004a30 tx=0x7fb82c004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:17.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.976+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c00e040 con 0x7fb8340fca80 2024-03-22T07:30:17.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.976+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb82c0128e0 con 0x7fb8340fca80 2024-03-22T07:30:17.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.977+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834115ce0 con 0x7fb8340fca80 2024-03-22T07:30:17.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.977+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8341162a0 con 0x7fb8340fca80 2024-03-22T07:30:17.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.977+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb82c01c640 con 0x7fb8340fca80 2024-03-22T07:30:17.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.979+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83405f5f0 con 0x7fb8340fca80 2024-03-22T07:30:17.979 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.979+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 88753+0+0 (secure 0 0 0) 0x7fb82c012a50 con 0x7fb8340fca80 2024-03-22T07:30:17.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.980+0000 7fb81b7fe700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb81c06adc0 0x7fb81c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:17.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.980+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb82c08b4e0 con 0x7fb8340fca80 2024-03-22T07:30:17.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.980+0000 7fb8327fc700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb81c06adc0 0x7fb81c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:17.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.981+0000 7fb8327fc700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb81c06adc0 0x7fb81c06d270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb824006fd0 tx=0x7fb824008040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:17.984 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:17.985+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb82c059400 con 0x7fb8340fca80 2024-03-22T07:30:18.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.269+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb834100430 con 0x7fb81c06adc0 2024-03-22T07:30:18.270 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:18 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:18.270 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:18 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:18.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.270+0000 7fb81b7fe700 1 -- 172.21.15.134:0/3153295134 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb834100430 con 0x7fb81c06adc0 2024-03-22T07:30:18.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb81c06adc0 msgr2=0x7fb81c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:18.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb81c06adc0 0x7fb81c06d270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb824006fd0 tx=0x7fb824008040 comp rx=0 tx=0).stop 2024-03-22T07:30:18.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 msgr2=0x7fb8341142d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:18.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 0x7fb8341142d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb82c004a30 tx=0x7fb82c004d10 comp rx=0 tx=0).stop 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 shutdown_connections 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8340fca80 0x7fb8341142d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fb81c06adc0 0x7fb81c06d270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 --2- 172.21.15.134:0/3153295134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb834114810 0x7fb834115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 >> 172.21.15.134:0/3153295134 conn(0x7fb8340f6ba0 msgr2=0x7fb8340f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 shutdown_connections 2024-03-22T07:30:18.274 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.273+0000 7fb8398f7700 1 -- 172.21.15.134:0/3153295134 wait complete. 2024-03-22T07:30:18.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.406+0000 7f472c8e3700 1 -- 172.21.15.134:0/3418389387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fcf90 msgr2=0x7f47280fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:18.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.406+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3418389387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fcf90 0x7f47280fd400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f471c004940 tx=0x7f471c009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:18.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.407+0000 7f472c8e3700 1 -- 172.21.15.134:0/3418389387 shutdown_connections 2024-03-22T07:30:18.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.407+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3418389387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fcf90 0x7f47280fd400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.407+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3418389387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fbce0 0x7f47280fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.407+0000 7f472c8e3700 1 -- 172.21.15.134:0/3418389387 >> 172.21.15.134:0/3418389387 conn(0x7f47280f7460 msgr2=0x7f47280f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:18.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.408+0000 7f472c8e3700 1 -- 172.21.15.134:0/3418389387 shutdown_connections 2024-03-22T07:30:18.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.408+0000 7f472c8e3700 1 -- 172.21.15.134:0/3418389387 wait complete. 2024-03-22T07:30:18.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.409+0000 7f472c8e3700 1 Processor -- start 2024-03-22T07:30:18.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.409+0000 7f472c8e3700 1 -- start start 2024-03-22T07:30:18.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.409+0000 7f472c8e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fbce0 0x7f472810c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:18.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f472c8e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 0x7f472810cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:18.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f472c8e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472810d300 con 0x7f47280fbce0 2024-03-22T07:30:18.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f472c8e3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472810d470 con 0x7f47280fcf90 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f472659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fbce0 0x7f472810c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f4725d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 0x7f472810cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f4725d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 0x7f472810cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:50740/0 (socket says 172.21.15.134:50740) 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f4725d9b700 1 -- 172.21.15.134:0/3904420112 learned_addr learned my addr 172.21.15.134:0/3904420112 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f4725d9b700 1 -- 172.21.15.134:0/3904420112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fbce0 msgr2=0x7f472810c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f4725d9b700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fbce0 0x7f472810c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.410+0000 7f4725d9b700 1 -- 172.21.15.134:0/3904420112 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c005040 con 0x7f47280fcf90 2024-03-22T07:30:18.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.411+0000 7f4725d9b700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 0x7f472810cd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f471c00b0d0 tx=0x7f471c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:18.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.411+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f471c00e070 con 0x7f47280fcf90 2024-03-22T07:30:18.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.411+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f471c013d00 con 0x7f47280fcf90 2024-03-22T07:30:18.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.411+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f471c022620 con 0x7f47280fcf90 2024-03-22T07:30:18.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.411+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4728066270 con 0x7f47280fcf90 2024-03-22T07:30:18.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.411+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4728066830 con 0x7f47280fcf90 2024-03-22T07:30:18.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.413+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472804c710 con 0x7f47280fcf90 2024-03-22T07:30:18.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.414+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 88753+0+0 (secure 0 0 0) 0x7f471c01a9a0 con 0x7f47280fcf90 2024-03-22T07:30:18.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.414+0000 7f4716ffd700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f471006af90 0x7f471006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:18.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.414+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f471c08cf10 con 0x7f47280fcf90 2024-03-22T07:30:18.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.414+0000 7f472659c700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f471006af90 0x7f471006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:18.415 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.415+0000 7f472659c700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f471006af90 0x7f471006d440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4718009b80 tx=0x7f471800b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:18.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.419+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f471c05aeb0 con 0x7f47280fcf90 2024-03-22T07:30:18.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:18 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:18.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:18 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:18.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:18 smithi195 ceph-mon[36144]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 976 op/s 2024-03-22T07:30:18.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:18 smithi195 ceph-mon[36144]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:18 smithi134 ceph-mon[29057]: pgmap v55: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 976 op/s 2024-03-22T07:30:18.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:18 smithi134 ceph-mon[29057]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:18.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.810+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4728066dd0 con 0x7f471006af90 2024-03-22T07:30:18.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.831+0000 7f4716ffd700 1 -- 172.21.15.134:0/3904420112 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4728066dd0 con 0x7f471006af90 2024-03-22T07:30:18.833 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (73s) 1s ago 9m 16.6M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (9m) 1s ago 9m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (8m) 5s ago 8m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (37s) 1s ago 9m 78.5M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (4m) 1s ago 4m 211M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (4m) 1s ago 4m 12.2M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (4m) 5s ago 4m 13.7M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (4m) 5s ago 4m 12.8M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (9s) 1s ago 10m 88.9M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (2m) 5s ago 8m 502M - 19.0.0-1667-gdb0330b1 4f325f8440e9 06db0bc1a216 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (11m) 1s ago 11m 52.4M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (8m) 5s ago 8m 40.8M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (79s) 1s ago 9m 8648k - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:30:18.834 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (16s) 5s ago 8m 7289k - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 1s ago 7m 241M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (7m) 1s ago 7m 249M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (6m) 1s ago 6m 203M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (6m) 5s ago 6m 282M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (6m) 5s ago 6m 249M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (5m) 5s ago 5m 221M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:30:18.835 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (19s) 1s ago 9m 42.3M - 2.43.0 a07b618ecd1d d5dc703cf6ef 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f471006af90 msgr2=0x7f471006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f471006af90 0x7f471006d440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4718009b80 tx=0x7f471800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 msgr2=0x7f472810cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 0x7f472810cd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f471c00b0d0 tx=0x7f471c009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 shutdown_connections 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f471006af90 0x7f471006d440 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4718009b80 tx=0x7f471800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:18.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47280fbce0 0x7f472810c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:18.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 --2- 172.21.15.134:0/3904420112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47280fcf90 0x7f472810cd00 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f471c00b0d0 tx=0x7f471c009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:18.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.835+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 >> 172.21.15.134:0/3904420112 conn(0x7f47280f7460 msgr2=0x7f47280f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:18.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.839+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 shutdown_connections 2024-03-22T07:30:18.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:18.840+0000 7f472c8e3700 1 -- 172.21.15.134:0/3904420112 wait complete. 2024-03-22T07:30:19.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.006+0000 7fbbdd208700 1 -- 172.21.15.134:0/577576185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 msgr2=0x7fbbd80fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:19.007 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.006+0000 7fbbdd208700 1 --2- 172.21.15.134:0/577576185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd80fd3e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0049c0 tx=0x7fbbcc009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.006+0000 7fbbdd208700 1 -- 172.21.15.134:0/577576185 shutdown_connections 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.006+0000 7fbbdd208700 1 --2- 172.21.15.134:0/577576185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd80fd3e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.006+0000 7fbbdd208700 1 --2- 172.21.15.134:0/577576185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd80fbe00 0x7fbbd80fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.006+0000 7fbbdd208700 1 -- 172.21.15.134:0/577576185 >> 172.21.15.134:0/577576185 conn(0x7fbbd80f74e0 msgr2=0x7fbbd80f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.007+0000 7fbbdd208700 1 -- 172.21.15.134:0/577576185 shutdown_connections 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.007+0000 7fbbdd208700 1 -- 172.21.15.134:0/577576185 wait complete. 2024-03-22T07:30:19.008 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.008+0000 7fbbdd208700 1 Processor -- start 2024-03-22T07:30:19.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.008+0000 7fbbdd208700 1 -- start start 2024-03-22T07:30:19.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.008+0000 7fbbdd208700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd80fbe00 0x7fbbd806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:19.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.008+0000 7fbbdd208700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd806e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:19.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.008+0000 7fbbdd208700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8119c00 con 0x7fbbd80fcf70 2024-03-22T07:30:19.009 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.008+0000 7fbbdd208700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8119d40 con 0x7fbbd80fbe00 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd80fbe00 0x7fbbd806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd806e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd806e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56380/0 (socket says 172.21.15.134:56380) 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 -- 172.21.15.134:0/321773794 learned_addr learned my addr 172.21.15.134:0/321773794 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 -- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd80fbe00 msgr2=0x7fbbd806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd80fbe00 0x7fbbd806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 -- 172.21.15.134:0/321773794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8005040 con 0x7fbbd80fcf70 2024-03-22T07:30:19.010 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.009+0000 7fbbd659c700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd806e730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009730 tx=0x7fbbcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:19.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.010+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbcc011480 con 0x7fbbd80fcf70 2024-03-22T07:30:19.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.010+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc005040 con 0x7fbbd80fcf70 2024-03-22T07:30:19.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.010+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbcc011ab0 con 0x7fbbd80fcf70 2024-03-22T07:30:19.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.010+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd806ec70 con 0x7fbbd80fcf70 2024-03-22T07:30:19.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.010+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbcc01a870 con 0x7fbbd80fcf70 2024-03-22T07:30:19.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.011+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd805f5f0 con 0x7fbbd80fcf70 2024-03-22T07:30:19.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.012+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 26) v1 ==== 88753+0+0 (secure 0 0 0) 0x7fbbcc011c20 con 0x7fbbd80fcf70 2024-03-22T07:30:19.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.012+0000 7fbbbf7fe700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fbbc006afa0 0x7fbbc006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:19.012 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.012+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbbcc08b200 con 0x7fbbd80fcf70 2024-03-22T07:30:19.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.013+0000 7fbbd6d9d700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fbbc006afa0 0x7fbbc006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:19.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.013+0000 7fbbd6d9d700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fbbc006afa0 0x7fbbc006d450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbd806fa60 tx=0x7fbbc800b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:19.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.022+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fbbcc055720 con 0x7fbbd80fcf70 2024-03-22T07:30:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:19 smithi134 ceph-mon[29057]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:19 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:19 smithi134 ceph-mon[29057]: from='client.24513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:19 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:19.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:19 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:19.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.588+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbbd804bed0 con 0x7fbbd80fcf70 2024-03-22T07:30:19.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.589+0000 7fbbbf7fe700 1 -- 172.21.15.134:0/321773794 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fbbcc004490 con 0x7fbbd80fcf70 2024-03-22T07:30:19.589 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:30:19.589 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:30:19.589 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:30:19.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 13, 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:30:19.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:30:19.591 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:30:19.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fbbc006afa0 msgr2=0x7fbbc006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fbbc006afa0 0x7fbbc006d450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbbd806fa60 tx=0x7fbbc800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 msgr2=0x7fbbd806e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd806e730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009730 tx=0x7fbbcc009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 shutdown_connections 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd80fbe00 0x7fbbd806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7fbbc006afa0 0x7fbbc006d450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 --2- 172.21.15.134:0/321773794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbd80fcf70 0x7fbbd806e730 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.592+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 >> 172.21.15.134:0/321773794 conn(0x7fbbd80f74e0 msgr2=0x7fbbd80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.593+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 shutdown_connections 2024-03-22T07:30:19.593 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.593+0000 7fbbdd208700 1 -- 172.21.15.134:0/321773794 wait complete. 2024-03-22T07:30:19.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:19 smithi195 ceph-mon[36144]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:19.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:19 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:19.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:19 smithi195 ceph-mon[36144]: from='client.24513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:19.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:19 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:19.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:19 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:19.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 -- 172.21.15.134:0/3655000346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806e9a0 msgr2=0x7f12d806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 --2- 172.21.15.134:0/3655000346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806e9a0 0x7f12d806ee10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f12cc004940 tx=0x7f12cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 -- 172.21.15.134:0/3655000346 shutdown_connections 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 --2- 172.21.15.134:0/3655000346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806e9a0 0x7f12d806ee10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 --2- 172.21.15.134:0/3655000346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806f9d0 0x7f12d806e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 -- 172.21.15.134:0/3655000346 >> 172.21.15.134:0/3655000346 conn(0x7f12d8069de0 msgr2=0x7f12d806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.734+0000 7f12dd345700 1 -- 172.21.15.134:0/3655000346 shutdown_connections 2024-03-22T07:30:19.735 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.735+0000 7f12dd345700 1 -- 172.21.15.134:0/3655000346 wait complete. 2024-03-22T07:30:19.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.735+0000 7f12dd345700 1 Processor -- start 2024-03-22T07:30:19.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.735+0000 7f12dd345700 1 -- start start 2024-03-22T07:30:19.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12dd345700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806e9a0 0x7f12d811c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:19.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12dd345700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806f9d0 0x7f12d811cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12dd345700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d811d1d0 con 0x7f12d806f9d0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12dd345700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d811d340 con 0x7f12d806e9a0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806f9d0 0x7f12d811cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806f9d0 0x7f12d811cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56402/0 (socket says 172.21.15.134:56402) 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d67fc700 1 -- 172.21.15.134:0/1087130752 learned_addr learned my addr 172.21.15.134:0/1087130752 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d6ffd700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806e9a0 0x7f12d811c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d6ffd700 1 -- 172.21.15.134:0/1087130752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806f9d0 msgr2=0x7f12d811cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d6ffd700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806f9d0 0x7f12d811cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d6ffd700 1 -- 172.21.15.134:0/1087130752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc005040 con 0x7f12d806e9a0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.736+0000 7f12d6ffd700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806e9a0 0x7f12d811c690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ec20 tx=0x7f12c800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.737+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c8004020 con 0x7f12d806e9a0 2024-03-22T07:30:19.738 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.737+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12c800f040 con 0x7f12d806e9a0 2024-03-22T07:30:19.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.737+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c800c8c0 con 0x7f12d806e9a0 2024-03-22T07:30:19.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.737+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d8121da0 con 0x7f12d806e9a0 2024-03-22T07:30:19.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.737+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d8122250 con 0x7f12d806e9a0 2024-03-22T07:30:19.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.738+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d804c710 con 0x7f12d806e9a0 2024-03-22T07:30:19.739 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.739+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 26) v1 ==== 88753+0+0 (secure 0 0 0) 0x7f12c8004180 con 0x7f12d806e9a0 2024-03-22T07:30:19.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.739+0000 7f12bf7fe700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f12c006af90 0x7f12c006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:19.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.740+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f12c80894e0 con 0x7f12d806e9a0 2024-03-22T07:30:19.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.740+0000 7f12d67fc700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f12c006af90 0x7f12c006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:19.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.740+0000 7f12d67fc700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f12c006af90 0x7f12c006d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009b30 tx=0x7f12cc009e30 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:19.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:19.744+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f12c804f620 con 0x7f12d806e9a0 2024-03-22T07:30:20.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.112+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f12d81227b0 con 0x7f12d806e9a0 2024-03-22T07:30:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.113+0000 7f12bf7fe700 1 -- 172.21.15.134:0/1087130752 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f12c8057400 con 0x7f12d806e9a0 2024-03-22T07:30:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:30:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:30:20.113 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:30:20.114 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:30:20.115 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:20.116 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.115+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f12c006af90 msgr2=0x7f12c006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.115+0000 7f12dd345700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f12c006af90 0x7f12c006d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009b30 tx=0x7f12cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.115+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806e9a0 msgr2=0x7f12d811c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.115+0000 7f12dd345700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806e9a0 0x7f12d811c690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ec20 tx=0x7f12c800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 shutdown_connections 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12d806e9a0 0x7f12d811c690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f12c006af90 0x7f12c006d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 --2- 172.21.15.134:0/1087130752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12d806f9d0 0x7f12d811cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 >> 172.21.15.134:0/1087130752 conn(0x7f12d8069de0 msgr2=0x7f12d806b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:20.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 shutdown_connections 2024-03-22T07:30:20.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.116+0000 7f12dd345700 1 -- 172.21.15.134:0/1087130752 wait complete. 2024-03-22T07:30:20.118 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:30:20.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 -- 172.21.15.134:0/2160426178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fb1e0 msgr2=0x7efe580fb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/2160426178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fb1e0 0x7efe580fb610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe4c004880 tx=0x7efe4c009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 -- 172.21.15.134:0/2160426178 shutdown_connections 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/2160426178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fbb50 0x7efe58102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/2160426178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fb1e0 0x7efe580fb610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 -- 172.21.15.134:0/2160426178 >> 172.21.15.134:0/2160426178 conn(0x7efe580f6ba0 msgr2=0x7efe580f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 -- 172.21.15.134:0/2160426178 shutdown_connections 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 -- 172.21.15.134:0/2160426178 wait complete. 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 Processor -- start 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.278+0000 7efe5f0cb700 1 -- start start 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5f0cb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 0x7efe5810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:20.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5f0cb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fbb50 0x7efe5810df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5f0cb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5810e580 con 0x7efe580fb1e0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5f0cb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5810edd0 con 0x7efe580fbb50 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 0x7efe5810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 0x7efe5810da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56406/0 (socket says 172.21.15.134:56406) 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 -- 172.21.15.134:0/4283404526 learned_addr learned my addr 172.21.15.134:0/4283404526 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe57fff700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fbb50 0x7efe5810df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 -- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fbb50 msgr2=0x7efe5810df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fbb50 0x7efe5810df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 -- 172.21.15.134:0/4283404526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c005040 con 0x7efe580fb1e0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.279+0000 7efe5ce67700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 0x7efe5810da40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0138f0 tx=0x7efe4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.280+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c00e030 con 0x7efe580fb1e0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.280+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5810f050 con 0x7efe580fb1e0 2024-03-22T07:30:20.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.280+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5810f590 con 0x7efe580fb1e0 2024-03-22T07:30:20.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.280+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe4c013e60 con 0x7efe580fb1e0 2024-03-22T07:30:20.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.280+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4c0123c0 con 0x7efe580fb1e0 2024-03-22T07:30:20.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.281+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5805f5f0 con 0x7efe580fb1e0 2024-03-22T07:30:20.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.282+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 26) v1 ==== 88753+0+0 (secure 0 0 0) 0x7efe4c01c400 con 0x7efe580fb1e0 2024-03-22T07:30:20.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.282+0000 7efe557fa700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7efe4806afa0 0x7efe4806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:20.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.282+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efe4c08b670 con 0x7efe580fb1e0 2024-03-22T07:30:20.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.283+0000 7efe57fff700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7efe4806afa0 0x7efe4806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:20.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.283+0000 7efe57fff700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7efe4806afa0 0x7efe4806d450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe440046c0 tx=0x7efe4400b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:20.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.286+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efe4c059770 con 0x7efe580fb1e0 2024-03-22T07:30:20.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.302+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 27) v1 ==== 90883+0+0 (secure 0 0 0) 0x7efe4c01c720 con 0x7efe580fb1e0 2024-03-22T07:30:20.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/321773794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:30:20.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: pgmap v56: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 976 op/s 2024-03-22T07:30:20.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: Standby manager daemon smithi134.wtwqre restarted 2024-03-22T07:30:20.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: Standby manager daemon smithi134.wtwqre started 2024-03-22T07:30:20.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/crt"}]: dispatch 2024-03-22T07:30:20.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:30:20.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/key"}]: dispatch 2024-03-22T07:30:20.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:30:20.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:20 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1087130752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:30:20.606 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/321773794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:30:20.606 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: pgmap v56: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 976 op/s 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: Standby manager daemon smithi134.wtwqre restarted 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: Standby manager daemon smithi134.wtwqre started 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/crt"}]: dispatch 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.wtwqre/key"}]: dispatch 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:30:20.607 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:20 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1087130752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:30:20.613 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.613+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 --> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe5810f980 con 0x7efe4806afa0 2024-03-22T07:30:20.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.614+0000 7efe557fa700 1 -- 172.21.15.134:0/4283404526 <== mgr.24409 v2:172.21.15.195:6828/3830729441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7efe5810f980 con 0x7efe4806afa0 2024-03-22T07:30:20.614 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:30:20.614 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:30:20.614 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/21 daemons upgraded", 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:30:20.615 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7efe4806afa0 msgr2=0x7efe4806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7efe4806afa0 0x7efe4806d450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe440046c0 tx=0x7efe4400b040 comp rx=0 tx=0).stop 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 msgr2=0x7efe5810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 0x7efe5810da40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0138f0 tx=0x7efe4c009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 shutdown_connections 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7efe4806afa0 0x7efe4806d450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe580fb1e0 0x7efe5810da40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 --2- 172.21.15.134:0/4283404526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe580fbb50 0x7efe5810df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.617 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 >> 172.21.15.134:0/4283404526 conn(0x7efe580f6ba0 msgr2=0x7efe581004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:20.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 shutdown_connections 2024-03-22T07:30:20.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.617+0000 7efe5f0cb700 1 -- 172.21.15.134:0/4283404526 wait complete. 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.747+0000 7f9e101f5700 1 -- 172.21.15.134:0/1169817574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fbe30 msgr2=0x7f9e080fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.747+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1169817574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fbe30 0x7f9e080fc240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9e04004940 tx=0x7f9e04009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.748+0000 7f9e101f5700 1 -- 172.21.15.134:0/1169817574 shutdown_connections 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.748+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1169817574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fcfa0 0x7f9e080fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.748+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1169817574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fbe30 0x7f9e080fc240 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.748+0000 7f9e101f5700 1 -- 172.21.15.134:0/1169817574 >> 172.21.15.134:0/1169817574 conn(0x7f9e080f7480 msgr2=0x7f9e080f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:20.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.748+0000 7f9e101f5700 1 -- 172.21.15.134:0/1169817574 shutdown_connections 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.748+0000 7f9e101f5700 1 -- 172.21.15.134:0/1169817574 wait complete. 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e101f5700 1 Processor -- start 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e101f5700 1 -- start start 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e101f5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fbe30 0x7f9e0810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e101f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 0x7f9e0810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e101f5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0810e4d0 con 0x7f9e080fcfa0 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e101f5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0810ed20 con 0x7f9e080fbe30 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0d790700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 0x7f9e0810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0d790700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 0x7f9e0810ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56420/0 (socket says 172.21.15.134:56420) 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0df91700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fbe30 0x7f9e0810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0d790700 1 -- 172.21.15.134:0/1240391490 learned_addr learned my addr 172.21.15.134:0/1240391490 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0df91700 1 -- 172.21.15.134:0/1240391490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 msgr2=0x7f9e0810ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:20.751 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0df91700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 0x7f9e0810ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0df91700 1 -- 172.21.15.134:0/1240391490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04005040 con 0x7f9e080fbe30 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.749+0000 7f9e0d790700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 0x7f9e0810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.750+0000 7f9e0df91700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fbe30 0x7f9e0810d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e04000c00 tx=0x7f9e04009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.750+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0400e040 con 0x7f9e080fbe30 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.750+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0810efa0 con 0x7f9e080fbe30 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.750+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e0400bbf0 con 0x7f9e080fbe30 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.750+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0401c650 con 0x7f9e080fbe30 2024-03-22T07:30:20.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.750+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0810f4e0 con 0x7f9e080fbe30 2024-03-22T07:30:20.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.751+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08101b30 con 0x7f9e080fbe30 2024-03-22T07:30:20.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.751+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 27) v1 ==== 90883+0+0 (secure 0 0 0) 0x7f9e04013420 con 0x7f9e080fbe30 2024-03-22T07:30:20.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.752+0000 7f9dfe7fc700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9df406cc80 0x7f9df406f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:20.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.752+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9e0408d100 con 0x7f9e080fbe30 2024-03-22T07:30:20.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.752+0000 7f9e0d790700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9df406cc80 0x7f9df406f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:20.754 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.753+0000 7f9e0d790700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9df406cc80 0x7f9df406f130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e5e0 tx=0x7f9df800b040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:20.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:20.756+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9e0405b0a0 con 0x7f9e080fbe30 2024-03-22T07:30:21.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.102+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9e081049b0 con 0x7f9e080fbe30 2024-03-22T07:30:21.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.103+0000 7f9dfe7fc700 1 -- 172.21.15.134:0/1240391490 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9e0405ac30 con 0x7f9e080fbe30 2024-03-22T07:30:21.103 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:30:21.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.107+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9df406cc80 msgr2=0x7f9df406f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:21.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.107+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9df406cc80 0x7f9df406f130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e5e0 tx=0x7f9df800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:21.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.107+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fbe30 msgr2=0x7f9e0810d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:21.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.107+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fbe30 0x7f9e0810d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e04000c00 tx=0x7f9e04009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:21.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.108+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 shutdown_connections 2024-03-22T07:30:21.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.108+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e080fbe30 0x7f9e0810d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:21.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.108+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.195:6828/3830729441,v1:172.21.15.195:6829/3830729441] conn(0x7f9df406cc80 0x7f9df406f130 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e5e0 tx=0x7f9df800b040 comp rx=0 tx=0).stop 2024-03-22T07:30:21.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.108+0000 7f9e101f5700 1 --2- 172.21.15.134:0/1240391490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e080fcfa0 0x7f9e0810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:21.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.108+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 >> 172.21.15.134:0/1240391490 conn(0x7f9e080f7480 msgr2=0x7f9e080f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:21.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.110+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 shutdown_connections 2024-03-22T07:30:21.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:21.112+0000 7f9e101f5700 1 -- 172.21.15.134:0/1240391490 wait complete. 2024-03-22T07:30:21.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:21 smithi134 ceph-mon[29057]: mgrmap e27: smithi195.jxfsnc(active, since 106s), standbys: smithi134.wtwqre 2024-03-22T07:30:21.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:21 smithi134 ceph-mon[29057]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:21.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:21 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/1240391490' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:30:21.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:21 smithi195 ceph-mon[36144]: mgrmap e27: smithi195.jxfsnc(active, since 106s), standbys: smithi134.wtwqre 2024-03-22T07:30:21.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:21 smithi195 ceph-mon[36144]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:21.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:21 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/1240391490' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:30:22.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:22 smithi134 ceph-mon[29057]: pgmap v57: 65 pgs: 65 active+clean; 233 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.0 MiB/s wr, 1.27k op/s 2024-03-22T07:30:22.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:22 smithi195 ceph-mon[36144]: pgmap v57: 65 pgs: 65 active+clean; 233 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 2.0 MiB/s wr, 1.27k op/s 2024-03-22T07:30:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:24 smithi134 ceph-mon[29057]: pgmap v58: 65 pgs: 65 active+clean; 233 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 928 op/s 2024-03-22T07:30:25.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:24 smithi195 ceph-mon[36144]: pgmap v58: 65 pgs: 65 active+clean; 233 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 928 op/s 2024-03-22T07:30:27.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:26 smithi134 ceph-mon[29057]: pgmap v59: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 1.10k op/s 2024-03-22T07:30:27.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:26 smithi195 ceph-mon[36144]: pgmap v59: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 1.10k op/s 2024-03-22T07:30:27.535 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-03-22T07:30:27.535 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-22T07:30:27.821 DEBUG:teuthology.parallel:result is None 2024-03-22T07:30:29.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:28 smithi134 ceph-mon[29057]: pgmap v60: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 461 op/s 2024-03-22T07:30:29.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:28 smithi195 ceph-mon[36144]: pgmap v60: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 461 op/s 2024-03-22T07:30:30.481 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-22T07:30:30.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-22T07:30:30.799 DEBUG:teuthology.parallel:result is None 2024-03-22T07:30:30.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-22T07:30:30.833 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-22T07:30:30.833 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-03-22T07:30:30.864 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-03-22T07:30:30.865 DEBUG:teuthology.parallel:result is None 2024-03-22T07:30:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:30 smithi134 ceph-mon[29057]: pgmap v61: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-03-22T07:30:31.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:30 smithi195 ceph-mon[36144]: pgmap v61: 65 pgs: 65 active+clean; 222 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-03-22T07:30:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:32 smithi134 ceph-mon[29057]: pgmap v62: 65 pgs: 65 active+clean; 216 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.7 MiB/s wr, 626 op/s 2024-03-22T07:30:33.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:32 smithi195 ceph-mon[36144]: pgmap v62: 65 pgs: 65 active+clean; 216 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.7 MiB/s wr, 626 op/s 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr fail", "who": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr fail", "who": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: osdmap e49: 6 total, 6 up, 6 in 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd='[{"prefix": "mgr fail", "who": "smithi195.jxfsnc"}]': finished 2024-03-22T07:30:34.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: mgrmap e28: smithi134.wtwqre(active, starting, since 0.00598617s) 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:30:34.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: [22/Mar/2024:07:30:34] ENGINE Bus STARTING 2024-03-22T07:30:34.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:34 smithi195 ceph-mon[36144]: [22/Mar/2024:07:30:34] ENGINE Serving on http://172.21.15.134:8765 2024-03-22T07:30:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 172.21.15.195:0/305743828' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr fail", "who": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "mgr fail", "who": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: osdmap e49: 6 total, 6 up, 6 in 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.24409 ' entity='mgr.smithi195.jxfsnc' cmd='[{"prefix": "mgr fail", "who": "smithi195.jxfsnc"}]': finished 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: mgrmap e28: smithi134.wtwqre(active, starting, since 0.00598617s) 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:30:35.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:30:35.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: [22/Mar/2024:07:30:34] ENGINE Bus STARTING 2024-03-22T07:30:35.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:34 smithi134 ceph-mon[29057]: [22/Mar/2024:07:30:34] ENGINE Serving on http://172.21.15.134:8765 2024-03-22T07:30:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:36 smithi134 ceph-mon[29057]: [22/Mar/2024:07:30:34] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:30:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:36 smithi134 ceph-mon[29057]: [22/Mar/2024:07:30:34] ENGINE Bus STARTED 2024-03-22T07:30:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:36 smithi134 ceph-mon[29057]: mgrmap e29: smithi134.wtwqre(active, since 1.00853s) 2024-03-22T07:30:36.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:36 smithi134 ceph-mon[29057]: pgmap v3: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:36.379 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:36 smithi195 ceph-mon[36144]: [22/Mar/2024:07:30:34] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:30:36.379 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:36 smithi195 ceph-mon[36144]: [22/Mar/2024:07:30:34] ENGINE Bus STARTED 2024-03-22T07:30:36.380 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:36 smithi195 ceph-mon[36144]: mgrmap e29: smithi134.wtwqre(active, since 1.00853s) 2024-03-22T07:30:36.380 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:36 smithi195 ceph-mon[36144]: pgmap v3: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:37.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:37 smithi195 ceph-mon[36144]: pgmap v4: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:37.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:37 smithi195 ceph-mon[36144]: mgrmap e30: smithi134.wtwqre(active, since 2s) 2024-03-22T07:30:37.497 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:37 smithi134 ceph-mon[29057]: pgmap v4: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:37.497 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:37 smithi134 ceph-mon[29057]: mgrmap e30: smithi134.wtwqre(active, since 2s) 2024-03-22T07:30:38.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:38 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:38.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:38 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:38.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:38 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:38.773 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:38 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:39 smithi195 ceph-mon[36144]: pgmap v5: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:39 smithi195 ceph-mon[36144]: mgrmap e31: smithi134.wtwqre(active, since 4s) 2024-03-22T07:30:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:39 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:39 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:39 smithi134 ceph-mon[29057]: pgmap v5: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:39 smithi134 ceph-mon[29057]: mgrmap e31: smithi134.wtwqre(active, since 4s) 2024-03-22T07:30:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:39 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:39 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:40 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:40 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:40.830 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:40 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:40.830 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:40 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: pgmap v6: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:30:41.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:30:41.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:30:41.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:30:41.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:41 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: pgmap v6: 65 pgs: 65 active+clean; 201 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:30:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:30:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:41 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/1127280394' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:30:42.739 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:42 smithi134 ceph-mon[29057]: mgrmap e32: smithi134.wtwqre(active, since 7s), standbys: smithi195.jxfsnc 2024-03-22T07:30:42.740 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:42 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:30:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:42 smithi195 ceph-mon[36144]: mgrmap e32: smithi134.wtwqre(active, since 7s), standbys: smithi195.jxfsnc 2024-03-22T07:30:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:42 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:30:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:43 smithi134 ceph-mon[29057]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.0 KiB/s wr, 18 op/s 2024-03-22T07:30:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:43 smithi195 ceph-mon[36144]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.0 KiB/s wr, 18 op/s 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 797 B/s wr, 14 op/s 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:30:45.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:30:45.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:45 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 797 B/s wr, 14 op/s 2024-03-22T07:30:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:45.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:45 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:46.517 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:30:46.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:30:46.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:30:46.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:30:46.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:30:46.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:30:46.518 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:46 smithi134 ceph-mon[29057]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:30:46.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:46 smithi195 ceph-mon[36144]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-22T07:30:47.576 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:47 smithi134 ceph-mon[29057]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-22T07:30:47.577 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:47 smithi134 ceph-mon[29057]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 652 B/s wr, 11 op/s 2024-03-22T07:30:47.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:47 smithi195 ceph-mon[36144]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-22T07:30:47.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:47 smithi195 ceph-mon[36144]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 652 B/s wr, 11 op/s 2024-03-22T07:30:49.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:49 smithi134 ceph-mon[29057]: pgmap v10: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-22T07:30:49.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:49 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:49.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:49 smithi195 ceph-mon[36144]: pgmap v10: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-22T07:30:49.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:49 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 -- 172.21.15.134:0/2183005730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc102360 msgr2=0x7f40cc104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/2183005730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc102360 0x7f40cc104740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f40bc004940 tx=0x7f40bc009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 -- 172.21.15.134:0/2183005730 shutdown_connections 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/2183005730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc102360 0x7f40cc104740 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/2183005730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40cc066280 0x7f40cc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 -- 172.21.15.134:0/2183005730 >> 172.21.15.134:0/2183005730 conn(0x7f40cc0f7430 msgr2=0x7f40cc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:51.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 -- 172.21.15.134:0/2183005730 shutdown_connections 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.226+0000 7f40d3e2b700 1 -- 172.21.15.134:0/2183005730 wait complete. 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d3e2b700 1 Processor -- start 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d3e2b700 1 -- start start 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d3e2b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 0x7f40cc10fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d3e2b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40cc102360 0x7f40cc1100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d3e2b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1106f0 con 0x7f40cc066280 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d3e2b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc110f40 con 0x7f40cc102360 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d1bc7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 0x7f40cc10fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d1bc7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 0x7f40cc10fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38894/0 (socket says 172.21.15.134:38894) 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d1bc7700 1 -- 172.21.15.134:0/3036972439 learned_addr learned my addr 172.21.15.134:0/3036972439 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d13c6700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40cc102360 0x7f40cc1100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d1bc7700 1 -- 172.21.15.134:0/3036972439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40cc102360 msgr2=0x7f40cc1100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.227+0000 7f40d1bc7700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40cc102360 0x7f40cc1100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40d1bc7700 1 -- 172.21.15.134:0/3036972439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc005040 con 0x7f40cc066280 2024-03-22T07:30:51.230 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40d1bc7700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 0x7f40cc10fbb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f40c8002a80 tx=0x7f40c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:51.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c8007cc0 con 0x7f40cc066280 2024-03-22T07:30:51.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40c800f040 con 0x7f40cc066280 2024-03-22T07:30:51.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c800db30 con 0x7f40cc066280 2024-03-22T07:30:51.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc111220 con 0x7f40cc066280 2024-03-22T07:30:51.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.228+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc1116a0 con 0x7f40cc066280 2024-03-22T07:30:51.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.229+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc05f5f0 con 0x7f40cc066280 2024-03-22T07:30:51.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.230+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7f40c800dc90 con 0x7f40cc066280 2024-03-22T07:30:51.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.230+0000 7f40c27fc700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f40b806cda0 0x7f40b806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.230+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f40c808b8f0 con 0x7f40cc066280 2024-03-22T07:30:51.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.230+0000 7f40d13c6700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f40b806cda0 0x7f40b806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.230+0000 7f40d13c6700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f40b806cda0 0x7f40b806f250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b3b0 tx=0x7f40bc009e30 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:51.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.235+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f40c8059560 con 0x7f40cc066280 2024-03-22T07:30:51.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.447+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 --> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40cc111ae0 con 0x7f40b806cda0 2024-03-22T07:30:51.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.448+0000 7f40c27fc700 1 -- 172.21.15.134:0/3036972439 <== mgr.14750 v2:172.21.15.134:6800/2106493148 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f40cc111ae0 con 0x7f40b806cda0 2024-03-22T07:30:51.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f40b806cda0 msgr2=0x7f40b806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f40b806cda0 0x7f40b806f250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b3b0 tx=0x7f40bc009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:51.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 msgr2=0x7f40cc10fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 0x7f40cc10fbb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f40c8002a80 tx=0x7f40c80046b0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 shutdown_connections 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f40b806cda0 0x7f40b806f250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40cc066280 0x7f40cc10fbb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 --2- 172.21.15.134:0/3036972439 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40cc102360 0x7f40cc1100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.450+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 >> 172.21.15.134:0/3036972439 conn(0x7f40cc0f7430 msgr2=0x7f40cc0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.451+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 shutdown_connections 2024-03-22T07:30:51.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.451+0000 7f40d3e2b700 1 -- 172.21.15.134:0/3036972439 wait complete. 2024-03-22T07:30:51.462 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:30:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:51 smithi134 ceph-mon[29057]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-22T07:30:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:51 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:51 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:51 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:51 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:51.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 -- 172.21.15.134:0/2151934977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fbd10 msgr2=0x7fa5400fc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 --2- 172.21.15.134:0/2151934977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fbd10 0x7fa5400fc120 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa534004940 tx=0x7fa534009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 -- 172.21.15.134:0/2151934977 shutdown_connections 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 --2- 172.21.15.134:0/2151934977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5400fcfc0 0x7fa5400fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 --2- 172.21.15.134:0/2151934977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fbd10 0x7fa5400fc120 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 -- 172.21.15.134:0/2151934977 >> 172.21.15.134:0/2151934977 conn(0x7fa5400f7490 msgr2=0x7fa5400f98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 -- 172.21.15.134:0/2151934977 shutdown_connections 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.553+0000 7fa546e82700 1 -- 172.21.15.134:0/2151934977 wait complete. 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa546e82700 1 Processor -- start 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa546e82700 1 -- start start 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa546e82700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5400fbd10 0x7fa54010c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa546e82700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 0x7fa54010cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa546e82700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54010d420 con 0x7fa5400fcfc0 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa546e82700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa540111dc0 con 0x7fa5400fbd10 2024-03-22T07:30:51.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa53ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 0x7fa54010cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa53ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 0x7fa54010cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38908/0 (socket says 172.21.15.134:38908) 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa53ffff700 1 -- 172.21.15.134:0/704736680 learned_addr learned my addr 172.21.15.134:0/704736680 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.554+0000 7fa544c1e700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5400fbd10 0x7fa54010c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53ffff700 1 -- 172.21.15.134:0/704736680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5400fbd10 msgr2=0x7fa54010c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53ffff700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5400fbd10 0x7fa54010c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53ffff700 1 -- 172.21.15.134:0/704736680 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534005040 con 0x7fa5400fcfc0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53ffff700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 0x7fa54010cd90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b790 tx=0x7fa52c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52c00f6f0 con 0x7fa5400fcfc0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa52c00fd20 con 0x7fa5400fcfc0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540112020 con 0x7fa5400fcfc0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa52c0103a0 con 0x7fa5400fcfc0 2024-03-22T07:30:51.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.555+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540112560 con 0x7fa5400fcfc0 2024-03-22T07:30:51.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.556+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54004c710 con 0x7fa5400fcfc0 2024-03-22T07:30:51.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.556+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7fa52c011400 con 0x7fa5400fcfc0 2024-03-22T07:30:51.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.557+0000 7fa53d7fa700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fa53006cdb0 0x7fa53006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.557+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa52c08bdb0 con 0x7fa5400fcfc0 2024-03-22T07:30:51.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.557+0000 7fa544c1e700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fa53006cdb0 0x7fa53006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.557+0000 7fa544c1e700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fa53006cdb0 0x7fa53006f260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa53400b970 tx=0x7fa534009e30 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:51.562 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.561+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa52c059bd0 con 0x7fa5400fcfc0 2024-03-22T07:30:51.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:51 smithi195 ceph-mon[36144]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-22T07:30:51.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:51 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:51.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:51 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:51.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:51 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:51.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:51 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:51.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.772+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 --> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa540101260 con 0x7fa53006cdb0 2024-03-22T07:30:51.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.773+0000 7fa53d7fa700 1 -- 172.21.15.134:0/704736680 <== mgr.14750 v2:172.21.15.134:6800/2106493148 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa540101260 con 0x7fa53006cdb0 2024-03-22T07:30:51.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fa53006cdb0 msgr2=0x7fa53006f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fa53006cdb0 0x7fa53006f260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa53400b970 tx=0x7fa534009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:51.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 msgr2=0x7fa54010cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 0x7fa54010cd90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b790 tx=0x7fa52c009250 comp rx=0 tx=0).stop 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 shutdown_connections 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fa53006cdb0 0x7fa53006f260 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa5400fbd10 0x7fa54010c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 --2- 172.21.15.134:0/704736680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5400fcfc0 0x7fa54010cd90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 >> 172.21.15.134:0/704736680 conn(0x7fa5400f7490 msgr2=0x7fa5400f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 shutdown_connections 2024-03-22T07:30:51.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.775+0000 7fa546e82700 1 -- 172.21.15.134:0/704736680 wait complete. 2024-03-22T07:30:51.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 -- 172.21.15.134:0/3277492971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 msgr2=0x7f43240fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 --2- 172.21.15.134:0/3277492971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f43240fc0e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4320004940 tx=0x7f4320009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:51.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 -- 172.21.15.134:0/3277492971 shutdown_connections 2024-03-22T07:30:51.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 --2- 172.21.15.134:0/3277492971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43240fcf80 0x7f43240fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 --2- 172.21.15.134:0/3277492971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f43240fc0e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 -- 172.21.15.134:0/3277492971 >> 172.21.15.134:0/3277492971 conn(0x7f43240f7430 msgr2=0x7f43240f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:51.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 -- 172.21.15.134:0/3277492971 shutdown_connections 2024-03-22T07:30:51.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.876+0000 7f432c0d7700 1 -- 172.21.15.134:0/3277492971 wait complete. 2024-03-22T07:30:51.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f432c0d7700 1 Processor -- start 2024-03-22T07:30:51.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f432c0d7700 1 -- start start 2024-03-22T07:30:51.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f432c0d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f4324110630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f432c0d7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43240fcf80 0x7f4324112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f432c0d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240663b0 con 0x7f43240fbcd0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f432c0d7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240664f0 con 0x7f43240fcf80 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329e73700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f4324110630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329e73700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f4324110630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38912/0 (socket says 172.21.15.134:38912) 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329e73700 1 -- 172.21.15.134:0/166635564 learned_addr learned my addr 172.21.15.134:0/166635564 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329672700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43240fcf80 0x7f4324112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329e73700 1 -- 172.21.15.134:0/166635564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43240fcf80 msgr2=0x7f4324112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329e73700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43240fcf80 0x7f4324112b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.877+0000 7f4329e73700 1 -- 172.21.15.134:0/166635564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320005040 con 0x7f43240fbcd0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.878+0000 7f4329e73700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f4324110630 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4320009150 tx=0x7f4320009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.878+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432000e040 con 0x7f43240fbcd0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.878+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4320004290 con 0x7f43240fbcd0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.878+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4324113120 con 0x7f43240fbcd0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.878+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43241136e0 con 0x7f43240fbcd0 2024-03-22T07:30:51.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.878+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432001c630 con 0x7f43240fbcd0 2024-03-22T07:30:51.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.879+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432405f5f0 con 0x7f43240fbcd0 2024-03-22T07:30:51.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.879+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7f432000bbf0 con 0x7f43240fbcd0 2024-03-22T07:30:51.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.880+0000 7f431a7fc700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f431006cda0 0x7f431006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:51.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.880+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f432008ccd0 con 0x7f43240fbcd0 2024-03-22T07:30:51.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.880+0000 7f4329672700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f431006cda0 0x7f431006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:51.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.880+0000 7f4329672700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f431006cda0 0x7f431006f250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4314009fd0 tx=0x7f431400b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:51.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:51.885+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4320056eb0 con 0x7f43240fbcd0 2024-03-22T07:30:52.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.087+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 --> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43241012f0 con 0x7f431006cda0 2024-03-22T07:30:52.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.097+0000 7f431a7fc700 1 -- 172.21.15.134:0/166635564 <== mgr.14750 v2:172.21.15.134:6800/2106493148 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f43241012f0 con 0x7f431006cda0 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (106s) 12s ago 10m 16.6M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (10m) 12s ago 10m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (9m) 14s ago 9m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (71s) 12s ago 9m 78.5M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (4m) 12s ago 4m 169M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (4m) 12s ago 4m 12.4M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (4m) 14s ago 4m 13.9M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (4m) 14s ago 4m 13.0M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (42s) 12s ago 11m 476M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:30:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283 running (2m) 14s ago 9m 73.4M - 19.0.0-1667-gdb0330b1 4f325f8440e9 06db0bc1a216 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (11m) 12s ago 11m 54.4M 2048M 17.2.7-726-g9c4e0c34 837124da804f ce8eba791f2c 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (9m) 14s ago 9m 41.5M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (112s) 12s ago 10m 8791k - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (50s) 14s ago 9m 7415k - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (8m) 12s ago 8m 261M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (7m) 12s ago 7m 269M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (7m) 12s ago 7m 216M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (7m) 14s ago 7m 294M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (6m) 14s ago 6m 261M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (6m) 14s ago 6m 237M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:30:52.099 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 starting - - - - 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f431006cda0 msgr2=0x7f431006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f431006cda0 0x7f431006f250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4314009fd0 tx=0x7f431400b040 comp rx=0 tx=0).stop 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 msgr2=0x7f4324110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f4324110630 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4320009150 tx=0x7f4320009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 shutdown_connections 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f431006cda0 0x7f431006f250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43240fbcd0 0x7f4324110630 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 --2- 172.21.15.134:0/166635564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43240fcf80 0x7f4324112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 >> 172.21.15.134:0/166635564 conn(0x7f43240f7430 msgr2=0x7f43240f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:52.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 shutdown_connections 2024-03-22T07:30:52.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.099+0000 7f432c0d7700 1 -- 172.21.15.134:0/166635564 wait complete. 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 -- 172.21.15.134:0/3217398310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 msgr2=0x7fca740fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 --2- 172.21.15.134:0/3217398310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca740fc0e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca64004940 tx=0x7fca64009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 -- 172.21.15.134:0/3217398310 shutdown_connections 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 --2- 172.21.15.134:0/3217398310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca740fcf80 0x7fca740fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 --2- 172.21.15.134:0/3217398310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca740fc0e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 -- 172.21.15.134:0/3217398310 >> 172.21.15.134:0/3217398310 conn(0x7fca740f7430 msgr2=0x7fca740f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 -- 172.21.15.134:0/3217398310 shutdown_connections 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.199+0000 7fca79c32700 1 -- 172.21.15.134:0/3217398310 wait complete. 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca79c32700 1 Processor -- start 2024-03-22T07:30:52.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca79c32700 1 -- start start 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca79c32700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca7410fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca79c32700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca740fcf80 0x7fca74110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca79c32700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca74110670 con 0x7fca740fbcd0 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca79c32700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca741107e0 con 0x7fca740fcf80 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca7410fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca737fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca7410fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38934/0 (socket says 172.21.15.134:38934) 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca737fe700 1 -- 172.21.15.134:0/3034055984 learned_addr learned my addr 172.21.15.134:0/3034055984 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.200+0000 7fca6bfff700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca740fcf80 0x7fca74110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca737fe700 1 -- 172.21.15.134:0/3034055984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca740fcf80 msgr2=0x7fca74110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca737fe700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca740fcf80 0x7fca74110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca737fe700 1 -- 172.21.15.134:0/3034055984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64005040 con 0x7fca740fbcd0 2024-03-22T07:30:52.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca737fe700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca7410fb30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca64009150 tx=0x7fca64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:52.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca6400e040 con 0x7fca740fbcd0 2024-03-22T07:30:52.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca741151e0 con 0x7fca740fbcd0 2024-03-22T07:30:52.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca64004290 con 0x7fca740fbcd0 2024-03-22T07:30:52.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca6401c630 con 0x7fca740fbcd0 2024-03-22T07:30:52.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.201+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca741157a0 con 0x7fca740fbcd0 2024-03-22T07:30:52.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.202+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca74101910 con 0x7fca740fbcd0 2024-03-22T07:30:52.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.203+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7fca6400bbf0 con 0x7fca740fbcd0 2024-03-22T07:30:52.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.203+0000 7fca70ff9700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fca6006cdb0 0x7fca6006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.203+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fca6408cdf0 con 0x7fca740fbcd0 2024-03-22T07:30:52.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.203+0000 7fca6bfff700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fca6006cdb0 0x7fca6006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.204+0000 7fca6bfff700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fca6006cdb0 0x7fca6006f260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fca5c004f40 tx=0x7fca5c00b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:52.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.208+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fca6405aa60 con 0x7fca740fbcd0 2024-03-22T07:30:52.482 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.481+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca741047c0 con 0x7fca740fbcd0 2024-03-22T07:30:52.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:52 smithi134 ceph-mon[29057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:52.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:52 smithi134 ceph-mon[29057]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.481+0000 7fca70ff9700 1 -- 172.21.15.134:0/3034055984 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fca6405a5f0 con 0x7fca740fbcd0 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:30:52.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 12, 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:30:52.484 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fca6006cdb0 msgr2=0x7fca6006f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fca6006cdb0 0x7fca6006f260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fca5c004f40 tx=0x7fca5c00b040 comp rx=0 tx=0).stop 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 msgr2=0x7fca7410fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca7410fb30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca64009150 tx=0x7fca64009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 shutdown_connections 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7fca6006cdb0 0x7fca6006f260 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca740fbcd0 0x7fca7410fb30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 --2- 172.21.15.134:0/3034055984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca740fcf80 0x7fca74110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 >> 172.21.15.134:0/3034055984 conn(0x7fca740f7430 msgr2=0x7fca740f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:52.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 shutdown_connections 2024-03-22T07:30:52.486 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.483+0000 7fca79c32700 1 -- 172.21.15.134:0/3034055984 wait complete. 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 -- 172.21.15.134:0/1353469727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 msgr2=0x7f16700fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 --2- 172.21.15.134:0/1353469727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f16700fe4e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1664004940 tx=0x7f1664009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 -- 172.21.15.134:0/1353469727 shutdown_connections 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 --2- 172.21.15.134:0/1353469727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f16700fe4e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 --2- 172.21.15.134:0/1353469727 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16700fcf00 0x7f16700fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 -- 172.21.15.134:0/1353469727 >> 172.21.15.134:0/1353469727 conn(0x7f16700f85a0 msgr2=0x7f16700fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:52.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 -- 172.21.15.134:0/1353469727 shutdown_connections 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.583+0000 7f167617d700 1 -- 172.21.15.134:0/1353469727 wait complete. 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f167617d700 1 Processor -- start 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f167617d700 1 -- start start 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f167617d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16700fcf00 0x7f167010da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f167617d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f167010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f167617d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167010e590 con 0x7f16700fe070 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f167617d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167010ede0 con 0x7f16700fcf00 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f166effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f167010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f166effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f167010df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38962/0 (socket says 172.21.15.134:38962) 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f166effd700 1 -- 172.21.15.134:0/442415322 learned_addr learned my addr 172.21.15.134:0/442415322 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.584+0000 7f166f7fe700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16700fcf00 0x7f167010da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f166effd700 1 -- 172.21.15.134:0/442415322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16700fcf00 msgr2=0x7f167010da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f166effd700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16700fcf00 0x7f167010da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f166effd700 1 -- 172.21.15.134:0/442415322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664005040 con 0x7f16700fe070 2024-03-22T07:30:52.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f166effd700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f167010df90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f166400b3b0 tx=0x7f1664009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166400e040 con 0x7f16700fe070 2024-03-22T07:30:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f166400bbf0 con 0x7f16700fe070 2024-03-22T07:30:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167010f060 con 0x7f16700fe070 2024-03-22T07:30:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f166401c630 con 0x7f16700fe070 2024-03-22T07:30:52.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.585+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167010f5a0 con 0x7f16700fe070 2024-03-22T07:30:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.586+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167005f5f0 con 0x7f16700fe070 2024-03-22T07:30:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.586+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7f166400bd60 con 0x7f16700fe070 2024-03-22T07:30:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.587+0000 7f1657fff700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f165806cda0 0x7f165806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.587+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f166408cdc0 con 0x7f16700fe070 2024-03-22T07:30:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.587+0000 7f166f7fe700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f165806cda0 0x7f165806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.587+0000 7f166f7fe700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f165806cda0 0x7f165806f250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1660004f40 tx=0x7f166000b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:52.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.591+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1664090030 con 0x7f16700fe070 2024-03-22T07:30:52.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:52 smithi195 ceph-mon[36144]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:30:52.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:52 smithi195 ceph-mon[36144]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:52.828 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.827+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f167004bed0 con 0x7f16700fe070 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.827+0000 7f1657fff700 1 -- 172.21.15.134:0/442415322 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f166405aa10 con 0x7f16700fe070 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:30:52.829 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:30:52.830 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:52.831 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:52.832 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:30:52.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f165806cda0 msgr2=0x7f165806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f165806cda0 0x7f165806f250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1660004f40 tx=0x7f166000b040 comp rx=0 tx=0).stop 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 msgr2=0x7f167010df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f167010df90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f166400b3b0 tx=0x7f1664009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 shutdown_connections 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f165806cda0 0x7f165806f250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16700fcf00 0x7f167010da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 --2- 172.21.15.134:0/442415322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16700fe070 0x7f167010df90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 >> 172.21.15.134:0/442415322 conn(0x7f16700f85a0 msgr2=0x7f16700f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 shutdown_connections 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.830+0000 7f167617d700 1 -- 172.21.15.134:0/442415322 wait complete. 2024-03-22T07:30:52.833 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:30:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- 172.21.15.134:0/4000389227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 msgr2=0x7f5d1c0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/4000389227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c0fd3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d10004940 tx=0x7f5d10009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- 172.21.15.134:0/4000389227 shutdown_connections 2024-03-22T07:30:52.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/4000389227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c0fd3f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/4000389227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d1c0fbcd0 0x7f5d1c0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- 172.21.15.134:0/4000389227 >> 172.21.15.134:0/4000389227 conn(0x7f5d1c0f7430 msgr2=0x7f5d1c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- 172.21.15.134:0/4000389227 shutdown_connections 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- 172.21.15.134:0/4000389227 wait complete. 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 Processor -- start 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- start start 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d1c0fbcd0 0x7f5d1c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c10df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c10e520 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.943+0000 7f5d20ca0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c10ed20 con 0x7f5d1c0fbcd0 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c10df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d1a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d1c0fbcd0 0x7f5d1c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c10df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38980/0 (socket says 172.21.15.134:38980) 2024-03-22T07:30:52.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 -- 172.21.15.134:0/3614622500 learned_addr learned my addr 172.21.15.134:0/3614622500 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 -- 172.21.15.134:0/3614622500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d1c0fbcd0 msgr2=0x7f5d1c10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d1c0fbcd0 0x7f5d1c10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 -- 172.21.15.134:0/3614622500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d10005040 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d19d9b700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c10df20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009150 tx=0x7f5d10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1000e040 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d10004290 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c10efa0 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d1001c630 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.944+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c10f4e0 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.945+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c101b10 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.946+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7f5d1000bbf0 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.946+0000 7f5d0affd700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f5d0406cda0 0x7f5d0406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:52.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.946+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5d1008cdd0 con 0x7f5d1c0fcf80 2024-03-22T07:30:52.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.946+0000 7f5d1a59c700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f5d0406cda0 0x7f5d0406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:52.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.947+0000 7f5d1a59c700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f5d0406cda0 0x7f5d0406f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d14007b20 tx=0x7f5d14009e20 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:52.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:52.951+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5d1005aa40 con 0x7f5d1c0fcf80 2024-03-22T07:30:53.163 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.162+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 --> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d1c1048d0 con 0x7f5d0406cda0 2024-03-22T07:30:53.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.163+0000 7f5d0affd700 1 -- 172.21.15.134:0/3614622500 <== mgr.14750 v2:172.21.15.134:6800/2106493148 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5d1c1048d0 con 0x7f5d0406cda0 2024-03-22T07:30:53.164 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:30:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:30:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:30:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:30:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:30:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-03-22T07:30:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:30:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "2/21 daemons upgraded", 2024-03-22T07:30:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mgr daemons", 2024-03-22T07:30:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:30:53.165 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f5d0406cda0 msgr2=0x7f5d0406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f5d0406cda0 0x7f5d0406f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d14007b20 tx=0x7f5d14009e20 comp rx=0 tx=0).stop 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 msgr2=0x7f5d1c10df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c10df20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009150 tx=0x7f5d10009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 shutdown_connections 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f5d0406cda0 0x7f5d0406f250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d1c0fbcd0 0x7f5d1c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 --2- 172.21.15.134:0/3614622500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d1c0fcf80 0x7f5d1c10df20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.165+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 >> 172.21.15.134:0/3614622500 conn(0x7f5d1c0f7430 msgr2=0x7f5d1c065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.166+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 shutdown_connections 2024-03-22T07:30:53.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.166+0000 7f5d20ca0700 1 -- 172.21.15.134:0/3614622500 wait complete. 2024-03-22T07:30:53.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 -- 172.21.15.134:0/1049094999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fbd00 msgr2=0x7f63e00fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:53.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 --2- 172.21.15.134:0/1049094999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fbd00 0x7f63e00fc110 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f63d0004940 tx=0x7f63d0009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:53.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 -- 172.21.15.134:0/1049094999 shutdown_connections 2024-03-22T07:30:53.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 --2- 172.21.15.134:0/1049094999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63e00fcfb0 0x7f63e00fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.269 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 --2- 172.21.15.134:0/1049094999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fbd00 0x7f63e00fc110 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 -- 172.21.15.134:0/1049094999 >> 172.21.15.134:0/1049094999 conn(0x7f63e00f7460 msgr2=0x7f63e00f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 -- 172.21.15.134:0/1049094999 shutdown_connections 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.266+0000 7f63e4e40700 1 -- 172.21.15.134:0/1049094999 wait complete. 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63e4e40700 1 Processor -- start 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63e4e40700 1 -- start start 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63e4e40700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63e00fbd00 0x7f63e0066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63e4e40700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 0x7f63e0112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63e4e40700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0112c60 con 0x7f63e00fcfb0 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63e4e40700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0112dd0 con 0x7f63e00fbd00 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63ddd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 0x7f63e0112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63ddd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 0x7f63e0112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39004/0 (socket says 172.21.15.134:39004) 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63ddd9b700 1 -- 172.21.15.134:0/2729836960 learned_addr learned my addr 172.21.15.134:0/2729836960 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63de59c700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63e00fbd00 0x7f63e0066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:53.270 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63ddd9b700 1 -- 172.21.15.134:0/2729836960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63e00fbd00 msgr2=0x7f63e0066d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63ddd9b700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63e00fbd00 0x7f63e0066d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.267+0000 7f63ddd9b700 1 -- 172.21.15.134:0/2729836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0005040 con 0x7f63e00fcfb0 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.268+0000 7f63ddd9b700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 0x7f63e0112720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f63d400b790 tx=0x7f63d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.268+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d400f6f0 con 0x7f63e00fcfb0 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.268+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63d400fd20 con 0x7f63e00fcfb0 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.268+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d40103a0 con 0x7f63e00fcfb0 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.268+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e01130b0 con 0x7f63e00fcfb0 2024-03-22T07:30:53.271 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.268+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e0113670 con 0x7f63e00fcfb0 2024-03-22T07:30:53.272 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.269+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e004c710 con 0x7f63e00fcfb0 2024-03-22T07:30:53.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.269+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 32) v1 ==== 90985+0+0 (secure 0 0 0) 0x7f63d4011400 con 0x7f63e00fcfb0 2024-03-22T07:30:53.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.270+0000 7f63ceffd700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f63c806cdb0 0x7f63c806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:30:53.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.270+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f63d408be00 con 0x7f63e00fcfb0 2024-03-22T07:30:53.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.270+0000 7f63de59c700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f63c806cdb0 0x7f63c806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:30:53.273 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.270+0000 7f63de59c700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f63c806cdb0 0x7f63c806f260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f63d000b970 tx=0x7f63d0009e30 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:30:53.275 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.274+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f63d4059c20 con 0x7f63e00fcfb0 2024-03-22T07:30:53.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.549+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f63e0104870 con 0x7f63e00fcfb0 2024-03-22T07:30:53.550 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.549+0000 7f63ceffd700 1 -- 172.21.15.134:0/2729836960 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f63d40597b0 con 0x7f63e00fcfb0 2024-03-22T07:30:53.550 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:30:53.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f63c806cdb0 msgr2=0x7f63c806f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f63c806cdb0 0x7f63c806f260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f63d000b970 tx=0x7f63d0009e30 comp rx=0 tx=0).stop 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 msgr2=0x7f63e0112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 0x7f63e0112720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f63d400b790 tx=0x7f63d4009250 comp rx=0 tx=0).stop 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 shutdown_connections 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:6800/2106493148,v1:172.21.15.134:6801/2106493148] conn(0x7f63c806cdb0 0x7f63c806f260 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63e00fbd00 0x7f63e0066d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 --2- 172.21.15.134:0/2729836960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e00fcfb0 0x7f63e0112720 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 >> 172.21.15.134:0/2729836960 conn(0x7f63e00f7460 msgr2=0x7f63e00f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 shutdown_connections 2024-03-22T07:30:53.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:30:53.551+0000 7f63e4e40700 1 -- 172.21.15.134:0/2729836960 wait complete. 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3034055984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/442415322' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:30:53.669 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:53 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 597 B/s wr, 10 op/s 2024-03-22T07:30:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/3034055984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:30:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/442415322' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:30:53.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:30:53.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:30:53.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:53 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:30:54.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:54 smithi195 ceph-mon[36144]: Upgrade: Updating mgr.smithi195.jxfsnc 2024-03-22T07:30:54.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:54 smithi195 ceph-mon[36144]: Deploying daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:30:54.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:54 smithi195 ceph-mon[36144]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:54.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:54 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2729836960' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:30:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:54 smithi134 ceph-mon[29057]: Upgrade: Updating mgr.smithi195.jxfsnc 2024-03-22T07:30:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:54 smithi134 ceph-mon[29057]: Deploying daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:30:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:54 smithi134 ceph-mon[29057]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:30:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:54 smithi134 ceph-mon[29057]: from='client.? 172.21.15.134:0/2729836960' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:30:55.645 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:55 smithi195 ceph-mon[36144]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:55.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:55 smithi134 ceph-mon[29057]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:57.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:57 smithi195 ceph-mon[36144]: pgmap v14: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:57.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:57 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:57.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:57 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:57.683 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:57 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:57 smithi134 ceph-mon[29057]: pgmap v14: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:57 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:57 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:30:58.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:57 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:30:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:30:59 smithi134 ceph-mon[29057]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:30:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:30:59 smithi195 ceph-mon[36144]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:00.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:00 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:00.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:00 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:00.782 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:00 smithi195 ceph-mon[36144]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:01.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:00 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:01.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:00 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:01.029 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:00 smithi134 ceph-mon[29057]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:01 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:01 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:01 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:01 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:02 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:02 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:02 smithi195 ceph-mon[36144]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:02 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:02 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:03.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:02 smithi134 ceph-mon[29057]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:03 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc restarted 2024-03-22T07:31:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:03 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:31:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:03 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:31:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:03 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:31:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:03 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:31:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:03 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:31:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:03 smithi134 ceph-mon[29057]: Standby manager daemon smithi195.jxfsnc restarted 2024-03-22T07:31:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:03 smithi134 ceph-mon[29057]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:31:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:03 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:31:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:03 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:31:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:03 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:31:04.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:03 smithi134 ceph-mon[29057]: from='mgr.? 172.21.15.195:0/2658256814' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: mgrmap e33: smithi134.wtwqre(active, since 29s), standbys: smithi195.jxfsnc 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: Upgrade: Setting container_image for all mgr 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.wtwqre"}]: dispatch 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.wtwqre"}]': finished 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.jxfsnc"}]: dispatch 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.jxfsnc"}]': finished 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-22T07:31:05.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:04 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: mgrmap e33: smithi134.wtwqre(active, since 29s), standbys: smithi195.jxfsnc 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: Upgrade: Setting container_image for all mgr 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.wtwqre"}]: dispatch 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.wtwqre"}]': finished 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.jxfsnc"}]: dispatch 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi195.jxfsnc"}]': finished 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-22T07:31:05.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:04 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: Upgrade: Updating mon.smithi134 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: Deploying daemon mon.smithi134 on smithi134 2024-03-22T07:31:07.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:06 smithi134 ceph-mon[29057]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: Upgrade: Updating mon.smithi134 2024-03-22T07:31:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:07.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:07.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: Deploying daemon mon.smithi134 on smithi134 2024-03-22T07:31:07.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:06 smithi195 ceph-mon[36144]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:08.368 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:08 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:31:08.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:08 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[29053]: 2024-03-22T07:31:08.367+0000 7f29ddb4d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:31:08.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:08 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[29053]: 2024-03-22T07:31:08.367+0000 7f29ddb4d700 -1 mon.smithi134@0(leader) e2 *** Got Signal Terminated *** 2024-03-22T07:31:08.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:08 smithi134 podman[93773]: 2024-03-22 07:31:08.551304369 +0000 UTC m=+0.316471027 container died ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-9c4e0c3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-22T07:31:09.285 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:08 smithi134 podman[93773]: 2024-03-22 07:31:08.976162938 +0000 UTC m=+0.741329647 container cleanup ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, org.label-schema.vendor=CentOS, RELEASE=quincy-9c4e0c3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-22T07:31:09.286 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:08 smithi134 bash[93773]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134 2024-03-22T07:31:09.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 podman[93798]: 2024-03-22 07:31:09.286284957 +0000 UTC m=+0.734321905 container remove ce8eba791f2cd33f158ed747407539ddd265708d092ec14cbfd87d598f3cacf0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-9c4e0c3) 2024-03-22T07:31:09.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service: Deactivated successfully. 2024-03-22T07:31:09.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:31:09.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service: Consumed 11.146s CPU time. 2024-03-22T07:31:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 systemd[1]: Starting Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:31:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 podman[93927]: 2024-03-22 07:31:09.825274176 +0000 UTC m=+0.017976090 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:31:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:09 smithi134 podman[93927]: 2024-03-22 07:31:09.954325989 +0000 UTC m=+0.147027934 container create 6529604eecda8409350b4af6edbc33e8ff97090a3d7ec5b9b29ef67f5f11cb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 podman[93927]: 2024-03-22 07:31:10.156716606 +0000 UTC m=+0.349418528 container init 6529604eecda8409350b4af6edbc33e8ff97090a3d7ec5b9b29ef67f5f11cb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 podman[93927]: 2024-03-22 07:31:10.160336039 +0000 UTC m=+0.353037948 container start 6529604eecda8409350b4af6edbc33e8ff97090a3d7ec5b9b29ef67f5f11cb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: set uid:gid to 167:167 (ceph:ceph) 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev), process ceph-mon, pid 2 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: pidfile_write: ignore empty --pid-file 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: load: jerasure load: lrc 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: RocksDB version: 7.9.2 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Git sha 0 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Compile date 2024-03-16 10:36:11 2024-03-22T07:31:10.317 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: DB SUMMARY 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: DB Session ID: MMIMWN4K66JBYLANDUND 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: CURRENT file: CURRENT 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: IDENTITY file: IDENTITY 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000030.sst 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000028.log size: 2448722 ; 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.error_if_exists: 0 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.create_if_missing: 0 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.paranoid_checks: 1 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.env: 0x5611f510dae0 2024-03-22T07:31:10.318 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.fs: PosixFileSystem 2024-03-22T07:31:10.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.info_log: 0x5611f6835760 2024-03-22T07:31:10.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_file_opening_threads: 16 2024-03-22T07:31:10.319 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.statistics: (nil) 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.use_fsync: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_log_file_size: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.keep_log_file_num: 1000 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.recycle_log_file_num: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.allow_fallocate: 1 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.allow_mmap_reads: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.allow_mmap_writes: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.use_direct_reads: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.create_missing_column_families: 0 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.db_log_dir: 2024-03-22T07:31:10.320 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.wal_dir: 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.advise_random_on_open: 1 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.db_write_buffer_size: 0 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.write_buffer_manager: 0x5611f6809400 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.rate_limiter: (nil) 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-22T07:31:10.321 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.wal_recovery_mode: 2 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.enable_thread_tracking: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.enable_pipelined_write: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.unordered_write: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.row_cache: None 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.wal_filter: None 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.allow_ingest_behind: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.two_write_queues: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.manual_wal_flush: 0 2024-03-22T07:31:10.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.wal_compression: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.atomic_flush: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.log_readahead_size: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.best_efforts_recovery: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.allow_data_in_errors: 0 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.db_host_id: __hostname__ 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_background_jobs: 2 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_background_compactions: -1 2024-03-22T07:31:10.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_subcompactions: 1 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_total_wal_size: 0 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_open_files: -1 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bytes_per_sync: 0 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_readahead_size: 0 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_background_flushes: -1 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Compression algorithms supported: 2024-03-22T07:31:10.324 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kZSTD supported: 0 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kXpressCompression supported: 0 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kLZ4HCCompression supported: 1 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kZlibCompression supported: 1 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kSnappyCompression supported: 1 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kLZ4Compression supported: 1 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: kBZip2Compression supported: 0 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000015 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.merge_operator: 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_filter: None 2024-03-22T07:31:10.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_filter_factory: None 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.sst_partitioner_factory: None 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5611f6835880) 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-03-22T07:31:10.326 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x5611f6839090 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-03-22T07:31:10.327 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-03-22T07:31:10.328 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.write_buffer_size: 33554432 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_write_buffer_number: 2 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression: NoCompression 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression: Disabled 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.prefix_extractor: nullptr 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.num_levels: 7 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-22T07:31:10.329 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.level: 32767 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.strategy: 0 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.enabled: false 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-22T07:31:10.330 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.target_file_size_base: 67108864 2024-03-22T07:31:10.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-22T07:31:10.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-22T07:31:10.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-22T07:31:10.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-22T07:31:10.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-22T07:31:10.331 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.arena_block_size: 1048576 2024-03-22T07:31:10.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.disable_auto_compactions: 0 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.table_properties_collectors: 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.inplace_update_support: 0 2024-03-22T07:31:10.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.bloom_locality: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.max_successive_merges: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.paranoid_file_checks: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.force_consistency_checks: 1 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.report_bg_io_stats: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.ttl: 2592000 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.enable_blob_files: false 2024-03-22T07:31:10.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.min_blob_size: 0 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.blob_file_size: 268435456 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.blob_file_starting_level: 0 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10495, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4dcdf53e-c488-4171-b76f-37adeb69f14d 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092670189545, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-03-22T07:31:10.335 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092670196460, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2252402, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10496, "largest_seqno": 11455, "table_properties": {"data_size": 2247178, "index_size": 3053, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 10296, "raw_average_key_size": 23, "raw_value_size": 2237535, "raw_average_value_size": 5062, "num_data_blocks": 140, "num_entries": 442, "num_filter_entries": 442, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711092670, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4dcdf53e-c488-4171-b76f-37adeb69f14d", "db_session_id": "MMIMWN4K66JBYLANDUND", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092670196561, "job": 1, "event": "recovery_finished"} 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5611f6928000 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: DB pointer 0x5611f6914000 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-22T07:31:10.336 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 2.15 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 598.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L6 1/0 5.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 7.59 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 598.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 598.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-22T07:31:10.337 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 598.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 195.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 195.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-22T07:31:10.338 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x5611f6839090#2 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: starting mon.smithi134 rank 0 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???) e2 preinit fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).mds e14 new map 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).mds e14 print_map 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e14 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: 1 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Filesystem 'cephfs' (1) 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: fs_name cephfs 2024-03-22T07:31:10.339 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: epoch 14 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: tableserver 0 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: root 0 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_timeout 60 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_autoclose 300 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_file_size 1099511627776 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_xattr_size 65536 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: required_client_features {} 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure 0 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure_osd_epoch 47 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_mds 1 2024-03-22T07:31:10.340 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: in 0 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: up {0=14474} 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: failed 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: damaged 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: stopped 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_pools [3] 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_pool 2 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: inline_data disabled 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: balancer 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: bal_rank_mask -1 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: standby_count_wanted 1 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Standby daemons: 2024-03-22T07:31:10.341 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 ceph-mon[93947]: mon.smithi134@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 bash[93927]: 6529604eecda8409350b4af6edbc33e8ff97090a3d7ec5b9b29ef67f5f11cb36 2024-03-22T07:31:10.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:10 smithi134 systemd[1]: Started Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: mon.smithi134 calling monitor election 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: mon.smithi134 is new leader, mons smithi134,smithi195 in quorum (ranks 0,1) 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:31:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:31:11.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: osdmap e49: 6 total, 6 up, 6 in 2024-03-22T07:31:11.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: mgrmap e33: smithi134.wtwqre(active, since 37s), standbys: smithi195.jxfsnc 2024-03-22T07:31:11.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: overall HEALTH_OK 2024-03-22T07:31:11.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: from='mgr.14750 ' entity='' 2024-03-22T07:31:11.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:11 smithi195 ceph-mon[36144]: mgrmap e34: smithi134.wtwqre(active, since 37s), standbys: smithi195.jxfsnc 2024-03-22T07:31:12.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:31:12.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: from='mgr.14750 172.21.15.134:0/3865468718' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:31:12.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: mon.smithi134 calling monitor election 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: mon.smithi134 is new leader, mons smithi134,smithi195 in quorum (ranks 0,1) 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: monmap e2: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: osdmap e49: 6 total, 6 up, 6 in 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: mgrmap e33: smithi134.wtwqre(active, since 37s), standbys: smithi195.jxfsnc 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: overall HEALTH_OK 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: from='mgr.14750 ' entity='' 2024-03-22T07:31:12.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:11 smithi134 ceph-mon[93947]: mgrmap e34: smithi134.wtwqre(active, since 37s), standbys: smithi195.jxfsnc 2024-03-22T07:31:18.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195[36138]: 2024-03-22T07:31:18.449+0000 7f4ec6194700 -1 mon.smithi195@1(peon).osd e50 update_from_paxos full map CRC mismatch, resetting to canonical 2024-03-22T07:31:18.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: Active manager daemon smithi134.wtwqre restarted 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: osdmap e50: 6 total, 6 up, 6 in 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: mgrmap e35: smithi134.wtwqre(active, starting, since 0.00526194s), standbys: smithi195.jxfsnc 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:31:18.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc restarted 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:31:18.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:18 smithi195 ceph-mon[36144]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:31:18.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: Active manager daemon smithi134.wtwqre restarted 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: Activating manager daemon smithi134.wtwqre 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: osdmap e50: 6 total, 6 up, 6 in 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: mgrmap e35: smithi134.wtwqre(active, starting, since 0.00526194s), standbys: smithi195.jxfsnc 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi134.wtwqre", "id": "smithi134.wtwqre"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr metadata", "who": "smithi195.jxfsnc", "id": "smithi195.jxfsnc"}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:31:18.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: Manager daemon smithi134.wtwqre is now available 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: Standby manager daemon smithi195.jxfsnc restarted 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: Standby manager daemon smithi195.jxfsnc started 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/crt"}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-22T07:31:18.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi195.jxfsnc/key"}]: dispatch 2024-03-22T07:31:18.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:18 smithi134 ceph-mon[93947]: from='mgr.? 172.21.15.195:0/3944550696' entity='mgr.smithi195.jxfsnc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: failed to encode map e50 with expected crc 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: failed to encode map e50 with expected crc 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:19.772 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:19 smithi134 ceph-mon[93947]: mgrmap e36: smithi134.wtwqre(active, since 1.00954s), standbys: smithi195.jxfsnc 2024-03-22T07:31:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: failed to encode map e50 with expected crc 2024-03-22T07:31:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: failed to encode map e50 with expected crc 2024-03-22T07:31:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:31:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/mirror_snapshot_schedule"}]: dispatch 2024-03-22T07:31:19.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.wtwqre/trash_purge_schedule"}]: dispatch 2024-03-22T07:31:19.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:19.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:19.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:19 smithi195 ceph-mon[36144]: mgrmap e36: smithi134.wtwqre(active, since 1.00954s), standbys: smithi195.jxfsnc 2024-03-22T07:31:20.780 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:20 smithi195 ceph-mon[36144]: [22/Mar/2024:07:31:19] ENGINE Bus STARTING 2024-03-22T07:31:20.780 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:20 smithi195 ceph-mon[36144]: [22/Mar/2024:07:31:19] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:31:20.781 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:20 smithi195 ceph-mon[36144]: pgmap v3: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:20.781 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:20 smithi195 ceph-mon[36144]: [22/Mar/2024:07:31:19] ENGINE Serving on http://172.21.15.134:8765 2024-03-22T07:31:20.781 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:20 smithi195 ceph-mon[36144]: [22/Mar/2024:07:31:19] ENGINE Bus STARTED 2024-03-22T07:31:20.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:20 smithi134 ceph-mon[93947]: [22/Mar/2024:07:31:19] ENGINE Bus STARTING 2024-03-22T07:31:20.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:20 smithi134 ceph-mon[93947]: [22/Mar/2024:07:31:19] ENGINE Serving on https://172.21.15.134:7150 2024-03-22T07:31:20.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:20 smithi134 ceph-mon[93947]: pgmap v3: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:20.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:20 smithi134 ceph-mon[93947]: [22/Mar/2024:07:31:19] ENGINE Serving on http://172.21.15.134:8765 2024-03-22T07:31:20.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:20 smithi134 ceph-mon[93947]: [22/Mar/2024:07:31:19] ENGINE Bus STARTED 2024-03-22T07:31:21.735 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:21 smithi195 ceph-mon[36144]: pgmap v4: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:21.735 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:21 smithi195 ceph-mon[36144]: mgrmap e37: smithi134.wtwqre(active, since 3s), standbys: smithi195.jxfsnc 2024-03-22T07:31:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:21 smithi134 ceph-mon[93947]: pgmap v4: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:21 smithi134 ceph-mon[93947]: mgrmap e37: smithi134.wtwqre(active, since 3s), standbys: smithi195.jxfsnc 2024-03-22T07:31:23.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:23.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:23.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:23 smithi134 ceph-mon[93947]: pgmap v5: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:23.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 -- 172.21.15.134:0/2623547028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fbcd0 msgr2=0x7f0d5c0fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 --2- 172.21.15.134:0/2623547028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fbcd0 0x7f0d5c0fc0e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c004940 tx=0x7f0d4c009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 -- 172.21.15.134:0/2623547028 shutdown_connections 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 --2- 172.21.15.134:0/2623547028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c0fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 --2- 172.21.15.134:0/2623547028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fbcd0 0x7f0d5c0fc0e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 -- 172.21.15.134:0/2623547028 >> 172.21.15.134:0/2623547028 conn(0x7f0d5c0f7430 msgr2=0x7f0d5c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 -- 172.21.15.134:0/2623547028 shutdown_connections 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.657+0000 7f0d6206a700 1 -- 172.21.15.134:0/2623547028 wait complete. 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d6206a700 1 Processor -- start 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d6206a700 1 -- start start 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d6206a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0fbcd0 0x7f0d5c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d6206a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d6206a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c110760 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d6206a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c110f10 con 0x7f0d5c0fbcd0 2024-03-22T07:31:23.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48996/0 (socket says 172.21.15.134:48996) 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 -- 172.21.15.134:0/1733636390 learned_addr learned my addr 172.21.15.134:0/1733636390 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d5b7fe700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0fbcd0 0x7f0d5c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 -- 172.21.15.134:0/1733636390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0fbcd0 msgr2=0x7f0d5c10fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0fbcd0 0x7f0d5c10fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 -- 172.21.15.134:0/1733636390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c005040 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d53fff700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c110160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400eb40 tx=0x7f0d4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.658+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d44007cc0 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.659+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d4400f040 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.659+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c111190 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.659+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4400ca10 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.659+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c1116d0 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.659+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c101910 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.660+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f0d4400cb70 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.660+0000 7f0d58ff9700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0d4806d4a0 0x7f0d4806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:23.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.661+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0d4408c680 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.661+0000 7f0d5b7fe700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0d4806d4a0 0x7f0d4806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:23.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.661+0000 7f0d5b7fe700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0d4806d4a0 0x7f0d4806f950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009b30 tx=0x7f0d4c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:23.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.666+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0d44059b50 con 0x7f0d5c0fcf80 2024-03-22T07:31:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:23 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:23 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:23 smithi195 ceph-mon[36144]: pgmap v5: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:23.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.902+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d5c111940 con 0x7f0d4806d4a0 2024-03-22T07:31:23.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.904+0000 7f0d58ff9700 1 -- 172.21.15.134:0/1733636390 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f0d5c111940 con 0x7f0d4806d4a0 2024-03-22T07:31:23.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0d4806d4a0 msgr2=0x7f0d4806f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0d4806d4a0 0x7f0d4806f950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009b30 tx=0x7f0d4c009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 msgr2=0x7f0d5c110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c110160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400eb40 tx=0x7f0d4400b040 comp rx=0 tx=0).stop 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 shutdown_connections 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0d4806d4a0 0x7f0d4806f950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0d5c0fbcd0 0x7f0d5c10fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 --2- 172.21.15.134:0/1733636390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d5c0fcf80 0x7f0d5c110160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.906+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 >> 172.21.15.134:0/1733636390 conn(0x7f0d5c0f7430 msgr2=0x7f0d5c065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.907+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 shutdown_connections 2024-03-22T07:31:23.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:23.907+0000 7f0d6206a700 1 -- 172.21.15.134:0/1733636390 wait complete. 2024-03-22T07:31:23.917 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 -- 172.21.15.134:0/1369299013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fcfa0 msgr2=0x7f5c540fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/1369299013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fcfa0 0x7f5c540fd410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5c48004940 tx=0x7f5c48009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 -- 172.21.15.134:0/1369299013 shutdown_connections 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/1369299013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fcfa0 0x7f5c540fd410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/1369299013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fbe30 0x7f5c540fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 -- 172.21.15.134:0/1369299013 >> 172.21.15.134:0/1369299013 conn(0x7f5c540f7480 msgr2=0x7f5c540f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:24.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 -- 172.21.15.134:0/1369299013 shutdown_connections 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.013+0000 7f5c59f0c700 1 -- 172.21.15.134:0/1369299013 wait complete. 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c59f0c700 1 Processor -- start 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c59f0c700 1 -- start start 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c59f0c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 0x7f5c5410c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c59f0c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fcfa0 0x7f5c5410ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c59f0c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5410d410 con 0x7f5c540fbe30 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c59f0c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5410dc10 con 0x7f5c540fcfa0 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c537fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 0x7f5c5410c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c537fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 0x7f5c5410c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49012/0 (socket says 172.21.15.134:49012) 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c537fe700 1 -- 172.21.15.134:0/260230743 learned_addr learned my addr 172.21.15.134:0/260230743 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:24.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.014+0000 7f5c52ffd700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fcfa0 0x7f5c5410ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c537fe700 1 -- 172.21.15.134:0/260230743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fcfa0 msgr2=0x7f5c5410ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c537fe700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fcfa0 0x7f5c5410ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c537fe700 1 -- 172.21.15.134:0/260230743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48005040 con 0x7f5c540fbe30 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c52ffd700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fcfa0 0x7f5c5410ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c537fe700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 0x7f5c5410c8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c44010d50 tx=0x7f5c4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4400ed60 con 0x7f5c540fbe30 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5410de90 con 0x7f5c540fbe30 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c440090d0 con 0x7f5c540fbe30 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c44012670 con 0x7f5c540fbe30 2024-03-22T07:31:24.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.015+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5410e3d0 con 0x7f5c540fbe30 2024-03-22T07:31:24.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.016+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5405f5f0 con 0x7f5c540fbe30 2024-03-22T07:31:24.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.017+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f5c44018030 con 0x7f5c540fbe30 2024-03-22T07:31:24.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.017+0000 7f5c3bfff700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f5c3c06d4a0 0x7f5c3c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.017+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5c44016070 con 0x7f5c540fbe30 2024-03-22T07:31:24.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.017+0000 7f5c52ffd700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f5c3c06d4a0 0x7f5c3c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.017+0000 7f5c52ffd700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f5c3c06d4a0 0x7f5c3c06f950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009b30 tx=0x7f5c48009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:24.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.022+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5c4405c4e0 con 0x7f5c540fbe30 2024-03-22T07:31:24.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.241+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c5410e770 con 0x7f5c3c06d4a0 2024-03-22T07:31:24.242 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.243+0000 7f5c3bfff700 1 -- 172.21.15.134:0/260230743 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f5c5410e770 con 0x7f5c3c06d4a0 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f5c3c06d4a0 msgr2=0x7f5c3c06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f5c3c06d4a0 0x7f5c3c06f950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009b30 tx=0x7f5c48009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 msgr2=0x7f5c5410c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 0x7f5c5410c8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c44010d50 tx=0x7f5c4400b040 comp rx=0 tx=0).stop 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 shutdown_connections 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f5c3c06d4a0 0x7f5c3c06f950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c540fbe30 0x7f5c5410c8d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 --2- 172.21.15.134:0/260230743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c540fcfa0 0x7f5c5410ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.245+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 >> 172.21.15.134:0/260230743 conn(0x7f5c540f7480 msgr2=0x7f5c540f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:24.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.246+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 shutdown_connections 2024-03-22T07:31:24.246 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.246+0000 7f5c59f0c700 1 -- 172.21.15.134:0/260230743 wait complete. 2024-03-22T07:31:24.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 -- 172.21.15.134:0/2667324764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 msgr2=0x7f555c0fe810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.349 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2667324764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c0fe810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5550004940 tx=0x7f5550009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 -- 172.21.15.134:0/2667324764 shutdown_connections 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2667324764 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f555c0fed50 0x7f555c0fae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2667324764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c0fe810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 -- 172.21.15.134:0/2667324764 >> 172.21.15.134:0/2667324764 conn(0x7f555c0f6ba0 msgr2=0x7f555c0f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 -- 172.21.15.134:0/2667324764 shutdown_connections 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 -- 172.21.15.134:0/2667324764 wait complete. 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 Processor -- start 2024-03-22T07:31:24.350 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.349+0000 7f5562bf7700 1 -- start start 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5562bf7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c10d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5562bf7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f555c0fed50 0x7f555c10dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5562bf7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c10e4c0 con 0x7f555c0fe400 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5562bf7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c10ed10 con 0x7f555c0fed50 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c10d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c10d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49034/0 (socket says 172.21.15.134:49034) 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 -- 172.21.15.134:0/2983611610 learned_addr learned my addr 172.21.15.134:0/2983611610 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f555bfff700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f555c0fed50 0x7f555c10dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 -- 172.21.15.134:0/2983611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f555c0fed50 msgr2=0x7f555c10dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.352 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f555c0fed50 0x7f555c10dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 -- 172.21.15.134:0/2983611610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550005040 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5560993700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c10d980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5550009150 tx=0x7f5550009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f555000e040 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f555000bbf0 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.350+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c10ef90 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.351+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f555001c630 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.351+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c10f4d0 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.352+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c05f5f0 con 0x7f555c0fe400 2024-03-22T07:31:24.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.352+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f555001c8f0 con 0x7f555c0fe400 2024-03-22T07:31:24.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.352+0000 7f55597fa700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f554c06d4a0 0x7f554c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.353+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f555008df80 con 0x7f555c0fe400 2024-03-22T07:31:24.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.353+0000 7f555bfff700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f554c06d4a0 0x7f554c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.353+0000 7f555bfff700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f554c06d4a0 0x7f554c06f950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5548009fd0 tx=0x7f5548009f60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:24.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.357+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f555005b3a0 con 0x7f555c0fe400 2024-03-22T07:31:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:24 smithi134 ceph-mon[93947]: mgrmap e38: smithi134.wtwqre(active, since 4s), standbys: smithi195.jxfsnc 2024-03-22T07:31:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.559 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:24 smithi195 ceph-mon[36144]: mgrmap e38: smithi134.wtwqre(active, since 4s), standbys: smithi195.jxfsnc 2024-03-22T07:31:24.559 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:24 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.559 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:24 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.560 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:24 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.560 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:24 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:24.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.574+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f555c10f800 con 0x7f554c06d4a0 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.586+0000 7f55597fa700 1 -- 172.21.15.134:0/2983611610 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f555c10f800 con 0x7f554c06d4a0 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (2m) 0s ago 10m 16.7M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (10m) 0s ago 10m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (9m) 2s ago 9m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (103s) 0s ago 10m 78.6M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (5m) 0s ago 5m 148M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (5m) 0s ago 5m 13.0M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:31:24.586 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (5m) 2s ago 5m 14.3M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (5m) 2s ago 5m 13.5M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (75s) 0s ago 12m 472M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (28s) 2s ago 9m 446M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (14s) 0s ago 12m 30.0M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (9m) 2s ago 9m 46.5M 2048M 17.2.7-726-g9c4e0c34 837124da804f 2f6420311d73 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 0s ago 10m 8066k - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (82s) 2s ago 9m 15.4M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (9m) 0s ago 9m 263M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (8m) 0s ago 8m 270M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (8m) 0s ago 8m 217M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (7m) 2s ago 7m 295M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (7m) 2s ago 7m 261M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (6m) 2s ago 6m 237M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:31:24.587 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (33s) 0s ago 10m 44.5M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.588+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f554c06d4a0 msgr2=0x7f554c06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.588+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f554c06d4a0 0x7f554c06f950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5548009fd0 tx=0x7f5548009f60 comp rx=0 tx=0).stop 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.588+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 msgr2=0x7f555c10d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.588+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c10d980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5550009150 tx=0x7f5550009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 shutdown_connections 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f554c06d4a0 0x7f554c06f950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f555c0fe400 0x7f555c10d980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 --2- 172.21.15.134:0/2983611610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f555c0fed50 0x7f555c10dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 >> 172.21.15.134:0/2983611610 conn(0x7f555c0f6ba0 msgr2=0x7f555c0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 shutdown_connections 2024-03-22T07:31:24.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.589+0000 7f5562bf7700 1 -- 172.21.15.134:0/2983611610 wait complete. 2024-03-22T07:31:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.693+0000 7f3d12df8700 1 -- 172.21.15.134:0/3825377761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 msgr2=0x7f3d0c0fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.693+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3825377761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c0fc0f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d00004940 tx=0x7f3d00009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.693+0000 7f3d12df8700 1 -- 172.21.15.134:0/3825377761 shutdown_connections 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.693+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3825377761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d0c0fcf90 0x7f3d0c0fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.693+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3825377761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c0fc0f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.693+0000 7f3d12df8700 1 -- 172.21.15.134:0/3825377761 >> 172.21.15.134:0/3825377761 conn(0x7f3d0c0f7440 msgr2=0x7f3d0c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 -- 172.21.15.134:0/3825377761 shutdown_connections 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 -- 172.21.15.134:0/3825377761 wait complete. 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 Processor -- start 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 -- start start 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c10d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d0c0fcf90 0x7f3d0c10df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c10e500 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.694+0000 7f3d12df8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c10ed50 con 0x7f3d0c0fcf90 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c10d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c10d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49046/0 (socket says 172.21.15.134:49046) 2024-03-22T07:31:24.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 -- 172.21.15.134:0/3282288442 learned_addr learned my addr 172.21.15.134:0/3282288442 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d0bfff700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d0c0fcf90 0x7f3d0c10df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 -- 172.21.15.134:0/3282288442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d0c0fcf90 msgr2=0x7f3d0c10df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d0c0fcf90 0x7f3d0c10df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 -- 172.21.15.134:0/3282288442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00005040 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d10b94700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c10d9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000b0d0 tx=0x7f3d00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0000e030 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d0001c400 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d0000b630 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c10efd0 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.695+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c10f510 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.697+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c101b20 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.697+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f3d0001c570 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.697+0000 7f3d097fa700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3cfc06d4a0 0x7f3cfc06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.698+0000 7f3d0bfff700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3cfc06d4a0 0x7f3cfc06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.698+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3d0008e380 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.698+0000 7f3d0bfff700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3cfc06d4a0 0x7f3cfc06f950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009b80 tx=0x7f3cf800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:24.702 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.702+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3d0005b840 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.982+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3d0c04bed0 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.982 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.982+0000 7f3d097fa700 1 -- 172.21.15.134:0/3282288442 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f3d0001c820 con 0x7f3d0c0fbce0 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:31:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 11, 2024-03-22T07:31:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 3 2024-03-22T07:31:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:31:24.984 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.985+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3cfc06d4a0 msgr2=0x7f3cfc06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.985+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3cfc06d4a0 0x7f3cfc06f950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009b80 tx=0x7f3cf800b040 comp rx=0 tx=0).stop 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.985+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 msgr2=0x7f3d0c10d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.985+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c10d9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000b0d0 tx=0x7f3d00009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 shutdown_connections 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3cfc06d4a0 0x7f3cfc06f950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d0c0fbce0 0x7f3d0c10d9c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 --2- 172.21.15.134:0/3282288442 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d0c0fcf90 0x7f3d0c10df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 >> 172.21.15.134:0/3282288442 conn(0x7f3d0c0f7440 msgr2=0x7f3d0c0663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 shutdown_connections 2024-03-22T07:31:24.986 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:24.986+0000 7f3d12df8700 1 -- 172.21.15.134:0/3282288442 wait complete. 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 -- 172.21.15.134:0/3802865760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 msgr2=0x7f7e8c0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3802865760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c0fd250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c004940 tx=0x7f7e7c009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 -- 172.21.15.134:0/3802865760 shutdown_connections 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3802865760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e8c0fe040 0x7f7e8c0fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3802865760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c0fd250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 -- 172.21.15.134:0/3802865760 >> 172.21.15.134:0/3802865760 conn(0x7f7e8c0f8550 msgr2=0x7f7e8c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 -- 172.21.15.134:0/3802865760 shutdown_connections 2024-03-22T07:31:25.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 -- 172.21.15.134:0/3802865760 wait complete. 2024-03-22T07:31:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 Processor -- start 2024-03-22T07:31:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.093+0000 7f7e91df8700 1 -- start start 2024-03-22T07:31:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e91df8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e91df8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e8c0fe040 0x7f7e8c10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e91df8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c10e4d0 con 0x7f7e8c0fce40 2024-03-22T07:31:25.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e91df8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c10e640 con 0x7f7e8c0fe040 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49066/0 (socket says 172.21.15.134:49066) 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 -- 172.21.15.134:0/3253824422 learned_addr learned my addr 172.21.15.134:0/3253824422 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 -- 172.21.15.134:0/3253824422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e8c0fe040 msgr2=0x7f7e8c10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e8c0fe040 0x7f7e8c10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 -- 172.21.15.134:0/3253824422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c005040 con 0x7f7e8c0fce40 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e8b7fe700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c10d990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b3b0 tx=0x7f7e7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e7c00e040 con 0x7f7e8c0fce40 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e7c00bcc0 con 0x7f7e8c0fce40 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c113040 con 0x7f7e8c0fce40 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c113600 con 0x7f7e8c0fce40 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.094+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e7c01c630 con 0x7f7e8c0fce40 2024-03-22T07:31:25.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.095+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c04c710 con 0x7f7e8c0fce40 2024-03-22T07:31:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.096+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f7e7c0139f0 con 0x7f7e8c0fce40 2024-03-22T07:31:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.096+0000 7f7e88ff9700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7e7806d4b0 0x7f7e7806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.096+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7e7c08d760 con 0x7f7e8c0fce40 2024-03-22T07:31:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.096+0000 7f7e83fff700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7e7806d4b0 0x7f7e7806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.097+0000 7f7e83fff700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7e7806d4b0 0x7f7e7806f960 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e74004d00 tx=0x7f7e74009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:25.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.101+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7e7c05ac20 con 0x7f7e8c0fce40 2024-03-22T07:31:25.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.343+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e8c113b30 con 0x7f7e8c0fce40 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.344+0000 7f7e88ff9700 1 -- 172.21.15.134:0/3253824422 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f7e7c05a7b0 con 0x7f7e8c0fce40 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:31:25.344 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:31:25.345 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:25.346 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:25.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7e7806d4b0 msgr2=0x7f7e7806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7e7806d4b0 0x7f7e7806f960 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e74004d00 tx=0x7f7e74009ce0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 msgr2=0x7f7e8c10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.347 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c10d990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00b3b0 tx=0x7f7e7c009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 shutdown_connections 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7e7806d4b0 0x7f7e7806f960 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e8c0fce40 0x7f7e8c10d990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 --2- 172.21.15.134:0/3253824422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e8c0fe040 0x7f7e8c10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 >> 172.21.15.134:0/3253824422 conn(0x7f7e8c0f8550 msgr2=0x7f7e8c0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 shutdown_connections 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.346+0000 7f7e91df8700 1 -- 172.21.15.134:0/3253824422 wait complete. 2024-03-22T07:31:25.348 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:31:25.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 -- 172.21.15.134:0/215676059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 msgr2=0x7f36b00fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 --2- 172.21.15.134:0/215676059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b00fd280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f36a0004940 tx=0x7f36a0009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 -- 172.21.15.134:0/215676059 shutdown_connections 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 --2- 172.21.15.134:0/215676059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36b00fdfe0 0x7f36b00fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 --2- 172.21.15.134:0/215676059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b00fd280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 -- 172.21.15.134:0/215676059 >> 172.21.15.134:0/215676059 conn(0x7f36b00f8550 msgr2=0x7f36b00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 -- 172.21.15.134:0/215676059 shutdown_connections 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.447+0000 7f36b6876700 1 -- 172.21.15.134:0/215676059 wait complete. 2024-03-22T07:31:25.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36b6876700 1 Processor -- start 2024-03-22T07:31:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36b6876700 1 -- start start 2024-03-22T07:31:25.449 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36b6876700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b010d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36b6876700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36b00fdfe0 0x7f36b010de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36b6876700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b010e490 con 0x7f36b00fce70 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36b6876700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b010e600 con 0x7f36b00fdfe0 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36affff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b010d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36affff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b010d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49084/0 (socket says 172.21.15.134:49084) 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36affff700 1 -- 172.21.15.134:0/1013559650 learned_addr learned my addr 172.21.15.134:0/1013559650 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.448+0000 7f36af7fe700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36b00fdfe0 0x7f36b010de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36affff700 1 -- 172.21.15.134:0/1013559650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36b00fdfe0 msgr2=0x7f36b010de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36affff700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36b00fdfe0 0x7f36b010de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36affff700 1 -- 172.21.15.134:0/1013559650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0005040 con 0x7f36b00fce70 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36affff700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b010d950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009150 tx=0x7f36a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a000e040 con 0x7f36b00fce70 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36a000bcc0 con 0x7f36b00fce70 2024-03-22T07:31:25.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b0113000 con 0x7f36b00fce70 2024-03-22T07:31:25.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a001c630 con 0x7f36b00fce70 2024-03-22T07:31:25.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.449+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b01135c0 con 0x7f36b00fce70 2024-03-22T07:31:25.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.450+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b004c710 con 0x7f36b00fce70 2024-03-22T07:31:25.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.450+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f36a0013420 con 0x7f36b00fce70 2024-03-22T07:31:25.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.451+0000 7f36acff9700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f369806d4b0 0x7f369806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.451+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f36a008d870 con 0x7f36b00fce70 2024-03-22T07:31:25.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.451+0000 7f36af7fe700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f369806d4b0 0x7f369806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.452 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.451+0000 7f36af7fe700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f369806d4b0 0x7f369806f960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36a4007fd0 tx=0x7f36a4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:25.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.456+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f36a005ac90 con 0x7f36b00fce70 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: pgmap v6: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3282288442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:25.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:25.581 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:25.581 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:25.581 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: pgmap v6: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:25.582 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:25.582 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3282288442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:25.582 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:25.582 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:25 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:25.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.681+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36b0102340 con 0x7f369806d4b0 2024-03-22T07:31:25.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.682+0000 7f36acff9700 1 -- 172.21.15.134:0/1013559650 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f36b0102340 con 0x7f369806d4b0 2024-03-22T07:31:25.682 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:31:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:31:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:31:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:31:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:31:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-03-22T07:31:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:31:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "3/21 daemons upgraded", 2024-03-22T07:31:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-03-22T07:31:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:31:25.683 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:31:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f369806d4b0 msgr2=0x7f369806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f369806d4b0 0x7f369806f960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36a4007fd0 tx=0x7f36a4009040 comp rx=0 tx=0).stop 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 msgr2=0x7f36b010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b010d950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009150 tx=0x7f36a0009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 shutdown_connections 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f369806d4b0 0x7f369806f960 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36b00fce70 0x7f36b010d950 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 --2- 172.21.15.134:0/1013559650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f36b00fdfe0 0x7f36b010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 >> 172.21.15.134:0/1013559650 conn(0x7f36b00f8550 msgr2=0x7f36b00f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 shutdown_connections 2024-03-22T07:31:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.684+0000 7f36b6876700 1 -- 172.21.15.134:0/1013559650 wait complete. 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.784+0000 7f76307fc700 1 -- 172.21.15.134:0/3994213618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fcf80 msgr2=0x7f76280fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.784+0000 7f76307fc700 1 --2- 172.21.15.134:0/3994213618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fcf80 0x7f76280fd3f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7618004940 tx=0x7f7618009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- 172.21.15.134:0/3994213618 shutdown_connections 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 --2- 172.21.15.134:0/3994213618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fcf80 0x7f76280fd3f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 --2- 172.21.15.134:0/3994213618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280fbcd0 0x7f76280fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- 172.21.15.134:0/3994213618 >> 172.21.15.134:0/3994213618 conn(0x7f76280f7450 msgr2=0x7f76280f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- 172.21.15.134:0/3994213618 shutdown_connections 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- 172.21.15.134:0/3994213618 wait complete. 2024-03-22T07:31:25.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 Processor -- start 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- start start 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 0x7f7628066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280fcf80 0x7f76281126a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7628112be0 con 0x7f76280fbcd0 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f76307fc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7628112d20 con 0x7f76280fcf80 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f762e598700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 0x7f7628066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f762e598700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 0x7f7628066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49108/0 (socket says 172.21.15.134:49108) 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.785+0000 7f762e598700 1 -- 172.21.15.134:0/2922998337 learned_addr learned my addr 172.21.15.134:0/2922998337 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f762dd97700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280fcf80 0x7f76281126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f762e598700 1 -- 172.21.15.134:0/2922998337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280fcf80 msgr2=0x7f76281126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f762e598700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280fcf80 0x7f76281126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f762e598700 1 -- 172.21.15.134:0/2922998337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618005040 con 0x7f76280fbcd0 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f762e598700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 0x7f7628066cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f762400eb40 tx=0x7f762400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:25.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7624007cc0 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7628112f50 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f762400f040 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762400c9b0 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.786+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7628113400 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.787+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762804c710 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.788+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f762400cc70 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.788+0000 7f761effd700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761406d4b0 0x7f761406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.788+0000 7f762dd97700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761406d4b0 0x7f761406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.788+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f762408c730 con 0x7f76280fbcd0 2024-03-22T07:31:25.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.788+0000 7f762dd97700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761406d4b0 0x7f761406f960 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f761800b0d0 tx=0x7f7618009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:25.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:25.792+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7624059b80 con 0x7f76280fbcd0 2024-03-22T07:31:26.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.064+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f76281135f0 con 0x7f76280fbcd0 2024-03-22T07:31:26.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.065+0000 7f761effd700 1 -- 172.21.15.134:0/2922998337 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7624059710 con 0x7f76280fbcd0 2024-03-22T07:31:26.065 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761406d4b0 msgr2=0x7f761406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761406d4b0 0x7f761406f960 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f761800b0d0 tx=0x7f7618009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 msgr2=0x7f7628066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 0x7f7628066cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f762400eb40 tx=0x7f762400b040 comp rx=0 tx=0).stop 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 shutdown_connections 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761406d4b0 0x7f761406f960 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76280fbcd0 0x7f7628066cf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:26.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 --2- 172.21.15.134:0/2922998337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280fcf80 0x7f76281126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:26.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 >> 172.21.15.134:0/2922998337 conn(0x7f76280f7450 msgr2=0x7f76280f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:26.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 shutdown_connections 2024-03-22T07:31:26.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:26.067+0000 7f76307fc700 1 -- 172.21.15.134:0/2922998337 wait complete. 2024-03-22T07:31:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:26 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/3253824422' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:31:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:26 smithi195 ceph-mon[36144]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:26 smithi195 ceph-mon[36144]: from='client.? 172.21.15.134:0/2922998337' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:31:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:26 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3253824422' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:31:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:26 smithi134 ceph-mon[93947]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:26 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2922998337' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:31:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:27 smithi134 ceph-mon[93947]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-22T07:31:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:31:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:27 smithi195 ceph-mon[36144]: pgmap v7: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-22T07:31:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:27 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:27 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:27 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:27.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:27 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:31:28.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:31:28.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:31:28.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:28.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:28 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.conf 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: Updating smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.587 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.588 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:28.588 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:28.588 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:28.588 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:28 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-22T07:31:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:29 smithi134 ceph-mon[93947]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-22T07:31:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:29 smithi195 ceph-mon[36144]: pgmap v8: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-22T07:31:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:30 smithi195 ceph-mon[36144]: Upgrade: Updating mon.smithi195 2024-03-22T07:31:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:30 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:30 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:30 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:30 smithi195 ceph-mon[36144]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:30.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:30 smithi195 ceph-mon[36144]: Deploying daemon mon.smithi195 on smithi195 2024-03-22T07:31:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:30 smithi134 ceph-mon[93947]: Upgrade: Updating mon.smithi195 2024-03-22T07:31:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:30 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:30 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:30.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:30 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:30.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:30 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:30.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:30 smithi134 ceph-mon[93947]: Deploying daemon mon.smithi195 on smithi195 2024-03-22T07:31:31.604 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:31:31.604 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 ceph-mon[36144]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-22T07:31:31.604 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195[36138]: 2024-03-22T07:31:31.562+0000 7f4ecb99f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:31:31.604 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195[36138]: 2024-03-22T07:31:31.562+0000 7f4ecb99f700 -1 mon.smithi195@1(peon) e2 *** Got Signal Terminated *** 2024-03-22T07:31:31.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:31 smithi134 ceph-mon[93947]: pgmap v9: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-22T07:31:31.906 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 podman[81898]: 2024-03-22 07:31:31.604563151 +0000 UTC m=+0.127325568 container died 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=quincy-9c4e0c3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:31:32.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 podman[81898]: 2024-03-22 07:31:31.932369675 +0000 UTC m=+0.455132046 container cleanup 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9c4e0c3, ceph=True, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-22T07:31:32.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:31 smithi195 bash[81898]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195 2024-03-22T07:31:32.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 podman[81911]: 2024-03-22 07:31:32.114833497 +0000 UTC m=+0.503668064 container remove 2f6420311d73ba75468ba435e1d56fd4fb836fe3ccb08d888a939418c2086194 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9c4e0c3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:31:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195.service: Deactivated successfully. 2024-03-22T07:31:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 systemd[1]: Stopped Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:31:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195.service: Consumed 5.994s CPU time. 2024-03-22T07:31:32.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 systemd[1]: Starting Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:31:33.011 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 podman[82042]: 2024-03-22 07:31:32.648210996 +0000 UTC m=+0.017476817 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:31:33.011 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:32 smithi195 podman[82042]: 2024-03-22 07:31:32.766404703 +0000 UTC m=+0.135670517 container create 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b) 2024-03-22T07:31:33.011 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 podman[82042]: 2024-03-22 07:31:33.011347181 +0000 UTC m=+0.380613008 container init 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 podman[82042]: 2024-03-22 07:31:33.014913195 +0000 UTC m=+0.384179012 container start 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: set uid:gid to 167:167 (ceph:ceph) 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev), process ceph-mon, pid 2 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: pidfile_write: ignore empty --pid-file 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: load: jerasure load: lrc 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: RocksDB version: 7.9.2 2024-03-22T07:31:33.346 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Git sha 0 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Compile date 2024-03-16 10:36:11 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: DB SUMMARY 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: DB Session ID: I52P9TAUF43KKGMPMDMG 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: CURRENT file: CURRENT 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: IDENTITY file: IDENTITY 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1084 Bytes 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi195/store.db dir, Total Num: 1, files: 000027.sst 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi195/store.db: 000025.log size: 246788 ; 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.error_if_exists: 0 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.create_if_missing: 0 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.paranoid_checks: 1 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-22T07:31:33.347 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.env: 0x558a534d8ae0 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.fs: PosixFileSystem 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.info_log: 0x558a54d7d760 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_file_opening_threads: 16 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.statistics: (nil) 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.use_fsync: 0 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_log_file_size: 0 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.keep_log_file_num: 1000 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.recycle_log_file_num: 0 2024-03-22T07:31:33.348 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.allow_fallocate: 1 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.allow_mmap_reads: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.allow_mmap_writes: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.use_direct_reads: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.create_missing_column_families: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.db_log_dir: 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.wal_dir: 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-22T07:31:33.350 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.advise_random_on_open: 1 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.db_write_buffer_size: 0 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.write_buffer_manager: 0x558a54d51400 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.rate_limiter: (nil) 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.wal_recovery_mode: 2 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.enable_thread_tracking: 0 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.enable_pipelined_write: 0 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.unordered_write: 0 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-22T07:31:33.351 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.row_cache: None 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.wal_filter: None 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.allow_ingest_behind: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.two_write_queues: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.manual_wal_flush: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.wal_compression: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.atomic_flush: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.log_readahead_size: 0 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-22T07:31:33.352 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.best_efforts_recovery: 0 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.allow_data_in_errors: 0 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.db_host_id: __hostname__ 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_background_jobs: 2 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_background_compactions: -1 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_subcompactions: 1 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_total_wal_size: 0 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-22T07:31:33.353 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_open_files: -1 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bytes_per_sync: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_readahead_size: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_background_flushes: -1 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Compression algorithms supported: 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kZSTD supported: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kXpressCompression supported: 0 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kLZ4HCCompression supported: 1 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kZlibCompression supported: 1 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kSnappyCompression supported: 1 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kLZ4Compression supported: 1 2024-03-22T07:31:33.354 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: kBZip2Compression supported: 0 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000009 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.merge_operator: 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_filter: None 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_filter_factory: None 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.sst_partitioner_factory: None 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-22T07:31:33.355 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558a54d7d880) 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks: 1 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: pin_top_level_index_and_filter: 1 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_type: 0 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_index_type: 0 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_shortening: 1 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: checksum: 4 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: no_block_cache: 0 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache: 0x558a54d81090 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_name: BinnedLRUCache 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_options: 2024-03-22T07:31:33.356 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: capacity : 536870912 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_shard_bits : 4 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: strict_capacity_limit : 0 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: high_pri_pool_ratio: 0.000 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_cache_compressed: (nil) 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: persistent_cache: (nil) 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size: 4096 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_size_deviation: 10 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_restart_interval: 16 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: index_block_restart_interval: 1 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_block_size: 4096 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: partition_filters: 0 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: use_delta_encoding: 1 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: filter_policy: bloomfilter 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: whole_key_filtering: 1 2024-03-22T07:31:33.357 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: verify_compression: 0 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: read_amp_bytes_per_bit: 0 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: format_version: 5 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_index_compression: 1 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: block_align: 0 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_auto_readahead_size: 262144 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: prepopulate_block_cache: 0 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: initial_auto_readahead_size: 8192 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.write_buffer_size: 33554432 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_write_buffer_number: 2 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression: NoCompression 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression: Disabled 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.prefix_extractor: nullptr 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-22T07:31:33.358 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.num_levels: 7 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-22T07:31:33.359 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.level: 32767 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.strategy: 0 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.enabled: false 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.target_file_size_base: 67108864 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-22T07:31:33.360 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.arena_block_size: 1048576 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-22T07:31:33.361 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.disable_auto_compactions: 0 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.table_properties_collectors: 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.inplace_update_support: 0 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-22T07:31:33.362 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.bloom_locality: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.max_successive_merges: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.paranoid_file_checks: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.force_consistency_checks: 1 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.report_bg_io_stats: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.ttl: 2592000 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.enable_blob_files: false 2024-03-22T07:31:33.363 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.min_blob_size: 0 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.blob_file_size: 268435456 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.blob_file_starting_level: 0 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi195/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12298, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7fcb5c71-6c82-4c4b-9e02-cc547623cba6 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092693044117, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-03-22T07:31:33.364 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092693045478, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 164204, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12303, "largest_seqno": 12437, "table_properties": {"data_size": 162551, "index_size": 449, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1928, "raw_average_key_size": 26, "raw_value_size": 160824, "raw_average_value_size": 2203, "num_data_blocks": 18, "num_entries": 73, "num_filter_entries": 73, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711092693, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7fcb5c71-6c82-4c4b-9e02-cc547623cba6", "db_session_id": "I52P9TAUF43KKGMPMDMG", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711092693045557, "job": 1, "event": "recovery_finished"} 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi195/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558a54e70000 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: DB pointer 0x558a54e5c000 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** DB Stats ** 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-22T07:31:33.365 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L0 1/0 160.36 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 178.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: L6 1/0 7.98 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Sum 2/0 8.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 178.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 178.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** Compaction Stats [default] ** 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-22T07:31:33.366 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 178.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Cumulative compaction: 0.00 GB write, 47.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Interval compaction: 0.00 GB write, 47.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache BinnedLRUCache@0x558a54d81090#2 capacity: 512.00 MB usage: 0.78 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-03-22T07:31:33.367 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.23 KB,4.47035e-05%) IndexBlock(1,0.55 KB,0.000104308%) Misc(1,0.00 KB,0%) 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: starting mon.smithi195 rank 1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi195 fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???) e2 preinit fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).mds e14 new map 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).mds e14 print_map 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: e14 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: legacy client fscid: 1 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Filesystem 'cephfs' (1) 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: fs_name cephfs 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: epoch 14 2024-03-22T07:31:33.368 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: tableserver 0 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: root 0 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_timeout 60 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: session_autoclose 300 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_file_size 1099511627776 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_xattr_size 65536 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: required_client_features {} 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure 0 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: last_failure_osd_epoch 47 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: max_mds 1 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: in 0 2024-03-22T07:31:33.369 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: up {0=14474} 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: failed 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: damaged 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: stopped 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: data_pools [3] 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: metadata_pool 2 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: inline_data disabled 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: balancer 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: bal_rank_mask -1 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: standby_count_wanted 1 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: Standby daemons: 2024-03-22T07:31:33.370 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout: [mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 ceph-mon[82061]: mon.smithi195@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 bash[82042]: 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 2024-03-22T07:31:33.371 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:33 smithi195 systemd[1]: Started Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:31:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-22T07:31:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:31:35.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: mon.smithi134 calling monitor election 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: mon.smithi195 calling monitor election 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: mon.smithi134 is new leader, mons smithi134,smithi195 in quorum (ranks 0,1) 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: monmap e3: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: osdmap e50: 6 total, 6 up, 6 in 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: mgrmap e38: smithi134.wtwqre(active, since 16s), standbys: smithi195.jxfsnc 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: overall HEALTH_OK 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:35.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: pgmap v11: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: mon.smithi134 calling monitor election 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: mon.smithi195 calling monitor election 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mon metadata", "id": "smithi195"}]: dispatch 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: mon.smithi134 is new leader, mons smithi134,smithi195 in quorum (ranks 0,1) 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: monmap e3: 2 mons at {smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],smithi195=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: osdmap e50: 6 total, 6 up, 6 in 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: mgrmap e38: smithi134.wtwqre(active, since 16s), standbys: smithi195.jxfsnc 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: overall HEALTH_OK 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:31:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:37 smithi195 ceph-mon[82061]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-22T07:31:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:37 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:37 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:37 smithi134 ceph-mon[93947]: pgmap v12: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-22T07:31:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:37 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:37 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:39 smithi195 ceph-mon[82061]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:39 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:39 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:40.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:39 smithi134 ceph-mon[93947]: pgmap v13: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:40.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:39 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:40.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:39 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:41.909 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:41 smithi195 ceph-mon[82061]: pgmap v14: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:42.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:41 smithi134 ceph-mon[93947]: pgmap v14: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:43.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:43.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:43.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:43.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:31:43.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:43.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: Reconfiguring mon.smithi134 (monmap changed)... 2024-03-22T07:31:43.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:43.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:43.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:43.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: Reconfiguring daemon mon.smithi134 on smithi134 2024-03-22T07:31:43.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:42 smithi134 ceph-mon[93947]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: Reconfiguring mon.smithi134 (monmap changed)... 2024-03-22T07:31:43.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:43.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:43.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:43.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: Reconfiguring daemon mon.smithi134 on smithi134 2024-03-22T07:31:43.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:42 smithi195 ceph-mon[82061]: pgmap v15: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: Reconfiguring mgr.smithi134.wtwqre (monmap changed)... 2024-03-22T07:31:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:31:45.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:31:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: Reconfiguring daemon mgr.smithi134.wtwqre on smithi134 2024-03-22T07:31:45.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:44 smithi134 ceph-mon[93947]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: Reconfiguring mgr.smithi134.wtwqre (monmap changed)... 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.wtwqre", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:45.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: Reconfiguring daemon mgr.smithi134.wtwqre on smithi134 2024-03-22T07:31:45.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:44 smithi195 ceph-mon[82061]: pgmap v16: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:46.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:46 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:46.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:46 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:46.693 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:46 smithi134 ceph-mon[93947]: Reconfiguring crash.smithi134 (monmap changed)... 2024-03-22T07:31:46.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:46 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:31:46.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:46 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:46.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:46 smithi134 ceph-mon[93947]: Reconfiguring daemon crash.smithi134 on smithi134 2024-03-22T07:31:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:46 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:46 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:46 smithi195 ceph-mon[82061]: Reconfiguring crash.smithi134 (monmap changed)... 2024-03-22T07:31:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:46 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:31:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:46 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:46 smithi195 ceph-mon[82061]: Reconfiguring daemon crash.smithi134 on smithi134 2024-03-22T07:31:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:47 smithi134 ceph-mon[93947]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:47 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:47 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:47 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-22T07:31:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:47 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:47 smithi195 ceph-mon[82061]: pgmap v17: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:47 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:47 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:47 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-22T07:31:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:47 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:48 smithi134 ceph-mon[93947]: Reconfiguring osd.0 (monmap changed)... 2024-03-22T07:31:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:48 smithi134 ceph-mon[93947]: Reconfiguring daemon osd.0 on smithi134 2024-03-22T07:31:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:48 smithi195 ceph-mon[82061]: Reconfiguring osd.0 (monmap changed)... 2024-03-22T07:31:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:48 smithi195 ceph-mon[82061]: Reconfiguring daemon osd.0 on smithi134 2024-03-22T07:31:49.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:49 smithi134 ceph-mon[93947]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:49.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:31:49.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:49.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:49.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-22T07:31:49.687 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:49 smithi195 ceph-mon[82061]: pgmap v18: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:31:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-22T07:31:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:50 smithi134 ceph-mon[93947]: Reconfiguring osd.1 (monmap changed)... 2024-03-22T07:31:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:50 smithi134 ceph-mon[93947]: Reconfiguring daemon osd.1 on smithi134 2024-03-22T07:31:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:50 smithi195 ceph-mon[82061]: Reconfiguring osd.1 (monmap changed)... 2024-03-22T07:31:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:50 smithi195 ceph-mon[82061]: Reconfiguring daemon osd.1 on smithi134 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: Reconfiguring osd.2 (monmap changed)... 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:51 smithi134 ceph-mon[93947]: Reconfiguring daemon osd.2 on smithi134 2024-03-22T07:31:51.856 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: pgmap v19: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:51.856 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:51.856 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:51.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: Reconfiguring osd.2 (monmap changed)... 2024-03-22T07:31:51.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-22T07:31:51.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:51.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:51 smithi195 ceph-mon[82061]: Reconfiguring daemon osd.2 on smithi134 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: Reconfiguring mds.cephfs.smithi134.yxdtlb (monmap changed)... 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: Reconfiguring daemon mds.cephfs.smithi134.yxdtlb on smithi134 2024-03-22T07:31:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:53 smithi195 ceph-mon[82061]: pgmap v20: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: Reconfiguring mds.cephfs.smithi134.yxdtlb (monmap changed)... 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: Reconfiguring daemon mds.cephfs.smithi134.yxdtlb on smithi134 2024-03-22T07:31:53.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:53 smithi134 ceph-mon[93947]: pgmap v20: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: Reconfiguring mds.cephfs.smithi134.dexlss (monmap changed)... 2024-03-22T07:31:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:31:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:55.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: Reconfiguring daemon mds.cephfs.smithi134.dexlss on smithi134 2024-03-22T07:31:55.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:54 smithi195 ceph-mon[82061]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: Reconfiguring mds.cephfs.smithi134.dexlss (monmap changed)... 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: Reconfiguring daemon mds.cephfs.smithi134.dexlss on smithi134 2024-03-22T07:31:55.254 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:54 smithi134 ceph-mon[93947]: pgmap v21: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:56.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.178+0000 7f3b776cb700 1 -- 172.21.15.134:0/904458345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 msgr2=0x7f3b700fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.178+0000 7f3b776cb700 1 --2- 172.21.15.134:0/904458345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b700fe450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b60004940 tx=0x7f3b60009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:56.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.178+0000 7f3b776cb700 1 -- 172.21.15.134:0/904458345 shutdown_connections 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.178+0000 7f3b776cb700 1 --2- 172.21.15.134:0/904458345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b700fe450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.178+0000 7f3b776cb700 1 --2- 172.21.15.134:0/904458345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b700fce70 0x7f3b700fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.178+0000 7f3b776cb700 1 -- 172.21.15.134:0/904458345 >> 172.21.15.134:0/904458345 conn(0x7f3b700f8550 msgr2=0x7f3b700fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 -- 172.21.15.134:0/904458345 shutdown_connections 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 -- 172.21.15.134:0/904458345 wait complete. 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 Processor -- start 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 -- start start 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b700fce70 0x7f3b7010d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b7010de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7010e410 con 0x7f3b700fdfe0 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b776cb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7010e580 con 0x7f3b700fce70 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b74c66700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b7010de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b74c66700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b7010de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47250/0 (socket says 172.21.15.134:47250) 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.179+0000 7f3b74c66700 1 -- 172.21.15.134:0/2688795832 learned_addr learned my addr 172.21.15.134:0/2688795832 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b75467700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b700fce70 0x7f3b7010d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b74c66700 1 -- 172.21.15.134:0/2688795832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b700fce70 msgr2=0x7f3b7010d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b74c66700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b700fce70 0x7f3b7010d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b74c66700 1 -- 172.21.15.134:0/2688795832 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60005040 con 0x7f3b700fdfe0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b74c66700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b7010de10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000b3b0 tx=0x7f3b60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6000e040 con 0x7f3b700fdfe0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b6000bbf0 con 0x7f3b700fdfe0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6001c630 con 0x7f3b700fdfe0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b70112f80 con 0x7f3b700fdfe0 2024-03-22T07:31:56.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.180+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b70113510 con 0x7f3b700fdfe0 2024-03-22T07:31:56.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.181+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7004c710 con 0x7f3b700fdfe0 2024-03-22T07:31:56.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.182+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f3b6000bd60 con 0x7f3b700fdfe0 2024-03-22T07:31:56.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.182+0000 7f3b65ffb700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b5c06d4b0 0x7f3b5c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.182+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3b6008d660 con 0x7f3b700fdfe0 2024-03-22T07:31:56.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.182+0000 7f3b75467700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b5c06d4b0 0x7f3b5c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.183+0000 7f3b75467700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b5c06d4b0 0x7f3b5c06f960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009fd0 tx=0x7f3b6c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:56.187 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.187+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3b6005ab20 con 0x7f3b700fdfe0 2024-03-22T07:31:56.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.397+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b701022b0 con 0x7f3b5c06d4b0 2024-03-22T07:31:56.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.398+0000 7f3b65ffb700 1 -- 172.21.15.134:0/2688795832 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f3b701022b0 con 0x7f3b5c06d4b0 2024-03-22T07:31:56.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b5c06d4b0 msgr2=0x7f3b5c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b5c06d4b0 0x7f3b5c06f960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009fd0 tx=0x7f3b6c00b040 comp rx=0 tx=0).stop 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 msgr2=0x7f3b7010de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b7010de10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000b3b0 tx=0x7f3b60009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 shutdown_connections 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b5c06d4b0 0x7f3b5c06f960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b700fce70 0x7f3b7010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 --2- 172.21.15.134:0/2688795832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b700fdfe0 0x7f3b7010de10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 >> 172.21.15.134:0/2688795832 conn(0x7f3b700f8550 msgr2=0x7f3b700f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 shutdown_connections 2024-03-22T07:31:56.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.400+0000 7f3b776cb700 1 -- 172.21.15.134:0/2688795832 wait complete. 2024-03-22T07:31:56.411 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:31:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.502+0000 7f231f557700 1 -- 172.21.15.134:0/1517577979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fcf90 msgr2=0x7f23180fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.502+0000 7f231f557700 1 --2- 172.21.15.134:0/1517577979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fcf90 0x7f23180fd400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2308004940 tx=0x7f2308009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.502+0000 7f231f557700 1 -- 172.21.15.134:0/1517577979 shutdown_connections 2024-03-22T07:31:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.502+0000 7f231f557700 1 --2- 172.21.15.134:0/1517577979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fcf90 0x7f23180fd400 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.502+0000 7f231f557700 1 --2- 172.21.15.134:0/1517577979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23180fbce0 0x7f23180fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.502+0000 7f231f557700 1 -- 172.21.15.134:0/1517577979 >> 172.21.15.134:0/1517577979 conn(0x7f23180f7440 msgr2=0x7f23180f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 -- 172.21.15.134:0/1517577979 shutdown_connections 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 -- 172.21.15.134:0/1517577979 wait complete. 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 Processor -- start 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 -- start start 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 0x7f231810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23180fcf90 0x7f231810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231810e600 con 0x7f23180fbce0 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231f557700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231810ee00 con 0x7f23180fcf90 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231d2f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 0x7f231810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231d2f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 0x7f231810dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47266/0 (socket says 172.21.15.134:47266) 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231d2f3700 1 -- 172.21.15.134:0/1050431138 learned_addr learned my addr 172.21.15.134:0/1050431138 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.503+0000 7f231caf2700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23180fcf90 0x7f231810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f231d2f3700 1 -- 172.21.15.134:0/1050431138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23180fcf90 msgr2=0x7f231810e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f231d2f3700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23180fcf90 0x7f231810e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f231d2f3700 1 -- 172.21.15.134:0/1050431138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308005040 con 0x7f23180fbce0 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f231d2f3700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 0x7f231810dac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2314002a50 tx=0x7f23140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2314007cc0 con 0x7f23180fbce0 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231810f0e0 con 0x7f23180fbce0 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f231400f040 con 0x7f23180fbce0 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231400da30 con 0x7f23180fbce0 2024-03-22T07:31:56.506 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.504+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231810f620 con 0x7f23180fbce0 2024-03-22T07:31:56.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.505+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318101b20 con 0x7f23180fbce0 2024-03-22T07:31:56.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.506+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f231400db90 con 0x7f23180fbce0 2024-03-22T07:31:56.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.506+0000 7f230dffb700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f230406d4a0 0x7f230406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.506+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f231408c820 con 0x7f23180fbce0 2024-03-22T07:31:56.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.506+0000 7f231caf2700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f230406d4a0 0x7f230406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.507+0000 7f231caf2700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f230406d4a0 0x7f230406f950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f230800b970 tx=0x7f2308009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:56.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.511+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2314059c40 con 0x7f23180fbce0 2024-03-22T07:31:56.723 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.723+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f231810f890 con 0x7f230406d4a0 2024-03-22T07:31:56.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.724+0000 7f230dffb700 1 -- 172.21.15.134:0/1050431138 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f231810f890 con 0x7f230406d4a0 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f230406d4a0 msgr2=0x7f230406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f230406d4a0 0x7f230406f950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f230800b970 tx=0x7f2308009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 msgr2=0x7f231810dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 0x7f231810dac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2314002a50 tx=0x7f23140046b0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 shutdown_connections 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f230406d4a0 0x7f230406f950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23180fbce0 0x7f231810dac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 --2- 172.21.15.134:0/1050431138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23180fcf90 0x7f231810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 >> 172.21.15.134:0/1050431138 conn(0x7f23180f7440 msgr2=0x7f23180664c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:56.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 shutdown_connections 2024-03-22T07:31:56.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.727+0000 7f231f557700 1 -- 172.21.15.134:0/1050431138 wait complete. 2024-03-22T07:31:56.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- 172.21.15.134:0/2954644018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0feda0 msgr2=0x7fbbac0faee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 --2- 172.21.15.134:0/2954644018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0feda0 0x7fbbac0faee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbba0004940 tx=0x7fbba0009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- 172.21.15.134:0/2954644018 shutdown_connections 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 --2- 172.21.15.134:0/2954644018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0feda0 0x7fbbac0faee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 --2- 172.21.15.134:0/2954644018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbac0fe450 0x7fbbac0fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- 172.21.15.134:0/2954644018 >> 172.21.15.134:0/2954644018 conn(0x7fbbac0f6c10 msgr2=0x7fbbac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- 172.21.15.134:0/2954644018 shutdown_connections 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- 172.21.15.134:0/2954644018 wait complete. 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 Processor -- start 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- start start 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 0x7fbbac10d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbac0feda0 0x7fbbac10de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac10e480 con 0x7fbbac0fe450 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.830+0000 7fbbb2285700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac10e5f0 con 0x7fbbac0feda0 2024-03-22T07:31:56.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 0x7fbbac10d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 0x7fbbac10d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47286/0 (socket says 172.21.15.134:47286) 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 -- 172.21.15.134:0/3562429745 learned_addr learned my addr 172.21.15.134:0/3562429745 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbab7fe700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbac0feda0 0x7fbbac10de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 -- 172.21.15.134:0/3562429745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbac0feda0 msgr2=0x7fbbac10de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbac0feda0 0x7fbbac10de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 -- 172.21.15.134:0/3562429745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0005040 con 0x7fbbac0fe450 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbabfff700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 0x7fbbac10d940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c002a50 tx=0x7fbb9c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb9c007cc0 con 0x7fbbac0fe450 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb9c00f040 con 0x7fbbac0fe450 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac112ff0 con 0x7fbbac0fe450 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb9c00da70 con 0x7fbbac0fe450 2024-03-22T07:31:56.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.831+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac113580 con 0x7fbbac0fe450 2024-03-22T07:31:56.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.832+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac04c710 con 0x7fbbac0fe450 2024-03-22T07:31:56.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.833+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7fbb9c00dc10 con 0x7fbbac0fe450 2024-03-22T07:31:56.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.833+0000 7fbba8ff9700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb9406d4b0 0x7fbb9406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.833+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbb9c08c1e0 con 0x7fbbac0fe450 2024-03-22T07:31:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.833+0000 7fbbab7fe700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb9406d4b0 0x7fbb9406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:56.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.833+0000 7fbbab7fe700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb9406d4b0 0x7fbb9406f960 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbba000b970 tx=0x7fbba0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:56.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:56.838+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbb9c059580 con 0x7fbbac0fe450 2024-03-22T07:31:57.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.037+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbac102520 con 0x7fbb9406d4b0 2024-03-22T07:31:57.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:57.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:57.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: Reconfiguring crash.smithi195 (monmap changed)... 2024-03-22T07:31:57.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:31:57.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:57.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: Reconfiguring daemon crash.smithi195 on smithi195 2024-03-22T07:31:57.038 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:57.038 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:56 smithi134 ceph-mon[93947]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:57.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.047+0000 7fbba8ff9700 1 -- 172.21.15.134:0/3562429745 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbbac102520 con 0x7fbb9406d4b0 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (2m) 33s ago 11m 16.7M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (11m) 33s ago 11m 6656k - 17.2.7-726-g9c4e0c34 837124da804f 4bc5be241738 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (10m) 19s ago 10m 6660k - 17.2.7-726-g9c4e0c34 837124da804f d511b4d9131b 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (2m) 33s ago 10m 78.6M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (5m) 33s ago 5m 148M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (5m) 33s ago 5m 13.0M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (5m) 19s ago 5m 14.5M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (5m) 19s ago 5m 13.8M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (107s) 33s ago 12m 472M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (60s) 19s ago 10m 447M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:31:57.047 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (47s) 33s ago 12m 30.0M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (24s) 19s ago 10m 18.6M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 33s ago 11m 8066k - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (114s) 19s ago 10m 15.0M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (9m) 33s ago 9m 263M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (9m) 33s ago 9m 270M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (8m) 33s ago 8m 217M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (8m) 19s ago 8m 296M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (7m) 19s ago 7m 262M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (7m) 19s ago 7m 237M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:31:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (66s) 33s ago 10m 44.5M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:31:57.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb9406d4b0 msgr2=0x7fbb9406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb9406d4b0 0x7fbb9406f960 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbba000b970 tx=0x7fbba0009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:57.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 msgr2=0x7fbbac10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 0x7fbbac10d940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c002a50 tx=0x7fbb9c0046b0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 shutdown_connections 2024-03-22T07:31:57.049 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb9406d4b0 0x7fbb9406f960 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbac0fe450 0x7fbbac10d940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 --2- 172.21.15.134:0/3562429745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbac0feda0 0x7fbbac10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 >> 172.21.15.134:0/3562429745 conn(0x7fbbac0f6c10 msgr2=0x7fbbac0f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:57.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 shutdown_connections 2024-03-22T07:31:57.050 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.049+0000 7fbbb2285700 1 -- 172.21.15.134:0/3562429745 wait complete. 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 -- 172.21.15.134:0/74573335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fdfe0 msgr2=0x7fd5340fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 --2- 172.21.15.134:0/74573335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fdfe0 0x7fd5340fe450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd51c004940 tx=0x7fd51c009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 -- 172.21.15.134:0/74573335 shutdown_connections 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 --2- 172.21.15.134:0/74573335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fdfe0 0x7fd5340fe450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 --2- 172.21.15.134:0/74573335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340fce70 0x7fd5340fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 -- 172.21.15.134:0/74573335 >> 172.21.15.134:0/74573335 conn(0x7fd5340f8550 msgr2=0x7fd5340fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 -- 172.21.15.134:0/74573335 shutdown_connections 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 -- 172.21.15.134:0/74573335 wait complete. 2024-03-22T07:31:57.150 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 Processor -- start 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.148+0000 7fd5391a8700 1 -- start start 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd5391a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 0x7fd53410d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd5391a8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340fdfe0 0x7fd53410ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd5391a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53410e3d0 con 0x7fd5340fce70 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd5391a8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53410e540 con 0x7fd5340fdfe0 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 0x7fd53410d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 0x7fd53410d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47318/0 (socket says 172.21.15.134:47318) 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 -- 172.21.15.134:0/2713946728 learned_addr learned my addr 172.21.15.134:0/2713946728 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd52bfff700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340fdfe0 0x7fd53410ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 -- 172.21.15.134:0/2713946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340fdfe0 msgr2=0x7fd53410ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340fdfe0 0x7fd53410ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 -- 172.21.15.134:0/2713946728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c005040 con 0x7fd5340fce70 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd532d9d700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 0x7fd53410d890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd52400eb40 tx=0x7fd52400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd524007cc0 con 0x7fd5340fce70 2024-03-22T07:31:57.151 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd52400f040 con 0x7fd5340fce70 2024-03-22T07:31:57.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd534112f40 con 0x7fd5340fce70 2024-03-22T07:31:57.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd52400ca10 con 0x7fd5340fce70 2024-03-22T07:31:57.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.149+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5341133f0 con 0x7fd5340fce70 2024-03-22T07:31:57.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.150+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53404c710 con 0x7fd5340fce70 2024-03-22T07:31:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.151+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7fd52400cc80 con 0x7fd5340fce70 2024-03-22T07:31:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.151+0000 7fd52b7fe700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd52006d4b0 0x7fd52006f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.151+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd52408c750 con 0x7fd5340fce70 2024-03-22T07:31:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.151+0000 7fd52bfff700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd52006d4b0 0x7fd52006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.153 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.152+0000 7fd52bfff700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd52006d4b0 0x7fd52006f960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009b30 tx=0x7fd51c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:57.156 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.156+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd524059ba0 con 0x7fd5340fce70 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: Reconfiguring crash.smithi195 (monmap changed)... 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: Reconfiguring daemon crash.smithi195 on smithi195 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:56 smithi195 ceph-mon[82061]: pgmap v22: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.430+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd534113920 con 0x7fd5340fce70 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.431+0000 7fd52b7fe700 1 -- 172.21.15.134:0/2713946728 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fd524059730 con 0x7fd5340fce70 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:57.431 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 10, 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:31:57.432 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:31:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd52006d4b0 msgr2=0x7fd52006f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd52006d4b0 0x7fd52006f960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009b30 tx=0x7fd51c009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 msgr2=0x7fd53410d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 0x7fd53410d890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd52400eb40 tx=0x7fd52400b040 comp rx=0 tx=0).stop 2024-03-22T07:31:57.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 shutdown_connections 2024-03-22T07:31:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd52006d4b0 0x7fd52006f960 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5340fce70 0x7fd53410d890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 --2- 172.21.15.134:0/2713946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5340fdfe0 0x7fd53410ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 >> 172.21.15.134:0/2713946728 conn(0x7fd5340f8550 msgr2=0x7fd5340f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 shutdown_connections 2024-03-22T07:31:57.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.433+0000 7fd5391a8700 1 -- 172.21.15.134:0/2713946728 wait complete. 2024-03-22T07:31:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 -- 172.21.15.134:0/1742674931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 msgr2=0x7fc1540ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 --2- 172.21.15.134:0/1742674931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc1540ffa50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009ce0 tx=0x7fc14c004d10 comp rx=0 tx=0).stop 2024-03-22T07:31:57.537 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 -- 172.21.15.134:0/1742674931 shutdown_connections 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 --2- 172.21.15.134:0/1742674931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1540fff90 0x7fc154102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 --2- 172.21.15.134:0/1742674931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc1540ffa50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 -- 172.21.15.134:0/1742674931 >> 172.21.15.134:0/1742674931 conn(0x7fc1540f7440 msgr2=0x7fc1540f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 -- 172.21.15.134:0/1742674931 shutdown_connections 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 -- 172.21.15.134:0/1742674931 wait complete. 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 Processor -- start 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.536+0000 7fc158990700 1 -- start start 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc158990700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc15410fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc158990700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1540fff90 0x7fc154110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.538 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc158990700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc154111060 con 0x7fc154066af0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc158990700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1541111d0 con 0x7fc1540fff90 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc15410fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc15410fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47336/0 (socket says 172.21.15.134:47336) 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 -- 172.21.15.134:0/2498401981 learned_addr learned my addr 172.21.15.134:0/2498401981 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc151d9b700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1540fff90 0x7fc154110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 -- 172.21.15.134:0/2498401981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1540fff90 msgr2=0x7fc154110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1540fff90 0x7fc154110340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 -- 172.21.15.134:0/2498401981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c009940 con 0x7fc154066af0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc15259c700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc15410fe00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009380 tx=0x7fc14c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc14c00e040 con 0x7fc154066af0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc14c008ea0 con 0x7fc154066af0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1541113f0 con 0x7fc154066af0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc14c01c870 con 0x7fc154066af0 2024-03-22T07:31:57.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.537+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1541119b0 con 0x7fc154066af0 2024-03-22T07:31:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.538+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15405f5f0 con 0x7fc154066af0 2024-03-22T07:31:57.540 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.539+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7fc14c012410 con 0x7fc154066af0 2024-03-22T07:31:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.539+0000 7fc142ffd700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc13c06d4a0 0x7fc13c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.539+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc14c08e620 con 0x7fc154066af0 2024-03-22T07:31:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.539+0000 7fc151d9b700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc13c06d4a0 0x7fc13c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.541 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.540+0000 7fc151d9b700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc13c06d4a0 0x7fc13c06f950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc148009fd0 tx=0x7fc14800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:57.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.544+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc14c057f10 con 0x7fc154066af0 2024-03-22T07:31:57.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.777+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc1541058c0 con 0x7fc154066af0 2024-03-22T07:31:57.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.778+0000 7fc142ffd700 1 -- 172.21.15.134:0/2498401981 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7fc14c05b5d0 con 0x7fc154066af0 2024-03-22T07:31:57.778 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:31:57.778 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:31:57.778 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:57.778 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:31:57.779 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:31:57.780 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc13c06d4a0 msgr2=0x7fc13c06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc13c06d4a0 0x7fc13c06f950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc148009fd0 tx=0x7fc14800b040 comp rx=0 tx=0).stop 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 msgr2=0x7fc15410fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc15410fe00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009380 tx=0x7fc14c004d10 comp rx=0 tx=0).stop 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 shutdown_connections 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc13c06d4a0 0x7fc13c06f950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc154066af0 0x7fc15410fe00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 --2- 172.21.15.134:0/2498401981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1540fff90 0x7fc154110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 >> 172.21.15.134:0/2498401981 conn(0x7fc1540f7440 msgr2=0x7fc154100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:57.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 shutdown_connections 2024-03-22T07:31:57.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.780+0000 7fc158990700 1 -- 172.21.15.134:0/2498401981 wait complete. 2024-03-22T07:31:57.783 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 -- 172.21.15.134:0/2030727683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fdff0 msgr2=0x7f153c0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 --2- 172.21.15.134:0/2030727683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fdff0 0x7f153c0fe460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1530004940 tx=0x7f1530009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 -- 172.21.15.134:0/2030727683 shutdown_connections 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 --2- 172.21.15.134:0/2030727683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fdff0 0x7f153c0fe460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 --2- 172.21.15.134:0/2030727683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f153c0fce80 0x7f153c0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 -- 172.21.15.134:0/2030727683 >> 172.21.15.134:0/2030727683 conn(0x7f153c0f8580 msgr2=0x7f153c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 -- 172.21.15.134:0/2030727683 shutdown_connections 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.882+0000 7f1542648700 1 -- 172.21.15.134:0/2030727683 wait complete. 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f1542648700 1 Processor -- start 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f1542648700 1 -- start start 2024-03-22T07:31:57.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f1542648700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 0x7f153c10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f1542648700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f153c0fdff0 0x7f153c10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f1542648700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c10e4d0 con 0x7f153c0fce80 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f1542648700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c10ed20 con 0x7f153c0fdff0 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 0x7f153c10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 0x7f153c10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47368/0 (socket says 172.21.15.134:47368) 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153bfff700 1 -- 172.21.15.134:0/4111037576 learned_addr learned my addr 172.21.15.134:0/4111037576 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153b7fe700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f153c0fdff0 0x7f153c10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153bfff700 1 -- 172.21.15.134:0/4111037576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f153c0fdff0 msgr2=0x7f153c10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153bfff700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f153c0fdff0 0x7f153c10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.883+0000 7f153bfff700 1 -- 172.21.15.134:0/4111037576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530005040 con 0x7f153c0fce80 2024-03-22T07:31:57.885 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.884+0000 7f153bfff700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 0x7f153c10d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f152c00eb40 tx=0x7f152c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:57.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.884+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152c007cc0 con 0x7f153c0fce80 2024-03-22T07:31:57.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.884+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c10efa0 con 0x7f153c0fce80 2024-03-22T07:31:57.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.884+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f152c00f040 con 0x7f153c0fce80 2024-03-22T07:31:57.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.884+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152c00ca10 con 0x7f153c0fce80 2024-03-22T07:31:57.886 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.884+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c10f4e0 con 0x7f153c0fce80 2024-03-22T07:31:57.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.885+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c05f5f0 con 0x7f153c0fce80 2024-03-22T07:31:57.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.885+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f152c00cc80 con 0x7f153c0fce80 2024-03-22T07:31:57.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.885+0000 7f1538ff9700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f152406d4a0 0x7f152406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:57.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.886+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f152c08c740 con 0x7f153c0fce80 2024-03-22T07:31:57.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.886+0000 7f153b7fe700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f152406d4a0 0x7f152406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:57.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.886+0000 7f153b7fe700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f152406d4a0 0x7f152406f950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1530009b30 tx=0x7f1530009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:57.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:57.890+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f152c059b90 con 0x7f153c0fce80 2024-03-22T07:31:58.107 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.107+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f153c10f7c0 con 0x7f152406d4a0 2024-03-22T07:31:58.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.108+0000 7f1538ff9700 1 -- 172.21.15.134:0/4111037576 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f153c10f7c0 con 0x7f152406d4a0 2024-03-22T07:31:58.108 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:31:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:31:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:31:58.108 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr" 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "4/21 daemons upgraded", 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mon daemons", 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:31:58.109 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:31:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f152406d4a0 msgr2=0x7f152406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f152406d4a0 0x7f152406f950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1530009b30 tx=0x7f1530009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 msgr2=0x7f153c10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 0x7f153c10d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f152c00eb40 tx=0x7f152c00b040 comp rx=0 tx=0).stop 2024-03-22T07:31:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 shutdown_connections 2024-03-22T07:31:58.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f152406d4a0 0x7f152406f950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f153c0fce80 0x7f153c10d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 --2- 172.21.15.134:0/4111037576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f153c0fdff0 0x7f153c10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 >> 172.21.15.134:0/4111037576 conn(0x7f153c0f8580 msgr2=0x7f153c0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 shutdown_connections 2024-03-22T07:31:58.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.110+0000 7f1542648700 1 -- 172.21.15.134:0/4111037576 wait complete. 2024-03-22T07:31:58.211 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 -- 172.21.15.134:0/1638899137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 msgr2=0x7f99480fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 --2- 172.21.15.134:0/1638899137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f99480fc0e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9938004940 tx=0x7f9938009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 -- 172.21.15.134:0/1638899137 shutdown_connections 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 --2- 172.21.15.134:0/1638899137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99480fcf80 0x7f99480fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 --2- 172.21.15.134:0/1638899137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f99480fc0e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 -- 172.21.15.134:0/1638899137 >> 172.21.15.134:0/1638899137 conn(0x7f99480f7450 msgr2=0x7f99480f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 -- 172.21.15.134:0/1638899137 shutdown_connections 2024-03-22T07:31:58.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.211+0000 7f994f679700 1 -- 172.21.15.134:0/1638899137 wait complete. 2024-03-22T07:31:58.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994f679700 1 Processor -- start 2024-03-22T07:31:58.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994f679700 1 -- start start 2024-03-22T07:31:58.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994f679700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f994810c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:58.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994f679700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99480fcf80 0x7f994810ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994f679700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994810d2f0 con 0x7f99480fbcd0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994f679700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994810d460 con 0x7f99480fcf80 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994d415700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f994810c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994d415700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f994810c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47396/0 (socket says 172.21.15.134:47396) 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994d415700 1 -- 172.21.15.134:0/902103831 learned_addr learned my addr 172.21.15.134:0/902103831 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.212+0000 7f994cc14700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99480fcf80 0x7f994810ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f994d415700 1 -- 172.21.15.134:0/902103831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99480fcf80 msgr2=0x7f994810ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f994d415700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99480fcf80 0x7f994810ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f994d415700 1 -- 172.21.15.134:0/902103831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938005040 con 0x7f99480fbcd0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f994d415700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f994810c7b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9938009150 tx=0x7f9938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f993800e040 con 0x7f99480fbcd0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f993800bbf0 con 0x7f99480fbcd0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9948111e60 con 0x7f99480fbcd0 2024-03-22T07:31:58.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f993801c630 con 0x7f99480fbcd0 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.213+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9948112390 con 0x7f99480fbcd0 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.214+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994804c710 con 0x7f99480fbcd0 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.214+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f9938013420 con 0x7f99480fbcd0 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.215+0000 7f993dffb700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f993406d4b0 0x7f993406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.215+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f993808de30 con 0x7f99480fbcd0 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.215+0000 7f994cc14700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f993406d4b0 0x7f993406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:31:58.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.215+0000 7f994cc14700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f993406d4b0 0x7f993406f960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9944009fd0 tx=0x7f994400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:31:58.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.219+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f993805b2f0 con 0x7f99480fbcd0 2024-03-22T07:31:58.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.491+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f99481047c0 con 0x7f99480fbcd0 2024-03-22T07:31:58.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.492+0000 7f993dffb700 1 -- 172.21.15.134:0/902103831 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9938013e60 con 0x7f99480fbcd0 2024-03-22T07:31:58.492 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f993406d4b0 msgr2=0x7f993406f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f993406d4b0 0x7f993406f960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9944009fd0 tx=0x7f994400b040 comp rx=0 tx=0).stop 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 msgr2=0x7f994810c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f994810c7b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9938009150 tx=0x7f9938009e30 comp rx=0 tx=0).stop 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 shutdown_connections 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f993406d4b0 0x7f993406f960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99480fbcd0 0x7f994810c7b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 --2- 172.21.15.134:0/902103831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99480fcf80 0x7f994810ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 >> 172.21.15.134:0/902103831 conn(0x7f99480f7450 msgr2=0x7f99480f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 shutdown_connections 2024-03-22T07:31:58.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:31:58.494+0000 7f994f679700 1 -- 172.21.15.134:0/902103831 wait complete. 2024-03-22T07:31:58.681 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:58.681 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:58.681 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:58.681 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2713946728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: Reconfiguring mgr.smithi195.jxfsnc (monmap changed)... 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: Reconfiguring daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:31:58.682 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:58 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2498401981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2713946728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: Reconfiguring mgr.smithi195.jxfsnc (monmap changed)... 2024-03-22T07:31:58.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi195.jxfsnc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-22T07:31:58.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-22T07:31:58.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:58.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: Reconfiguring daemon mgr.smithi195.jxfsnc on smithi195 2024-03-22T07:31:58.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:58 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2498401981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/902103831' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:31:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: pgmap v23: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/902103831' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-22T07:31:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:31:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:00.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:00 smithi195 ceph-mon[82061]: Reconfiguring mon.smithi195 (monmap changed)... 2024-03-22T07:32:00.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:00 smithi195 ceph-mon[82061]: Reconfiguring daemon mon.smithi195 on smithi195 2024-03-22T07:32:00.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:00 smithi134 ceph-mon[93947]: Reconfiguring mon.smithi195 (monmap changed)... 2024-03-22T07:32:00.799 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:00 smithi134 ceph-mon[93947]: Reconfiguring daemon mon.smithi195 on smithi195 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: pgmap v24: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: Reconfiguring osd.3 (monmap changed)... 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:01.837 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:01 smithi195 ceph-mon[82061]: Reconfiguring daemon osd.3 on smithi195 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: pgmap v24: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: Reconfiguring osd.3 (monmap changed)... 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:01 smithi134 ceph-mon[93947]: Reconfiguring daemon osd.3 on smithi195 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: Reconfiguring osd.4 (monmap changed)... 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: Reconfiguring daemon osd.4 on smithi195 2024-03-22T07:32:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:03 smithi195 ceph-mon[82061]: pgmap v25: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: Reconfiguring osd.4 (monmap changed)... 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: Reconfiguring daemon osd.4 on smithi195 2024-03-22T07:32:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:03 smithi134 ceph-mon[93947]: pgmap v25: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:04.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:04.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:04.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:04.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-22T07:32:04.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:04.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:04.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:04.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:04.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-22T07:32:04.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:05.483 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:05 smithi195 ceph-mon[82061]: Reconfiguring osd.5 (monmap changed)... 2024-03-22T07:32:05.483 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:05 smithi195 ceph-mon[82061]: Reconfiguring daemon osd.5 on smithi195 2024-03-22T07:32:05.483 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:05 smithi195 ceph-mon[82061]: pgmap v26: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:05.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:05 smithi134 ceph-mon[93947]: Reconfiguring osd.5 (monmap changed)... 2024-03-22T07:32:05.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:05 smithi134 ceph-mon[93947]: Reconfiguring daemon osd.5 on smithi195 2024-03-22T07:32:05.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:05 smithi134 ceph-mon[93947]: pgmap v26: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:06.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:06 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:06.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:06 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:06.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:06 smithi195 ceph-mon[82061]: Reconfiguring mds.cephfs.smithi195.dayrmo (monmap changed)... 2024-03-22T07:32:06.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:06 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:32:06.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:06 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:06.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:06 smithi195 ceph-mon[82061]: Reconfiguring daemon mds.cephfs.smithi195.dayrmo on smithi195 2024-03-22T07:32:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:06 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:06 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:06 smithi134 ceph-mon[93947]: Reconfiguring mds.cephfs.smithi195.dayrmo (monmap changed)... 2024-03-22T07:32:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:06 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:32:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:06 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:06 smithi134 ceph-mon[93947]: Reconfiguring daemon mds.cephfs.smithi195.dayrmo on smithi195 2024-03-22T07:32:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:07 smithi134 ceph-mon[93947]: pgmap v27: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:32:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:07.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:07 smithi195 ceph-mon[82061]: pgmap v27: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:07.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:07.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:07.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:32:07.901 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:08.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:08 smithi195 ceph-mon[82061]: Reconfiguring mds.cephfs.smithi195.jursxo (monmap changed)... 2024-03-22T07:32:08.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:08 smithi195 ceph-mon[82061]: Reconfiguring daemon mds.cephfs.smithi195.jursxo on smithi195 2024-03-22T07:32:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:08 smithi134 ceph-mon[93947]: Reconfiguring mds.cephfs.smithi195.jursxo (monmap changed)... 2024-03-22T07:32:09.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:08 smithi134 ceph-mon[93947]: Reconfiguring daemon mds.cephfs.smithi195.jursxo on smithi195 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: pgmap v28: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all mon 2024-03-22T07:32:09.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:09.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-03-22T07:32:09.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-03-22T07:32:09.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-03-22T07:32:09.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-03-22T07:32:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: pgmap v28: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:10.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all mon 2024-03-22T07:32:10.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:10.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-03-22T07:32:10.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-03-22T07:32:10.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]: dispatch 2024-03-22T07:32:10.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi195"}]': finished 2024-03-22T07:32:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:11 smithi134 ceph-mon[93947]: Upgrade: Updating crash.smithi134 (1/2) 2024-03-22T07:32:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:32:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:11 smithi134 ceph-mon[93947]: Deploying daemon crash.smithi134 on smithi134 2024-03-22T07:32:11.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:11 smithi134 ceph-mon[93947]: pgmap v29: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:11 smithi195 ceph-mon[82061]: Upgrade: Updating crash.smithi134 (1/2) 2024-03-22T07:32:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:32:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:11 smithi195 ceph-mon[82061]: Deploying daemon crash.smithi134 on smithi134 2024-03-22T07:32:11.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:11 smithi195 ceph-mon[82061]: pgmap v29: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:13.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:13 smithi134 ceph-mon[93947]: pgmap v30: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:13 smithi195 ceph-mon[82061]: pgmap v30: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:15.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:14 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:15.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:14 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:15.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:14 smithi195 ceph-mon[82061]: pgmap v31: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:15.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:14 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:15.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:14 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:15.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:14 smithi134 ceph-mon[93947]: pgmap v31: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:16.676 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:16 smithi195 ceph-mon[82061]: Upgrade: Updating crash.smithi195 (2/2) 2024-03-22T07:32:16.676 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:16 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:16.676 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:16 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:32:16.676 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:16 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:16.676 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:16 smithi195 ceph-mon[82061]: Deploying daemon crash.smithi195 on smithi195 2024-03-22T07:32:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:16 smithi134 ceph-mon[93947]: Upgrade: Updating crash.smithi195 (2/2) 2024-03-22T07:32:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:16 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:16 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi195", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-22T07:32:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:16 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:16 smithi134 ceph-mon[93947]: Deploying daemon crash.smithi195 on smithi195 2024-03-22T07:32:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:17 smithi134 ceph-mon[93947]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:17.855 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:17 smithi195 ceph-mon[82061]: pgmap v32: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:18.777 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:19.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:19 smithi195 ceph-mon[82061]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:19.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:19.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:19.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:19.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:19 smithi134 ceph-mon[93947]: pgmap v33: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:19.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:19.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:19.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:21.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:21 smithi195 ceph-mon[82061]: pgmap v34: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:21 smithi134 ceph-mon[93947]: pgmap v34: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:23.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:22 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:23.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:22 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:23.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:22 smithi134 ceph-mon[93947]: pgmap v35: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:23.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:22 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:23.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:22 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:23.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:22 smithi195 ceph-mon[82061]: pgmap v35: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:24 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:24.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:24 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:24.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:25 smithi134 ceph-mon[93947]: pgmap v36: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:25 smithi195 ceph-mon[82061]: pgmap v36: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:26.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:26.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:27.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:27.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:27.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:27 smithi134 ceph-mon[93947]: pgmap v37: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:27 smithi195 ceph-mon[82061]: pgmap v37: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- 172.21.15.134:0/770318754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 msgr2=0x7f56d80fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 --2- 172.21.15.134:0/770318754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d80fd280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56cc004940 tx=0x7f56cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- 172.21.15.134:0/770318754 shutdown_connections 2024-03-22T07:32:28.601 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 --2- 172.21.15.134:0/770318754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d80fdfe0 0x7f56d80fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 --2- 172.21.15.134:0/770318754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d80fd280 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- 172.21.15.134:0/770318754 >> 172.21.15.134:0/770318754 conn(0x7f56d80f8550 msgr2=0x7f56d80fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- 172.21.15.134:0/770318754 shutdown_connections 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- 172.21.15.134:0/770318754 wait complete. 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 Processor -- start 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- start start 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d810d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d80fdfe0 0x7f56d810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d810e520 con 0x7f56d80fce70 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.600+0000 7f56deacc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8112ec0 con 0x7f56d80fdfe0 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d810d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d810d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34918/0 (socket says 172.21.15.134:34918) 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 -- 172.21.15.134:0/1568891497 learned_addr learned my addr 172.21.15.134:0/1568891497 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:28.602 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 -- 172.21.15.134:0/1568891497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d80fdfe0 msgr2=0x7f56d810de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d80fdfe0 0x7f56d810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 -- 172.21.15.134:0/1568891497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc005040 con 0x7f56d80fce70 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56dc868700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d810d950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009150 tx=0x7f56cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56cc00e040 con 0x7f56d80fce70 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d81130c0 con 0x7f56d80fce70 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56cc00bbf0 con 0x7f56d80fce70 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56cc01c630 con 0x7f56d80fce70 2024-03-22T07:32:28.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.601+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d8113630 con 0x7f56d80fce70 2024-03-22T07:32:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.602+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d804c710 con 0x7f56d80fce70 2024-03-22T07:32:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.603+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f56cc00bd60 con 0x7f56d80fce70 2024-03-22T07:32:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.603+0000 7f56d57fa700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f56c806d4b0 0x7f56c806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.603+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f56cc08df90 con 0x7f56d80fce70 2024-03-22T07:32:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.603+0000 7f56d7fff700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f56c806d4b0 0x7f56c806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:28.604 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.604+0000 7f56d7fff700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f56c806d4b0 0x7f56c806f960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4006db0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:28.607 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.608+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f56cc05b3b0 con 0x7f56d80fce70 2024-03-22T07:32:28.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.826+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56d81022b0 con 0x7f56c806d4b0 2024-03-22T07:32:28.827 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.827+0000 7f56d57fa700 1 -- 172.21.15.134:0/1568891497 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f56d81022b0 con 0x7f56c806d4b0 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.829+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f56c806d4b0 msgr2=0x7f56c806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.829+0000 7f56deacc700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f56c806d4b0 0x7f56c806f960 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4006db0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.829+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 msgr2=0x7f56d810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.829+0000 7f56deacc700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d810d950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009150 tx=0x7f56cc009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 shutdown_connections 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f56c806d4b0 0x7f56c806f960 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56d80fce70 0x7f56d810d950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 --2- 172.21.15.134:0/1568891497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d80fdfe0 0x7f56d810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 >> 172.21.15.134:0/1568891497 conn(0x7f56d80f8550 msgr2=0x7f56d80f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 shutdown_connections 2024-03-22T07:32:28.830 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.830+0000 7f56deacc700 1 -- 172.21.15.134:0/1568891497 wait complete. 2024-03-22T07:32:28.841 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:32:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 -- 172.21.15.134:0/1058037791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fce70 msgr2=0x7f9e740fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:28.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/1058037791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fce70 0x7f9e740fd280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009ce0 tx=0x7f9e6c004d10 comp rx=0 tx=0).stop 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 -- 172.21.15.134:0/1058037791 shutdown_connections 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/1058037791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fdfe0 0x7f9e740fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/1058037791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fce70 0x7f9e740fd280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 -- 172.21.15.134:0/1058037791 >> 172.21.15.134:0/1058037791 conn(0x7f9e740f8550 msgr2=0x7f9e740fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 -- 172.21.15.134:0/1058037791 shutdown_connections 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 -- 172.21.15.134:0/1058037791 wait complete. 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 Processor -- start 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.936+0000 7f9e78ae2700 1 -- start start 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e78ae2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fce70 0x7f9e7410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e78ae2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 0x7f9e7410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e78ae2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7410e680 con 0x7f9e740fdfe0 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e78ae2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e74113020 con 0x7f9e740fce70 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 0x7f9e7410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:28.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 0x7f9e7410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34934/0 (socket says 172.21.15.134:34934) 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 -- 172.21.15.134:0/874075262 learned_addr learned my addr 172.21.15.134:0/874075262 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e7259c700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fce70 0x7f9e7410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 -- 172.21.15.134:0/874075262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fce70 msgr2=0x7f9e7410dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fce70 0x7f9e7410dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 -- 172.21.15.134:0/874075262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c009940 con 0x7f9e740fdfe0 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e7259c700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fce70 0x7f9e7410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e71d9b700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 0x7f9e7410dff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b790 tx=0x7f9e68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6800f770 con 0x7f9e740fdfe0 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e6800fda0 con 0x7f9e740fdfe0 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e74113280 con 0x7f9e740fdfe0 2024-03-22T07:32:28.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.937+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6800d310 con 0x7f9e740fdfe0 2024-03-22T07:32:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.938+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e741137f0 con 0x7f9e740fdfe0 2024-03-22T07:32:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.938+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7404c710 con 0x7f9e740fdfe0 2024-03-22T07:32:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.939+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f9e68010420 con 0x7f9e740fdfe0 2024-03-22T07:32:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.940+0000 7f9e62ffd700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f9e5c06d4b0 0x7f9e5c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.940+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9e6808c9f0 con 0x7f9e740fdfe0 2024-03-22T07:32:28.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.940+0000 7f9e7259c700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f9e5c06d4b0 0x7f9e5c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:28.942 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.940+0000 7f9e7259c700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f9e5c06d4b0 0x7f9e5c06f960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0095a0 tx=0x7f9e6c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:28.944 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:28.944+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9e6808ee60 con 0x7f9e740fdfe0 2024-03-22T07:32:29.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.170+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e74102280 con 0x7f9e5c06d4b0 2024-03-22T07:32:29.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.171+0000 7f9e62ffd700 1 -- 172.21.15.134:0/874075262 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9e74102280 con 0x7f9e5c06d4b0 2024-03-22T07:32:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f9e5c06d4b0 msgr2=0x7f9e5c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f9e5c06d4b0 0x7f9e5c06f960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0095a0 tx=0x7f9e6c004d10 comp rx=0 tx=0).stop 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 msgr2=0x7f9e7410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 0x7f9e7410dff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b790 tx=0x7f9e68009250 comp rx=0 tx=0).stop 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 shutdown_connections 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f9e5c06d4b0 0x7f9e5c06f960 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9e740fce70 0x7f9e7410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 --2- 172.21.15.134:0/874075262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e740fdfe0 0x7f9e7410dff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 >> 172.21.15.134:0/874075262 conn(0x7f9e740f8550 msgr2=0x7f9e740f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 shutdown_connections 2024-03-22T07:32:29.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.173+0000 7f9e78ae2700 1 -- 172.21.15.134:0/874075262 wait complete. 2024-03-22T07:32:29.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 -- 172.21.15.134:0/2947474567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fe4c0 msgr2=0x7ff66c0fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 --2- 172.21.15.134:0/2947474567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fe8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff668004940 tx=0x7ff668009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:29.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 -- 172.21.15.134:0/2947474567 shutdown_connections 2024-03-22T07:32:29.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 --2- 172.21.15.134:0/2947474567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fee10 0x7ff66c0faf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 --2- 172.21.15.134:0/2947474567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fe8d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 -- 172.21.15.134:0/2947474567 >> 172.21.15.134:0/2947474567 conn(0x7ff66c0f6ba0 msgr2=0x7ff66c0f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:29.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 -- 172.21.15.134:0/2947474567 shutdown_connections 2024-03-22T07:32:29.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.279+0000 7ff67473b700 1 -- 172.21.15.134:0/2947474567 wait complete. 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff67473b700 1 Processor -- start 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff67473b700 1 -- start start 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff67473b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff67473b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fee10 0x7ff66c0fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff67473b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0fc730 con 0x7ff66c0fee10 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff67473b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0fc8a0 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff671cd6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fee10 0x7ff66c0fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff671cd6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fee10 0x7ff66c0fc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34960/0 (socket says 172.21.15.134:34960) 2024-03-22T07:32:29.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff671cd6700 1 -- 172.21.15.134:0/1176912324 learned_addr learned my addr 172.21.15.134:0/1176912324 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:29.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff6724d7700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:29.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff6724d7700 1 -- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fee10 msgr2=0x7ff66c0fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff6724d7700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fee10 0x7ff66c0fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.280+0000 7ff6724d7700 1 -- 172.21.15.134:0/1176912324 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668005040 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.281+0000 7ff6724d7700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fdcb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff66800b3b0 tx=0x7ff668009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:29.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.281+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66800e040 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.281+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c0fcb20 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.281+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff66800bbf0 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.281+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff668013660 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.281+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c115a80 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.282+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c05f5f0 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.282+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7ff66800bd60 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.283+0000 7ff662ffd700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65806d4a0 0x7ff65806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.283+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff66808df30 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.283+0000 7ff671cd6700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65806d4a0 0x7ff65806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:29.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.283+0000 7ff671cd6700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65806d4a0 0x7ff65806f950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0041d0 tx=0x7ff65c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:29.288 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.288+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff668057780 con 0x7ff66c0fe4c0 2024-03-22T07:32:29.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.509+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff66c102580 con 0x7ff65806d4a0 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.519+0000 7ff662ffd700 1 -- 172.21.15.134:0/1176912324 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff66c102580 con 0x7ff65806d4a0 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 5s ago 11m 25.7M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (16s) 5s ago 12m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (10s) 7s ago 11m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (2m) 5s ago 11m 80.8M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (6m) 5s ago 6m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:32:29.519 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (6m) 5s ago 6m 13.4M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (6m) 7s ago 6m 14.7M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (6m) 7s ago 6m 14.0M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (2m) 5s ago 13m 498M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (93s) 7s ago 10m 449M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (79s) 5s ago 13m 44.3M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (56s) 7s ago 10m 31.2M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 5s ago 11m 15.0M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 7s ago 10m 15.0M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (10m) 5s ago 10m 263M 1557M 17.2.7-726-g9c4e0c34 837124da804f 55182ad5cf25 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (9m) 5s ago 9m 272M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (9m) 5s ago 9m 218M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (8m) 7s ago 8m 296M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (8m) 7s ago 8m 262M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (7m) 7s ago 7m 238M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:32:29.520 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (98s) 5s ago 11m 47.2M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:32:29.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65806d4a0 msgr2=0x7ff65806f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65806d4a0 0x7ff65806f950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0041d0 tx=0x7ff65c00b040 comp rx=0 tx=0).stop 2024-03-22T07:32:29.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fe4c0 msgr2=0x7ff66c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fdcb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff66800b3b0 tx=0x7ff668009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:29.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 shutdown_connections 2024-03-22T07:32:29.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65806d4a0 0x7ff65806f950 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fe4c0 0x7ff66c0fdcb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 --2- 172.21.15.134:0/1176912324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fee10 0x7ff66c0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 >> 172.21.15.134:0/1176912324 conn(0x7ff66c0f6ba0 msgr2=0x7ff66c0f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:29.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 shutdown_connections 2024-03-22T07:32:29.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.521+0000 7ff67473b700 1 -- 172.21.15.134:0/1176912324 wait complete. 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: pgmap v38: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-03-22T07:32:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.624+0000 7f782ddf0700 1 -- 172.21.15.134:0/2000183157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 msgr2=0x7f78280fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.624+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2000183157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f78280fe460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f781c004940 tx=0x7f781c009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.624+0000 7f782ddf0700 1 -- 172.21.15.134:0/2000183157 shutdown_connections 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.624+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2000183157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f78280fe460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.624+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2000183157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78280fce80 0x7f78280fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.624+0000 7f782ddf0700 1 -- 172.21.15.134:0/2000183157 >> 172.21.15.134:0/2000183157 conn(0x7f78280f8580 msgr2=0x7f78280fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.625+0000 7f782ddf0700 1 -- 172.21.15.134:0/2000183157 shutdown_connections 2024-03-22T07:32:29.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.625+0000 7f782ddf0700 1 -- 172.21.15.134:0/2000183157 wait complete. 2024-03-22T07:32:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.625+0000 7f782ddf0700 1 Processor -- start 2024-03-22T07:32:29.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.625+0000 7f782ddf0700 1 -- start start 2024-03-22T07:32:29.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f782ddf0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78280fce80 0x7f782810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:29.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f782ddf0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f782810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:29.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f782ddf0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782810e4b0 con 0x7f78280fdff0 2024-03-22T07:32:29.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f782ddf0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782810ed00 con 0x7f78280fce80 2024-03-22T07:32:29.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f782810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f782810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34968/0 (socket says 172.21.15.134:34968) 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 -- 172.21.15.134:0/2658607323 learned_addr learned my addr 172.21.15.134:0/2658607323 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f78277fe700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78280fce80 0x7f782810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 -- 172.21.15.134:0/2658607323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78280fce80 msgr2=0x7f782810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78280fce80 0x7f782810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 -- 172.21.15.134:0/2658607323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c005040 con 0x7f78280fdff0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f7826ffd700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f782810deb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f781c009150 tx=0x7f781c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781c00e040 con 0x7f78280fdff0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f781c00bcc0 con 0x7f78280fdff0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782810ef80 con 0x7f78280fdff0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781c01c630 con 0x7f78280fdff0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.626+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782810f4c0 con 0x7f78280fdff0 2024-03-22T07:32:29.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.628+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782805f5f0 con 0x7f78280fdff0 2024-03-22T07:32:29.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.628+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f781c026440 con 0x7f78280fdff0 2024-03-22T07:32:29.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.628+0000 7f780ffff700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f781006d4a0 0x7f781006f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:29.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.628+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f781c08d870 con 0x7f78280fdff0 2024-03-22T07:32:29.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.628+0000 7f78277fe700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f781006d4a0 0x7f781006f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:29.629 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.629+0000 7f78277fe700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f781006d4a0 0x7f781006f950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7818007fd0 tx=0x7f7818009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:29.632 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.633+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f781c05ad00 con 0x7f78280fdff0 2024-03-22T07:32:29.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.918+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f782804bed0 con 0x7f78280fdff0 2024-03-22T07:32:29.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.919+0000 7f780ffff700 1 -- 172.21.15.134:0/2658607323 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f781c05a890 con 0x7f78280fdff0 2024-03-22T07:32:29.919 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:32:29.919 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:32:29.919 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 10, 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:32:29.920 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f781006d4a0 msgr2=0x7f781006f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f781006d4a0 0x7f781006f950 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7818007fd0 tx=0x7f7818009040 comp rx=0 tx=0).stop 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 msgr2=0x7f782810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f782810deb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f781c009150 tx=0x7f781c009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 shutdown_connections 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f781006d4a0 0x7f781006f950 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78280fce80 0x7f782810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.922 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 --2- 172.21.15.134:0/2658607323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78280fdff0 0x7f782810deb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:29.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 >> 172.21.15.134:0/2658607323 conn(0x7f78280f8580 msgr2=0x7f78280f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:29.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 shutdown_connections 2024-03-22T07:32:29.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:29.922+0000 7f782ddf0700 1 -- 172.21.15.134:0/2658607323 wait complete. 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: pgmap v38: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]: dispatch 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi195"}]': finished 2024-03-22T07:32:29.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 -- 172.21.15.134:0/3436226359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 msgr2=0x7f89800fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 --2- 172.21.15.134:0/3436226359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f89800fd790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f897c004940 tx=0x7f897c009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 -- 172.21.15.134:0/3436226359 shutdown_connections 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 --2- 172.21.15.134:0/3436226359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89800fdcd0 0x7f8980104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 --2- 172.21.15.134:0/3436226359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f89800fd790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 -- 172.21.15.134:0/3436226359 >> 172.21.15.134:0/3436226359 conn(0x7f89800f6c10 msgr2=0x7f89800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 -- 172.21.15.134:0/3436226359 shutdown_connections 2024-03-22T07:32:30.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 -- 172.21.15.134:0/3436226359 wait complete. 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 Processor -- start 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.033+0000 7f8987759700 1 -- start start 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8987759700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f898010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8987759700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89800fdcd0 0x7f8980110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8987759700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980110660 con 0x7f89800fd380 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8987759700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801107d0 con 0x7f89800fdcd0 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f898010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f898010fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34980/0 (socket says 172.21.15.134:34980) 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 -- 172.21.15.134:0/225141382 learned_addr learned my addr 172.21.15.134:0/225141382 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8984cf4700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89800fdcd0 0x7f8980110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 -- 172.21.15.134:0/225141382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89800fdcd0 msgr2=0x7f8980110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89800fdcd0 0x7f8980110060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 -- 172.21.15.134:0/225141382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c005040 con 0x7f89800fd380 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f89854f5700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f898010fb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f897c009150 tx=0x7f897c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c00e040 con 0x7f89800fd380 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89801151d0 con 0x7f89800fd380 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f897c00bbf0 con 0x7f89800fd380 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.034+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c01c630 con 0x7f89800fd380 2024-03-22T07:32:30.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.035+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8980115790 con 0x7f89800fd380 2024-03-22T07:32:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.035+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898004c710 con 0x7f89800fd380 2024-03-22T07:32:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.036+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f897c00bd60 con 0x7f89800fd380 2024-03-22T07:32:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.036+0000 7f8975ffb700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f896c06d4b0 0x7f896c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.036+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f897c08de90 con 0x7f89800fd380 2024-03-22T07:32:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.036+0000 7f8984cf4700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f896c06d4b0 0x7f896c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.037+0000 7f8984cf4700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f896c06d4b0 0x7f896c06f960 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8970004f30 tx=0x7f897000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:30.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.041+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f897c05b2b0 con 0x7f89800fd380 2024-03-22T07:32:30.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.286+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8980115b20 con 0x7f89800fd380 2024-03-22T07:32:30.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.286+0000 7f8975ffb700 1 -- 172.21.15.134:0/225141382 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f897c013e60 con 0x7f89800fd380 2024-03-22T07:32:30.286 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:32:30.286 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:32:30.286 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:32:30.287 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:32:30.288 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:32:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f896c06d4b0 msgr2=0x7f896c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f896c06d4b0 0x7f896c06f960 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8970004f30 tx=0x7f897000b040 comp rx=0 tx=0).stop 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 msgr2=0x7f898010fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f898010fb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f897c009150 tx=0x7f897c009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 shutdown_connections 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f896c06d4b0 0x7f896c06f960 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89800fd380 0x7f898010fb20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 --2- 172.21.15.134:0/225141382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f89800fdcd0 0x7f8980110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 >> 172.21.15.134:0/225141382 conn(0x7f89800f6c10 msgr2=0x7f89800f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:30.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 shutdown_connections 2024-03-22T07:32:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.288+0000 7f8987759700 1 -- 172.21.15.134:0/225141382 wait complete. 2024-03-22T07:32:30.291 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:32:30.393 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 -- 172.21.15.134:0/3334039128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 msgr2=0x7f30e80fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 --2- 172.21.15.134:0/3334039128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e80fc110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30dc004940 tx=0x7f30dc009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 -- 172.21.15.134:0/3334039128 shutdown_connections 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 --2- 172.21.15.134:0/3334039128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 0x7f30e80fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 --2- 172.21.15.134:0/3334039128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e80fc110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 -- 172.21.15.134:0/3334039128 >> 172.21.15.134:0/3334039128 conn(0x7f30e80f7480 msgr2=0x7f30e80f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 -- 172.21.15.134:0/3334039128 shutdown_connections 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 -- 172.21.15.134:0/3334039128 wait complete. 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 Processor -- start 2024-03-22T07:32:30.394 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.392+0000 7f30eeba9700 1 -- start start 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30eeba9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e8066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30eeba9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 0x7f30e81126c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30eeba9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8112c00 con 0x7f30e80fbd00 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30eeba9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8112d40 con 0x7f30e80fcfb0 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e8066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e8066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:34994/0 (socket says 172.21.15.134:34994) 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 -- 172.21.15.134:0/2650103003 learned_addr learned my addr 172.21.15.134:0/2650103003 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30e7fff700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 0x7f30e81126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 -- 172.21.15.134:0/2650103003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 msgr2=0x7f30e81126c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 0x7f30e81126c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 -- 172.21.15.134:0/2650103003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc005040 con 0x7f30e80fbd00 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30e7fff700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 0x7f30e81126c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30ec945700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e8066cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00b3b0 tx=0x7f30dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30dc00e040 con 0x7f30e80fbd00 2024-03-22T07:32:30.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30dc00bcc0 con 0x7f30e80fbd00 2024-03-22T07:32:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e8112f40 con 0x7f30e80fbd00 2024-03-22T07:32:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30dc01c630 con 0x7f30e80fbd00 2024-03-22T07:32:30.396 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.393+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8113470 con 0x7f30e80fbd00 2024-03-22T07:32:30.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.394+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e804c710 con 0x7f30e80fbd00 2024-03-22T07:32:30.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.395+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f30dc013980 con 0x7f30e80fbd00 2024-03-22T07:32:30.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.395+0000 7f30e57fa700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f30d806d4b0 0x7f30d806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.395+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f30dc08d890 con 0x7f30e80fbd00 2024-03-22T07:32:30.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.395+0000 7f30e7fff700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f30d806d4b0 0x7f30d806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.396+0000 7f30e7fff700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f30d806d4b0 0x7f30d806f960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f30d4007fd0 tx=0x7f30d4009f60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:30.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.400+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f30dc05ac30 con 0x7f30e80fbd00 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all crash 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: Upgrade: osd.0 is safe to restart 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2658607323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:30.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:30 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/225141382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:32:30.619 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.619+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30e81012d0 con 0x7f30d806d4b0 2024-03-22T07:32:30.620 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.621+0000 7f30e57fa700 1 -- 172.21.15.134:0/2650103003 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f30e81012d0 con 0x7f30d806d4b0 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "6/21 daemons upgraded", 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:32:30.621 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f30d806d4b0 msgr2=0x7f30d806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f30d806d4b0 0x7f30d806f960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f30d4007fd0 tx=0x7f30d4009f60 comp rx=0 tx=0).stop 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 msgr2=0x7f30e8066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e8066cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00b3b0 tx=0x7f30dc009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 shutdown_connections 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f30d806d4b0 0x7f30d806f960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30e80fbd00 0x7f30e8066cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.623 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 --2- 172.21.15.134:0/2650103003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30e80fcfb0 0x7f30e81126c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 >> 172.21.15.134:0/2650103003 conn(0x7f30e80f7480 msgr2=0x7f30e80f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 shutdown_connections 2024-03-22T07:32:30.624 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.623+0000 7f30eeba9700 1 -- 172.21.15.134:0/2650103003 wait complete. 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 -- 172.21.15.134:0/1888272762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 msgr2=0x7f23ec0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/1888272762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec0fd3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23e0004940 tx=0x7f23e0009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 -- 172.21.15.134:0/1888272762 shutdown_connections 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/1888272762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec0fd3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/1888272762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 0x7f23ec0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 -- 172.21.15.134:0/1888272762 >> 172.21.15.134:0/1888272762 conn(0x7f23ec0f7430 msgr2=0x7f23ec0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 -- 172.21.15.134:0/1888272762 shutdown_connections 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.729+0000 7f23f0f6c700 1 -- 172.21.15.134:0/1888272762 wait complete. 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23f0f6c700 1 Processor -- start 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23f0f6c700 1 -- start start 2024-03-22T07:32:30.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23f0f6c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 0x7f23ec112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23f0f6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec115070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23f0f6c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec066240 con 0x7f23ec0fcf80 2024-03-22T07:32:30.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23f0f6c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec066380 con 0x7f23ec0fbcd0 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23ea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 0x7f23ec112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23e9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec115070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23ea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 0x7f23ec112b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:51872/0 (socket says 172.21.15.134:51872) 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23ea59c700 1 -- 172.21.15.134:0/979895346 learned_addr learned my addr 172.21.15.134:0/979895346 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.730+0000 7f23e9d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec115070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35012/0 (socket says 172.21.15.134:35012) 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23e9d9b700 1 -- 172.21.15.134:0/979895346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 msgr2=0x7f23ec112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23e9d9b700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 0x7f23ec112b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23e9d9b700 1 -- 172.21.15.134:0/979895346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0005040 con 0x7f23ec0fcf80 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23e9d9b700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec115070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23e000b3b0 tx=0x7f23e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:30.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e000e040 con 0x7f23ec0fcf80 2024-03-22T07:32:30.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23e000bbf0 con 0x7f23ec0fcf80 2024-03-22T07:32:30.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e0013660 con 0x7f23ec0fcf80 2024-03-22T07:32:30.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec1155b0 con 0x7f23ec0fcf80 2024-03-22T07:32:30.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.731+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec115980 con 0x7f23ec0fcf80 2024-03-22T07:32:30.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.732+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec05f5f0 con 0x7f23ec0fcf80 2024-03-22T07:32:30.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.732+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91271+0+0 (secure 0 0 0) 0x7f23e000bd60 con 0x7f23ec0fcf80 2024-03-22T07:32:30.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.733+0000 7f23daffd700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f23d406d4a0 0x7f23d406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:32:30.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.733+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f23e008de70 con 0x7f23ec0fcf80 2024-03-22T07:32:30.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.733+0000 7f23ea59c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f23d406d4a0 0x7f23d406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:32:30.734 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.734+0000 7f23ea59c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f23d406d4a0 0x7f23d406f950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23ec065fd0 tx=0x7f23dc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:32:30.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:30.738+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f23e0057760 con 0x7f23ec0fcf80 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all crash 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: Upgrade: osd.0 is safe to restart 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2658607323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:30 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/225141382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:32:31.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.019+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f23ec04bed0 con 0x7f23ec0fcf80 2024-03-22T07:32:31.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.020+0000 7f23daffd700 1 -- 172.21.15.134:0/979895346 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f23e005ae20 con 0x7f23ec0fcf80 2024-03-22T07:32:31.020 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:32:31.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f23d406d4a0 msgr2=0x7f23d406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:31.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f23d406d4a0 0x7f23d406f950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23ec065fd0 tx=0x7f23dc00b040 comp rx=0 tx=0).stop 2024-03-22T07:32:31.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 msgr2=0x7f23ec115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec115070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23e000b3b0 tx=0x7f23e0009e30 comp rx=0 tx=0).stop 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 shutdown_connections 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f23d406d4a0 0x7f23d406f950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23ec0fbcd0 0x7f23ec112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 --2- 172.21.15.134:0/979895346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23ec0fcf80 0x7f23ec115070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 >> 172.21.15.134:0/979895346 conn(0x7f23ec0f7430 msgr2=0x7f23ec0f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 shutdown_connections 2024-03-22T07:32:31.023 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:32:31.022+0000 7f23f0f6c700 1 -- 172.21.15.134:0/979895346 wait complete. 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: pgmap v39: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: Upgrade: Updating osd.0 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: Deploying daemon osd.0 on smithi134 2024-03-22T07:32:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:31 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/979895346' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:32:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: pgmap v39: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:32:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: Upgrade: Updating osd.0 2024-03-22T07:32:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-22T07:32:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:32.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: Deploying daemon osd.0 on smithi134 2024-03-22T07:32:32.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:31 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/979895346' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:32:33.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:33 smithi134 ceph-mon[93947]: pgmap v40: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:33.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:33 smithi195 ceph-mon[82061]: pgmap v40: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:34.139 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:33 smithi134 systemd[1]: Stopping Ceph osd.0 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:32:34.545 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:34 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[47476]: 2024-03-22T07:32:34.139+0000 7febb36e7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:32:34.545 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:34 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[47476]: 2024-03-22T07:32:34.139+0000 7febb36e7700 -1 osd.0 50 *** Got signal Terminated *** 2024-03-22T07:32:34.545 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:34 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[47476]: 2024-03-22T07:32:34.139+0000 7febb36e7700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:32:34.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:34 smithi195 ceph-mon[82061]: osd.0 marked itself down and dead 2024-03-22T07:32:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:34 smithi134 ceph-mon[93947]: osd.0 marked itself down and dead 2024-03-22T07:32:35.370 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:35 smithi134 podman[102198]: 2024-03-22 07:32:35.067127401 +0000 UTC m=+1.032576349 container died 55182ad5cf25286b4f10ac0c2eb8a2e1ddeac710dedce92cfafc20f7f09576cc (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=quincy-9c4e0c3, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-22T07:32:35.648 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:35 smithi134 podman[102198]: 2024-03-22 07:32:35.473134666 +0000 UTC m=+1.438583618 container cleanup 55182ad5cf25286b4f10ac0c2eb8a2e1ddeac710dedce92cfafc20f7f09576cc (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=quincy-9c4e0c3, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-22T07:32:35.649 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:35 smithi134 bash[102198]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0 2024-03-22T07:32:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:35 smithi195 ceph-mon[82061]: pgmap v41: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:35 smithi195 ceph-mon[82061]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:32:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:35 smithi195 ceph-mon[82061]: failed to encode map e51 with expected crc 2024-03-22T07:32:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:35 smithi195 ceph-mon[82061]: osdmap e51: 6 total, 5 up, 6 in 2024-03-22T07:32:36.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:35 smithi134 ceph-mon[93947]: pgmap v41: 65 pgs: 65 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:36.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:35 smithi134 ceph-mon[93947]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:32:36.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:35 smithi134 ceph-mon[93947]: failed to encode map e51 with expected crc 2024-03-22T07:32:36.035 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:35 smithi134 ceph-mon[93947]: osdmap e51: 6 total, 5 up, 6 in 2024-03-22T07:32:36.036 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:35 smithi134 podman[102216]: 2024-03-22 07:32:35.716490505 +0000 UTC m=+0.643348013 container remove 55182ad5cf25286b4f10ac0c2eb8a2e1ddeac710dedce92cfafc20f7f09576cc (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=quincy-9c4e0c3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-03-22T07:32:36.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:36 smithi134 podman[102304]: 2024-03-22 07:32:35.939397789 +0000 UTC m=+0.019698876 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:32:36.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:36 smithi134 podman[102304]: 2024-03-22 07:32:36.058996718 +0000 UTC m=+0.139297799 container create 3de201ea44fb3240863c11b0e0c9a4cac129ca8279993b96f44ec2b5d37788da (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True) 2024-03-22T07:32:36.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:36 smithi134 podman[102304]: 2024-03-22 07:32:36.270104786 +0000 UTC m=+0.350405870 container init 3de201ea44fb3240863c11b0e0c9a4cac129ca8279993b96f44ec2b5d37788da (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-22T07:32:36.296 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:36 smithi134 podman[102304]: 2024-03-22 07:32:36.273716268 +0000 UTC m=+0.354017343 container start 3de201ea44fb3240863c11b0e0c9a4cac129ca8279993b96f44ec2b5d37788da (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, GIT_CLEAN=True, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-22T07:32:36.663 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:36 smithi134 podman[102304]: 2024-03-22 07:32:36.353201059 +0000 UTC m=+0.433502136 container attach 3de201ea44fb3240863c11b0e0c9a4cac129ca8279993b96f44ec2b5d37788da (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-22T07:32:36.663 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:36 smithi134 podman[102304]: 2024-03-22 07:32:36.563518767 +0000 UTC m=+0.643819849 container died 3de201ea44fb3240863c11b0e0c9a4cac129ca8279993b96f44ec2b5d37788da (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240307, RELEASE=squid-db0330b) 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: failed to encode map e52 with expected crc 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: osdmap e52: 6 total, 5 up, 6 in 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: failed to encode map e52 with expected crc 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: failed to encode map e52 with expected crc 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: failed to encode map e52 with expected crc 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: failed to encode map e52 with expected crc 2024-03-22T07:32:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:36 smithi195 ceph-mon[82061]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: osdmap e52: 6 total, 5 up, 6 in 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:36 smithi134 ceph-mon[93947]: failed to encode map e52 with expected crc 2024-03-22T07:32:37.545 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 podman[102329]: 2024-03-22 07:32:37.149339408 +0000 UTC m=+0.580693596 container remove 3de201ea44fb3240863c11b0e0c9a4cac129ca8279993b96f44ec2b5d37788da (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-22T07:32:37.545 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.0.service: Deactivated successfully. 2024-03-22T07:32:37.546 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 systemd[1]: Stopped Ceph osd.0 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:32:37.546 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.0.service: Consumed 1min 3.902s CPU time. 2024-03-22T07:32:37.546 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 systemd[1]: Starting Ceph osd.0 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:32:37.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:37 smithi134 ceph-mon[93947]: pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:37.903 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 podman[102429]: 2024-03-22 07:32:37.500708182 +0000 UTC m=+0.017774693 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:32:37.903 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 podman[102429]: 2024-03-22 07:32:37.658958354 +0000 UTC m=+0.176024860 container create c4cba66467f9387c878f10a1d12ecb751f47281ebe79b39269fbb855f810ba75 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-db0330b, org.label-schema.build-date=20240307) 2024-03-22T07:32:37.903 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 podman[102429]: 2024-03-22 07:32:37.903580603 +0000 UTC m=+0.420647114 container init c4cba66467f9387c878f10a1d12ecb751f47281ebe79b39269fbb855f810ba75 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD) 2024-03-22T07:32:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:37 smithi195 ceph-mon[82061]: pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:38.297 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:37 smithi134 podman[102429]: 2024-03-22 07:32:37.907106649 +0000 UTC m=+0.424173164 container start c4cba66467f9387c878f10a1d12ecb751f47281ebe79b39269fbb855f810ba75 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-22T07:32:38.298 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 podman[102429]: 2024-03-22 07:32:38.028530286 +0000 UTC m=+0.545596801 container attach c4cba66467f9387c878f10a1d12ecb751f47281ebe79b39269fbb855f810ba75 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, ceph=True, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-22T07:32:38.659 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-22T07:32:38.659 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-22T07:32:38.659 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-22T07:32:38.659 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-22T07:32:38.659 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-22T07:32:38.659 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 bash[102429]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate[102443]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-22T07:32:38.660 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 podman[102429]: 2024-03-22 07:32:38.376353572 +0000 UTC m=+0.893420080 container died c4cba66467f9387c878f10a1d12ecb751f47281ebe79b39269fbb855f810ba75 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-22T07:32:39.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:38 smithi134 podman[102582]: 2024-03-22 07:32:38.966395807 +0000 UTC m=+0.581551001 container remove c4cba66467f9387c878f10a1d12ecb751f47281ebe79b39269fbb855f810ba75 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-activate, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-22T07:32:39.296 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 podman[102645]: 2024-03-22 07:32:39.079945956 +0000 UTC m=+0.018096946 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:32:39.296 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 podman[102645]: 2024-03-22 07:32:39.192240915 +0000 UTC m=+0.130391897 container create 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=) 2024-03-22T07:32:39.666 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 podman[102645]: 2024-03-22 07:32:39.403246589 +0000 UTC m=+0.341397578 container init 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-22T07:32:39.666 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 podman[102645]: 2024-03-22 07:32:39.406269344 +0000 UTC m=+0.344420327 container start 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-22T07:32:39.666 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 ceph-osd[102664]: -- 172.21.15.134:0/1703730877 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56074bd671e0 con 0x56074bd39000 2024-03-22T07:32:39.666 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 bash[102645]: 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef 2024-03-22T07:32:39.666 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 systemd[1]: Started Ceph osd.0 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:32:39.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:39 smithi134 ceph-mon[93947]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:39.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:39 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:39.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:39 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:39.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:39 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:39 smithi195 ceph-mon[82061]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:32:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:39 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:39 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:39 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:40.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:39 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:32:39.948+0000 7fc45d6ea7c0 -1 Falling back to public interface 2024-03-22T07:32:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:40 smithi134 ceph-mon[93947]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:40 smithi134 ceph-mon[93947]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 17 pgs degraded (PG_DEGRADED) 2024-03-22T07:32:41.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:40 smithi195 ceph-mon[82061]: pgmap v46: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:41.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:40 smithi195 ceph-mon[82061]: Health check failed: Degraded data redundancy: 43/219 objects degraded (19.635%), 17 pgs degraded (PG_DEGRADED) 2024-03-22T07:32:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:43 smithi134 ceph-mon[93947]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:43 smithi195 ceph-mon[82061]: pgmap v47: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:44.795 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:44 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:32:44.497+0000 7fc45d6ea7c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-03-22T07:32:45.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:45 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:32:45.003+0000 7fc45d6ea7c0 -1 osd.0 50 log_to_monitors true 2024-03-22T07:32:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:45 smithi134 ceph-mon[93947]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:45.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:45 smithi134 ceph-mon[93947]: from='osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-22T07:32:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:45 smithi195 ceph-mon[82061]: pgmap v48: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:45 smithi195 ceph-mon[82061]: from='osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-22T07:32:46.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:32:45 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:32:45.879+0000 7fc44eb42700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:32:47.165 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: from='osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-22T07:32:47.166 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: failed to encode map e53 with expected crc 2024-03-22T07:32:47.166 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: osdmap e53: 6 total, 5 up, 6 in 2024-03-22T07:32:47.166 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: from='osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:32:47.166 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:47.166 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:47.166 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:46 smithi134 ceph-mon[93947]: pgmap v50: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: from='osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: failed to encode map e53 with expected crc 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: osdmap e53: 6 total, 5 up, 6 in 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: from='osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:46 smithi195 ceph-mon[82061]: pgmap v50: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:48.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:47 smithi134 ceph-mon[93947]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:32:48.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:47 smithi134 ceph-mon[93947]: failed to encode map e53 with expected crc 2024-03-22T07:32:48.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:47 smithi134 ceph-mon[93947]: osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408] boot 2024-03-22T07:32:48.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:47 smithi134 ceph-mon[93947]: osdmap e54: 6 total, 6 up, 6 in 2024-03-22T07:32:48.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:47 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:32:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:47 smithi195 ceph-mon[82061]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:32:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:47 smithi195 ceph-mon[82061]: failed to encode map e53 with expected crc 2024-03-22T07:32:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:47 smithi195 ceph-mon[82061]: osd.0 [v2:172.21.15.134:6802/2109678408,v1:172.21.15.134:6803/2109678408] boot 2024-03-22T07:32:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:47 smithi195 ceph-mon[82061]: osdmap e54: 6 total, 6 up, 6 in 2024-03-22T07:32:48.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:47 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-22T07:32:49.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: osdmap e55: 6 total, 6 up, 6 in 2024-03-22T07:32:49.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: pgmap v53: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:49.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: osdmap e55: 6 total, 6 up, 6 in 2024-03-22T07:32:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: failed to encode map e55 with expected crc 2024-03-22T07:32:49.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: pgmap v53: 65 pgs: 17 active+undersized+degraded, 17 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/219 objects degraded (19.635%) 2024-03-22T07:32:49.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:49.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:32:50.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:50.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:50.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:50.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-22T07:32:50.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:50 smithi195 ceph-mon[82061]: mgrmap e39: smithi134.wtwqre(active, since 91s), standbys: smithi195.jxfsnc 2024-03-22T07:32:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:32:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:32:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:32:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:50.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:50.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:32:50.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:32:50.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:32:50.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-22T07:32:50.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:50 smithi134 ceph-mon[93947]: mgrmap e39: smithi134.wtwqre(active, since 91s), standbys: smithi195.jxfsnc 2024-03-22T07:32:51.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:51 smithi195 ceph-mon[82061]: pgmap v54: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 5/219 objects degraded (2.283%) 2024-03-22T07:32:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:51 smithi134 ceph-mon[93947]: pgmap v54: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 5/219 objects degraded (2.283%) 2024-03-22T07:32:52.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:52 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2024-03-22T07:32:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:52 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded (PG_DEGRADED) 2024-03-22T07:32:53.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:53 smithi195 ceph-mon[82061]: pgmap v55: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 464 B/s wr, 0 op/s 2024-03-22T07:32:53.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:53 smithi134 ceph-mon[93947]: pgmap v55: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 464 B/s wr, 0 op/s 2024-03-22T07:32:54.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:54 smithi195 ceph-mon[82061]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded) 2024-03-22T07:32:54.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:54 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:32:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:54 smithi134 ceph-mon[93947]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/219 objects degraded (2.283%), 2 pgs degraded) 2024-03-22T07:32:54.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:54 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:32:55.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:55 smithi195 ceph-mon[82061]: pgmap v56: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-03-22T07:32:55.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:55 smithi134 ceph-mon[93947]: pgmap v56: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-03-22T07:32:57.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:57 smithi134 ceph-mon[93947]: pgmap v57: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 319 B/s wr, 0 op/s 2024-03-22T07:32:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:57 smithi195 ceph-mon[82061]: pgmap v57: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 319 B/s wr, 0 op/s 2024-03-22T07:32:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:59 smithi134 ceph-mon[93947]: pgmap v58: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 289 B/s wr, 0 op/s 2024-03-22T07:32:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:32:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:32:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:59 smithi195 ceph-mon[82061]: pgmap v58: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 289 B/s wr, 0 op/s 2024-03-22T07:32:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:32:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:01.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 -- 172.21.15.134:0/3124183301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 msgr2=0x7f007c0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 --2- 172.21.15.134:0/3124183301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c0fd310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f006c004940 tx=0x7f006c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 -- 172.21.15.134:0/3124183301 shutdown_connections 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 --2- 172.21.15.134:0/3124183301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007c0fe070 0x7f007c0fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 --2- 172.21.15.134:0/3124183301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c0fd310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 -- 172.21.15.134:0/3124183301 >> 172.21.15.134:0/3124183301 conn(0x7f007c0f85a0 msgr2=0x7f007c0fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 -- 172.21.15.134:0/3124183301 shutdown_connections 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.135+0000 7f0083f5f700 1 -- 172.21.15.134:0/3124183301 wait complete. 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0083f5f700 1 Processor -- start 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0083f5f700 1 -- start start 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0083f5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c10d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0083f5f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007c0fe070 0x7f007c10df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0083f5f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c10e500 con 0x7f007c0fcf00 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0083f5f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c10ed50 con 0x7f007c0fe070 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0081cfb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c10d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0081cfb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c10d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56666/0 (socket says 172.21.15.134:56666) 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f0081cfb700 1 -- 172.21.15.134:0/937997093 learned_addr learned my addr 172.21.15.134:0/937997093 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.136+0000 7f00814fa700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007c0fe070 0x7f007c10df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f0081cfb700 1 -- 172.21.15.134:0/937997093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007c0fe070 msgr2=0x7f007c10df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f0081cfb700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007c0fe070 0x7f007c10df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f0081cfb700 1 -- 172.21.15.134:0/937997093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c005040 con 0x7f007c0fcf00 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f0081cfb700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c10d9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f006c013870 tx=0x7f006c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c021070 con 0x7f007c0fcf00 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f006c009430 con 0x7f007c0fcf00 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c00e070 con 0x7f007c0fcf00 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c10efd0 con 0x7f007c0fcf00 2024-03-22T07:33:01.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.137+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c10f510 con 0x7f007c0fcf00 2024-03-22T07:33:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.138+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c05f5f0 con 0x7f007c0fcf00 2024-03-22T07:33:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.138+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f006c01c750 con 0x7f007c0fcf00 2024-03-22T07:33:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.139+0000 7f00727fc700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f006806d380 0x7f006806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.139+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f006c08d9a0 con 0x7f007c0fcf00 2024-03-22T07:33:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.139+0000 7f00814fa700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f006806d380 0x7f006806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.139+0000 7f00814fa700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f006806d380 0x7f006806f830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0078009b80 tx=0x7f007800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:01.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.144+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f006c05b080 con 0x7f007c0fcf00 2024-03-22T07:33:01.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.358+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f007c10f7f0 con 0x7f006806d380 2024-03-22T07:33:01.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.360+0000 7f00727fc700 1 -- 172.21.15.134:0/937997093 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f007c10f7f0 con 0x7f006806d380 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f006806d380 msgr2=0x7f006806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f006806d380 0x7f006806f830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0078009b80 tx=0x7f007800b040 comp rx=0 tx=0).stop 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 msgr2=0x7f007c10d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c10d9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f006c013870 tx=0x7f006c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 shutdown_connections 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f006806d380 0x7f006806f830 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007c0fcf00 0x7f007c10d9c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 --2- 172.21.15.134:0/937997093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f007c0fe070 0x7f007c10df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 >> 172.21.15.134:0/937997093 conn(0x7f007c0f85a0 msgr2=0x7f007c0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 shutdown_connections 2024-03-22T07:33:01.363 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.362+0000 7f0083f5f700 1 -- 172.21.15.134:0/937997093 wait complete. 2024-03-22T07:33:01.373 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.464+0000 7fdfaafde700 1 -- 172.21.15.134:0/1780909084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 msgr2=0x7fdfa40fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.464+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1780909084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fd3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf90004940 tx=0x7fdf90009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 -- 172.21.15.134:0/1780909084 shutdown_connections 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1780909084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fd3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1780909084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 0x7fdfa40fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 -- 172.21.15.134:0/1780909084 >> 172.21.15.134:0/1780909084 conn(0x7fdfa40f7450 msgr2=0x7fdfa40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:01.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 -- 172.21.15.134:0/1780909084 shutdown_connections 2024-03-22T07:33:01.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 -- 172.21.15.134:0/1780909084 wait complete. 2024-03-22T07:33:01.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 Processor -- start 2024-03-22T07:33:01.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.465+0000 7fdfaafde700 1 -- start start 2024-03-22T07:33:01.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfaafde700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 0x7fdfa40ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfaafde700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfaafde700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4100150 con 0x7fdfa40fcf80 2024-03-22T07:33:01.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfaafde700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40fe800 con 0x7fdfa40fbcd0 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fe2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56692/0 (socket says 172.21.15.134:56692) 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 -- 172.21.15.134:0/1513269132 learned_addr learned my addr 172.21.15.134:0/1513269132 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa8d7a700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 0x7fdfa40ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 -- 172.21.15.134:0/1513269132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 msgr2=0x7fdfa40ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 0x7fdfa40ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 -- 172.21.15.134:0/1513269132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90005040 con 0x7fdfa40fcf80 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa8d7a700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 0x7fdfa40ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa3fff700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fe2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000b3b0 tx=0x7fdf90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf9000e040 con 0x7fdfa40fcf80 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa40fea80 con 0x7fdfa40fcf80 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.466+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf90004290 con 0x7fdfa40fcf80 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.467+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf9001c630 con 0x7fdfa40fcf80 2024-03-22T07:33:01.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.467+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40ff040 con 0x7fdfa40fcf80 2024-03-22T07:33:01.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.468+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa404c710 con 0x7fdfa40fcf80 2024-03-22T07:33:01.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.468+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fdf9000bbf0 con 0x7fdfa40fcf80 2024-03-22T07:33:01.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.468+0000 7fdfa17fa700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdf9406d380 0x7fdf9406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.469+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdf9008dd10 con 0x7fdfa40fcf80 2024-03-22T07:33:01.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.469+0000 7fdfa8d7a700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdf9406d380 0x7fdf9406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.469+0000 7fdfa8d7a700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdf9406d380 0x7fdf9406f830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf98007fd0 tx=0x7fdf98009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:01.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.473+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdf9005b350 con 0x7fdfa40fcf80 2024-03-22T07:33:01.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.685+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfa405e400 con 0x7fdf9406d380 2024-03-22T07:33:01.687 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.686+0000 7fdfa17fa700 1 -- 172.21.15.134:0/1513269132 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdfa405e400 con 0x7fdf9406d380 2024-03-22T07:33:01.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdf9406d380 msgr2=0x7fdf9406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdf9406d380 0x7fdf9406f830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf98007fd0 tx=0x7fdf98009040 comp rx=0 tx=0).stop 2024-03-22T07:33:01.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 msgr2=0x7fdfa40fe2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fe2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000b3b0 tx=0x7fdf90009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 shutdown_connections 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdf9406d380 0x7fdf9406f830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfa40fbcd0 0x7fdfa40ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 --2- 172.21.15.134:0/1513269132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa40fcf80 0x7fdfa40fe2c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.688+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 >> 172.21.15.134:0/1513269132 conn(0x7fdfa40f7450 msgr2=0x7fdfa4066810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.689+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 shutdown_connections 2024-03-22T07:33:01.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.689+0000 7fdfaafde700 1 -- 172.21.15.134:0/1513269132 wait complete. 2024-03-22T07:33:01.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.789+0000 7faee72a8700 1 -- 172.21.15.134:0/3733601920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 msgr2=0x7faee00fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.789+0000 7faee72a8700 1 --2- 172.21.15.134:0/3733601920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee00fc0e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faed0004940 tx=0x7faed0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:01.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.789+0000 7faee72a8700 1 -- 172.21.15.134:0/3733601920 shutdown_connections 2024-03-22T07:33:01.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.789+0000 7faee72a8700 1 --2- 172.21.15.134:0/3733601920 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee00fcf80 0x7faee00fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.789+0000 7faee72a8700 1 --2- 172.21.15.134:0/3733601920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee00fc0e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.791 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.789+0000 7faee72a8700 1 -- 172.21.15.134:0/3733601920 >> 172.21.15.134:0/3733601920 conn(0x7faee00f7450 msgr2=0x7faee00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:01.791 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:01 smithi134 ceph-mon[93947]: pgmap v59: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-22T07:33:01.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 -- 172.21.15.134:0/3733601920 shutdown_connections 2024-03-22T07:33:01.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 -- 172.21.15.134:0/3733601920 wait complete. 2024-03-22T07:33:01.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 Processor -- start 2024-03-22T07:33:01.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 -- start start 2024-03-22T07:33:01.793 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee00fcf80 0x7faee010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee010e470 con 0x7faee00fbcd0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee72a8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee010e5e0 con 0x7faee00fcf80 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.790+0000 7faee5044700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee5044700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee010d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56716/0 (socket says 172.21.15.134:56716) 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee5044700 1 -- 172.21.15.134:0/3098343682 learned_addr learned my addr 172.21.15.134:0/3098343682 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee4843700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee00fcf80 0x7faee010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee5044700 1 -- 172.21.15.134:0/3098343682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee00fcf80 msgr2=0x7faee010de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee5044700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee00fcf80 0x7faee010de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee5044700 1 -- 172.21.15.134:0/3098343682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0005040 con 0x7faee00fbcd0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee5044700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee010d930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faed000b3b0 tx=0x7faed0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed000e040 con 0x7faee00fbcd0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faed000bbf0 con 0x7faee00fbcd0 2024-03-22T07:33:01.794 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0112fe0 con 0x7faee00fbcd0 2024-03-22T07:33:01.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed001c630 con 0x7faee00fbcd0 2024-03-22T07:33:01.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.791+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee0113510 con 0x7faee00fbcd0 2024-03-22T07:33:01.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.792+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee0101b10 con 0x7faee00fbcd0 2024-03-22T07:33:01.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.793+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7faed000bd60 con 0x7faee00fbcd0 2024-03-22T07:33:01.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.793+0000 7faed5ffb700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faecc06d380 0x7faecc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:01.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.793+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faed008d4d0 con 0x7faee00fbcd0 2024-03-22T07:33:01.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.794+0000 7faee4843700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faecc06d380 0x7faecc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:01.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.794+0000 7faee4843700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faecc06d380 0x7faecc06f830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faedc004f40 tx=0x7faedc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:01.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:01.798+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faed005ab10 con 0x7faee00fbcd0 2024-03-22T07:33:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:01 smithi195 ceph-mon[82061]: pgmap v59: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-03-22T07:33:02.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.000+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faee002b3b0 con 0x7faecc06d380 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.010+0000 7faed5ffb700 1 -- 172.21.15.134:0/3098343682 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7faee002b3b0 con 0x7faecc06d380 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (3m) 17s ago 12m 25.7M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (48s) 17s ago 12m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (43s) 40s ago 11m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 17s ago 12m 81.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (6m) 17s ago 6m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:33:02.011 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (6m) 17s ago 6m 13.5M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (6m) 40s ago 6m 14.7M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (6m) 40s ago 6m 14.0M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (2m) 17s ago 13m 500M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (2m) 40s ago 11m 449M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (112s) 17s ago 13m 45.3M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (89s) 40s ago 11m 31.2M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 17s ago 12m 15.0M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 40s ago 11m 15.0M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (22s) 17s ago 10m 12.7M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (10m) 17s ago 10m 272M 1557M 17.2.7-726-g9c4e0c34 837124da804f a8374e1fddb9 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (9m) 17s ago 9m 219M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (9m) 40s ago 9m 296M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (8m) 40s ago 8m 262M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (8m) 40s ago 8m 238M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:33:02.012 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 17s ago 11m 49.5M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:33:02.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faecc06d380 msgr2=0x7faecc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faecc06d380 0x7faecc06f830 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faedc004f40 tx=0x7faedc00b040 comp rx=0 tx=0).stop 2024-03-22T07:33:02.013 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 msgr2=0x7faee010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee010d930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faed000b3b0 tx=0x7faed0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 shutdown_connections 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faecc06d380 0x7faecc06f830 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee00fbcd0 0x7faee010d930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 --2- 172.21.15.134:0/3098343682 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee00fcf80 0x7faee010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.012+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 >> 172.21.15.134:0/3098343682 conn(0x7faee00f7450 msgr2=0x7faee00667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.013+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 shutdown_connections 2024-03-22T07:33:02.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.013+0000 7faee72a8700 1 -- 172.21.15.134:0/3098343682 wait complete. 2024-03-22T07:33:02.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f577fe700 1 -- 172.21.15.134:0/2824559617 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4400bcb0 con 0x7f7f580fff00 2024-03-22T07:33:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2824559617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 msgr2=0x7f7f58102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2824559617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f58102320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7f44004940 tx=0x7f7f44009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2824559617 shutdown_connections 2024-03-22T07:33:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2824559617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f58102320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2824559617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f58066f50 0x7f7f580ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.115 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2824559617 >> 172.21.15.134:0/2824559617 conn(0x7f7f580f7450 msgr2=0x7f7f580f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2824559617 shutdown_connections 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.112+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2824559617 wait complete. 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5eb24700 1 Processor -- start 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5eb24700 1 -- start start 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5eb24700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f58066f50 0x7f7f5810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5eb24700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f5810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5eb24700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5810e560 con 0x7f7f580fff00 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5eb24700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58112f00 con 0x7f7f58066f50 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f57fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f5810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f57fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f5810ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56730/0 (socket says 172.21.15.134:56730) 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f57fff700 1 -- 172.21.15.134:0/2471122558 learned_addr learned my addr 172.21.15.134:0/2471122558 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.113+0000 7f7f5c8c0700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f58066f50 0x7f7f5810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f57fff700 1 -- 172.21.15.134:0/2471122558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f58066f50 msgr2=0x7f7f5810d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f57fff700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f58066f50 0x7f7f5810d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f57fff700 1 -- 172.21.15.134:0/2471122558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f44005040 con 0x7f7f580fff00 2024-03-22T07:33:02.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f57fff700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f5810ded0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009150 tx=0x7f7f44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:02.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4400e040 con 0x7f7f580fff00 2024-03-22T07:33:02.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f4400bcc0 con 0x7f7f580fff00 2024-03-22T07:33:02.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f58113100 con 0x7f7f580fff00 2024-03-22T07:33:02.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4401c630 con 0x7f7f580fff00 2024-03-22T07:33:02.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.114+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f58113670 con 0x7f7f580fff00 2024-03-22T07:33:02.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.115+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5804c710 con 0x7f7f580fff00 2024-03-22T07:33:02.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.115+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f7f44013420 con 0x7f7f580fff00 2024-03-22T07:33:02.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.116+0000 7f7f557fa700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7f4806d380 0x7f7f4806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.116+0000 7f7f5c8c0700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7f4806d380 0x7f7f4806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.116+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7f4408d4e0 con 0x7f7f580fff00 2024-03-22T07:33:02.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.116+0000 7f7f5c8c0700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7f4806d380 0x7f7f4806f830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c006fd0 tx=0x7f7f4c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:02.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.121+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7f4405abc0 con 0x7f7f580fff00 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.393+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f58105950 con 0x7f7f580fff00 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.394+0000 7f7f557fa700 1 -- 172.21.15.134:0/2471122558 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f7f4405fe60 con 0x7f7f580fff00 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:33:02.395 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 5, 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 1 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 9, 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 5 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:33:02.396 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:33:02.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.396+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7f4806d380 msgr2=0x7f7f4806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.396+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7f4806d380 0x7f7f4806f830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c006fd0 tx=0x7f7f4c008040 comp rx=0 tx=0).stop 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.396+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 msgr2=0x7f7f5810ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.396+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f5810ded0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009150 tx=0x7f7f44009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 shutdown_connections 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7f4806d380 0x7f7f4806f830 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f58066f50 0x7f7f5810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 --2- 172.21.15.134:0/2471122558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fff00 0x7f7f5810ded0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 >> 172.21.15.134:0/2471122558 conn(0x7f7f580f7450 msgr2=0x7f7f580f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:02.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 shutdown_connections 2024-03-22T07:33:02.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.397+0000 7f7f5eb24700 1 -- 172.21.15.134:0/2471122558 wait complete. 2024-03-22T07:33:02.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.498+0000 7fd32e298700 1 -- 172.21.15.134:0/1627787133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 msgr2=0x7fd3280fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.498+0000 7fd32e298700 1 --2- 172.21.15.134:0/1627787133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd3280fe450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd31c004940 tx=0x7fd31c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.498+0000 7fd32e298700 1 -- 172.21.15.134:0/1627787133 shutdown_connections 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.498+0000 7fd32e298700 1 --2- 172.21.15.134:0/1627787133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd3280fe450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.498+0000 7fd32e298700 1 --2- 172.21.15.134:0/1627787133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 0x7fd3280fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.498+0000 7fd32e298700 1 -- 172.21.15.134:0/1627787133 >> 172.21.15.134:0/1627787133 conn(0x7fd3280f8550 msgr2=0x7fd3280fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 -- 172.21.15.134:0/1627787133 shutdown_connections 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 -- 172.21.15.134:0/1627787133 wait complete. 2024-03-22T07:33:02.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 Processor -- start 2024-03-22T07:33:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 -- start start 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 0x7fd32810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd32810de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32810e500 con 0x7fd3280fdfe0 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd32e298700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328112ea0 con 0x7fd3280fce70 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd3277fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd32810de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd3277fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd32810de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56756/0 (socket says 172.21.15.134:56756) 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.499+0000 7fd3277fe700 1 -- 172.21.15.134:0/741276062 learned_addr learned my addr 172.21.15.134:0/741276062 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd327fff700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 0x7fd32810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd3277fe700 1 -- 172.21.15.134:0/741276062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 msgr2=0x7fd32810d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd3277fe700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 0x7fd32810d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd3277fe700 1 -- 172.21.15.134:0/741276062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c005040 con 0x7fd3280fdfe0 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd327fff700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 0x7fd32810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd3277fe700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd32810de70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00b3b0 tx=0x7fd31c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:02.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31c00e040 con 0x7fd3280fdfe0 2024-03-22T07:33:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd31c00bcc0 con 0x7fd3280fdfe0 2024-03-22T07:33:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31c01c630 con 0x7fd3280fdfe0 2024-03-22T07:33:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3281130a0 con 0x7fd3280fdfe0 2024-03-22T07:33:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.500+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd328113610 con 0x7fd3280fdfe0 2024-03-22T07:33:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.501+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32804c710 con 0x7fd3280fdfe0 2024-03-22T07:33:02.504 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.502+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fd31c013980 con 0x7fd3280fdfe0 2024-03-22T07:33:02.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.502+0000 7fd324ff9700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd31006d380 0x7fd31006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.502+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd31c08d540 con 0x7fd3280fdfe0 2024-03-22T07:33:02.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.502+0000 7fd327fff700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd31006d380 0x7fd31006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.503+0000 7fd327fff700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd31006d380 0x7fd31006f830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd318006fd0 tx=0x7fd318008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:02.507 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.507+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd31c05ab80 con 0x7fd3280fdfe0 2024-03-22T07:33:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:02 smithi195 ceph-mon[82061]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:02 smithi195 ceph-mon[82061]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:02 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2471122558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:02.747 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.746+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd328105950 con 0x7fd3280fdfe0 2024-03-22T07:33:02.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:02 smithi134 ceph-mon[93947]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:02.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:02 smithi134 ceph-mon[93947]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:02.748 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:02 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2471122558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:02.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.746+0000 7fd324ff9700 1 -- 172.21.15.134:0/741276062 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7fd31c05a710 con 0x7fd3280fdfe0 2024-03-22T07:33:02.749 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:33:02.749 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:33:02.749 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:33:02.750 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:33:02.751 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:33:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:33:02.753 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:33:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:02.755 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:02.755 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:02.755 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:02.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd31006d380 msgr2=0x7fd31006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd31006d380 0x7fd31006f830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd318006fd0 tx=0x7fd318008040 comp rx=0 tx=0).stop 2024-03-22T07:33:02.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 msgr2=0x7fd32810de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd32810de70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00b3b0 tx=0x7fd31c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 shutdown_connections 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd31006d380 0x7fd31006f830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3280fce70 0x7fd32810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 --2- 172.21.15.134:0/741276062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3280fdfe0 0x7fd32810de70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 >> 172.21.15.134:0/741276062 conn(0x7fd3280f8550 msgr2=0x7fd3280f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 shutdown_connections 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.749+0000 7fd32e298700 1 -- 172.21.15.134:0/741276062 wait complete. 2024-03-22T07:33:02.757 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:33:02.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 -- 172.21.15.134:0/1082115450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880662e0 msgr2=0x7f22880ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 --2- 172.21.15.134:0/1082115450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880662e0 0x7f22880ff9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2280009ce0 tx=0x7f2280004d10 comp rx=0 tx=0).stop 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 -- 172.21.15.134:0/1082115450 shutdown_connections 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 --2- 172.21.15.134:0/1082115450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22880fff00 0x7f2288102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 --2- 172.21.15.134:0/1082115450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880662e0 0x7f22880ff9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 -- 172.21.15.134:0/1082115450 >> 172.21.15.134:0/1082115450 conn(0x7f22880f7430 msgr2=0x7f22880f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 -- 172.21.15.134:0/1082115450 shutdown_connections 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 -- 172.21.15.134:0/1082115450 wait complete. 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 Processor -- start 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.850+0000 7f228c8cd700 1 -- start start 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f228c8cd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22880662e0 0x7f22880fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f228c8cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 0x7f22880fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f228c8cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880fbe70 con 0x7f22880fff00 2024-03-22T07:33:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f228c8cd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880fbfe0 con 0x7f22880662e0 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 0x7f22880fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 0x7f22880fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56780/0 (socket says 172.21.15.134:56780) 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 -- 172.21.15.134:0/3684741438 learned_addr learned my addr 172.21.15.134:0/3684741438 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f228659c700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22880662e0 0x7f22880fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 -- 172.21.15.134:0/3684741438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22880662e0 msgr2=0x7f22880fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22880662e0 0x7f22880fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 -- 172.21.15.134:0/3684741438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280009940 con 0x7f22880fff00 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2285d9b700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 0x7f22880fb8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f227c00c8c0 tx=0x7f227c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227c00a760 con 0x7f22880fff00 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22880fc2c0 con 0x7f22880fff00 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f227c00ad90 con 0x7f22880fff00 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.851+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227c0113a0 con 0x7f22880fff00 2024-03-22T07:33:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.852+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288115bd0 con 0x7f22880fff00 2024-03-22T07:33:02.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.852+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228805f5f0 con 0x7f22880fff00 2024-03-22T07:33:02.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.853+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f227c012400 con 0x7f22880fff00 2024-03-22T07:33:02.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.853+0000 7f2276ffd700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f227006d380 0x7f227006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:02.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.853+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f227c08c8d0 con 0x7f22880fff00 2024-03-22T07:33:02.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.853+0000 7f228659c700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f227006d380 0x7f227006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:02.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.854+0000 7f228659c700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f227006d380 0x7f227006f830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2280009cb0 tx=0x7f2280004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:02.859 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:02.858+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f227c0563e0 con 0x7f22880fff00 2024-03-22T07:33:03.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.072+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22880f8f70 con 0x7f227006d380 2024-03-22T07:33:03.074 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.073+0000 7f2276ffd700 1 -- 172.21.15.134:0/3684741438 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f22880f8f70 con 0x7f227006d380 2024-03-22T07:33:03.074 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:33:03.074 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:33:03.074 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:33:03.074 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "7/21 daemons upgraded", 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:33:03.075 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:33:03.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f227006d380 msgr2=0x7f227006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f227006d380 0x7f227006f830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2280009cb0 tx=0x7f2280004d10 comp rx=0 tx=0).stop 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 msgr2=0x7f22880fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 0x7f22880fb8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f227c00c8c0 tx=0x7f227c0044c0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 shutdown_connections 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f227006d380 0x7f227006f830 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22880662e0 0x7f22880fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 --2- 172.21.15.134:0/3684741438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22880fff00 0x7f22880fb8c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.075+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 >> 172.21.15.134:0/3684741438 conn(0x7f22880f7430 msgr2=0x7f22880f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.076+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 shutdown_connections 2024-03-22T07:33:03.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.076+0000 7f228c8cd700 1 -- 172.21.15.134:0/3684741438 wait complete. 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.177+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/1142798770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fdfe0 msgr2=0x7fcfc40fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.177+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/1142798770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fdfe0 0x7fcfc40fe450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8004940 tx=0x7fcfb8009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/1142798770 shutdown_connections 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/1142798770 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fdfe0 0x7fcfc40fe450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/1142798770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfc40fce70 0x7fcfc40fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/1142798770 >> 172.21.15.134:0/1142798770 conn(0x7fcfc40f8550 msgr2=0x7fcfc40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/1142798770 shutdown_connections 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/1142798770 wait complete. 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 Processor -- start 2024-03-22T07:33:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- start start 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 0x7fcfc410d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfc40fdfe0 0x7fcfc410de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc410e480 con 0x7fcfc40fce70 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc8bb6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc410e5f0 con 0x7fcfc40fdfe0 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 0x7fcfc410d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 0x7fcfc410d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:56802/0 (socket says 172.21.15.134:56802) 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.178+0000 7fcfc259c700 1 -- 172.21.15.134:0/3318700829 learned_addr learned my addr 172.21.15.134:0/3318700829 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc1d9b700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfc40fdfe0 0x7fcfc410de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc259c700 1 -- 172.21.15.134:0/3318700829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfc40fdfe0 msgr2=0x7fcfc410de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc259c700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfc40fdfe0 0x7fcfc410de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc259c700 1 -- 172.21.15.134:0/3318700829 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8005040 con 0x7fcfc40fce70 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc259c700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 0x7fcfc410d940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4002a50 tx=0x7fcfb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb4007cc0 con 0x7fcfc40fce70 2024-03-22T07:33:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfb400f040 con 0x7fcfc40fce70 2024-03-22T07:33:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc4112ff0 con 0x7fcfc40fce70 2024-03-22T07:33:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb400da70 con 0x7fcfc40fce70 2024-03-22T07:33:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.179+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc4113580 con 0x7fcfc40fce70 2024-03-22T07:33:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.180+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc404c710 con 0x7fcfc40fce70 2024-03-22T07:33:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.181+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fcfb400dc10 con 0x7fcfc40fce70 2024-03-22T07:33:03.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.181+0000 7fcfb2ffd700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfac06d380 0x7fcfac06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:03.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.181+0000 7fcfc1d9b700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfac06d380 0x7fcfac06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:03.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.181+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcfb408be80 con 0x7fcfc40fce70 2024-03-22T07:33:03.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.182+0000 7fcfc1d9b700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfac06d380 0x7fcfac06f830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009fd0 tx=0x7fcfb8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:03.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.186+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcfb40594c0 con 0x7fcfc40fce70 2024-03-22T07:33:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.460+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcfc41058f0 con 0x7fcfc40fce70 2024-03-22T07:33:03.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.460+0000 7fcfb2ffd700 1 -- 172.21.15.134:0/3318700829 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcfb4017020 con 0x7fcfc40fce70 2024-03-22T07:33:03.461 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:33:03.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfac06d380 msgr2=0x7fcfac06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:03.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfac06d380 0x7fcfac06f830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009fd0 tx=0x7fcfb8009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:03.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 msgr2=0x7fcfc410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:03.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 0x7fcfc410d940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4002a50 tx=0x7fcfb40046b0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 shutdown_connections 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfac06d380 0x7fcfac06f830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc40fce70 0x7fcfc410d940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 --2- 172.21.15.134:0/3318700829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfc40fdfe0 0x7fcfc410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 >> 172.21.15.134:0/3318700829 conn(0x7fcfc40f8550 msgr2=0x7fcfc40f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 shutdown_connections 2024-03-22T07:33:03.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:03.462+0000 7fcfc8bb6700 1 -- 172.21.15.134:0/3318700829 wait complete. 2024-03-22T07:33:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:03 smithi134 ceph-mon[93947]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:03 smithi134 ceph-mon[93947]: pgmap v60: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:03 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/741276062' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:33:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:03 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3318700829' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:33:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:03.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:03 smithi195 ceph-mon[82061]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:03 smithi195 ceph-mon[82061]: pgmap v60: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:03 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/741276062' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:33:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:03 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3318700829' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:33:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:04.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:04 smithi134 ceph-mon[93947]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:04.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:04 smithi195 ceph-mon[82061]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:05 smithi134 ceph-mon[93947]: pgmap v61: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:05 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:33:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:05 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:33:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:05 smithi134 ceph-mon[93947]: Upgrade: osd.1 is safe to restart 2024-03-22T07:33:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:05 smithi195 ceph-mon[82061]: pgmap v61: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:05 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:33:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:05 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-22T07:33:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:05 smithi195 ceph-mon[82061]: Upgrade: osd.1 is safe to restart 2024-03-22T07:33:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:07 smithi134 ceph-mon[93947]: Upgrade: Updating osd.1 2024-03-22T07:33:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-22T07:33:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:33:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:07 smithi134 ceph-mon[93947]: Deploying daemon osd.1 on smithi134 2024-03-22T07:33:07.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:07 smithi134 ceph-mon[93947]: pgmap v62: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:07.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:07 smithi195 ceph-mon[82061]: Upgrade: Updating osd.1 2024-03-22T07:33:07.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:07.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-22T07:33:07.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:33:07.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:07 smithi195 ceph-mon[82061]: Deploying daemon osd.1 on smithi134 2024-03-22T07:33:07.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:07 smithi195 ceph-mon[82061]: pgmap v62: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:09.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:09 smithi134 ceph-mon[93947]: pgmap v63: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:09.795 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:09 smithi134 systemd[1]: Stopping Ceph osd.1 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:33:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:09 smithi195 ceph-mon[82061]: pgmap v63: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:10.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:09 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[55534]: 2024-03-22T07:33:09.885+0000 7eff77000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:33:10.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:09 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[55534]: 2024-03-22T07:33:09.885+0000 7eff77000700 -1 osd.1 55 *** Got signal Terminated *** 2024-03-22T07:33:10.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:09 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[55534]: 2024-03-22T07:33:09.885+0000 7eff77000700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:33:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:10 smithi134 ceph-mon[93947]: osd.1 marked itself down and dead 2024-03-22T07:33:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:10 smithi195 ceph-mon[82061]: osd.1 marked itself down and dead 2024-03-22T07:33:11.127 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:10 smithi134 podman[107578]: 2024-03-22 07:33:10.877111959 +0000 UTC m=+1.199197364 container died a8374e1fddb97434bc22ee3d4ac49e7c8de067c96a0ff5e5a9678ad139dbc857 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9c4e0c3, org.label-schema.license=GPLv2, ceph=True) 2024-03-22T07:33:11.386 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:11 smithi134 podman[107578]: 2024-03-22 07:33:11.20217659 +0000 UTC m=+1.524262090 container cleanup a8374e1fddb97434bc22ee3d4ac49e7c8de067c96a0ff5e5a9678ad139dbc857 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=quincy-9c4e0c3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, ceph=True) 2024-03-22T07:33:11.386 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:11 smithi134 bash[107578]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1 2024-03-22T07:33:11.795 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:11 smithi134 podman[107597]: 2024-03-22 07:33:11.386976516 +0000 UTC m=+0.506687478 container remove a8374e1fddb97434bc22ee3d4ac49e7c8de067c96a0ff5e5a9678ad139dbc857 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-9c4e0c3, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-22T07:33:11.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: pgmap v64: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:11.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:33:11.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: osdmap e56: 6 total, 5 up, 6 in 2024-03-22T07:33:11.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:11 smithi134 ceph-mon[93947]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: pgmap v64: 65 pgs: 65 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: osdmap e56: 6 total, 5 up, 6 in 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: failed to encode map e56 with expected crc 2024-03-22T07:33:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:11 smithi195 ceph-mon[82061]: failed to encode map e56 with expected crc 2024-03-22T07:33:12.132 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:11 smithi134 podman[107691]: 2024-03-22 07:33:11.741266113 +0000 UTC m=+0.019259161 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:33:12.132 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:11 smithi134 podman[107691]: 2024-03-22 07:33:11.846508043 +0000 UTC m=+0.124501105 container create 1ca7479df91aa49204c2c4157cecb7008d3569f3acb359c8050caa41cc22217c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-22T07:33:12.132 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:12 smithi134 podman[107691]: 2024-03-22 07:33:12.132445042 +0000 UTC m=+0.410438080 container init 1ca7479df91aa49204c2c4157cecb7008d3569f3acb359c8050caa41cc22217c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:33:12.427 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:12 smithi134 podman[107691]: 2024-03-22 07:33:12.135656291 +0000 UTC m=+0.413649317 container start 1ca7479df91aa49204c2c4157cecb7008d3569f3acb359c8050caa41cc22217c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux ) 2024-03-22T07:33:12.427 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:12 smithi134 podman[107691]: 2024-03-22 07:33:12.216126864 +0000 UTC m=+0.494119886 container attach 1ca7479df91aa49204c2c4157cecb7008d3569f3acb359c8050caa41cc22217c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b) 2024-03-22T07:33:12.728 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:12 smithi134 podman[107691]: 2024-03-22 07:33:12.428021853 +0000 UTC m=+0.706014883 container died 1ca7479df91aa49204c2c4157cecb7008d3569f3acb359c8050caa41cc22217c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: osdmap e57: 6 total, 5 up, 6 in 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.728 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:12 smithi134 ceph-mon[93947]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: osdmap e57: 6 total, 5 up, 6 in 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: failed to encode map e57 with expected crc 2024-03-22T07:33:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:12 smithi195 ceph-mon[82061]: failed to encode map e57 with expected crc 2024-03-22T07:33:13.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 podman[107717]: 2024-03-22 07:33:13.003715854 +0000 UTC m=+0.570842846 container remove 1ca7479df91aa49204c2c4157cecb7008d3569f3acb359c8050caa41cc22217c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307) 2024-03-22T07:33:13.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.1.service: Deactivated successfully. 2024-03-22T07:33:13.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 systemd[1]: Stopped Ceph osd.1 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:33:13.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.1.service: Consumed 1min 8.873s CPU time. 2024-03-22T07:33:13.295 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 systemd[1]: Starting Ceph osd.1 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:33:13.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:13 smithi134 ceph-mon[93947]: pgmap v67: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:13.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:13 smithi134 ceph-mon[93947]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-22T07:33:13.732 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 podman[107824]: 2024-03-22 07:33:13.342958552 +0000 UTC m=+0.018102394 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:33:13.733 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 podman[107824]: 2024-03-22 07:33:13.446542052 +0000 UTC m=+0.121685883 container create 7a8d3954422f15fec2f6d4bf17d51ba1366111f96a686c2fe4f4dbd00fd1597d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-db0330b) 2024-03-22T07:33:13.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:13 smithi195 ceph-mon[82061]: pgmap v67: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-03-22T07:33:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:13 smithi195 ceph-mon[82061]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-22T07:33:14.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 podman[107824]: 2024-03-22 07:33:13.733074903 +0000 UTC m=+0.408218744 container init 7a8d3954422f15fec2f6d4bf17d51ba1366111f96a686c2fe4f4dbd00fd1597d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-22T07:33:14.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 podman[107824]: 2024-03-22 07:33:13.736463589 +0000 UTC m=+0.411607428 container start 7a8d3954422f15fec2f6d4bf17d51ba1366111f96a686c2fe4f4dbd00fd1597d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-22T07:33:14.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:13 smithi134 podman[107824]: 2024-03-22 07:33:13.87445058 +0000 UTC m=+0.549594433 container attach 7a8d3954422f15fec2f6d4bf17d51ba1366111f96a686c2fe4f4dbd00fd1597d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 bash[107824]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-22T07:33:14.511 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-22T07:33:14.512 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-22T07:33:14.512 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate[107840]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-22T07:33:14.512 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 podman[107824]: 2024-03-22 07:33:14.199627144 +0000 UTC m=+0.874770967 container died 7a8d3954422f15fec2f6d4bf17d51ba1366111f96a686c2fe4f4dbd00fd1597d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-db0330b, ceph=True) 2024-03-22T07:33:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:14 smithi134 ceph-mon[93947]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:14 smithi195 ceph-mon[82061]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:15.173 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:14 smithi134 podman[107969]: 2024-03-22 07:33:14.820541239 +0000 UTC m=+0.615219010 container remove 7a8d3954422f15fec2f6d4bf17d51ba1366111f96a686c2fe4f4dbd00fd1597d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-22T07:33:15.173 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 podman[108031]: 2024-03-22 07:33:14.934156131 +0000 UTC m=+0.018216304 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:33:15.173 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 podman[108031]: 2024-03-22 07:33:15.046307823 +0000 UTC m=+0.130367978 container create 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD) 2024-03-22T07:33:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:15 smithi195 ceph-mon[82061]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:16.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:15 smithi134 ceph-mon[93947]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 5 peering, 18 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:16.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 podman[108031]: 2024-03-22 07:33:15.674619778 +0000 UTC m=+0.758679949 container init 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-22T07:33:16.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 podman[108031]: 2024-03-22 07:33:15.678189653 +0000 UTC m=+0.762249810 container start 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-22T07:33:16.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 ceph-osd[108050]: -- 172.21.15.134:0/1094264914 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5628727c11e0 con 0x562872792c00 2024-03-22T07:33:16.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 bash[108031]: 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa 2024-03-22T07:33:16.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:15 smithi134 systemd[1]: Started Ceph osd.1 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:33:16.313 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:16 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:33:16.224+0000 7ffb6acda7c0 -1 Falling back to public interface 2024-03-22T07:33:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:16 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:16 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:16 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:33:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:16 smithi134 ceph-mon[93947]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:16 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:16 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:16 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:33:17.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:16 smithi195 ceph-mon[82061]: pgmap v69: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:18.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:17 smithi134 ceph-mon[93947]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-03-22T07:33:18.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:17 smithi195 ceph-mon[82061]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-03-22T07:33:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:19 smithi134 ceph-mon[93947]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:19 smithi195 ceph-mon[82061]: pgmap v70: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:20.681 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:20 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:20.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:20 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:21.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:20 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:33:20.816+0000 7ffb6acda7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-03-22T07:33:21.795 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:21 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:33:21.447+0000 7ffb6acda7c0 -1 osd.1 55 log_to_monitors true 2024-03-22T07:33:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:21 smithi134 ceph-mon[93947]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:21 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:21 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:21 smithi134 ceph-mon[93947]: from='osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-22T07:33:21.856 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:21 smithi195 ceph-mon[82061]: pgmap v71: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:21.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:21 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:21.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:21 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:21.857 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:21 smithi195 ceph-mon[82061]: from='osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-22T07:33:22.545 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:33:22 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:33:22.186+0000 7ffb5c132700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: from='osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: osdmap e58: 6 total, 5 up, 6 in 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: from='osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: failed to encode map e58 with expected crc 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:23.173 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:23 smithi134 ceph-mon[93947]: pgmap v73: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:23.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: from='osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-22T07:33:23.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: osdmap e58: 6 total, 5 up, 6 in 2024-03-22T07:33:23.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: from='osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:33:23.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:23.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: failed to encode map e58 with expected crc 2024-03-22T07:33:23.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:23.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:23 smithi195 ceph-mon[82061]: pgmap v73: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:33:24.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:24 smithi195 ceph-mon[82061]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:33:24.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:24 smithi195 ceph-mon[82061]: failed to encode map e58 with expected crc 2024-03-22T07:33:24.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:24 smithi195 ceph-mon[82061]: osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473] boot 2024-03-22T07:33:24.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:24 smithi195 ceph-mon[82061]: osdmap e59: 6 total, 6 up, 6 in 2024-03-22T07:33:24.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:24 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:33:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:24 smithi134 ceph-mon[93947]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:33:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:24 smithi134 ceph-mon[93947]: failed to encode map e58 with expected crc 2024-03-22T07:33:24.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:24 smithi134 ceph-mon[93947]: osd.1 [v2:172.21.15.134:6810/3479896473,v1:172.21.15.134:6811/3479896473] boot 2024-03-22T07:33:24.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:24 smithi134 ceph-mon[93947]: osdmap e59: 6 total, 6 up, 6 in 2024-03-22T07:33:24.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-22T07:33:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: osdmap e60: 6 total, 6 up, 6 in 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.296 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:25 smithi134 ceph-mon[93947]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: osdmap e60: 6 total, 6 up, 6 in 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: failed to encode map e60 with expected crc 2024-03-22T07:33:25.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:25 smithi195 ceph-mon[82061]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-03-22T07:33:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:33:26.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:33:26.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:26.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:33:26.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:26.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:26.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:26.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:26 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:26.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:26.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:26.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:26 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:27 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:27 smithi195 ceph-mon[82061]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-03-22T07:33:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:27 smithi195 ceph-mon[82061]: pgmap v77: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-03-22T07:33:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:27 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:27 smithi134 ceph-mon[93947]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-03-22T07:33:27.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:27 smithi134 ceph-mon[93947]: pgmap v77: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-03-22T07:33:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:28 smithi195 ceph-mon[82061]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-03-22T07:33:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:28 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:33:29.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:28 smithi134 ceph-mon[93947]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-03-22T07:33:29.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:28 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:33:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:29 smithi195 ceph-mon[82061]: pgmap v78: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:29 smithi134 ceph-mon[93947]: pgmap v78: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:31 smithi195 ceph-mon[82061]: pgmap v79: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:31 smithi134 ceph-mon[93947]: pgmap v79: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:33.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.583+0000 7f1602b3f700 1 -- 172.21.15.134:0/1627635423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 msgr2=0x7f15fc0fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:33.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.583+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1627635423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc0fc0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15f0004940 tx=0x7f15f0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:33.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.583+0000 7f1602b3f700 1 -- 172.21.15.134:0/1627635423 shutdown_connections 2024-03-22T07:33:33.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.583+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1627635423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15fc0fcf80 0x7f15fc0fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.583+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1627635423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc0fc0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.583+0000 7f1602b3f700 1 -- 172.21.15.134:0/1627635423 >> 172.21.15.134:0/1627635423 conn(0x7f15fc0f7450 msgr2=0x7f15fc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.584+0000 7f1602b3f700 1 -- 172.21.15.134:0/1627635423 shutdown_connections 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.584+0000 7f1602b3f700 1 -- 172.21.15.134:0/1627635423 wait complete. 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.584+0000 7f1602b3f700 1 Processor -- start 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.584+0000 7f1602b3f700 1 -- start start 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.584+0000 7f1602b3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc10c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f1602b3f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15fc0fcf80 0x7f15fc10cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f1602b3f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc10d380 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f1602b3f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc10d4f0 con 0x7f15fc0fcf80 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc10c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc10c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46482/0 (socket says 172.21.15.134:46482) 2024-03-22T07:33:33.586 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 -- 172.21.15.134:0/1504856800 learned_addr learned my addr 172.21.15.134:0/1504856800 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f15fbfff700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15fc0fcf80 0x7f15fc10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 -- 172.21.15.134:0/1504856800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15fc0fcf80 msgr2=0x7f15fc10cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15fc0fcf80 0x7f15fc10cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 -- 172.21.15.134:0/1504856800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0005040 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f16008db700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc10c840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009150 tx=0x7f15f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f000e040 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15f0004290 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc111ef0 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f001c630 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.585+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc112420 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.587+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc04c710 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.587+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f15f000bbf0 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.587+0000 7f15f97fa700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f15ec06d380 0x7f15ec06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.588+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f15f008d4a0 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.588+0000 7f15fbfff700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f15ec06d380 0x7f15ec06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:33.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.588+0000 7f15fbfff700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f15ec06d380 0x7f15ec06f830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007fd0 tx=0x7f15e8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:33.592 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.592+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f15f005aae0 con 0x7f15fc0fbcd0 2024-03-22T07:33:33.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.806+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15fc1012e0 con 0x7f15ec06d380 2024-03-22T07:33:33.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.808+0000 7f15f97fa700 1 -- 172.21.15.134:0/1504856800 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f15fc1012e0 con 0x7f15ec06d380 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f15ec06d380 msgr2=0x7f15ec06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f15ec06d380 0x7f15ec06f830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f15e8007fd0 tx=0x7f15e8009040 comp rx=0 tx=0).stop 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 msgr2=0x7f15fc10c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc10c840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009150 tx=0x7f15f0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 shutdown_connections 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f15ec06d380 0x7f15ec06f830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15fc0fbcd0 0x7f15fc10c840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 --2- 172.21.15.134:0/1504856800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15fc0fcf80 0x7f15fc10cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 >> 172.21.15.134:0/1504856800 conn(0x7f15fc0f7450 msgr2=0x7f15fc0f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:33.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 shutdown_connections 2024-03-22T07:33:33.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.810+0000 7f1602b3f700 1 -- 172.21.15.134:0/1504856800 wait complete. 2024-03-22T07:33:33.820 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:33:33.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 -- 172.21.15.134:0/3635154319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 msgr2=0x7fa6f40fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 --2- 172.21.15.134:0/3635154319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f40fd3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8004940 tx=0x7fa6e8009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 -- 172.21.15.134:0/3635154319 shutdown_connections 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 --2- 172.21.15.134:0/3635154319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f40fd3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 --2- 172.21.15.134:0/3635154319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6f40fbcd0 0x7fa6f40fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 -- 172.21.15.134:0/3635154319 >> 172.21.15.134:0/3635154319 conn(0x7fa6f40f7430 msgr2=0x7fa6f40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 -- 172.21.15.134:0/3635154319 shutdown_connections 2024-03-22T07:33:33.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.912+0000 7fa6fa472700 1 -- 172.21.15.134:0/3635154319 wait complete. 2024-03-22T07:33:33.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:33 smithi134 ceph-mon[93947]: pgmap v80: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:33.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:33.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:33.913 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:33.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6fa472700 1 Processor -- start 2024-03-22T07:33:33.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6fa472700 1 -- start start 2024-03-22T07:33:33.915 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6fa472700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6f40fbcd0 0x7fa6f4110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6fa472700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f4112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6fa472700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40663e0 con 0x7fa6f40fcf80 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6fa472700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4066520 con 0x7fa6f40fbcd0 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6f37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f4112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6f37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f4112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35852/0 (socket says 172.21.15.134:35852) 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6f37fe700 1 -- 172.21.15.134:0/889574300 learned_addr learned my addr 172.21.15.134:0/889574300 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.913+0000 7fa6f3fff700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6f40fbcd0 0x7fa6f4110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f37fe700 1 -- 172.21.15.134:0/889574300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6f40fbcd0 msgr2=0x7fa6f4110730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f37fe700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6f40fbcd0 0x7fa6f4110730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f37fe700 1 -- 172.21.15.134:0/889574300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8005040 con 0x7fa6f40fcf80 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f37fe700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f4112c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009150 tx=0x7fa6e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6e800e040 con 0x7fa6f40fcf80 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6e800bbf0 con 0x7fa6f40fcf80 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f4113280 con 0x7fa6f40fcf80 2024-03-22T07:33:33.916 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6e801c630 con 0x7fa6f40fcf80 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.914+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f4113810 con 0x7fa6f40fcf80 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.915+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f405f5f0 con 0x7fa6f40fcf80 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.915+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fa6e800bd60 con 0x7fa6f40fcf80 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.916+0000 7fa6f0ff9700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa6dc06d390 0x7fa6dc06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.916+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa6e808dc70 con 0x7fa6f40fcf80 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.916+0000 7fa6f3fff700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa6dc06d390 0x7fa6dc06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:33.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.916+0000 7fa6f3fff700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa6dc06d390 0x7fa6dc06f840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4065fd0 tx=0x7fa6e40091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:33.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:33.920+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa6e8057720 con 0x7fa6f40fcf80 2024-03-22T07:33:33.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:33 smithi195 ceph-mon[82061]: pgmap v80: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:34.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.136+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6f405f5f0 con 0x7fa6dc06d390 2024-03-22T07:33:34.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.138+0000 7fa6f0ff9700 1 -- 172.21.15.134:0/889574300 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa6f405f5f0 con 0x7fa6dc06d390 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa6dc06d390 msgr2=0x7fa6dc06f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa6dc06d390 0x7fa6dc06f840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4065fd0 tx=0x7fa6e40091a0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 msgr2=0x7fa6f4112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f4112c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009150 tx=0x7fa6e8009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 shutdown_connections 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa6dc06d390 0x7fa6dc06f840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa6f40fbcd0 0x7fa6f4110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 --2- 172.21.15.134:0/889574300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6f40fcf80 0x7fa6f4112c80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 >> 172.21.15.134:0/889574300 conn(0x7fa6f40f7430 msgr2=0x7fa6f40f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 shutdown_connections 2024-03-22T07:33:34.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.140+0000 7fa6fa472700 1 -- 172.21.15.134:0/889574300 wait complete. 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.240+0000 7fdc7ed08700 1 -- 172.21.15.134:0/2013459847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 msgr2=0x7fdc780fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.240+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/2013459847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc780fd280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c004940 tx=0x7fdc6c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.240+0000 7fdc7ed08700 1 -- 172.21.15.134:0/2013459847 shutdown_connections 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.240+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/2013459847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc780fdfe0 0x7fdc780fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.240+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/2013459847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc780fd280 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.240+0000 7fdc7ed08700 1 -- 172.21.15.134:0/2013459847 >> 172.21.15.134:0/2013459847 conn(0x7fdc780f8550 msgr2=0x7fdc780fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.241+0000 7fdc7ed08700 1 -- 172.21.15.134:0/2013459847 shutdown_connections 2024-03-22T07:33:34.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.241+0000 7fdc7ed08700 1 -- 172.21.15.134:0/2013459847 wait complete. 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.241+0000 7fdc7ed08700 1 Processor -- start 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.241+0000 7fdc7ed08700 1 -- start start 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7ed08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc7810d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7ed08700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc780fdfe0 0x7fdc7810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7ed08700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7810e490 con 0x7fdc780fce70 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7ed08700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7810e600 con 0x7fdc780fdfe0 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc7810d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc7810d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35878/0 (socket says 172.21.15.134:35878) 2024-03-22T07:33:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 -- 172.21.15.134:0/1949886513 learned_addr learned my addr 172.21.15.134:0/1949886513 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc77fff700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc780fdfe0 0x7fdc7810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 -- 172.21.15.134:0/1949886513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc780fdfe0 msgr2=0x7fdc7810de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc780fdfe0 0x7fdc7810de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 -- 172.21.15.134:0/1949886513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c005040 con 0x7fdc780fce70 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc7caa4700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc7810d950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00b3b0 tx=0x7fdc6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c00e040 con 0x7fdc780fce70 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.242+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc6c00bbf0 con 0x7fdc780fce70 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.243+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc78113000 con 0x7fdc780fce70 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.243+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c01c630 con 0x7fdc780fce70 2024-03-22T07:33:34.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.243+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc781135c0 con 0x7fdc780fce70 2024-03-22T07:33:34.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.244+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7804c710 con 0x7fdc780fce70 2024-03-22T07:33:34.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.244+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fdc6c00bd60 con 0x7fdc780fce70 2024-03-22T07:33:34.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.245+0000 7fdc757fa700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc6806d380 0x7fdc6806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.245+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdc6c08d3f0 con 0x7fdc780fce70 2024-03-22T07:33:34.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.245+0000 7fdc77fff700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc6806d380 0x7fdc6806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.245+0000 7fdc77fff700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc6806d380 0x7fdc6806f830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc64004f40 tx=0x7fdc6400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:34.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.249+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdc6c05aad0 con 0x7fdc780fce70 2024-03-22T07:33:34.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.451+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc78102340 con 0x7fdc6806d380 2024-03-22T07:33:34.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.463+0000 7fdc757fa700 1 -- 172.21.15.134:0/1949886513 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdc78102340 con 0x7fdc6806d380 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (4m) 13s ago 12m 25.0M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (81s) 13s ago 13m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (75s) 72s ago 12m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (3m) 13s ago 12m 80.6M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (7m) 13s ago 7m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (7m) 13s ago 7m 13.7M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (7m) 72s ago 7m 14.7M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (7m) 72s ago 7m 14.0M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (3m) 13s ago 14m 501M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (2m) 72s ago 12m 449M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (2m) 13s ago 14m 47.2M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (2m) 72s ago 11m 31.2M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:33:34.463 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 13s ago 13m 15.6M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (3m) 72s ago 12m 15.0M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (55s) 13s ago 11m 95.5M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (19s) 13s ago 10m 14.8M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (10m) 13s ago 10m 218M 1557M 17.2.7-726-g9c4e0c34 837124da804f 21b120a462d9 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (9m) 72s ago 9m 296M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (9m) 72s ago 9m 262M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (9m) 72s ago 8m 238M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:33:34.464 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 13s ago 12m 51.9M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc6806d380 msgr2=0x7fdc6806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc6806d380 0x7fdc6806f830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc64004f40 tx=0x7fdc6400b040 comp rx=0 tx=0).stop 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 msgr2=0x7fdc7810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc7810d950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00b3b0 tx=0x7fdc6c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 shutdown_connections 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc6806d380 0x7fdc6806f830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc780fce70 0x7fdc7810d950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 --2- 172.21.15.134:0/1949886513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc780fdfe0 0x7fdc7810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 >> 172.21.15.134:0/1949886513 conn(0x7fdc780f8550 msgr2=0x7fdc780f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 shutdown_connections 2024-03-22T07:33:34.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.465+0000 7fdc7ed08700 1 -- 172.21.15.134:0/1949886513 wait complete. 2024-03-22T07:33:34.566 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 -- 172.21.15.134:0/3410106569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 msgr2=0x7f69c40fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 --2- 172.21.15.134:0/3410106569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c40fd280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69c0004940 tx=0x7f69c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 -- 172.21.15.134:0/3410106569 shutdown_connections 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 --2- 172.21.15.134:0/3410106569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69c40fdfe0 0x7f69c40fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 --2- 172.21.15.134:0/3410106569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c40fd280 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 -- 172.21.15.134:0/3410106569 >> 172.21.15.134:0/3410106569 conn(0x7f69c40f8550 msgr2=0x7f69c40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 -- 172.21.15.134:0/3410106569 shutdown_connections 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 -- 172.21.15.134:0/3410106569 wait complete. 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 Processor -- start 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.566+0000 7f69cb65e700 1 -- start start 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69cb65e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69cb65e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69c40fdfe0 0x7f69c410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69cb65e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c410e460 con 0x7f69c40fce70 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69cb65e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c410e5d0 con 0x7f69c40fdfe0 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.567 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c410d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35890/0 (socket says 172.21.15.134:35890) 2024-03-22T07:33:34.568 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 -- 172.21.15.134:0/1597302058 learned_addr learned my addr 172.21.15.134:0/1597302058 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 -- 172.21.15.134:0/1597302058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69c40fdfe0 msgr2=0x7f69c410de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69c40fdfe0 0x7f69c410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 -- 172.21.15.134:0/1597302058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0005040 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69c93fa700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c410d920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009150 tx=0x7f69c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c000e040 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69c000bbf0 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c4112fd0 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.567+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c001c630 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.568+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c4113530 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.569+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c404c710 con 0x7f69c40fce70 2024-03-22T07:33:34.569 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.569+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f69c000bd60 con 0x7f69c40fce70 2024-03-22T07:33:34.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.569+0000 7f69b9ffb700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f69b006d380 0x7f69b006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.570+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f69c008dcb0 con 0x7f69c40fce70 2024-03-22T07:33:34.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.570+0000 7f69c8bf9700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f69b006d380 0x7f69b006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.570 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.570+0000 7f69c8bf9700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f69b006d380 0x7f69b006f830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69b4004d00 tx=0x7f69b4009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:34.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.574+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f69c005b2f0 con 0x7f69c40fce70 2024-03-22T07:33:34.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.849+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69c4113a70 con 0x7f69c40fce70 2024-03-22T07:33:34.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.850+0000 7f69b9ffb700 1 -- 172.21.15.134:0/1597302058 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f69c005ae80 con 0x7f69c40fce70 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4, 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:33:34.850 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:33:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:33:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:33:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 8, 2024-03-22T07:33:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:33:34.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:33:34.851 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f69b006d380 msgr2=0x7f69b006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f69b006d380 0x7f69b006f830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69b4004d00 tx=0x7f69b4009ce0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 msgr2=0x7f69c410d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c410d920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009150 tx=0x7f69c0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 shutdown_connections 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f69b006d380 0x7f69b006f830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69c40fce70 0x7f69c410d920 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 --2- 172.21.15.134:0/1597302058 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f69c40fdfe0 0x7f69c410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 >> 172.21.15.134:0/1597302058 conn(0x7f69c40f8550 msgr2=0x7f69c40f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 shutdown_connections 2024-03-22T07:33:34.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.852+0000 7f69cb65e700 1 -- 172.21.15.134:0/1597302058 wait complete. 2024-03-22T07:33:34.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 -- 172.21.15.134:0/2018546952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 msgr2=0x7f3a300fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 --2- 172.21.15.134:0/2018546952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a300fe860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c004940 tx=0x7f3a2c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 -- 172.21.15.134:0/2018546952 shutdown_connections 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 --2- 172.21.15.134:0/2018546952 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a300feda0 0x7f3a300faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 --2- 172.21.15.134:0/2018546952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a300fe860 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 -- 172.21.15.134:0/2018546952 >> 172.21.15.134:0/2018546952 conn(0x7f3a300f6c10 msgr2=0x7f3a300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 -- 172.21.15.134:0/2018546952 shutdown_connections 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.952+0000 7f3a37c09700 1 -- 172.21.15.134:0/2018546952 wait complete. 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a37c09700 1 Processor -- start 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a37c09700 1 -- start start 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a37c09700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a3010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a37c09700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a300feda0 0x7f3a3010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a37c09700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3010e4e0 con 0x7f3a300fe450 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a37c09700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30112e80 con 0x7f3a300feda0 2024-03-22T07:33:34.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a359a5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a3010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a359a5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a3010d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35902/0 (socket says 172.21.15.134:35902) 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a359a5700 1 -- 172.21.15.134:0/3693894627 learned_addr learned my addr 172.21.15.134:0/3693894627 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a351a4700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a300feda0 0x7f3a3010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a359a5700 1 -- 172.21.15.134:0/3693894627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a300feda0 msgr2=0x7f3a3010de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a359a5700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a300feda0 0x7f3a3010de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.953+0000 7f3a359a5700 1 -- 172.21.15.134:0/3693894627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c005040 con 0x7f3a300fe450 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.954+0000 7f3a359a5700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a3010d910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00b3b0 tx=0x7f3a2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.954+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c00e040 con 0x7f3a300fe450 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.954+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a2c00bcc0 con 0x7f3a300fe450 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.954+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a30113080 con 0x7f3a300fe450 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.954+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c01c630 con 0x7f3a300fe450 2024-03-22T07:33:34.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.954+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a301135f0 con 0x7f3a300fe450 2024-03-22T07:33:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.955+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3004c710 con 0x7f3a300fe450 2024-03-22T07:33:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.955+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f3a2c013980 con 0x7f3a300fe450 2024-03-22T07:33:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.956+0000 7f3a267fc700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3a1c06d380 0x7f3a1c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.956+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3a2c08d540 con 0x7f3a300fe450 2024-03-22T07:33:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.956+0000 7f3a351a4700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3a1c06d380 0x7f3a1c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:34.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.956+0000 7f3a351a4700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3a1c06d380 0x7f3a1c06f830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a20006fd0 tx=0x7f3a20008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:34.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:34.960+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3a2c05ab80 con 0x7f3a300fe450 2024-03-22T07:33:35.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.199+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3a301139a0 con 0x7f3a300fe450 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.199+0000 7f3a267fc700 1 -- 172.21.15.134:0/3693894627 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f3a2c05a710 con 0x7f3a300fe450 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:35.199 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:33:35.200 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:33:35.201 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:35.202 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:35.202 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:33:35.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3a1c06d380 msgr2=0x7f3a1c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3a1c06d380 0x7f3a1c06f830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a20006fd0 tx=0x7f3a20008040 comp rx=0 tx=0).stop 2024-03-22T07:33:35.202 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 msgr2=0x7f3a3010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a3010d910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00b3b0 tx=0x7f3a2c009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 shutdown_connections 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3a1c06d380 0x7f3a1c06f830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a300fe450 0x7f3a3010d910 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 --2- 172.21.15.134:0/3693894627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a300feda0 0x7f3a3010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 >> 172.21.15.134:0/3693894627 conn(0x7f3a300f6c10 msgr2=0x7f3a300f8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 shutdown_connections 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.201+0000 7f3a37c09700 1 -- 172.21.15.134:0/3693894627 wait complete. 2024-03-22T07:33:35.203 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 -- 172.21.15.134:0/1113997318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 msgr2=0x7ffad40fc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 --2- 172.21.15.134:0/1113997318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad40fc580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffad0004940 tx=0x7ffad0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 -- 172.21.15.134:0/1113997318 shutdown_connections 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 --2- 172.21.15.134:0/1113997318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 0x7ffad40faed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 --2- 172.21.15.134:0/1113997318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad40fc580 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 -- 172.21.15.134:0/1113997318 >> 172.21.15.134:0/1113997318 conn(0x7ffad40f6be0 msgr2=0x7ffad40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 -- 172.21.15.134:0/1113997318 shutdown_connections 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 -- 172.21.15.134:0/1113997318 wait complete. 2024-03-22T07:33:35.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 Processor -- start 2024-03-22T07:33:35.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.304+0000 7ffadad25700 1 -- start start 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffadad25700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad4113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffadad25700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 0x7ffad4114500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffadad25700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4114b00 con 0x7ffad40fc170 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffadad25700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4114c70 con 0x7ffad40fcac0 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad4113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad4113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35924/0 (socket says 172.21.15.134:35924) 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 -- 172.21.15.134:0/3905909185 learned_addr learned my addr 172.21.15.134:0/3905909185 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffacbfff700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 0x7ffad4114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 -- 172.21.15.134:0/3905909185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 msgr2=0x7ffad4114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 0x7ffad4114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 -- 172.21.15.134:0/3905909185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0005040 con 0x7ffad40fc170 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffacbfff700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 0x7ffad4114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffad8ac1700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad4113fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009150 tx=0x7ffad0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad000e040 con 0x7ffad40fc170 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad4119620 con 0x7ffad40fc170 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffad000bbf0 con 0x7ffad40fc170 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.305+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad001c630 con 0x7ffad40fc170 2024-03-22T07:33:35.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.306+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad4119be0 con 0x7ffad40fc170 2024-03-22T07:33:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.307+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad404c710 con 0x7ffad40fc170 2024-03-22T07:33:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.307+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ffad000bd60 con 0x7ffad40fc170 2024-03-22T07:33:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.307+0000 7ffac97fa700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffabc06d380 0x7ffabc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.308+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffad008dcb0 con 0x7ffad40fc170 2024-03-22T07:33:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.308+0000 7ffacbfff700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffabc06d380 0x7ffabc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:35.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.308+0000 7ffacbfff700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffabc06d380 0x7ffabc06f830 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009fd0 tx=0x7ffac4009f20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:35.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.312+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffad005b2f0 con 0x7ffad40fc170 2024-03-22T07:33:35.526 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.526+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffad4100250 con 0x7ffabc06d380 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.527+0000 7ffac97fa700 1 -- 172.21.15.134:0/3905909185 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffad4100250 con 0x7ffabc06d380 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:33:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:33:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:33:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:33:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "8/21 daemons upgraded", 2024-03-22T07:33:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-03-22T07:33:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:33:35.528 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:33:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffabc06d380 msgr2=0x7ffabc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffabc06d380 0x7ffabc06f830 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009fd0 tx=0x7ffac4009f20 comp rx=0 tx=0).stop 2024-03-22T07:33:35.530 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 msgr2=0x7ffad4113fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad4113fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009150 tx=0x7ffad0009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 shutdown_connections 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffabc06d380 0x7ffabc06f830 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fc170 0x7ffad4113fc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 --2- 172.21.15.134:0/3905909185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad40fcac0 0x7ffad4114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 >> 172.21.15.134:0/3905909185 conn(0x7ffad40f6be0 msgr2=0x7ffad40f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 shutdown_connections 2024-03-22T07:33:35.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.530+0000 7ffadad25700 1 -- 172.21.15.134:0/3905909185 wait complete. 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 -- 172.21.15.134:0/2280086751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fdfe0 msgr2=0x7fac140fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 --2- 172.21.15.134:0/2280086751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fdfe0 0x7fac140fe450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac04004940 tx=0x7fac04009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 -- 172.21.15.134:0/2280086751 shutdown_connections 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 --2- 172.21.15.134:0/2280086751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fdfe0 0x7fac140fe450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 --2- 172.21.15.134:0/2280086751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac140fce70 0x7fac140fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 -- 172.21.15.134:0/2280086751 >> 172.21.15.134:0/2280086751 conn(0x7fac140f8550 msgr2=0x7fac140fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.633+0000 7fac1baff700 1 -- 172.21.15.134:0/2280086751 shutdown_connections 2024-03-22T07:33:35.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 -- 172.21.15.134:0/2280086751 wait complete. 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 Processor -- start 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 -- start start 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 0x7fac1410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac140fdfe0 0x7fac1410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1410e500 con 0x7fac140fce70 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1baff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14112ea0 con 0x7fac140fdfe0 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1989b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 0x7fac1410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1989b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 0x7fac1410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:35934/0 (socket says 172.21.15.134:35934) 2024-03-22T07:33:35.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1989b700 1 -- 172.21.15.134:0/3459104077 learned_addr learned my addr 172.21.15.134:0/3459104077 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.634+0000 7fac1909a700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac140fdfe0 0x7fac1410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac1989b700 1 -- 172.21.15.134:0/3459104077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac140fdfe0 msgr2=0x7fac1410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac1989b700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac140fdfe0 0x7fac1410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac1989b700 1 -- 172.21.15.134:0/3459104077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04005040 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac1989b700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 0x7fac1410d930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac1000b790 tx=0x7fac10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1000f770 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac1000fda0 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac14113100 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1000d310 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.635+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac14113670 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.636+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1404c710 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.636+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fac10010420 con 0x7fac140fce70 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.637+0000 7fac0a7fc700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fac0006d380 0x7fac0006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:33:35.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.637+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fac1008c880 con 0x7fac140fce70 2024-03-22T07:33:35.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.637+0000 7fac1909a700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fac0006d380 0x7fac0006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:33:35.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.637+0000 7fac1909a700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fac0006d380 0x7fac0006f830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac04000c00 tx=0x7fac04009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:33:35.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.641+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac10059f60 con 0x7fac140fce70 2024-03-22T07:33:35.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:35 smithi134 ceph-mon[93947]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:35.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:35 smithi134 ceph-mon[93947]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:35.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:35 smithi134 ceph-mon[93947]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:35.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:35 smithi134 ceph-mon[93947]: pgmap v81: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:35.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:35 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1597302058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:35.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:35 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3693894627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:33:35.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.917+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fac14113b60 con 0x7fac140fce70 2024-03-22T07:33:35.917 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.917+0000 7fac0a7fc700 1 -- 172.21.15.134:0/3459104077 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fac10059af0 con 0x7fac140fce70 2024-03-22T07:33:35.918 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:33:35.919 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fac0006d380 msgr2=0x7fac0006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fac0006d380 0x7fac0006f830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac04000c00 tx=0x7fac04009e30 comp rx=0 tx=0).stop 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 msgr2=0x7fac1410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 0x7fac1410d930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac1000b790 tx=0x7fac10009250 comp rx=0 tx=0).stop 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 shutdown_connections 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fac0006d380 0x7fac0006f830 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac140fce70 0x7fac1410d930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 --2- 172.21.15.134:0/3459104077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac140fdfe0 0x7fac1410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.919+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 >> 172.21.15.134:0/3459104077 conn(0x7fac140f8550 msgr2=0x7fac140f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.920+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 shutdown_connections 2024-03-22T07:33:35.920 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:33:35.920+0000 7fac1baff700 1 -- 172.21.15.134:0/3459104077 wait complete. 2024-03-22T07:33:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:35 smithi195 ceph-mon[82061]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:35 smithi195 ceph-mon[82061]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:35 smithi195 ceph-mon[82061]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:35 smithi195 ceph-mon[82061]: pgmap v81: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:35 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1597302058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:33:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:35 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3693894627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:33:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:36 smithi195 ceph-mon[82061]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:36 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3459104077' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:33:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:36 smithi134 ceph-mon[93947]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:33:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:36 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3459104077' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:33:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:37 smithi134 ceph-mon[93947]: pgmap v82: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:37 smithi195 ceph-mon[82061]: pgmap v82: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:39 smithi195 ceph-mon[82061]: pgmap v83: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:40.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:39 smithi134 ceph-mon[93947]: pgmap v83: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:41.907 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:41 smithi134 ceph-mon[93947]: pgmap v84: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:41.908 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:41.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:41 smithi195 ceph-mon[82061]: pgmap v84: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:42 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:42 smithi195 ceph-mon[82061]: Upgrade: osd.2 is safe to restart 2024-03-22T07:33:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:42 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-22T07:33:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:42 smithi134 ceph-mon[93947]: Upgrade: osd.2 is safe to restart 2024-03-22T07:33:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:43 smithi134 ceph-mon[93947]: pgmap v85: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:43 smithi134 ceph-mon[93947]: Upgrade: Updating osd.2 2024-03-22T07:33:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-22T07:33:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:33:43.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:43 smithi134 ceph-mon[93947]: Deploying daemon osd.2 on smithi134 2024-03-22T07:33:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:43 smithi195 ceph-mon[82061]: pgmap v85: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:43 smithi195 ceph-mon[82061]: Upgrade: Updating osd.2 2024-03-22T07:33:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-22T07:33:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:33:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:43 smithi195 ceph-mon[82061]: Deploying daemon osd.2 on smithi134 2024-03-22T07:33:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:45 smithi195 ceph-mon[82061]: pgmap v86: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:45.991 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:45 smithi134 ceph-mon[93947]: pgmap v86: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:46.241 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:45 smithi134 systemd[1]: Stopping Ceph osd.2 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:33:46.242 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:46 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[62862]: 2024-03-22T07:33:46.239+0000 7f6a5a55b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:33:46.242 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:46 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[62862]: 2024-03-22T07:33:46.239+0000 7f6a5a55b700 -1 osd.2 60 *** Got signal Terminated *** 2024-03-22T07:33:46.242 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:46 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[62862]: 2024-03-22T07:33:46.239+0000 7f6a5a55b700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:33:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:46 smithi195 ceph-mon[82061]: osd.2 marked itself down and dead 2024-03-22T07:33:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:46 smithi134 ceph-mon[93947]: osd.2 marked itself down and dead 2024-03-22T07:33:47.475 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:47 smithi134 podman[112950]: 2024-03-22 07:33:47.159135241 +0000 UTC m=+1.026703913 container died 21b120a462d98b16877ac8e11a16436775a59a580088924e4541ca414c880ede (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=quincy-9c4e0c3) 2024-03-22T07:33:47.795 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:47 smithi134 podman[112950]: 2024-03-22 07:33:47.574815936 +0000 UTC m=+1.442384618 container cleanup 21b120a462d98b16877ac8e11a16436775a59a580088924e4541ca414c880ede (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-9c4e0c3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-22T07:33:47.795 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:47 smithi134 bash[112950]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2 2024-03-22T07:33:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:47 smithi134 ceph-mon[93947]: pgmap v87: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:47 smithi134 ceph-mon[93947]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:33:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:47 smithi134 ceph-mon[93947]: failed to encode map e61 with expected crc 2024-03-22T07:33:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:47 smithi134 ceph-mon[93947]: failed to encode map e61 with expected crc 2024-03-22T07:33:47.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:47 smithi134 ceph-mon[93947]: failed to encode map e61 with expected crc 2024-03-22T07:33:47.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:47 smithi134 ceph-mon[93947]: osdmap e61: 6 total, 5 up, 6 in 2024-03-22T07:33:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:47 smithi195 ceph-mon[82061]: pgmap v87: 65 pgs: 65 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:47 smithi195 ceph-mon[82061]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:33:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:47 smithi195 ceph-mon[82061]: failed to encode map e61 with expected crc 2024-03-22T07:33:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:47 smithi195 ceph-mon[82061]: failed to encode map e61 with expected crc 2024-03-22T07:33:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:47 smithi195 ceph-mon[82061]: failed to encode map e61 with expected crc 2024-03-22T07:33:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:47 smithi195 ceph-mon[82061]: osdmap e61: 6 total, 5 up, 6 in 2024-03-22T07:33:48.269 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:47 smithi134 podman[112967]: 2024-03-22 07:33:47.821875195 +0000 UTC m=+0.659161392 container remove 21b120a462d98b16877ac8e11a16436775a59a580088924e4541ca414c880ede (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-9c4e0c3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-22T07:33:48.523 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:48 smithi134 podman[113067]: 2024-03-22 07:33:48.173048658 +0000 UTC m=+0.018100416 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:33:48.523 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:48 smithi134 podman[113067]: 2024-03-22 07:33:48.310905262 +0000 UTC m=+0.155957015 container create 0dbd96a4d7556164a423da0549145929285d8b23055e1050319ea95bc4707358 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:33:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: osdmap e62: 6 total, 5 up, 6 in 2024-03-22T07:33:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:48.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:48.796 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:48 smithi134 podman[113067]: 2024-03-22 07:33:48.597675963 +0000 UTC m=+0.442727728 container init 0dbd96a4d7556164a423da0549145929285d8b23055e1050319ea95bc4707358 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-22T07:33:48.796 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:48 smithi134 podman[113067]: 2024-03-22 07:33:48.601289653 +0000 UTC m=+0.446341407 container start 0dbd96a4d7556164a423da0549145929285d8b23055e1050319ea95bc4707358 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-22T07:33:48.796 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:48 smithi134 podman[113067]: 2024-03-22 07:33:48.672116438 +0000 UTC m=+0.517168209 container attach 0dbd96a4d7556164a423da0549145929285d8b23055e1050319ea95bc4707358 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: osdmap e62: 6 total, 5 up, 6 in 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: failed to encode map e62 with expected crc 2024-03-22T07:33:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:48.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:33:49.233 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:48 smithi134 podman[113067]: 2024-03-22 07:33:48.895922627 +0000 UTC m=+0.740974373 container died 0dbd96a4d7556164a423da0549145929285d8b23055e1050319ea95bc4707358 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:33:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:49 smithi195 ceph-mon[82061]: pgmap v90: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:49 smithi195 ceph-mon[82061]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-03-22T07:33:50.014 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:49 smithi134 ceph-mon[93947]: pgmap v90: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:33:50.014 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:49 smithi134 ceph-mon[93947]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-03-22T07:33:50.014 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:49 smithi134 podman[113094]: 2024-03-22 07:33:49.567733459 +0000 UTC m=+0.666970169 container remove 0dbd96a4d7556164a423da0549145929285d8b23055e1050319ea95bc4707358 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-22T07:33:50.014 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:49 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.2.service: Deactivated successfully. 2024-03-22T07:33:50.014 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:49 smithi134 systemd[1]: Stopped Ceph osd.2 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:33:50.015 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:49 smithi134 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.2.service: Consumed 56.165s CPU time. 2024-03-22T07:33:50.015 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:49 smithi134 systemd[1]: Starting Ceph osd.2 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:33:50.295 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 podman[113198]: 2024-03-22 07:33:49.917492082 +0000 UTC m=+0.018065603 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:33:50.295 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 podman[113198]: 2024-03-22 07:33:50.018939267 +0000 UTC m=+0.119512819 container create f4a7b93d4edf8acae18d3d335d85a1d723a435cee3c9e4738d03d99b684fae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-22T07:33:50.295 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 podman[113198]: 2024-03-22 07:33:50.257312561 +0000 UTC m=+0.357886089 container init f4a7b93d4edf8acae18d3d335d85a1d723a435cee3c9e4738d03d99b684fae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate, org.label-schema.build-date=20240307, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-22T07:33:50.295 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 podman[113198]: 2024-03-22 07:33:50.260746965 +0000 UTC m=+0.361320476 container start f4a7b93d4edf8acae18d3d335d85a1d723a435cee3c9e4738d03d99b684fae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, RELEASE=squid-db0330b, ceph=True) 2024-03-22T07:33:50.694 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 podman[113198]: 2024-03-22 07:33:50.348745035 +0000 UTC m=+0.449318564 container attach f4a7b93d4edf8acae18d3d335d85a1d723a435cee3c9e4738d03d99b684fae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-22T07:33:50.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:50 smithi195 ceph-mon[82061]: Health check failed: Degraded data redundancy: 9/219 objects degraded (4.110%), 5 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:51.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-mon[93947]: Health check failed: Degraded data redundancy: 9/219 objects degraded (4.110%), 5 pgs degraded (PG_DEGRADED) 2024-03-22T07:33:51.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-22T07:33:51.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 bash[113198]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate[113214]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-22T07:33:51.046 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:50 smithi134 podman[113198]: 2024-03-22 07:33:50.728813807 +0000 UTC m=+0.829387318 container died f4a7b93d4edf8acae18d3d335d85a1d723a435cee3c9e4738d03d99b684fae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-22T07:33:51.683 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 podman[113353]: 2024-03-22 07:33:51.344450031 +0000 UTC m=+0.610769790 container remove f4a7b93d4edf8acae18d3d335d85a1d723a435cee3c9e4738d03d99b684fae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-db0330b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:33:51.683 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 podman[113417]: 2024-03-22 07:33:51.459661719 +0000 UTC m=+0.018447132 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:33:51.683 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 podman[113417]: 2024-03-22 07:33:51.587128545 +0000 UTC m=+0.145913943 container create 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-22T07:33:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:51 smithi195 ceph-mon[82061]: pgmap v91: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-03-22T07:33:52.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:51 smithi134 ceph-mon[93947]: pgmap v91: 65 pgs: 5 active+undersized+degraded, 7 peering, 3 stale+active+clean, 7 active+undersized, 43 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-03-22T07:33:52.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 podman[113417]: 2024-03-22 07:33:51.789566701 +0000 UTC m=+0.348352107 container init 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-22T07:33:52.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 podman[113417]: 2024-03-22 07:33:51.792648208 +0000 UTC m=+0.351433603 container start 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b) 2024-03-22T07:33:52.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 ceph-osd[113437]: -- 172.21.15.134:0/3762394488 <== mon.0 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5573ef4291e0 con 0x5573ef3fb000 2024-03-22T07:33:52.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 bash[113417]: 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 2024-03-22T07:33:52.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:51 smithi134 systemd[1]: Started Ceph osd.2 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:33:52.795 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:52 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:33:52.339+0000 7ff5b71847c0 -1 Falling back to public interface 2024-03-22T07:33:53.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:53.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:53.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:33:53.242 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:52 smithi134 ceph-mon[93947]: pgmap v92: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:33:53.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:52 smithi195 ceph-mon[82061]: pgmap v92: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:54.295 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:53 smithi134 ceph-mon[93947]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-03-22T07:33:54.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:53 smithi195 ceph-mon[82061]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-03-22T07:33:55.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:54 smithi134 ceph-mon[93947]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:55.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:54 smithi195 ceph-mon[82061]: pgmap v93: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:56.853 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:56 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:33:56.577+0000 7ff5b71847c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-03-22T07:33:57.295 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:57 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:33:57.025+0000 7ff5b71847c0 -1 osd.2 60 log_to_monitors true 2024-03-22T07:33:57.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:57 smithi134 ceph-mon[93947]: pgmap v94: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:57.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:57 smithi134 ceph-mon[93947]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-22T07:33:57.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:57 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:57.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:57 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:57 smithi195 ceph-mon[82061]: pgmap v94: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:57 smithi195 ceph-mon[82061]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-22T07:33:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:57 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:57 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:58.659 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:33:58.407+0000 7ff5a45d4700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:33:58.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-22T07:33:58.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: osdmap e63: 6 total, 5 up, 6 in 2024-03-22T07:33:58.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:33:58.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: failed to encode map e63 with expected crc 2024-03-22T07:33:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: failed to encode map e63 with expected crc 2024-03-22T07:33:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: failed to encode map e63 with expected crc 2024-03-22T07:33:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' 2024-03-22T07:33:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:58.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: osdmap e63: 6 total, 5 up, 6 in 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: failed to encode map e63 with expected crc 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: failed to encode map e63 with expected crc 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: failed to encode map e63 with expected crc 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: from='osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896]' entity='osd.2' 2024-03-22T07:33:58.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:58.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:33:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:59 smithi134 ceph-mon[93947]: pgmap v96: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:59 smithi134 ceph-mon[93947]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:33:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:59 smithi134 ceph-mon[93947]: osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896] boot 2024-03-22T07:33:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:59 smithi134 ceph-mon[93947]: osdmap e64: 6 total, 6 up, 6 in 2024-03-22T07:33:59.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:33:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:33:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:59 smithi195 ceph-mon[82061]: pgmap v96: 65 pgs: 11 active+undersized+degraded, 16 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:33:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:59 smithi195 ceph-mon[82061]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:33:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:59 smithi195 ceph-mon[82061]: osd.2 [v2:172.21.15.134:6818/2283292896,v1:172.21.15.134:6819/2283292896] boot 2024-03-22T07:33:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:59 smithi195 ceph-mon[82061]: osdmap e64: 6 total, 6 up, 6 in 2024-03-22T07:33:59.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:33:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-22T07:34:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:00 smithi134 ceph-mon[93947]: failed to encode map e64 with expected crc 2024-03-22T07:34:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:00 smithi134 ceph-mon[93947]: failed to encode map e64 with expected crc 2024-03-22T07:34:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:00 smithi134 ceph-mon[93947]: failed to encode map e64 with expected crc 2024-03-22T07:34:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:00 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:00.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:00 smithi134 ceph-mon[93947]: osdmap e65: 6 total, 6 up, 6 in 2024-03-22T07:34:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:00 smithi195 ceph-mon[82061]: failed to encode map e64 with expected crc 2024-03-22T07:34:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:00 smithi195 ceph-mon[82061]: failed to encode map e64 with expected crc 2024-03-22T07:34:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:00 smithi195 ceph-mon[82061]: failed to encode map e64 with expected crc 2024-03-22T07:34:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:00 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:00.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:00 smithi195 ceph-mon[82061]: osdmap e65: 6 total, 6 up, 6 in 2024-03-22T07:34:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:01 smithi195 ceph-mon[82061]: failed to encode map e65 with expected crc 2024-03-22T07:34:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:01 smithi195 ceph-mon[82061]: failed to encode map e65 with expected crc 2024-03-22T07:34:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:01 smithi195 ceph-mon[82061]: failed to encode map e65 with expected crc 2024-03-22T07:34:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:01 smithi195 ceph-mon[82061]: failed to encode map e65 with expected crc 2024-03-22T07:34:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:01 smithi195 ceph-mon[82061]: pgmap v99: 65 pgs: 10 peering, 7 active+undersized+degraded, 10 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2024-03-22T07:34:02.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:01 smithi134 ceph-mon[93947]: failed to encode map e65 with expected crc 2024-03-22T07:34:02.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:01 smithi134 ceph-mon[93947]: failed to encode map e65 with expected crc 2024-03-22T07:34:02.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:01 smithi134 ceph-mon[93947]: failed to encode map e65 with expected crc 2024-03-22T07:34:02.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:01 smithi134 ceph-mon[93947]: failed to encode map e65 with expected crc 2024-03-22T07:34:02.022 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:01 smithi134 ceph-mon[93947]: pgmap v99: 65 pgs: 10 peering, 7 active+undersized+degraded, 10 active+undersized, 38 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21/219 objects degraded (9.589%) 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:03.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:03.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:03.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:03.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:03.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-22T07:34:03.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:03 smithi195 ceph-mon[82061]: pgmap v100: 65 pgs: 10 peering, 5 active+undersized+degraded, 4 active+undersized, 46 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-03-22T07:34:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:34:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:03.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-22T07:34:03.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:03 smithi134 ceph-mon[93947]: pgmap v100: 65 pgs: 10 peering, 5 active+undersized+degraded, 4 active+undersized, 46 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-03-22T07:34:04.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:04.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:05 smithi134 ceph-mon[93947]: pgmap v101: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:05 smithi134 ceph-mon[93947]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded) 2024-03-22T07:34:05.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:05 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:34:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:05 smithi195 ceph-mon[82061]: pgmap v101: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:05.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:05 smithi195 ceph-mon[82061]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 5 pgs degraded) 2024-03-22T07:34:05.985 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:05 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 -- 172.21.15.134:0/915569397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fb440 msgr2=0x7f23580fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 --2- 172.21.15.134:0/915569397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fb440 0x7f23580fb850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2348004940 tx=0x7f2348009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 -- 172.21.15.134:0/915569397 shutdown_connections 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 --2- 172.21.15.134:0/915569397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23580fc6f0 0x7f23580fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 --2- 172.21.15.134:0/915569397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fb440 0x7f23580fb850 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 -- 172.21.15.134:0/915569397 >> 172.21.15.134:0/915569397 conn(0x7f23580f6ba0 msgr2=0x7f23580f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:06.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 -- 172.21.15.134:0/915569397 shutdown_connections 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.035+0000 7f235e728700 1 -- 172.21.15.134:0/915569397 wait complete. 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f235e728700 1 Processor -- start 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f235e728700 1 -- start start 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f235e728700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23580fb440 0x7f235810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f235e728700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 0x7f235810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f235e728700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235810e570 con 0x7f23580fc6f0 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f235e728700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235810edc0 con 0x7f23580fb440 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f23577fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 0x7f235810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f23577fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 0x7f235810df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45950/0 (socket says 172.21.15.134:45950) 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.036+0000 7f23577fe700 1 -- 172.21.15.134:0/1933677484 learned_addr learned my addr 172.21.15.134:0/1933677484 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f2357fff700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23580fb440 0x7f235810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f23577fe700 1 -- 172.21.15.134:0/1933677484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23580fb440 msgr2=0x7f235810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f23577fe700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23580fb440 0x7f235810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f23577fe700 1 -- 172.21.15.134:0/1933677484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348005040 con 0x7f23580fc6f0 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f23577fe700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 0x7f235810df70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f234c00a6e0 tx=0x7f234c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234c00f040 con 0x7f23580fc6f0 2024-03-22T07:34:06.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f234c00de70 con 0x7f23580fc6f0 2024-03-22T07:34:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235810f0a0 con 0x7f23580fc6f0 2024-03-22T07:34:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f234c013620 con 0x7f23580fc6f0 2024-03-22T07:34:06.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.037+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235810f5e0 con 0x7f23580fc6f0 2024-03-22T07:34:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.038+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235805f5f0 con 0x7f23580fc6f0 2024-03-22T07:34:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.039+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f234c014480 con 0x7f23580fc6f0 2024-03-22T07:34:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.039+0000 7f2354ff9700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f234006d380 0x7f234006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.039+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f234c08c5d0 con 0x7f23580fc6f0 2024-03-22T07:34:06.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.039+0000 7f2357fff700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f234006d380 0x7f234006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.040+0000 7f2357fff700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f234006d380 0x7f234006f830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2348000c00 tx=0x7f2348009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:06.044 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.044+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f234c059cc0 con 0x7f23580fc6f0 2024-03-22T07:34:06.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.256+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f235810f9c0 con 0x7f234006d380 2024-03-22T07:34:06.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.258+0000 7f2354ff9700 1 -- 172.21.15.134:0/1933677484 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f235810f9c0 con 0x7f234006d380 2024-03-22T07:34:06.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f234006d380 msgr2=0x7f234006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f234006d380 0x7f234006f830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2348000c00 tx=0x7f2348009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:06.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 msgr2=0x7f235810df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 0x7f235810df70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f234c00a6e0 tx=0x7f234c00c040 comp rx=0 tx=0).stop 2024-03-22T07:34:06.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 shutdown_connections 2024-03-22T07:34:06.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f234006d380 0x7f234006f830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.261 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f23580fb440 0x7f235810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 --2- 172.21.15.134:0/1933677484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23580fc6f0 0x7f235810df70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 >> 172.21.15.134:0/1933677484 conn(0x7f23580f6ba0 msgr2=0x7f23580f82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 shutdown_connections 2024-03-22T07:34:06.262 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.260+0000 7f235e728700 1 -- 172.21.15.134:0/1933677484 wait complete. 2024-03-22T07:34:06.271 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:34:06.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 -- 172.21.15.134:0/785692068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fe500 msgr2=0x7f91700fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 --2- 172.21.15.134:0/785692068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fe500 0x7f91700fe910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f916c004940 tx=0x7f916c009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:06.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 -- 172.21.15.134:0/785692068 shutdown_connections 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 --2- 172.21.15.134:0/785692068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fee50 0x7f91700faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 --2- 172.21.15.134:0/785692068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fe500 0x7f91700fe910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 -- 172.21.15.134:0/785692068 >> 172.21.15.134:0/785692068 conn(0x7f91700f6be0 msgr2=0x7f91700f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 -- 172.21.15.134:0/785692068 shutdown_connections 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.363+0000 7f9177370700 1 -- 172.21.15.134:0/785692068 wait complete. 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f9177370700 1 Processor -- start 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f9177370700 1 -- start start 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f9177370700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fe500 0x7f917010d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f9177370700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 0x7f917010dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f9177370700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917010e3e0 con 0x7f91700fee50 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f9177370700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917010e550 con 0x7f91700fe500 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 0x7f917010dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 0x7f917010dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45968/0 (socket says 172.21.15.134:45968) 2024-03-22T07:34:06.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 -- 172.21.15.134:0/812660202 learned_addr learned my addr 172.21.15.134:0/812660202 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917510c700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fe500 0x7f917010d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 -- 172.21.15.134:0/812660202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fe500 msgr2=0x7f917010d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fe500 0x7f917010d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 -- 172.21.15.134:0/812660202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c005040 con 0x7f91700fee50 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.364+0000 7f917490b700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 0x7f917010dde0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9160002a80 tx=0x7f91600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.365+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9160007cc0 con 0x7f91700fee50 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.365+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f916000f040 con 0x7f91700fee50 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.365+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f916000dac0 con 0x7f91700fee50 2024-03-22T07:34:06.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.365+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9170112fb0 con 0x7f91700fee50 2024-03-22T07:34:06.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.365+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9170113540 con 0x7f91700fee50 2024-03-22T07:34:06.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.366+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917004c710 con 0x7f91700fee50 2024-03-22T07:34:06.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.366+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f916000dc20 con 0x7f91700fee50 2024-03-22T07:34:06.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.367+0000 7f9165ffb700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f915c06d380 0x7f915c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.367+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f916008c560 con 0x7f91700fee50 2024-03-22T07:34:06.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.367+0000 7f917510c700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f915c06d380 0x7f915c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.367+0000 7f917510c700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f915c06d380 0x7f915c06f830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f916c009fd0 tx=0x7f916c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:06.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.371+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9160059b20 con 0x7f91700fee50 2024-03-22T07:34:06.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.584+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9170102580 con 0x7f915c06d380 2024-03-22T07:34:06.585 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.585+0000 7f9165ffb700 1 -- 172.21.15.134:0/812660202 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9170102580 con 0x7f915c06d380 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f915c06d380 msgr2=0x7f915c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f915c06d380 0x7f915c06f830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f916c009fd0 tx=0x7f916c009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 msgr2=0x7f917010dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 0x7f917010dde0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9160002a80 tx=0x7f91600046b0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 shutdown_connections 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f915c06d380 0x7f915c06f830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91700fe500 0x7f917010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 --2- 172.21.15.134:0/812660202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91700fee50 0x7f917010dde0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 >> 172.21.15.134:0/812660202 conn(0x7f91700f6be0 msgr2=0x7f91700f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:06.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 shutdown_connections 2024-03-22T07:34:06.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.587+0000 7f9177370700 1 -- 172.21.15.134:0/812660202 wait complete. 2024-03-22T07:34:06.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 -- 172.21.15.134:0/408058668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fbce0 msgr2=0x7febf40fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 --2- 172.21.15.134:0/408058668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fbce0 0x7febf40fc0f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7febe4004940 tx=0x7febe4009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:06.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 -- 172.21.15.134:0/408058668 shutdown_connections 2024-03-22T07:34:06.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 --2- 172.21.15.134:0/408058668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf40fcf90 0x7febf40fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 --2- 172.21.15.134:0/408058668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fbce0 0x7febf40fc0f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.690 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 -- 172.21.15.134:0/408058668 >> 172.21.15.134:0/408058668 conn(0x7febf40f7440 msgr2=0x7febf40f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 -- 172.21.15.134:0/408058668 shutdown_connections 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.688+0000 7febfa868700 1 -- 172.21.15.134:0/408058668 wait complete. 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febfa868700 1 Processor -- start 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febfa868700 1 -- start start 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febfa868700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf40fbce0 0x7febf410b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febfa868700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 0x7febf410bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febfa868700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf410c3a0 con 0x7febf40fcf90 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febfa868700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4111e50 con 0x7febf40fbce0 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febf37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 0x7febf410bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.689+0000 7febf37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 0x7febf410bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45978/0 (socket says 172.21.15.134:45978) 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf37fe700 1 -- 172.21.15.134:0/2989318560 learned_addr learned my addr 172.21.15.134:0/2989318560 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf3fff700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf40fbce0 0x7febf410b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf37fe700 1 -- 172.21.15.134:0/2989318560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf40fbce0 msgr2=0x7febf410b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf37fe700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf40fbce0 0x7febf410b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf37fe700 1 -- 172.21.15.134:0/2989318560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4005040 con 0x7febf40fcf90 2024-03-22T07:34:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf37fe700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 0x7febf410bd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7febe800c8c0 tx=0x7febe80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febe800a760 con 0x7febf40fcf90 2024-03-22T07:34:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf4112130 con 0x7febf40fcf90 2024-03-22T07:34:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febe800ad90 con 0x7febf40fcf90 2024-03-22T07:34:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf410cbf0 con 0x7febf40fcf90 2024-03-22T07:34:06.692 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.690+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febe801b400 con 0x7febf40fcf90 2024-03-22T07:34:06.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.691+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf4104fe0 con 0x7febf40fcf90 2024-03-22T07:34:06.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.692+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7febe801b560 con 0x7febf40fcf90 2024-03-22T07:34:06.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.692+0000 7febf0ff9700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7febdc06d380 0x7febdc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:06.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.692+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7febe808c8f0 con 0x7febf40fcf90 2024-03-22T07:34:06.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.692+0000 7febf3fff700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7febdc06d380 0x7febdc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:06.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.693+0000 7febf3fff700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7febdc06d380 0x7febdc06f830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febe400b970 tx=0x7febe4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:06.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.697+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7febe8056550 con 0x7febf40fcf90 2024-03-22T07:34:06.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.900+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febf41048e0 con 0x7febdc06d380 2024-03-22T07:34:06.910 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.910+0000 7febf0ff9700 1 -- 172.21.15.134:0/2989318560 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7febf41048e0 con 0x7febdc06d380 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 9s ago 13m 25.0M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (113s) 9s ago 13m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (108s) 104s ago 12m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 9s ago 13m 81.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (7m) 9s ago 7m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (8m) 9s ago 8m 13.8M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (8m) 104s ago 8m 14.7M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (7m) 104s ago 7m 14.0M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (3m) 9s ago 14m 503M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (3m) 104s ago 12m 449M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:34:06.911 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (2m) 9s ago 14m 48.8M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (2m) 104s ago 12m 31.2M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 9s ago 13m 15.5M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 104s ago 12m 15.0M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (87s) 9s ago 11m 96.2M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (51s) 9s ago 11m 103M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (15s) 9s ago 10m 15.1M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (10m) 104s ago 10m 296M 2581M 17.2.7-726-g9c4e0c34 837124da804f 3526cff918f2 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (9m) 104s ago 9m 262M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (9m) 104s ago 9m 238M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:34:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 9s ago 12m 52.0M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7febdc06d380 msgr2=0x7febdc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7febdc06d380 0x7febdc06f830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febe400b970 tx=0x7febe4009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 msgr2=0x7febf410bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 0x7febf410bd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7febe800c8c0 tx=0x7febe80044c0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 shutdown_connections 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7febdc06d380 0x7febdc06f830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febf40fbce0 0x7febf410b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 --2- 172.21.15.134:0/2989318560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febf40fcf90 0x7febf410bd50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.912+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 >> 172.21.15.134:0/2989318560 conn(0x7febf40f7440 msgr2=0x7febf40664c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.913+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 shutdown_connections 2024-03-22T07:34:06.913 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:06.913+0000 7febfa868700 1 -- 172.21.15.134:0/2989318560 wait complete. 2024-03-22T07:34:07.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 -- 172.21.15.134:0/756362863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fbcd0 msgr2=0x7f24600fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 --2- 172.21.15.134:0/756362863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fbcd0 0x7f24600fc0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2450004940 tx=0x7f2450009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:07.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 -- 172.21.15.134:0/756362863 shutdown_connections 2024-03-22T07:34:07.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 --2- 172.21.15.134:0/756362863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24600fcf80 0x7f24600fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 --2- 172.21.15.134:0/756362863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fbcd0 0x7f24600fc0e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 -- 172.21.15.134:0/756362863 >> 172.21.15.134:0/756362863 conn(0x7f24600f7430 msgr2=0x7f24600f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:07.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 -- 172.21.15.134:0/756362863 shutdown_connections 2024-03-22T07:34:07.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.013+0000 7f24663e4700 1 -- 172.21.15.134:0/756362863 wait complete. 2024-03-22T07:34:07.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f24663e4700 1 Processor -- start 2024-03-22T07:34:07.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f24663e4700 1 -- start start 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f24663e4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24600fbcd0 0x7f24600661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f24663e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 0x7f2460112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f24663e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2460112d60 con 0x7f24600fcf80 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f24663e4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2460112ed0 con 0x7f24600fbcd0 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 0x7f2460112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 0x7f2460112730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:45992/0 (socket says 172.21.15.134:45992) 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245f7fe700 1 -- 172.21.15.134:0/2609188916 learned_addr learned my addr 172.21.15.134:0/2609188916 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245ffff700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24600fbcd0 0x7f24600661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245f7fe700 1 -- 172.21.15.134:0/2609188916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24600fbcd0 msgr2=0x7f24600661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245f7fe700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24600fbcd0 0x7f24600661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.014+0000 7f245f7fe700 1 -- 172.21.15.134:0/2609188916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450005040 con 0x7f24600fcf80 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.015+0000 7f245f7fe700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 0x7f2460112730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f245400c8c0 tx=0x7f24540044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.015+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f245400a760 con 0x7f24600fcf80 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.015+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24601131b0 con 0x7f24600fcf80 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.015+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f245400ad90 con 0x7f24600fcf80 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.015+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24540113a0 con 0x7f24600fcf80 2024-03-22T07:34:07.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.015+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2460113770 con 0x7f24600fcf80 2024-03-22T07:34:07.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.016+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246005f5f0 con 0x7f24600fcf80 2024-03-22T07:34:07.019 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.017+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f2454012400 con 0x7f24600fcf80 2024-03-22T07:34:07.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.017+0000 7f245cff9700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f244806d380 0x7f244806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.018+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f245408c910 con 0x7f24600fcf80 2024-03-22T07:34:07.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.018+0000 7f245ffff700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f244806d380 0x7f244806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.020 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.018+0000 7f245ffff700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f244806d380 0x7f244806f830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f245000b970 tx=0x7f2450009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:07.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.022+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2454056420 con 0x7f24600fcf80 2024-03-22T07:34:07.295 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.295+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f246004bed0 con 0x7f24600fcf80 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.296+0000 7f245cff9700 1 -- 172.21.15.134:0/2609188916 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f2454059ae0 con 0x7f24600fcf80 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:34:07.296 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 3, 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 3 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:34:07.297 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 7, 2024-03-22T07:34:07.298 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 7 2024-03-22T07:34:07.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:34:07.298 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f244806d380 msgr2=0x7f244806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f244806d380 0x7f244806f830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f245000b970 tx=0x7f2450009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 msgr2=0x7f2460112730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 0x7f2460112730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f245400c8c0 tx=0x7f24540044c0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 shutdown_connections 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f244806d380 0x7f244806f830 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.299 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24600fbcd0 0x7f24600661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 --2- 172.21.15.134:0/2609188916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24600fcf80 0x7f2460112730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 >> 172.21.15.134:0/2609188916 conn(0x7f24600f7430 msgr2=0x7f24600f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:07.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 shutdown_connections 2024-03-22T07:34:07.300 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.298+0000 7f24663e4700 1 -- 172.21.15.134:0/2609188916 wait complete. 2024-03-22T07:34:07.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 -- 172.21.15.134:0/1842781491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 msgr2=0x7ff5a00fb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/1842781491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fb610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff590004940 tx=0x7ff590009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:07.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 -- 172.21.15.134:0/1842781491 shutdown_connections 2024-03-22T07:34:07.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/1842781491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a00fbb50 0x7ff5a00fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/1842781491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fb610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 -- 172.21.15.134:0/1842781491 >> 172.21.15.134:0/1842781491 conn(0x7ff5a00f6be0 msgr2=0x7ff5a00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:07.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 -- 172.21.15.134:0/1842781491 shutdown_connections 2024-03-22T07:34:07.401 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.400+0000 7ff5a53f2700 1 -- 172.21.15.134:0/1842781491 wait complete. 2024-03-22T07:34:07.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff5a53f2700 1 Processor -- start 2024-03-22T07:34:07.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff5a53f2700 1 -- start start 2024-03-22T07:34:07.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff5a53f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff5a53f2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a00fbb50 0x7ff5a00fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.402 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff5a53f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00fe130 con 0x7ff5a00fb200 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff5a53f2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00fc720 con 0x7ff5a00fbb50 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff59effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff59effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46018/0 (socket says 172.21.15.134:46018) 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff59effd700 1 -- 172.21.15.134:0/263796069 learned_addr learned my addr 172.21.15.134:0/263796069 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.401+0000 7ff59e7fc700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a00fbb50 0x7ff5a00fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff59effd700 1 -- 172.21.15.134:0/263796069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a00fbb50 msgr2=0x7ff5a00fc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff59effd700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a00fbb50 0x7ff5a00fc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff59effd700 1 -- 172.21.15.134:0/263796069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590005040 con 0x7ff5a00fb200 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff59effd700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fdb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff59000b3b0 tx=0x7ff590009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59000e040 con 0x7ff5a00fb200 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff59000bbf0 con 0x7ff5a00fb200 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59001c630 con 0x7ff5a00fb200 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a00fc970 con 0x7ff5a00fb200 2024-03-22T07:34:07.403 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.402+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a00fcf30 con 0x7ff5a00fb200 2024-03-22T07:34:07.404 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.403+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a004c710 con 0x7ff5a00fb200 2024-03-22T07:34:07.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.403+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff59000bd60 con 0x7ff5a00fb200 2024-03-22T07:34:07.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.404+0000 7ff5877fe700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff58806d380 0x7ff58806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.404+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff59008d500 con 0x7ff5a00fb200 2024-03-22T07:34:07.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.404+0000 7ff59e7fc700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff58806d380 0x7ff58806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.404+0000 7ff59e7fc700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff58806d380 0x7ff58806f830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff594004f40 tx=0x7ff59400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:07.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.408+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff59005ab40 con 0x7ff5a00fb200 2024-03-22T07:34:07.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.645+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff5a0115c80 con 0x7ff5a00fb200 2024-03-22T07:34:07.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:07 smithi134 ceph-mon[93947]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:07.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:07 smithi134 ceph-mon[93947]: pgmap v102: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:07.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:07 smithi134 ceph-mon[93947]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:07.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:07 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2609188916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:07.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.646+0000 7ff5877fe700 1 -- 172.21.15.134:0/263796069 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7ff59005a6d0 con 0x7ff5a00fb200 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:34:07.647 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:34:07.648 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:34:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:07.650 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:07.650 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:07.650 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:07.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff58806d380 msgr2=0x7ff58806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff58806d380 0x7ff58806f830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff594004f40 tx=0x7ff59400b040 comp rx=0 tx=0).stop 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 msgr2=0x7ff5a00fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fdb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff59000b3b0 tx=0x7ff590009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 shutdown_connections 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff58806d380 0x7ff58806f830 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5a00fb200 0x7ff5a00fdb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.648+0000 7ff5a53f2700 1 --2- 172.21.15.134:0/263796069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a00fbb50 0x7ff5a00fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.649+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 >> 172.21.15.134:0/263796069 conn(0x7ff5a00f6be0 msgr2=0x7ff5a00f82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.649+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 shutdown_connections 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.649+0000 7ff5a53f2700 1 -- 172.21.15.134:0/263796069 wait complete. 2024-03-22T07:34:07.651 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.753+0000 7fbb44912700 1 -- 172.21.15.134:0/2550353557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 msgr2=0x7fbb400fc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.753+0000 7fbb44912700 1 --2- 172.21.15.134:0/2550353557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400fc120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb30004940 tx=0x7fbb30009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- 172.21.15.134:0/2550353557 shutdown_connections 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 --2- 172.21.15.134:0/2550353557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb400fcfc0 0x7fbb400fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 --2- 172.21.15.134:0/2550353557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400fc120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- 172.21.15.134:0/2550353557 >> 172.21.15.134:0/2550353557 conn(0x7fbb400f7490 msgr2=0x7fbb400f98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:07.755 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- 172.21.15.134:0/2550353557 shutdown_connections 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- 172.21.15.134:0/2550353557 wait complete. 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 Processor -- start 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- start start 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb400fcfc0 0x7fbb400fe300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40100250 con 0x7fbb400fbd10 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb44912700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400fe840 con 0x7fbb400fcfc0 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb3e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb3e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400ffc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46034/0 (socket says 172.21.15.134:46034) 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.754+0000 7fbb3e59c700 1 -- 172.21.15.134:0/192748180 learned_addr learned my addr 172.21.15.134:0/192748180 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb3dd9b700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb400fcfc0 0x7fbb400fe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb3e59c700 1 -- 172.21.15.134:0/192748180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb400fcfc0 msgr2=0x7fbb400fe300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb3e59c700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb400fcfc0 0x7fbb400fe300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb3e59c700 1 -- 172.21.15.134:0/192748180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30005040 con 0x7fbb400fbd10 2024-03-22T07:34:07.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb3e59c700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400ffc50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009150 tx=0x7fbb30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:07.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb3000e040 con 0x7fbb400fbd10 2024-03-22T07:34:07.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb3000bbf0 con 0x7fbb400fbd10 2024-03-22T07:34:07.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb400fea90 con 0x7fbb400fbd10 2024-03-22T07:34:07.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb3001c630 con 0x7fbb400fbd10 2024-03-22T07:34:07.757 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.755+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb400ff050 con 0x7fbb400fbd10 2024-03-22T07:34:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.756+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb40101b50 con 0x7fbb400fbd10 2024-03-22T07:34:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.756+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fbb3000bd60 con 0x7fbb400fbd10 2024-03-22T07:34:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.757+0000 7fbb2effd700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb2806d380 0x7fbb2806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.757+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbb3008dc00 con 0x7fbb400fbd10 2024-03-22T07:34:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.757+0000 7fbb3dd9b700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb2806d380 0x7fbb2806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:07.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.757+0000 7fbb3dd9b700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb2806d380 0x7fbb2806f830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb34004f40 tx=0x7fbb3400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:07.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.761+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbb3005b260 con 0x7fbb400fbd10 2024-03-22T07:34:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:07 smithi195 ceph-mon[82061]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:07 smithi195 ceph-mon[82061]: pgmap v102: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:07 smithi195 ceph-mon[82061]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:07 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2609188916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:07.973 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.973+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb4002b310 con 0x7fbb2806d380 2024-03-22T07:34:07.974 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.975+0000 7fbb2effd700 1 -- 172.21.15.134:0/192748180 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbb4002b310 con 0x7fbb2806d380 2024-03-22T07:34:07.974 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "9/21 daemons upgraded", 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:34:07.975 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb2806d380 msgr2=0x7fbb2806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb2806d380 0x7fbb2806f830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb34004f40 tx=0x7fbb3400b040 comp rx=0 tx=0).stop 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 msgr2=0x7fbb400ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400ffc50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009150 tx=0x7fbb30009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 shutdown_connections 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbb2806d380 0x7fbb2806f830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb400fbd10 0x7fbb400ffc50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 --2- 172.21.15.134:0/192748180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb400fcfc0 0x7fbb400fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:07.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 >> 172.21.15.134:0/192748180 conn(0x7fbb400f7490 msgr2=0x7fbb40066800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:07.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 shutdown_connections 2024-03-22T07:34:07.978 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:07.977+0000 7fbb44912700 1 -- 172.21.15.134:0/192748180 wait complete. 2024-03-22T07:34:08.079 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/4160100856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 msgr2=0x7f0b180fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/4160100856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b180fe450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c004940 tx=0x7f0b0c009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/4160100856 shutdown_connections 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/4160100856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b180fe450 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/4160100856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b180fce70 0x7f0b180fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/4160100856 >> 172.21.15.134:0/4160100856 conn(0x7f0b180f8550 msgr2=0x7f0b180fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/4160100856 shutdown_connections 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.077+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/4160100856 wait complete. 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.078+0000 7f0b1d6c4700 1 Processor -- start 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.078+0000 7f0b1d6c4700 1 -- start start 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.078+0000 7f0b1d6c4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b180fce70 0x7f0b1810d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.078+0000 7f0b1d6c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b1810ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:08.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.078+0000 7f0b1d6c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1810e3f0 con 0x7f0b180fdfe0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.078+0000 7f0b1d6c4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1810e560 con 0x7f0b180fce70 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b1810ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b1810ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46054/0 (socket says 172.21.15.134:46054) 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 -- 172.21.15.134:0/751737357 learned_addr learned my addr 172.21.15.134:0/751737357 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b16ffd700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b180fce70 0x7f0b1810d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 -- 172.21.15.134:0/751737357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b180fce70 msgr2=0x7f0b1810d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b180fce70 0x7f0b1810d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 -- 172.21.15.134:0/751737357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c005040 con 0x7f0b180fdfe0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b167fc700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b1810ddf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c013870 tx=0x7f0b0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c00e070 con 0x7f0b180fdfe0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b0c01c400 con 0x7f0b180fdfe0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b18112f60 con 0x7f0b180fdfe0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c00b630 con 0x7f0b180fdfe0 2024-03-22T07:34:08.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.079+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b18113410 con 0x7f0b180fdfe0 2024-03-22T07:34:08.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.080+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1804c710 con 0x7f0b180fdfe0 2024-03-22T07:34:08.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.081+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f0b0c01c570 con 0x7f0b180fdfe0 2024-03-22T07:34:08.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.081+0000 7f0aff7fe700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0b0006d380 0x7f0b0006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:08.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.081+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0b0c08e090 con 0x7f0b180fdfe0 2024-03-22T07:34:08.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.081+0000 7f0b16ffd700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0b0006d380 0x7f0b0006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:08.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.082+0000 7f0b16ffd700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0b0006d380 0x7f0b0006f830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004600 tx=0x7f0b0800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:08.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.086+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0b0c05b6d0 con 0x7f0b180fdfe0 2024-03-22T07:34:08.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.359+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0b181058f0 con 0x7f0b180fdfe0 2024-03-22T07:34:08.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.359+0000 7f0aff7fe700 1 -- 172.21.15.134:0/751737357 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0b0c05b260 con 0x7f0b180fdfe0 2024-03-22T07:34:08.359 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:34:08.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0b0006d380 msgr2=0x7f0b0006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:08.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0b0006d380 0x7f0b0006f830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b08004600 tx=0x7f0b0800b040 comp rx=0 tx=0).stop 2024-03-22T07:34:08.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 msgr2=0x7f0b1810ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:08.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b1810ddf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c013870 tx=0x7f0b0c009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 shutdown_connections 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0b0006d380 0x7f0b0006f830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b180fce70 0x7f0b1810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 --2- 172.21.15.134:0/751737357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b180fdfe0 0x7f0b1810ddf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 >> 172.21.15.134:0/751737357 conn(0x7f0b180f8550 msgr2=0x7f0b180f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 shutdown_connections 2024-03-22T07:34:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:08.361+0000 7f0b1d6c4700 1 -- 172.21.15.134:0/751737357 wait complete. 2024-03-22T07:34:08.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:08 smithi134 ceph-mon[93947]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:08.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:08 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/263796069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:34:08.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:08 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/751737357' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:34:08.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:08 smithi195 ceph-mon[82061]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:08.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:08 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/263796069' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:34:08.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:08 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/751737357' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:34:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:09 smithi195 ceph-mon[82061]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:09 smithi195 ceph-mon[82061]: pgmap v103: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:09 smithi134 ceph-mon[93947]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:10.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:09 smithi134 ceph-mon[93947]: pgmap v103: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:11 smithi195 ceph-mon[82061]: pgmap v104: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:12.021 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:11 smithi134 ceph-mon[93947]: pgmap v104: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:13 smithi195 ceph-mon[82061]: pgmap v105: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:14.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:13 smithi134 ceph-mon[93947]: pgmap v105: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:14 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:14 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:15 smithi195 ceph-mon[82061]: pgmap v106: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:16.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:15 smithi134 ceph-mon[93947]: pgmap v106: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:17 smithi134 ceph-mon[93947]: pgmap v107: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:17 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:17.834 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:17 smithi195 ceph-mon[82061]: pgmap v107: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:17.834 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:17 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:18.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:18 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:18.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:18 smithi195 ceph-mon[82061]: Upgrade: osd.3 is safe to restart 2024-03-22T07:34:18.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:18.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:18 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-22T07:34:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:18 smithi134 ceph-mon[93947]: Upgrade: osd.3 is safe to restart 2024-03-22T07:34:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:19.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:19 smithi195 ceph-mon[82061]: pgmap v108: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:19.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:19.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-22T07:34:19.689 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:20.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:19 smithi134 ceph-mon[93947]: pgmap v108: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:20.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:20.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-22T07:34:20.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:20.773 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:20 smithi195 ceph-mon[82061]: Upgrade: Updating osd.3 2024-03-22T07:34:20.773 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:20 smithi195 ceph-mon[82061]: Deploying daemon osd.3 on smithi195 2024-03-22T07:34:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:20 smithi134 ceph-mon[93947]: Upgrade: Updating osd.3 2024-03-22T07:34:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:20 smithi134 ceph-mon[93947]: Deploying daemon osd.3 on smithi195 2024-03-22T07:34:21.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:21 smithi195 ceph-mon[82061]: pgmap v109: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:21.955 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:21 smithi195 systemd[1]: Stopping Ceph osd.3 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:34:22.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:21 smithi134 ceph-mon[93947]: pgmap v109: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:22.455 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:22 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[41585]: 2024-03-22T07:34:22.031+0000 7fc97989d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:34:22.455 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:22 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[41585]: 2024-03-22T07:34:22.031+0000 7fc97989d700 -1 osd.3 65 *** Got signal Terminated *** 2024-03-22T07:34:22.455 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:22 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[41585]: 2024-03-22T07:34:22.031+0000 7fc97989d700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:34:22.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:22 smithi195 ceph-mon[82061]: osd.3 marked itself down and dead 2024-03-22T07:34:23.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:22 smithi134 ceph-mon[93947]: osd.3 marked itself down and dead 2024-03-22T07:34:23.432 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:23 smithi195 podman[91437]: 2024-03-22 07:34:23.121246416 +0000 UTC m=+1.205975962 container died 3526cff918f2201aa32e4f096b75a207b63ee434e414b19e9b61719a5c5600cc (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, RELEASE=quincy-9c4e0c3, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-22T07:34:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:23 smithi195 ceph-mon[82061]: pgmap v110: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:23 smithi195 ceph-mon[82061]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:34:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:23 smithi195 ceph-mon[82061]: failed to encode map e66 with expected crc 2024-03-22T07:34:23.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:23 smithi195 ceph-mon[82061]: osdmap e66: 6 total, 5 up, 6 in 2024-03-22T07:34:23.706 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:23 smithi195 podman[91437]: 2024-03-22 07:34:23.548358157 +0000 UTC m=+1.633087714 container cleanup 3526cff918f2201aa32e4f096b75a207b63ee434e414b19e9b61719a5c5600cc (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, ceph=True, RELEASE=quincy-9c4e0c3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-22T07:34:23.706 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:23 smithi195 bash[91437]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3 2024-03-22T07:34:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:23 smithi134 ceph-mon[93947]: pgmap v110: 65 pgs: 65 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:23 smithi134 ceph-mon[93947]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:34:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:23 smithi134 ceph-mon[93947]: failed to encode map e66 with expected crc 2024-03-22T07:34:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:23 smithi134 ceph-mon[93947]: osdmap e66: 6 total, 5 up, 6 in 2024-03-22T07:34:24.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:23 smithi195 podman[91464]: 2024-03-22 07:34:23.774931685 +0000 UTC m=+0.654902329 container remove 3526cff918f2201aa32e4f096b75a207b63ee434e414b19e9b61719a5c5600cc (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-9c4e0c3, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-22T07:34:24.536 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:24 smithi195 podman[91555]: 2024-03-22 07:34:24.109753899 +0000 UTC m=+0.018727389 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:34:24.536 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:24 smithi195 podman[91555]: 2024-03-22 07:34:24.209231755 +0000 UTC m=+0.118205290 container create 55a4b62c803347bb586430c3c4422bc4bcdc92a26673a78e0a7bbf6896e1ae7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-22T07:34:24.536 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:24 smithi195 podman[91555]: 2024-03-22 07:34:24.436632939 +0000 UTC m=+0.345606425 container init 55a4b62c803347bb586430c3c4422bc4bcdc92a26673a78e0a7bbf6896e1ae7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-db0330b, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-22T07:34:24.536 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:24 smithi195 podman[91555]: 2024-03-22 07:34:24.439689647 +0000 UTC m=+0.348663141 container start 55a4b62c803347bb586430c3c4422bc4bcdc92a26673a78e0a7bbf6896e1ae7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, org.label-schema.build-date=20240307) 2024-03-22T07:34:24.536 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:24 smithi195 podman[91555]: 2024-03-22 07:34:24.536679815 +0000 UTC m=+0.445653328 container attach 55a4b62c803347bb586430c3c4422bc4bcdc92a26673a78e0a7bbf6896e1ae7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, RELEASE=squid-db0330b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-22T07:34:24.955 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:24 smithi195 podman[91555]: 2024-03-22 07:34:24.725411893 +0000 UTC m=+0.634385371 container died 55a4b62c803347bb586430c3c4422bc4bcdc92a26673a78e0a7bbf6896e1ae7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, RELEASE=squid-db0330b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0) 2024-03-22T07:34:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:24 smithi195 ceph-mon[82061]: osdmap e67: 6 total, 5 up, 6 in 2024-03-22T07:34:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:24 smithi195 ceph-mon[82061]: failed to encode map e67 with expected crc 2024-03-22T07:34:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:24 smithi195 ceph-mon[82061]: failed to encode map e67 with expected crc 2024-03-22T07:34:24.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:24 smithi195 ceph-mon[82061]: failed to encode map e67 with expected crc 2024-03-22T07:34:24.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:24 smithi195 ceph-mon[82061]: failed to encode map e67 with expected crc 2024-03-22T07:34:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:24 smithi134 ceph-mon[93947]: osdmap e67: 6 total, 5 up, 6 in 2024-03-22T07:34:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:24 smithi134 ceph-mon[93947]: failed to encode map e67 with expected crc 2024-03-22T07:34:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:24 smithi134 ceph-mon[93947]: failed to encode map e67 with expected crc 2024-03-22T07:34:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:24 smithi134 ceph-mon[93947]: failed to encode map e67 with expected crc 2024-03-22T07:34:25.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:24 smithi134 ceph-mon[93947]: failed to encode map e67 with expected crc 2024-03-22T07:34:25.601 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 podman[91581]: 2024-03-22 07:34:25.282093626 +0000 UTC m=+0.551101994 container remove 55a4b62c803347bb586430c3c4422bc4bcdc92a26673a78e0a7bbf6896e1ae7f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-22T07:34:25.601 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.3.service: Deactivated successfully. 2024-03-22T07:34:25.601 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 systemd[1]: Stopped Ceph osd.3 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:34:25.601 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.3.service: Consumed 1min 15.971s CPU time. 2024-03-22T07:34:25.601 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 systemd[1]: Starting Ceph osd.3 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:34:25.953 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:25 smithi195 ceph-mon[82061]: pgmap v113: 65 pgs: 7 active+undersized+degraded, 6 stale+active+clean, 11 active+undersized, 41 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2024-03-22T07:34:25.953 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:25 smithi195 ceph-mon[82061]: Health check failed: Degraded data redundancy: 24/219 objects degraded (10.959%), 7 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:25.953 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 podman[91686]: 2024-03-22 07:34:25.699775959 +0000 UTC m=+0.101850749 container create b2c590e9b2aa63a2385091caf02854a35c1db90115b50950e4442e45ef8ffc7b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b) 2024-03-22T07:34:25.953 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 podman[91686]: 2024-03-22 07:34:25.616131178 +0000 UTC m=+0.018205983 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:34:26.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:25 smithi134 ceph-mon[93947]: pgmap v113: 65 pgs: 7 active+undersized+degraded, 6 stale+active+clean, 11 active+undersized, 41 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%) 2024-03-22T07:34:26.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:25 smithi134 ceph-mon[93947]: Health check failed: Degraded data redundancy: 24/219 objects degraded (10.959%), 7 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:26.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 podman[91686]: 2024-03-22 07:34:25.953576429 +0000 UTC m=+0.355651234 container init b2c590e9b2aa63a2385091caf02854a35c1db90115b50950e4442e45ef8ffc7b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS) 2024-03-22T07:34:26.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:25 smithi195 podman[91686]: 2024-03-22 07:34:25.957206876 +0000 UTC m=+0.359281677 container start b2c590e9b2aa63a2385091caf02854a35c1db90115b50950e4442e45ef8ffc7b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-22T07:34:26.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 podman[91686]: 2024-03-22 07:34:26.077460581 +0000 UTC m=+0.479535376 container attach b2c590e9b2aa63a2385091caf02854a35c1db90115b50950e4442e45ef8ffc7b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-22T07:34:26.702 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 bash[91686]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate[91700]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-22T07:34:26.703 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 podman[91686]: 2024-03-22 07:34:26.420658892 +0000 UTC m=+0.822733683 container died b2c590e9b2aa63a2385091caf02854a35c1db90115b50950e4442e45ef8ffc7b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=squid-db0330b) 2024-03-22T07:34:27.282 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:26 smithi195 podman[91832]: 2024-03-22 07:34:26.956135252 +0000 UTC m=+0.530522160 container remove b2c590e9b2aa63a2385091caf02854a35c1db90115b50950e4442e45ef8ffc7b (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-22T07:34:27.282 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 podman[91892]: 2024-03-22 07:34:27.165421089 +0000 UTC m=+0.113251913 container create 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b) 2024-03-22T07:34:27.282 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 podman[91892]: 2024-03-22 07:34:27.070475349 +0000 UTC m=+0.018306189 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:34:27.603 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 podman[91892]: 2024-03-22 07:34:27.384880185 +0000 UTC m=+0.332711017 container init 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:34:27.603 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 podman[91892]: 2024-03-22 07:34:27.38828255 +0000 UTC m=+0.336113384 container start 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-22T07:34:27.604 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 ceph-osd[91911]: -- 172.21.15.195:0/1134503115 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55697e4031e0 con 0x55697e3d4c00 2024-03-22T07:34:27.604 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 bash[91892]: 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea 2024-03-22T07:34:27.604 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 systemd[1]: Started Ceph osd.3 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:34:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:27 smithi134 ceph-mon[93947]: pgmap v114: 65 pgs: 10 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 37 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-03-22T07:34:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:34:27.936 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:27 smithi195 ceph-mon[82061]: pgmap v114: 65 pgs: 10 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 37 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-03-22T07:34:27.936 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:27.936 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:27.936 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:34:28.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:27 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:34:27.935+0000 7ffb6b5827c0 -1 Falling back to public interface 2024-03-22T07:34:29.869 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:29 smithi195 ceph-mon[82061]: pgmap v115: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:29 smithi134 ceph-mon[93947]: pgmap v115: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:30.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:30 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 49/219 objects degraded (22.374%), 17 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:30 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:30 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:30 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 49/219 objects degraded (22.374%), 17 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:30 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:30 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:31.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:31 smithi195 ceph-mon[82061]: pgmap v116: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:31 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:31 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:31 smithi134 ceph-mon[93947]: pgmap v116: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:31 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:31 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:32.705 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:34:32.566+0000 7ffb6b5827c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-03-22T07:34:33.379 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:33 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:34:33.158+0000 7ffb6b5827c0 -1 osd.3 65 log_to_monitors true 2024-03-22T07:34:33.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:33 smithi195 ceph-mon[82061]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:33.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:33 smithi195 ceph-mon[82061]: from='osd.3 [v2:172.21.15.195:6800/3515380558,v1:172.21.15.195:6801/3515380558]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:34:33.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:33 smithi195 ceph-mon[82061]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:34:33.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:33.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:33 smithi134 ceph-mon[93947]: pgmap v117: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:33 smithi134 ceph-mon[93947]: from='osd.3 [v2:172.21.15.195:6800/3515380558,v1:172.21.15.195:6801/3515380558]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:34:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:33 smithi134 ceph-mon[93947]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-22T07:34:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:34.619 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:34:34 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:34:34.363+0000 7ffb589d2700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:34:34.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:34 smithi195 ceph-mon[82061]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-22T07:34:34.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:34 smithi195 ceph-mon[82061]: from='osd.3 [v2:172.21.15.195:6800/3515380558,v1:172.21.15.195:6801/3515380558]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:34:34.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:34 smithi195 ceph-mon[82061]: osdmap e68: 6 total, 5 up, 6 in 2024-03-22T07:34:34.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:34 smithi195 ceph-mon[82061]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:34:34.926 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:34 smithi195 ceph-mon[82061]: from='osd.3 ' entity='osd.3' 2024-03-22T07:34:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:34 smithi134 ceph-mon[93947]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-22T07:34:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:34 smithi134 ceph-mon[93947]: from='osd.3 [v2:172.21.15.195:6800/3515380558,v1:172.21.15.195:6801/3515380558]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:34:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:34 smithi134 ceph-mon[93947]: osdmap e68: 6 total, 5 up, 6 in 2024-03-22T07:34:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:34 smithi134 ceph-mon[93947]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:34:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:34 smithi134 ceph-mon[93947]: from='osd.3 ' entity='osd.3' 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: pgmap v119: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:34:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: osd.3 [v2:172.21.15.195:6800/3515380558,v1:172.21.15.195:6801/3515380558] boot 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: osdmap e69: 6 total, 6 up, 6 in 2024-03-22T07:34:35.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:35 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: pgmap v119: 65 pgs: 17 active+undersized+degraded, 21 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/219 objects degraded (22.374%) 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: osd.3 [v2:172.21.15.195:6800/3515380558,v1:172.21.15.195:6801/3515380558] boot 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: osdmap e69: 6 total, 6 up, 6 in 2024-03-22T07:34:36.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:35 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-22T07:34:36.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:36 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:36 smithi195 ceph-mon[82061]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-22T07:34:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:36 smithi195 ceph-mon[82061]: failed to encode map e68 with expected crc 2024-03-22T07:34:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:36 smithi195 ceph-mon[82061]: osdmap e70: 6 total, 6 up, 6 in 2024-03-22T07:34:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:36 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:36 smithi134 ceph-mon[93947]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-22T07:34:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:36 smithi134 ceph-mon[93947]: failed to encode map e68 with expected crc 2024-03-22T07:34:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:36 smithi134 ceph-mon[93947]: osdmap e70: 6 total, 6 up, 6 in 2024-03-22T07:34:37.624 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.624 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.625 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.625 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.625 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: failed to encode map e70 with expected crc 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: pgmap v122: 65 pgs: 4 peering, 16 active+undersized+degraded, 18 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-03-22T07:34:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:37 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 46/219 objects degraded (21.005%), 16 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: failed to encode map e70 with expected crc 2024-03-22T07:34:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: pgmap v122: 65 pgs: 4 peering, 16 active+undersized+degraded, 18 active+undersized, 27 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/219 objects degraded (21.005%) 2024-03-22T07:34:38.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:37 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 46/219 objects degraded (21.005%), 16 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 -- 172.21.15.134:0/2115065228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fbcd0 msgr2=0x7fbea00fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/2115065228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fbcd0 0x7fbea00fc0e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe98004940 tx=0x7fbe98009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 -- 172.21.15.134:0/2115065228 shutdown_connections 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/2115065228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fcf80 0x7fbea00fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/2115065228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fbcd0 0x7fbea00fc0e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 -- 172.21.15.134:0/2115065228 >> 172.21.15.134:0/2115065228 conn(0x7fbea00f7430 msgr2=0x7fbea00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 -- 172.21.15.134:0/2115065228 shutdown_connections 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.476+0000 7fbea7fa7700 1 -- 172.21.15.134:0/2115065228 wait complete. 2024-03-22T07:34:38.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea7fa7700 1 Processor -- start 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea7fa7700 1 -- start start 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea7fa7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fbcd0 0x7fbea01106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea7fa7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 0x7fbea0112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea7fa7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00663b0 con 0x7fbea00fcf80 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea7fa7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00664f0 con 0x7fbea00fbcd0 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea5542700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 0x7fbea0112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea5d43700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fbcd0 0x7fbea01106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea5542700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 0x7fbea0112c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38318/0 (socket says 172.21.15.134:38318) 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea5d43700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fbcd0 0x7fbea01106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:46296/0 (socket says 172.21.15.134:46296) 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.477+0000 7fbea5542700 1 -- 172.21.15.134:0/3195406067 learned_addr learned my addr 172.21.15.134:0/3195406067 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbea5542700 1 -- 172.21.15.134:0/3195406067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fbcd0 msgr2=0x7fbea01106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbea5542700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fbcd0 0x7fbea01106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbea5542700 1 -- 172.21.15.134:0/3195406067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98005040 con 0x7fbea00fcf80 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbea5542700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 0x7fbea0112c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe94002a50 tx=0x7fbe940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:38.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe94007cc0 con 0x7fbea00fcf80 2024-03-22T07:34:38.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9400f040 con 0x7fbea00fcf80 2024-03-22T07:34:38.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea0113210 con 0x7fbea00fcf80 2024-03-22T07:34:38.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9400da30 con 0x7fbea00fcf80 2024-03-22T07:34:38.480 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.478+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea01137d0 con 0x7fbea00fcf80 2024-03-22T07:34:38.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.479+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea005f5f0 con 0x7fbea00fcf80 2024-03-22T07:34:38.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.479+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fbe9400db90 con 0x7fbea00fcf80 2024-03-22T07:34:38.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.480+0000 7fbe9e7fc700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbe8806d390 0x7fbe8806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:38.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.480+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbe9408c6b0 con 0x7fbea00fcf80 2024-03-22T07:34:38.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.480+0000 7fbea5d43700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbe8806d390 0x7fbe8806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:38.481 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.480+0000 7fbea5d43700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbe8806d390 0x7fbe8806f840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe98000c00 tx=0x7fbe98009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:38.484 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.484+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbe94056140 con 0x7fbea00fcf80 2024-03-22T07:34:38.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.699+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbea0101290 con 0x7fbe8806d390 2024-03-22T07:34:38.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.701+0000 7fbe9e7fc700 1 -- 172.21.15.134:0/3195406067 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbea0101290 con 0x7fbe8806d390 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbe8806d390 msgr2=0x7fbe8806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbe8806d390 0x7fbe8806f840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe98000c00 tx=0x7fbe98009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 msgr2=0x7fbea0112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 0x7fbea0112c10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe94002a50 tx=0x7fbe940046b0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 shutdown_connections 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fbe8806d390 0x7fbe8806f840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbea00fbcd0 0x7fbea01106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 --2- 172.21.15.134:0/3195406067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbea00fcf80 0x7fbea0112c10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 >> 172.21.15.134:0/3195406067 conn(0x7fbea00f7430 msgr2=0x7fbea00f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 shutdown_connections 2024-03-22T07:34:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.703+0000 7fbea7fa7700 1 -- 172.21.15.134:0/3195406067 wait complete. 2024-03-22T07:34:38.713 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.805+0000 7f4b504ea700 1 -- 172.21.15.134:0/9389452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 msgr2=0x7f4b480ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.805+0000 7f4b504ea700 1 --2- 172.21.15.134:0/9389452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b480ffa20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4b44004940 tx=0x7f4b44009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.805+0000 7f4b504ea700 1 -- 172.21.15.134:0/9389452 shutdown_connections 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.805+0000 7f4b504ea700 1 --2- 172.21.15.134:0/9389452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 0x7f4b48102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 --2- 172.21.15.134:0/9389452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b480ffa20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 -- 172.21.15.134:0/9389452 >> 172.21.15.134:0/9389452 conn(0x7f4b480f7450 msgr2=0x7f4b480f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 -- 172.21.15.134:0/9389452 shutdown_connections 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 -- 172.21.15.134:0/9389452 wait complete. 2024-03-22T07:34:38.808 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 Processor -- start 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 -- start start 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b4810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 0x7f4b4810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4810e4b0 con 0x7f4b48066ef0 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b504ea700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4810e620 con 0x7f4b480fff60 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b4e286700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b4810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b4e286700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b4810d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38336/0 (socket says 172.21.15.134:38336) 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.806+0000 7f4b4e286700 1 -- 172.21.15.134:0/221721038 learned_addr learned my addr 172.21.15.134:0/221721038 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b4e286700 1 -- 172.21.15.134:0/221721038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 msgr2=0x7f4b4810deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b4da85700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 0x7f4b4810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b4e286700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 0x7f4b4810deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:38.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b4e286700 1 -- 172.21.15.134:0/221721038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44005040 con 0x7f4b48066ef0 2024-03-22T07:34:38.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b4da85700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 0x7f4b4810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:34:38.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b4e286700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b4810d970 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000c00 tx=0x7f4b44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:38.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4400e040 con 0x7f4b48066ef0 2024-03-22T07:34:38.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b48113020 con 0x7f4b48066ef0 2024-03-22T07:34:38.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b4400bcc0 con 0x7f4b48066ef0 2024-03-22T07:34:38.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b4401c630 con 0x7f4b48066ef0 2024-03-22T07:34:38.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.807+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b481135e0 con 0x7f4b48066ef0 2024-03-22T07:34:38.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.808+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4804c710 con 0x7f4b48066ef0 2024-03-22T07:34:38.812 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.809+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f4b44013980 con 0x7f4b48066ef0 2024-03-22T07:34:38.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.809+0000 7f4b3effd700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4b3406d380 0x7f4b3406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:38.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.809+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4b4408dbe0 con 0x7f4b48066ef0 2024-03-22T07:34:38.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.809+0000 7f4b4da85700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4b3406d380 0x7f4b3406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:38.813 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.809+0000 7f4b4da85700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4b3406d380 0x7f4b3406f830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b38007fd0 tx=0x7f4b38009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:38.814 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:38.814+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4b4405b2c0 con 0x7f4b48066ef0 2024-03-22T07:34:39.028 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.028+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b480f8f40 con 0x7f4b3406d380 2024-03-22T07:34:39.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.029+0000 7f4b3effd700 1 -- 172.21.15.134:0/221721038 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4b480f8f40 con 0x7f4b3406d380 2024-03-22T07:34:39.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4b3406d380 msgr2=0x7f4b3406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4b3406d380 0x7f4b3406f830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b38007fd0 tx=0x7f4b38009040 comp rx=0 tx=0).stop 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 msgr2=0x7f4b4810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b4810d970 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4b44000c00 tx=0x7f4b44009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 shutdown_connections 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4b3406d380 0x7f4b3406f830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b48066ef0 0x7f4b4810d970 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 --2- 172.21.15.134:0/221721038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b480fff60 0x7f4b4810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.031+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 >> 172.21.15.134:0/221721038 conn(0x7f4b480f7450 msgr2=0x7f4b480f7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.032+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 shutdown_connections 2024-03-22T07:34:39.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.032+0000 7f4b504ea700 1 -- 172.21.15.134:0/221721038 wait complete. 2024-03-22T07:34:39.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 -- 172.21.15.134:0/2113278133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fcf80 msgr2=0x7ff2f00fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 --2- 172.21.15.134:0/2113278133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fcf80 0x7ff2f00fd3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0004940 tx=0x7ff2e0009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 -- 172.21.15.134:0/2113278133 shutdown_connections 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 --2- 172.21.15.134:0/2113278133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fcf80 0x7ff2f00fd3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 --2- 172.21.15.134:0/2113278133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f00fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 -- 172.21.15.134:0/2113278133 >> 172.21.15.134:0/2113278133 conn(0x7ff2f00f7450 msgr2=0x7ff2f00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 -- 172.21.15.134:0/2113278133 shutdown_connections 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.133+0000 7ff2f7841700 1 -- 172.21.15.134:0/2113278133 wait complete. 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f7841700 1 Processor -- start 2024-03-22T07:34:39.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f7841700 1 -- start start 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f7841700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f010d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f7841700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f00fcf80 0x7ff2f010de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f7841700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f010e420 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f7841700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f010e590 con 0x7ff2f00fcf80 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f55dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f010d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f55dd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f010d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38354/0 (socket says 172.21.15.134:38354) 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f55dd700 1 -- 172.21.15.134:0/4283604467 learned_addr learned my addr 172.21.15.134:0/4283604467 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f4ddc700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f00fcf80 0x7ff2f010de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f55dd700 1 -- 172.21.15.134:0/4283604467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f00fcf80 msgr2=0x7ff2f010de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f55dd700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f00fcf80 0x7ff2f010de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.134+0000 7ff2f55dd700 1 -- 172.21.15.134:0/4283604467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0005040 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.135+0000 7ff2f55dd700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f010d8e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec002a80 tx=0x7ff2ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.135+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec007cc0 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.135+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2ec00f040 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.135+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f0112fa0 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.135+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec00dac0 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.135+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f01134d0 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.136+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f0101b10 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.136+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff2ec00dc20 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.137+0000 7ff2e5ffb700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff2dc06d380 0x7ff2dc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.137+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff2ec08c490 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.137+0000 7ff2f4ddc700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff2dc06d380 0x7ff2dc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.138 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.138+0000 7ff2f4ddc700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff2dc06d380 0x7ff2dc06f830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000b970 tx=0x7ff2e0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:39.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.142+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff2ec059ad0 con 0x7ff2f00fbcd0 2024-03-22T07:34:39.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.343+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2f002b460 con 0x7ff2dc06d380 2024-03-22T07:34:39.353 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.353+0000 7ff2e5ffb700 1 -- 172.21.15.134:0/4283604467 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff2f002b460 con 0x7ff2dc06d380 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (5m) 42s ago 13m 25.0M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (2m) 42s ago 14m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (2m) 9s ago 13m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (4m) 42s ago 13m 81.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (8m) 42s ago 8m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (8m) 42s ago 8m 13.8M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (8m) 9s ago 8m 15.2M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (8m) 9s ago 8m 14.6M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:34:39.354 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (4m) 42s ago 15m 503M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (3m) 9s ago 13m 450M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (3m) 42s ago 15m 48.8M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (3m) 9s ago 12m 36.7M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 42s ago 14m 15.5M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (4m) 9s ago 13m 15.4M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (2m) 42s ago 12m 96.2M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (84s) 42s ago 11m 103M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (47s) 42s ago 11m 15.1M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (12s) 9s ago 10m 15.0M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (10m) 9s ago 10m 264M 2581M 17.2.7-726-g9c4e0c34 837124da804f 8928f85a470b 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (10m) 9s ago 10m 241M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:34:39.355 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 42s ago 13m 52.0M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff2dc06d380 msgr2=0x7ff2dc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff2dc06d380 0x7ff2dc06f830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000b970 tx=0x7ff2e0009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 msgr2=0x7ff2f010d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f010d8e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec002a80 tx=0x7ff2ec0046b0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 shutdown_connections 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff2dc06d380 0x7ff2dc06f830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f00fbcd0 0x7ff2f010d8e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 --2- 172.21.15.134:0/4283604467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f00fcf80 0x7ff2f010de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 >> 172.21.15.134:0/4283604467 conn(0x7ff2f00f7450 msgr2=0x7ff2f00667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 shutdown_connections 2024-03-22T07:34:39.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.356+0000 7ff2f7841700 1 -- 172.21.15.134:0/4283604467 wait complete. 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/2811270045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 msgr2=0x7f8dd00fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/2811270045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd00fd3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8db8004940 tx=0x7f8db8009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/2811270045 shutdown_connections 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/2811270045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd00fd3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/2811270045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dd00fbcd0 0x7f8dd00fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/2811270045 >> 172.21.15.134:0/2811270045 conn(0x7f8dd00f7450 msgr2=0x7f8dd00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/2811270045 shutdown_connections 2024-03-22T07:34:39.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/2811270045 wait complete. 2024-03-22T07:34:39.457 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.456+0000 7f8dd5f5f700 1 Processor -- start 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dd5f5f700 1 -- start start 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dd5f5f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dd00fbcd0 0x7f8dd010c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dd5f5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd010cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dd5f5f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd010d350 con 0x7f8dd00fcf80 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dd5f5f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd010d4c0 con 0x7f8dd00fbcd0 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd010cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd010cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38372/0 (socket says 172.21.15.134:38372) 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 -- 172.21.15.134:0/1468194886 learned_addr learned my addr 172.21.15.134:0/1468194886 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dcf7fe700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dd00fbcd0 0x7f8dd010c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 -- 172.21.15.134:0/1468194886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dd00fbcd0 msgr2=0x7f8dd010c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dd00fbcd0 0x7f8dd010c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 -- 172.21.15.134:0/1468194886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db8005040 con 0x7f8dd00fcf80 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dc6ffd700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd010cd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009fd0 tx=0x7f8db8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.457+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db800e040 con 0x7f8dd00fcf80 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.458+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8db800be00 con 0x7f8dd00fcf80 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.458+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd0066270 con 0x7f8dd00fcf80 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.458+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db80137f0 con 0x7f8dd00fcf80 2024-03-22T07:34:39.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.458+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd0066830 con 0x7f8dd00fcf80 2024-03-22T07:34:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.459+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd004c710 con 0x7f8dd00fcf80 2024-03-22T07:34:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.459+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f8db8013a60 con 0x7f8dd00fcf80 2024-03-22T07:34:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.459+0000 7f8dccff9700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8dbc06d380 0x7f8dbc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.460+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8db808e020 con 0x7f8dd00fcf80 2024-03-22T07:34:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.460+0000 7f8dcf7fe700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8dbc06d380 0x7f8dbc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.460 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.460+0000 7f8dcf7fe700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8dbc06d380 0x7f8dbc06f830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00041d0 tx=0x7f8dc00043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:39.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.464+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8db805b690 con 0x7f8dd00fcf80 2024-03-22T07:34:39.741 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.741+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8dd0066c30 con 0x7f8dd00fcf80 2024-03-22T07:34:39.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:39 smithi134 ceph-mon[93947]: pgmap v123: 65 pgs: 4 peering, 10 active+undersized+degraded, 14 active+undersized, 37 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:34:39.742 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:39 smithi134 ceph-mon[93947]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.742+0000 7f8dccff9700 1 -- 172.21.15.134:0/1468194886 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f8db805b220 con 0x7f8dd00fcf80 2024-03-22T07:34:39.742 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:34:39.742 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:34:39.742 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:34:39.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:39.742 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2, 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 6, 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 8 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:34:39.743 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:34:39.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8dbc06d380 msgr2=0x7f8dbc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.744 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8dbc06d380 0x7f8dbc06f830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00041d0 tx=0x7f8dc00043c0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 msgr2=0x7f8dd010cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd010cd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009fd0 tx=0x7f8db8009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 shutdown_connections 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8dbc06d380 0x7f8dbc06f830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8dd00fbcd0 0x7f8dd010c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 --2- 172.21.15.134:0/1468194886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dd00fcf80 0x7f8dd010cd50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 >> 172.21.15.134:0/1468194886 conn(0x7f8dd00f7450 msgr2=0x7f8dd00f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 shutdown_connections 2024-03-22T07:34:39.745 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.744+0000 7f8dd5f5f700 1 -- 172.21.15.134:0/1468194886 wait complete. 2024-03-22T07:34:39.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 -- 172.21.15.134:0/2351928495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 msgr2=0x7f57240fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 --2- 172.21.15.134:0/2351928495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f57240fe540 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5714004940 tx=0x7f5714009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 -- 172.21.15.134:0/2351928495 shutdown_connections 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 --2- 172.21.15.134:0/2351928495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f57240fe540 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 --2- 172.21.15.134:0/2351928495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57240fcee0 0x7f57240fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 -- 172.21.15.134:0/2351928495 >> 172.21.15.134:0/2351928495 conn(0x7f57240f8560 msgr2=0x7f57240fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 -- 172.21.15.134:0/2351928495 shutdown_connections 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.846+0000 7f572b881700 1 -- 172.21.15.134:0/2351928495 wait complete. 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572b881700 1 Processor -- start 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572b881700 1 -- start start 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572b881700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57240fcee0 0x7f572410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572b881700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f572410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572b881700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572410e550 con 0x7f57240fe0d0 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572b881700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572410ed50 con 0x7f57240fcee0 2024-03-22T07:34:39.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f572410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f572410df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38388/0 (socket says 172.21.15.134:38388) 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 -- 172.21.15.134:0/2098818731 learned_addr learned my addr 172.21.15.134:0/2098818731 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f572961d700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57240fcee0 0x7f572410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 -- 172.21.15.134:0/2098818731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57240fcee0 msgr2=0x7f572410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57240fcee0 0x7f572410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 -- 172.21.15.134:0/2098818731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714005040 con 0x7f57240fe0d0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5728e1c700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f572410df50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f571400b3b0 tx=0x7f5714009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f571400e040 con 0x7f57240fe0d0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.847+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f571400bcc0 con 0x7f57240fe0d0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.848+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572410efd0 con 0x7f57240fe0d0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.848+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f571401c630 con 0x7f57240fe0d0 2024-03-22T07:34:39.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.848+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572410f510 con 0x7f57240fe0d0 2024-03-22T07:34:39.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.849+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572405f5f0 con 0x7f57240fe0d0 2024-03-22T07:34:39.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.849+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f5714013980 con 0x7f57240fe0d0 2024-03-22T07:34:39.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.849+0000 7f5719ffb700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f571006d380 0x7f571006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:39.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.850+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f571408d620 con 0x7f57240fe0d0 2024-03-22T07:34:39.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.850+0000 7f572961d700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f571006d380 0x7f571006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:39.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.850+0000 7f572961d700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f571006d380 0x7f571006f830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5720009b80 tx=0x7f572000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:39.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:39.854+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f571405abe0 con 0x7f57240fe0d0 2024-03-22T07:34:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:39 smithi195 ceph-mon[82061]: pgmap v123: 65 pgs: 4 peering, 10 active+undersized+degraded, 14 active+undersized, 37 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:34:39.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:39 smithi195 ceph-mon[82061]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:40.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.091+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5724105990 con 0x7f57240fe0d0 2024-03-22T07:34:40.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.092+0000 7f5719ffb700 1 -- 172.21.15.134:0/2098818731 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f571405a770 con 0x7f57240fe0d0 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:34:40.092 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:34:40.093 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:40.094 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:34:40.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f571006d380 msgr2=0x7f571006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f571006d380 0x7f571006f830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5720009b80 tx=0x7f572000b040 comp rx=0 tx=0).stop 2024-03-22T07:34:40.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 msgr2=0x7f572410df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f572410df50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f571400b3b0 tx=0x7f5714009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:40.095 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 shutdown_connections 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f571006d380 0x7f571006f830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f57240fcee0 0x7f572410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 --2- 172.21.15.134:0/2098818731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57240fe0d0 0x7f572410df50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 >> 172.21.15.134:0/2098818731 conn(0x7f57240f8560 msgr2=0x7f57240f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 shutdown_connections 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.094+0000 7f572b881700 1 -- 172.21.15.134:0/2098818731 wait complete. 2024-03-22T07:34:40.096 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:34:40.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.195+0000 7f345821b700 1 -- 172.21.15.134:0/3414243526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fe4f0 msgr2=0x7f34500fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.195+0000 7f345821b700 1 --2- 172.21.15.134:0/3414243526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fe4f0 0x7f34500fe900 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f344c004940 tx=0x7f344c009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.195+0000 7f345821b700 1 -- 172.21.15.134:0/3414243526 shutdown_connections 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.195+0000 7f345821b700 1 --2- 172.21.15.134:0/3414243526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fee40 0x7f34500faf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.195+0000 7f345821b700 1 --2- 172.21.15.134:0/3414243526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fe4f0 0x7f34500fe900 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.195+0000 7f345821b700 1 -- 172.21.15.134:0/3414243526 >> 172.21.15.134:0/3414243526 conn(0x7f34500f6c10 msgr2=0x7f34500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 -- 172.21.15.134:0/3414243526 shutdown_connections 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 -- 172.21.15.134:0/3414243526 wait complete. 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 Processor -- start 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 -- start start 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fe4f0 0x7f345010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 0x7f345010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345010e480 con 0x7f34500fee40 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f345821b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345010e5f0 con 0x7f34500fe4f0 2024-03-22T07:34:40.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f34557b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 0x7f345010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f34557b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 0x7f345010de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38398/0 (socket says 172.21.15.134:38398) 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.196+0000 7f34557b6700 1 -- 172.21.15.134:0/2681606522 learned_addr learned my addr 172.21.15.134:0/2681606522 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f3455fb7700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fe4f0 0x7f345010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34557b6700 1 -- 172.21.15.134:0/2681606522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fe4f0 msgr2=0x7f345010d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34557b6700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fe4f0 0x7f345010d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34557b6700 1 -- 172.21.15.134:0/2681606522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c005040 con 0x7f34500fee40 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f3455fb7700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fe4f0 0x7f345010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34557b6700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 0x7f345010de80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3440002a50 tx=0x7f34400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3440007cc0 con 0x7f34500fee40 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f344000f040 con 0x7f34500fee40 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3450113050 con 0x7f34500fee40 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3440009640 con 0x7f34500fee40 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.197+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34501135e0 con 0x7f34500fee40 2024-03-22T07:34:40.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.198+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345004c710 con 0x7f34500fee40 2024-03-22T07:34:40.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.199+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f34400097a0 con 0x7f34500fee40 2024-03-22T07:34:40.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.199+0000 7f34467fc700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f343c06d380 0x7f343c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:40.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.199+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f344008c6b0 con 0x7f34500fee40 2024-03-22T07:34:40.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.199+0000 7f3455fb7700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f343c06d380 0x7f343c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:40.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.200+0000 7f3455fb7700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f343c06d380 0x7f343c06f830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b3b0 tx=0x7f344c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:40.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.204+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3440059c70 con 0x7f34500fee40 2024-03-22T07:34:40.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.414+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3450102610 con 0x7f343c06d380 2024-03-22T07:34:40.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.415+0000 7f34467fc700 1 -- 172.21.15.134:0/2681606522 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3450102610 con 0x7f343c06d380 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "10/21 daemons upgraded", 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:34:40.415 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:34:40.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f343c06d380 msgr2=0x7f343c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f343c06d380 0x7f343c06f830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f344c00b3b0 tx=0x7f344c009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:40.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 msgr2=0x7f345010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 0x7f345010de80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3440002a50 tx=0x7f34400046b0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 shutdown_connections 2024-03-22T07:34:40.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f343c06d380 0x7f343c06f830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34500fe4f0 0x7f345010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 --2- 172.21.15.134:0/2681606522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34500fee40 0x7f345010de80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 >> 172.21.15.134:0/2681606522 conn(0x7f34500f6c10 msgr2=0x7f34500f82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:40.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.417+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 shutdown_connections 2024-03-22T07:34:40.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.418+0000 7f345821b700 1 -- 172.21.15.134:0/2681606522 wait complete. 2024-03-22T07:34:40.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 -- 172.21.15.134:0/4290771929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 msgr2=0x7f0aa80fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/4290771929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa80fd3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a98004940 tx=0x7f0a98009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 -- 172.21.15.134:0/4290771929 shutdown_connections 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/4290771929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa80fd3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/4290771929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aa80fbcd0 0x7f0aa80fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 -- 172.21.15.134:0/4290771929 >> 172.21.15.134:0/4290771929 conn(0x7f0aa80f7430 msgr2=0x7f0aa80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 -- 172.21.15.134:0/4290771929 shutdown_connections 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 -- 172.21.15.134:0/4290771929 wait complete. 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.520+0000 7f0aaf76d700 1 Processor -- start 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aaf76d700 1 -- start start 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aaf76d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aa80fbcd0 0x7f0aa81106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aaf76d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa8112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aaf76d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8066350 con 0x7f0aa80fcf80 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aaf76d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8066490 con 0x7f0aa80fbcd0 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa8112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:40.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa8112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38412/0 (socket says 172.21.15.134:38412) 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 -- 172.21.15.134:0/1263175615 learned_addr learned my addr 172.21.15.134:0/1263175615 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aad509700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aa80fbcd0 0x7f0aa81106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 -- 172.21.15.134:0/1263175615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aa80fbcd0 msgr2=0x7f0aa81106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aa80fbcd0 0x7f0aa81106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 -- 172.21.15.134:0/1263175615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98005040 con 0x7f0aa80fcf80 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aacd08700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa8112bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0a98013870 tx=0x7f0a98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a98021070 con 0x7f0aa80fcf80 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a9801c400 con 0x7f0aa80fcf80 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa8113130 con 0x7f0aa80fcf80 2024-03-22T07:34:40.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.521+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a9800e070 con 0x7f0aa80fcf80 2024-03-22T07:34:40.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.522+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa8113670 con 0x7f0aa80fcf80 2024-03-22T07:34:40.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.523+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa805f5f0 con 0x7f0aa80fcf80 2024-03-22T07:34:40.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.523+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f0a9800b780 con 0x7f0aa80fcf80 2024-03-22T07:34:40.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.523+0000 7f0a9dffb700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0a9406d380 0x7f0a9406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:34:40.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.524+0000 7f0aad509700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0a9406d380 0x7f0a9406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:34:40.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.524+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0a9808da10 con 0x7f0aa80fcf80 2024-03-22T07:34:40.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.524+0000 7f0aad509700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0a9406d380 0x7f0a9406f830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4004600 tx=0x7f0aa400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:34:40.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.528+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0a980575c0 con 0x7f0aa80fcf80 2024-03-22T07:34:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:40 smithi134 ceph-mon[93947]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:40 smithi134 ceph-mon[93947]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:40 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1468194886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:40.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:40 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2098818731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:34:40.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.806+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0aa804bed0 con 0x7f0aa80fcf80 2024-03-22T07:34:40.807 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.806+0000 7f0a9dffb700 1 -- 172.21.15.134:0/1263175615 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0a98004490 con 0x7f0aa80fcf80 2024-03-22T07:34:40.807 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0a9406d380 msgr2=0x7f0a9406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0a9406d380 0x7f0a9406f830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4004600 tx=0x7f0aa400b040 comp rx=0 tx=0).stop 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 msgr2=0x7f0aa8112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa8112bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0a98013870 tx=0x7f0a98009e30 comp rx=0 tx=0).stop 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 shutdown_connections 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f0a9406d380 0x7f0a9406f830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0aa80fbcd0 0x7f0aa81106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 --2- 172.21.15.134:0/1263175615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa80fcf80 0x7f0aa8112bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:34:40.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.808+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 >> 172.21.15.134:0/1263175615 conn(0x7f0aa80f7430 msgr2=0x7f0aa80f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:34:40.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.809+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 shutdown_connections 2024-03-22T07:34:40.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:34:40.809+0000 7f0aaf76d700 1 -- 172.21.15.134:0/1263175615 wait complete. 2024-03-22T07:34:40.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:40 smithi195 ceph-mon[82061]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:40.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:40 smithi195 ceph-mon[82061]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:40.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:40 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1468194886' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:34:40.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:40 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2098818731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:34:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:41 smithi195 ceph-mon[82061]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:41 smithi195 ceph-mon[82061]: pgmap v124: 65 pgs: 4 peering, 61 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:41 smithi195 ceph-mon[82061]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/219 objects degraded (14.155%), 10 pgs degraded) 2024-03-22T07:34:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:41 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:34:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:41 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1263175615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:34:42.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:41 smithi134 ceph-mon[93947]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:34:42.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:41 smithi134 ceph-mon[93947]: pgmap v124: 65 pgs: 4 peering, 61 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:42.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:41 smithi134 ceph-mon[93947]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/219 objects degraded (14.155%), 10 pgs degraded) 2024-03-22T07:34:42.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:41 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:34:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:41 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1263175615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:34:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:43 smithi195 ceph-mon[82061]: pgmap v125: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:44.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:43 smithi134 ceph-mon[93947]: pgmap v125: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:45 smithi195 ceph-mon[82061]: pgmap v126: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:45 smithi134 ceph-mon[93947]: pgmap v126: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:47.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:47 smithi195 ceph-mon[82061]: pgmap v127: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:48.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:47 smithi134 ceph-mon[93947]: pgmap v127: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:49 smithi134 ceph-mon[93947]: pgmap v128: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:49 smithi195 ceph-mon[82061]: pgmap v128: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:34:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:50.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:50.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:51 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:51 smithi134 ceph-mon[93947]: Upgrade: osd.4 is safe to restart 2024-03-22T07:34:51.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:51 smithi134 ceph-mon[93947]: pgmap v129: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:51.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:51 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-22T07:34:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:51 smithi195 ceph-mon[82061]: Upgrade: osd.4 is safe to restart 2024-03-22T07:34:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:51 smithi195 ceph-mon[82061]: pgmap v129: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:52.771 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:52 smithi195 ceph-mon[82061]: Upgrade: Updating osd.4 2024-03-22T07:34:52.772 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:52.772 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-22T07:34:52.772 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:52.772 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:52 smithi195 ceph-mon[82061]: Deploying daemon osd.4 on smithi195 2024-03-22T07:34:53.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:52 smithi134 ceph-mon[93947]: Upgrade: Updating osd.4 2024-03-22T07:34:53.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:34:53.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-22T07:34:53.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:34:53.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:52 smithi134 ceph-mon[93947]: Deploying daemon osd.4 on smithi195 2024-03-22T07:34:53.859 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:53 smithi195 ceph-mon[82061]: pgmap v130: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:54.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:53 smithi134 ceph-mon[93947]: pgmap v130: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:54.955 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:54 smithi195 systemd[1]: Stopping Ceph osd.4 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:34:55.455 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:55 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[48018]: 2024-03-22T07:34:55.042+0000 7f778b779700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:34:55.455 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:55 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[48018]: 2024-03-22T07:34:55.042+0000 7f778b779700 -1 osd.4 70 *** Got signal Terminated *** 2024-03-22T07:34:55.455 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:55 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[48018]: 2024-03-22T07:34:55.042+0000 7f778b779700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:34:55.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:55 smithi195 ceph-mon[82061]: pgmap v131: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:55.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:55 smithi195 ceph-mon[82061]: osd.4 marked itself down and dead 2024-03-22T07:34:56.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:55 smithi134 ceph-mon[93947]: pgmap v131: 65 pgs: 65 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:56.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:55 smithi134 ceph-mon[93947]: osd.4 marked itself down and dead 2024-03-22T07:34:56.409 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:56 smithi195 podman[96770]: 2024-03-22 07:34:56.136845457 +0000 UTC m=+1.215333041 container died 8928f85a470bfd35cd8ea8f9b02f944c4a9c5b40fc9a7c3cde372c1705dfcfaa (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=quincy-9c4e0c3, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-22T07:34:56.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:56 smithi195 ceph-mon[82061]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:34:56.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:56 smithi195 ceph-mon[82061]: failed to encode map e71 with expected crc 2024-03-22T07:34:56.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:56 smithi195 ceph-mon[82061]: osdmap e71: 6 total, 5 up, 6 in 2024-03-22T07:34:56.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:56 smithi195 podman[96770]: 2024-03-22 07:34:56.500717768 +0000 UTC m=+1.579205342 container cleanup 8928f85a470bfd35cd8ea8f9b02f944c4a9c5b40fc9a7c3cde372c1705dfcfaa (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=quincy-9c4e0c3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, ceph=True) 2024-03-22T07:34:56.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:56 smithi195 bash[96770]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4 2024-03-22T07:34:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:56 smithi134 ceph-mon[93947]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:34:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:56 smithi134 ceph-mon[93947]: failed to encode map e71 with expected crc 2024-03-22T07:34:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:56 smithi134 ceph-mon[93947]: osdmap e71: 6 total, 5 up, 6 in 2024-03-22T07:34:57.110 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:56 smithi195 podman[96789]: 2024-03-22 07:34:56.768588723 +0000 UTC m=+0.628033856 container remove 8928f85a470bfd35cd8ea8f9b02f944c4a9c5b40fc9a7c3cde372c1705dfcfaa (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=quincy-9c4e0c3, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:34:57.373 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:57 smithi195 podman[96882]: 2024-03-22 07:34:57.013900123 +0000 UTC m=+0.017989025 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:34:57.373 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:57 smithi195 podman[96882]: 2024-03-22 07:34:57.146863373 +0000 UTC m=+0.150952306 container create af6653961297463b64b08642aacb9d342e19fc3f0c7acf47ec2cc9ac5f082056 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:34:57.373 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:57 smithi195 podman[96882]: 2024-03-22 07:34:57.37414793 +0000 UTC m=+0.378236836 container init af6653961297463b64b08642aacb9d342e19fc3f0c7acf47ec2cc9ac5f082056 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-22T07:34:57.642 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:57 smithi195 podman[96882]: 2024-03-22 07:34:57.377496033 +0000 UTC m=+0.381584926 container start af6653961297463b64b08642aacb9d342e19fc3f0c7acf47ec2cc9ac5f082056 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:34:57.642 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:57 smithi195 podman[96882]: 2024-03-22 07:34:57.463791475 +0000 UTC m=+0.467880378 container attach af6653961297463b64b08642aacb9d342e19fc3f0c7acf47ec2cc9ac5f082056 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:34:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:57 smithi195 ceph-mon[82061]: pgmap v133: 65 pgs: 8 peering, 4 stale+active+clean, 53 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:57 smithi195 ceph-mon[82061]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-22T07:34:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:57 smithi195 ceph-mon[82061]: failed to encode map e72 with expected crc 2024-03-22T07:34:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:57 smithi195 ceph-mon[82061]: osdmap e72: 6 total, 5 up, 6 in 2024-03-22T07:34:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:57 smithi195 ceph-mon[82061]: failed to encode map e72 with expected crc 2024-03-22T07:34:57.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:57 smithi195 ceph-mon[82061]: failed to encode map e72 with expected crc 2024-03-22T07:34:57.955 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:57 smithi195 podman[96882]: 2024-03-22 07:34:57.662936053 +0000 UTC m=+0.667024943 container died af6653961297463b64b08642aacb9d342e19fc3f0c7acf47ec2cc9ac5f082056 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, ceph=True, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-22T07:34:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:57 smithi134 ceph-mon[93947]: pgmap v133: 65 pgs: 8 peering, 4 stale+active+clean, 53 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:34:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:57 smithi134 ceph-mon[93947]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-22T07:34:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:57 smithi134 ceph-mon[93947]: failed to encode map e72 with expected crc 2024-03-22T07:34:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:57 smithi134 ceph-mon[93947]: osdmap e72: 6 total, 5 up, 6 in 2024-03-22T07:34:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:57 smithi134 ceph-mon[93947]: failed to encode map e72 with expected crc 2024-03-22T07:34:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:57 smithi134 ceph-mon[93947]: failed to encode map e72 with expected crc 2024-03-22T07:34:58.695 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 podman[96908]: 2024-03-22 07:34:58.276304878 +0000 UTC m=+0.606333332 container remove af6653961297463b64b08642aacb9d342e19fc3f0c7acf47ec2cc9ac5f082056 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-db0330b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-03-22T07:34:58.696 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.4.service: Deactivated successfully. 2024-03-22T07:34:58.696 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 systemd[1]: Stopped Ceph osd.4 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:34:58.696 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.4.service: Consumed 1min 4.929s CPU time. 2024-03-22T07:34:58.696 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 systemd[1]: Starting Ceph osd.4 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:34:58.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:58 smithi195 ceph-mon[82061]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:58.955 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 podman[97016]: 2024-03-22 07:34:58.622203567 +0000 UTC m=+0.017631899 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:34:58.955 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:58 smithi195 podman[97016]: 2024-03-22 07:34:58.751973318 +0000 UTC m=+0.147401652 container create 83e8e0a28884c46f84589e15a1a7379bb24c0fdb29c97157452e1d7aa38a1676 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:34:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:58 smithi134 ceph-mon[93947]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 4 pgs degraded (PG_DEGRADED) 2024-03-22T07:34:59.455 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 podman[97016]: 2024-03-22 07:34:59.046920908 +0000 UTC m=+0.442349257 container init 83e8e0a28884c46f84589e15a1a7379bb24c0fdb29c97157452e1d7aa38a1676 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-22T07:34:59.455 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 podman[97016]: 2024-03-22 07:34:59.050233611 +0000 UTC m=+0.445661938 container start 83e8e0a28884c46f84589e15a1a7379bb24c0fdb29c97157452e1d7aa38a1676 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD) 2024-03-22T07:34:59.455 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 podman[97016]: 2024-03-22 07:34:59.146436702 +0000 UTC m=+0.541865037 container attach 83e8e0a28884c46f84589e15a1a7379bb24c0fdb29c97157452e1d7aa38a1676 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-22T07:34:59.774 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-mon[82061]: pgmap v135: 65 pgs: 4 active+undersized+degraded, 8 peering, 2 stale+active+clean, 6 active+undersized, 45 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-03-22T07:34:59.774 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-22T07:34:59.774 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-22T07:34:59.774 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-22T07:34:59.774 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 bash[97016]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate[97032]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-22T07:34:59.775 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:34:59 smithi195 podman[97016]: 2024-03-22 07:34:59.515901159 +0000 UTC m=+0.911329490 container died 83e8e0a28884c46f84589e15a1a7379bb24c0fdb29c97157452e1d7aa38a1676 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-22T07:35:00.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:34:59 smithi134 ceph-mon[93947]: pgmap v135: 65 pgs: 4 active+undersized+degraded, 8 peering, 2 stale+active+clean, 6 active+undersized, 45 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-03-22T07:35:00.418 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 podman[97157]: 2024-03-22 07:35:00.058689575 +0000 UTC m=+0.534508572 container remove 83e8e0a28884c46f84589e15a1a7379bb24c0fdb29c97157452e1d7aa38a1676 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-activate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-22T07:35:00.418 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 podman[97223]: 2024-03-22 07:35:00.174468996 +0000 UTC m=+0.017973664 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:35:00.418 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 podman[97223]: 2024-03-22 07:35:00.292768198 +0000 UTC m=+0.136272855 container create b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0) 2024-03-22T07:35:00.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 podman[97223]: 2024-03-22 07:35:00.514845127 +0000 UTC m=+0.358349803 container init b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:35:00.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 podman[97223]: 2024-03-22 07:35:00.517885029 +0000 UTC m=+0.361389688 container start b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, ceph=True, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:35:00.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 ceph-osd[97242]: -- 172.21.15.195:0/510236843 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5625092591e0 con 0x56250922b000 2024-03-22T07:35:00.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 bash[97223]: b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d 2024-03-22T07:35:00.705 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:00 smithi195 systemd[1]: Started Ceph osd.4 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:35:01.454 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:01 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:35:01.060+0000 7f9d12cba7c0 -1 Falling back to public interface 2024-03-22T07:35:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:01 smithi195 ceph-mon[82061]: pgmap v136: 65 pgs: 11 active+undersized+degraded, 8 peering, 15 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:35:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:01 smithi134 ceph-mon[93947]: pgmap v136: 65 pgs: 11 active+undersized+degraded, 8 peering, 15 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-03-22T07:35:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:02 smithi134 ceph-mon[93947]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-22T07:35:03.053 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:02 smithi195 ceph-mon[82061]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-03-22T07:35:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:03 smithi134 ceph-mon[93947]: pgmap v137: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:03 smithi195 ceph-mon[82061]: pgmap v137: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:05.955 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:05 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:35:05.648+0000 7f9d12cba7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-03-22T07:35:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:05 smithi195 ceph-mon[82061]: pgmap v138: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:05 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:05 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:05 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 36/219 objects degraded (16.438%), 14 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:05 smithi134 ceph-mon[93947]: pgmap v138: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:05 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:05 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:05 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 36/219 objects degraded (16.438%), 14 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:06.545 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:06 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:35:06.211+0000 7f9d12cba7c0 -1 osd.4 70 log_to_monitors true 2024-03-22T07:35:06.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:06 smithi195 ceph-mon[82061]: from='osd.4 [v2:172.21.15.195:6808/848656048,v1:172.21.15.195:6809/848656048]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:35:06.798 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:06 smithi195 ceph-mon[82061]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:35:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:06 smithi134 ceph-mon[93947]: from='osd.4 [v2:172.21.15.195:6808/848656048,v1:172.21.15.195:6809/848656048]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:35:07.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:06 smithi134 ceph-mon[93947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-22T07:35:07.955 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:35:07.486+0000 7f9d0010a700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: pgmap v139: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: failed to encode map e73 with expected crc 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: osdmap e73: 6 total, 5 up, 6 in 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: from='osd.4 [v2:172.21.15.195:6808/848656048,v1:172.21.15.195:6809/848656048]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:07 smithi195 ceph-mon[82061]: from='osd.4 ' entity='osd.4' 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: pgmap v139: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: failed to encode map e73 with expected crc 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: osdmap e73: 6 total, 5 up, 6 in 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: from='osd.4 [v2:172.21.15.195:6808/848656048,v1:172.21.15.195:6809/848656048]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:07 smithi134 ceph-mon[93947]: from='osd.4 ' entity='osd.4' 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: failed to encode map e74 with expected crc 2024-03-22T07:35:09.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: osd.4 [v2:172.21.15.195:6808/848656048,v1:172.21.15.195:6809/848656048] boot 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: osdmap e74: 6 total, 6 up, 6 in 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: failed to encode map e74 with expected crc 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: pgmap v142: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:09.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:09 smithi195 ceph-mon[82061]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-22T07:35:09.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:09.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:09.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: failed to encode map e74 with expected crc 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: osd.4 [v2:172.21.15.195:6808/848656048,v1:172.21.15.195:6809/848656048] boot 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: osdmap e74: 6 total, 6 up, 6 in 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: failed to encode map e74 with expected crc 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: pgmap v142: 65 pgs: 14 active+undersized+degraded, 20 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 36/219 objects degraded (16.438%) 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:09.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:09.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:09 smithi134 ceph-mon[93947]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-22T07:35:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:10 smithi134 ceph-mon[93947]: osdmap e75: 6 total, 6 up, 6 in 2024-03-22T07:35:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:10 smithi134 ceph-mon[93947]: failed to encode map e75 with expected crc 2024-03-22T07:35:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:10 smithi134 ceph-mon[93947]: failed to encode map e75 with expected crc 2024-03-22T07:35:10.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:10 smithi134 ceph-mon[93947]: failed to encode map e75 with expected crc 2024-03-22T07:35:10.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.922+0000 7f3225e32700 1 -- 172.21.15.134:0/3020496950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fcf80 msgr2=0x7f32200fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.922+0000 7f3225e32700 1 --2- 172.21.15.134:0/3020496950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fcf80 0x7f32200fd3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3208004940 tx=0x7f3208009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.922+0000 7f3225e32700 1 -- 172.21.15.134:0/3020496950 shutdown_connections 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.922+0000 7f3225e32700 1 --2- 172.21.15.134:0/3020496950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fcf80 0x7f32200fd3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.922+0000 7f3225e32700 1 --2- 172.21.15.134:0/3020496950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32200fbcd0 0x7f32200fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.922+0000 7f3225e32700 1 -- 172.21.15.134:0/3020496950 >> 172.21.15.134:0/3020496950 conn(0x7f32200f7430 msgr2=0x7f32200f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.923+0000 7f3225e32700 1 -- 172.21.15.134:0/3020496950 shutdown_connections 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.923+0000 7f3225e32700 1 -- 172.21.15.134:0/3020496950 wait complete. 2024-03-22T07:35:10.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.923+0000 7f3225e32700 1 Processor -- start 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.923+0000 7f3225e32700 1 -- start start 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3225e32700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 0x7f322010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3225e32700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32200fcf80 0x7f322010df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3225e32700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322010e550 con 0x7f32200fbcd0 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3225e32700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322010eda0 con 0x7f32200fcf80 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 0x7f322010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 0x7f322010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55132/0 (socket says 172.21.15.134:55132) 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 -- 172.21.15.134:0/3875408943 learned_addr learned my addr 172.21.15.134:0/3875408943 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321effd700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32200fcf80 0x7f322010df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 -- 172.21.15.134:0/3875408943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32200fcf80 msgr2=0x7f322010df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32200fcf80 0x7f322010df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 -- 172.21.15.134:0/3875408943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208005040 con 0x7f32200fbcd0 2024-03-22T07:35:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f321f7fe700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 0x7f322010da10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3218001d80 tx=0x7f3218009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:10.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3218007d10 con 0x7f32200fbcd0 2024-03-22T07:35:10.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3218001e80 con 0x7f32200fbcd0 2024-03-22T07:35:10.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3218014640 con 0x7f32200fbcd0 2024-03-22T07:35:10.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.924+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322010f080 con 0x7f32200fbcd0 2024-03-22T07:35:10.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.925+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322010f5c0 con 0x7f32200fbcd0 2024-03-22T07:35:10.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.925+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3220101b10 con 0x7f32200fbcd0 2024-03-22T07:35:10.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.926+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f321800e960 con 0x7f32200fbcd0 2024-03-22T07:35:10.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.926+0000 7f3217fff700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f320c06d380 0x7f320c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:10.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.926+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f321808c6c0 con 0x7f32200fbcd0 2024-03-22T07:35:10.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.926+0000 7f321effd700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f320c06d380 0x7f320c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:10.928 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.927+0000 7f321effd700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f320c06d380 0x7f320c06f830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f320800b970 tx=0x7f3208009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:10.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:10.931+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3218059d30 con 0x7f32200fbcd0 2024-03-22T07:35:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:10 smithi195 ceph-mon[82061]: osdmap e75: 6 total, 6 up, 6 in 2024-03-22T07:35:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:10 smithi195 ceph-mon[82061]: failed to encode map e75 with expected crc 2024-03-22T07:35:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:10 smithi195 ceph-mon[82061]: failed to encode map e75 with expected crc 2024-03-22T07:35:10.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:10 smithi195 ceph-mon[82061]: failed to encode map e75 with expected crc 2024-03-22T07:35:11.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.143+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f322010f840 con 0x7f320c06d380 2024-03-22T07:35:11.144 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.144+0000 7f3217fff700 1 -- 172.21.15.134:0/3875408943 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f322010f840 con 0x7f320c06d380 2024-03-22T07:35:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f320c06d380 msgr2=0x7f320c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f320c06d380 0x7f320c06f830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f320800b970 tx=0x7f3208009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 msgr2=0x7f322010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.147 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 0x7f322010da10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3218001d80 tx=0x7f3218009ec0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 shutdown_connections 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f320c06d380 0x7f320c06f830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32200fbcd0 0x7f322010da10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 --2- 172.21.15.134:0/3875408943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32200fcf80 0x7f322010df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 >> 172.21.15.134:0/3875408943 conn(0x7f32200f7430 msgr2=0x7f3220065b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 shutdown_connections 2024-03-22T07:35:11.148 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.146+0000 7f3225e32700 1 -- 172.21.15.134:0/3875408943 wait complete. 2024-03-22T07:35:11.157 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:35:11.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 -- 172.21.15.134:0/2562340714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 msgr2=0x7faf480fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 --2- 172.21.15.134:0/2562340714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf480fe450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf38004940 tx=0x7faf38009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:11.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 -- 172.21.15.134:0/2562340714 shutdown_connections 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 --2- 172.21.15.134:0/2562340714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf480fe450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 --2- 172.21.15.134:0/2562340714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf480fce70 0x7faf480fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 -- 172.21.15.134:0/2562340714 >> 172.21.15.134:0/2562340714 conn(0x7faf480f8550 msgr2=0x7faf480fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 -- 172.21.15.134:0/2562340714 shutdown_connections 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 -- 172.21.15.134:0/2562340714 wait complete. 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 Processor -- start 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.248+0000 7faf4e25c700 1 -- start start 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf4e25c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf480fce70 0x7faf4810d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf4e25c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf4810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf4e25c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4810e460 con 0x7faf480fdfe0 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf4e25c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4810e5d0 con 0x7faf480fce70 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf4810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf4810de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55146/0 (socket says 172.21.15.134:55146) 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 -- 172.21.15.134:0/567388476 learned_addr learned my addr 172.21.15.134:0/567388476 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:11.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf477fe700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf480fce70 0x7faf4810d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 -- 172.21.15.134:0/567388476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf480fce70 msgr2=0x7faf4810d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf480fce70 0x7faf4810d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 -- 172.21.15.134:0/567388476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38005040 con 0x7faf480fdfe0 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf46ffd700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf4810de60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf38009150 tx=0x7faf38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf3800e040 con 0x7faf480fdfe0 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf48112fd0 con 0x7faf480fdfe0 2024-03-22T07:35:11.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf38004290 con 0x7faf480fdfe0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf3801c630 con 0x7faf480fdfe0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.249+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf48113560 con 0x7faf480fdfe0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.250+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4804c710 con 0x7faf480fdfe0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.251+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7faf3800bbf0 con 0x7faf480fdfe0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.251+0000 7faf2ffff700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf3006d380 0x7faf3006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.251+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faf3808d490 con 0x7faf480fdfe0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.252+0000 7faf477fe700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf3006d380 0x7faf3006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.252+0000 7faf477fe700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf3006d380 0x7faf3006f830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007fd0 tx=0x7faf3c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:11.257 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.256+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faf3805aad0 con 0x7faf480fdfe0 2024-03-22T07:35:11.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.469+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf48102370 con 0x7faf3006d380 2024-03-22T07:35:11.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.470+0000 7faf2ffff700 1 -- 172.21.15.134:0/567388476 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7faf48102370 con 0x7faf3006d380 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf3006d380 msgr2=0x7faf3006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf3006d380 0x7faf3006f830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007fd0 tx=0x7faf3c009040 comp rx=0 tx=0).stop 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 msgr2=0x7faf4810de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf4810de60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf38009150 tx=0x7faf38009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 shutdown_connections 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf3006d380 0x7faf3006f830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf480fce70 0x7faf4810d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 --2- 172.21.15.134:0/567388476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf480fdfe0 0x7faf4810de60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 >> 172.21.15.134:0/567388476 conn(0x7faf480f8550 msgr2=0x7faf480f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 shutdown_connections 2024-03-22T07:35:11.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.472+0000 7faf4e25c700 1 -- 172.21.15.134:0/567388476 wait complete. 2024-03-22T07:35:11.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:11 smithi134 ceph-mon[93947]: pgmap v144: 65 pgs: 14 peering, 8 active+undersized+degraded, 12 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14/219 objects degraded (6.393%) 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 -- 172.21.15.134:0/1745674550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 msgr2=0x7fe9580fc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 --2- 172.21.15.134:0/1745674550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe9580fc570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe948004940 tx=0x7fe948009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 -- 172.21.15.134:0/1745674550 shutdown_connections 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 --2- 172.21.15.134:0/1745674550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 0x7fe9580faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 --2- 172.21.15.134:0/1745674550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe9580fc570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 -- 172.21.15.134:0/1745674550 >> 172.21.15.134:0/1745674550 conn(0x7fe9580f6bd0 msgr2=0x7fe9580f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 -- 172.21.15.134:0/1745674550 shutdown_connections 2024-03-22T07:35:11.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 -- 172.21.15.134:0/1745674550 wait complete. 2024-03-22T07:35:11.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.574+0000 7fe95e423700 1 Processor -- start 2024-03-22T07:35:11.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe95e423700 1 -- start start 2024-03-22T07:35:11.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe95e423700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe958113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe95e423700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 0x7fe958114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe95e423700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe958114a50 con 0x7fe9580fc160 2024-03-22T07:35:11.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe95e423700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe958114bc0 con 0x7fe9580fcab0 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe958113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe958113f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55166/0 (socket says 172.21.15.134:55166) 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 -- 172.21.15.134:0/2624107192 learned_addr learned my addr 172.21.15.134:0/2624107192 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe9577fe700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 0x7fe958114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 -- 172.21.15.134:0/2624107192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 msgr2=0x7fe958114450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 0x7fe958114450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 -- 172.21.15.134:0/2624107192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948005040 con 0x7fe9580fc160 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe9577fe700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 0x7fe958114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.575+0000 7fe957fff700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe958113f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe94800b3b0 tx=0x7fe948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.576+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe94800e040 con 0x7fe9580fc160 2024-03-22T07:35:11.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.576+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9581195c0 con 0x7fe9580fc160 2024-03-22T07:35:11.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.576+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe94800bcc0 con 0x7fe9580fc160 2024-03-22T07:35:11.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.576+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe94801c630 con 0x7fe9580fc160 2024-03-22T07:35:11.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.576+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe958119b80 con 0x7fe9580fc160 2024-03-22T07:35:11.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.577+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95804c710 con 0x7fe9580fc160 2024-03-22T07:35:11.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.577+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fe948013980 con 0x7fe9580fc160 2024-03-22T07:35:11.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.578+0000 7fe954ff9700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe94006d380 0x7fe94006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.578+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe94808d620 con 0x7fe9580fc160 2024-03-22T07:35:11.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.578+0000 7fe9577fe700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe94006d380 0x7fe94006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.578+0000 7fe9577fe700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe94006d380 0x7fe94006f830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009fd0 tx=0x7fe94c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:11.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.582+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe94805abe0 con 0x7fe9580fc160 2024-03-22T07:35:11.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.785+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9581001f0 con 0x7fe94006d380 2024-03-22T07:35:11.795 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.794+0000 7fe954ff9700 1 -- 172.21.15.134:0/2624107192 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe9581001f0 con 0x7fe94006d380 2024-03-22T07:35:11.795 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:35:11.795 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 74s ago 14m 25.0M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:35:11.795 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (2m) 74s ago 14m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (2m) 8s ago 13m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (5m) 74s ago 14m 81.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (9m) 74s ago 9m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (9m) 74s ago 9m 13.8M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (9m) 8s ago 9m 15.4M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (9m) 8s ago 9m 14.7M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (5m) 74s ago 15m 503M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (4m) 8s ago 13m 450M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (4m) 74s ago 15m 48.8M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (3m) 8s ago 13m 37.7M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 74s ago 14m 15.5M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 8s ago 13m 15.3M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (2m) 74s ago 12m 96.2M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (116s) 74s ago 12m 103M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (80s) 74s ago 11m 15.1M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:35:11.796 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (44s) 8s ago 11m 113M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:35:11.797 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (11s) 8s ago 11m 12.4M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:35:11.797 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (10m) 8s ago 10m 241M 2581M 17.2.7-726-g9c4e0c34 837124da804f e3a7fafbac76 2024-03-22T07:35:11.797 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 74s ago 14m 52.0M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe94006d380 msgr2=0x7fe94006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe94006d380 0x7fe94006f830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009fd0 tx=0x7fe94c00b040 comp rx=0 tx=0).stop 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 msgr2=0x7fe958113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe958113f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe94800b3b0 tx=0x7fe948009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 shutdown_connections 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe94006d380 0x7fe94006f830 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9580fc160 0x7fe958113f10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 --2- 172.21.15.134:0/2624107192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9580fcab0 0x7fe958114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 >> 172.21.15.134:0/2624107192 conn(0x7fe9580f6bd0 msgr2=0x7fe9580f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:11.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 shutdown_connections 2024-03-22T07:35:11.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.797+0000 7fe95e423700 1 -- 172.21.15.134:0/2624107192 wait complete. 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 -- 172.21.15.134:0/593387738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 msgr2=0x7f86fc0fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 --2- 172.21.15.134:0/593387738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc0fd280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86ec004940 tx=0x7f86ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 -- 172.21.15.134:0/593387738 shutdown_connections 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 --2- 172.21.15.134:0/593387738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86fc0fdfe0 0x7f86fc0fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 --2- 172.21.15.134:0/593387738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc0fd280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 -- 172.21.15.134:0/593387738 >> 172.21.15.134:0/593387738 conn(0x7f86fc0f8550 msgr2=0x7f86fc0fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.897+0000 7f8702211700 1 -- 172.21.15.134:0/593387738 shutdown_connections 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 -- 172.21.15.134:0/593387738 wait complete. 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 Processor -- start 2024-03-22T07:35:11.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 -- start start 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86fc0fdfe0 0x7f86fc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc072260 con 0x7f86fc0fce70 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f8702211700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc070850 con 0x7f86fc0fdfe0 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.898+0000 7f86fb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86fb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55184/0 (socket says 172.21.15.134:55184) 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86fb7fe700 1 -- 172.21.15.134:0/815179333 learned_addr learned my addr 172.21.15.134:0/815179333 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86faffd700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86fc0fdfe0 0x7f86fc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86fb7fe700 1 -- 172.21.15.134:0/815179333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86fc0fdfe0 msgr2=0x7f86fc070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86fb7fe700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86fc0fdfe0 0x7f86fc070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:11.901 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86fb7fe700 1 -- 172.21.15.134:0/815179333 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec005040 con 0x7f86fc0fce70 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86fb7fe700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc071c60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009150 tx=0x7f86ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ec00e040 con 0x7f86fc0fce70 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86ec00bbf0 con 0x7f86fc0fce70 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc070aa0 con 0x7f86fc0fce70 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86ec01c630 con 0x7f86fc0fce70 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.899+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc071060 con 0x7f86fc0fce70 2024-03-22T07:35:11.902 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.900+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc04c710 con 0x7f86fc0fce70 2024-03-22T07:35:11.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.901+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f86ec00bd60 con 0x7f86fc0fce70 2024-03-22T07:35:11.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.901+0000 7f86e3fff700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f86e406d380 0x7f86e406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:11.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.901+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f86ec08db80 con 0x7f86fc0fce70 2024-03-22T07:35:11.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.901+0000 7f86faffd700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f86e406d380 0x7f86e406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:11.903 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.902+0000 7f86faffd700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f86e406d380 0x7f86e406f830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86f0004f40 tx=0x7f86f000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:11.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:11.906+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f86ec05b260 con 0x7f86fc0fce70 2024-03-22T07:35:11.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:11 smithi195 ceph-mon[82061]: pgmap v144: 65 pgs: 14 peering, 8 active+undersized+degraded, 12 active+undersized, 31 active+clean; 197 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14/219 objects degraded (6.393%) 2024-03-22T07:35:12.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.177+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f86fc115cd0 con 0x7f86fc0fce70 2024-03-22T07:35:12.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.178+0000 7f86e3fff700 1 -- 172.21.15.134:0/815179333 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f86ec013e60 con 0x7f86fc0fce70 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 5 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 5, 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 9 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:35:12.180 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:35:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f86e406d380 msgr2=0x7f86e406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f86e406d380 0x7f86e406f830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86f0004f40 tx=0x7f86f000b040 comp rx=0 tx=0).stop 2024-03-22T07:35:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 msgr2=0x7f86fc071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc071c60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009150 tx=0x7f86ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 shutdown_connections 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f86e406d380 0x7f86e406f830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fce70 0x7f86fc071c60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 --2- 172.21.15.134:0/815179333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86fc0fdfe0 0x7f86fc070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 >> 172.21.15.134:0/815179333 conn(0x7f86fc0f8550 msgr2=0x7f86fc0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.180+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 shutdown_connections 2024-03-22T07:35:12.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.181+0000 7f8702211700 1 -- 172.21.15.134:0/815179333 wait complete. 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.281+0000 7f3206d2e700 1 -- 172.21.15.134:0/718091668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 msgr2=0x7f32000faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.281+0000 7f3206d2e700 1 --2- 172.21.15.134:0/718091668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32000faed0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31ec004940 tx=0x7f31ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.281+0000 7f3206d2e700 1 -- 172.21.15.134:0/718091668 shutdown_connections 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.281+0000 7f3206d2e700 1 --2- 172.21.15.134:0/718091668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32000faed0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.281+0000 7f3206d2e700 1 --2- 172.21.15.134:0/718091668 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32000fc170 0x7f32000fc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.281+0000 7f3206d2e700 1 -- 172.21.15.134:0/718091668 >> 172.21.15.134:0/718091668 conn(0x7f32000f6be0 msgr2=0x7f32000f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:12.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 -- 172.21.15.134:0/718091668 shutdown_connections 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 -- 172.21.15.134:0/718091668 wait complete. 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 Processor -- start 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 -- start start 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32000fc170 0x7f3200113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32001144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200114ad0 con 0x7f32000fcac0 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f3206d2e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200114c40 con 0x7f32000fc170 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f31fffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32001144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.282+0000 7f31fffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32001144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55198/0 (socket says 172.21.15.134:55198) 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fffff700 1 -- 172.21.15.134:0/1928210249 learned_addr learned my addr 172.21.15.134:0/1928210249 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f3204aca700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32000fc170 0x7f3200113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fffff700 1 -- 172.21.15.134:0/1928210249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32000fc170 msgr2=0x7f3200113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fffff700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32000fc170 0x7f3200113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fffff700 1 -- 172.21.15.134:0/1928210249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec005040 con 0x7f32000fcac0 2024-03-22T07:35:12.285 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fffff700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32001144d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00b3b0 tx=0x7f31ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:12.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31ec00e040 con 0x7f32000fcac0 2024-03-22T07:35:12.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31ec00bcc0 con 0x7f32000fcac0 2024-03-22T07:35:12.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32001195f0 con 0x7f32000fcac0 2024-03-22T07:35:12.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31ec01c630 con 0x7f32000fcac0 2024-03-22T07:35:12.286 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.283+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3200119bb0 con 0x7f32000fcac0 2024-03-22T07:35:12.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.284+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320004c710 con 0x7f32000fcac0 2024-03-22T07:35:12.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.285+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f31ec013980 con 0x7f32000fcac0 2024-03-22T07:35:12.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.285+0000 7f31fd7fa700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f31f006d380 0x7f31f006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.285+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f31ec08d600 con 0x7f32000fcac0 2024-03-22T07:35:12.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.285+0000 7f3204aca700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f31f006d380 0x7f31f006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.286+0000 7f3204aca700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f31f006d380 0x7f31f006f830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f31f4007fd0 tx=0x7f31f4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:12.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.290+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f31ec05abc0 con 0x7f32000fcac0 2024-03-22T07:35:12.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.526+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f320010bee0 con 0x7f32000fcac0 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.527+0000 7f31fd7fa700 1 -- 172.21.15.134:0/1928210249 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f31ec05fe60 con 0x7f32000fcac0 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:35:12.528 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:35:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:12.530 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f31f006d380 msgr2=0x7f31f006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f31f006d380 0x7f31f006f830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f31f4007fd0 tx=0x7f31f4009040 comp rx=0 tx=0).stop 2024-03-22T07:35:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 msgr2=0x7f32001144d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32001144d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00b3b0 tx=0x7f31ec009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 shutdown_connections 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f31f006d380 0x7f31f006f830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32000fc170 0x7f3200113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 --2- 172.21.15.134:0/1928210249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000fcac0 0x7f32001144d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 >> 172.21.15.134:0/1928210249 conn(0x7f32000f6be0 msgr2=0x7f32000f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 shutdown_connections 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.530+0000 7f3206d2e700 1 -- 172.21.15.134:0/1928210249 wait complete. 2024-03-22T07:35:12.532 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:35:12.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 -- 172.21.15.134:0/3904738404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fe050 msgr2=0x7f85540fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 --2- 172.21.15.134:0/3904738404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fe050 0x7f85540fe4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8548004940 tx=0x7f8548009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:12.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 -- 172.21.15.134:0/3904738404 shutdown_connections 2024-03-22T07:35:12.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 --2- 172.21.15.134:0/3904738404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fe050 0x7f85540fe4c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 --2- 172.21.15.134:0/3904738404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540fce50 0x7f85540fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.633 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 -- 172.21.15.134:0/3904738404 >> 172.21.15.134:0/3904738404 conn(0x7f85540f8580 msgr2=0x7f85540fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:12.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 -- 172.21.15.134:0/3904738404 shutdown_connections 2024-03-22T07:35:12.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.632+0000 7f8559144700 1 -- 172.21.15.134:0/3904738404 wait complete. 2024-03-22T07:35:12.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8559144700 1 Processor -- start 2024-03-22T07:35:12.635 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8559144700 1 -- start start 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8559144700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 0x7f855410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8559144700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540fe050 0x7f855410dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8559144700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855410e570 con 0x7f85540fce50 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8559144700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554112ec0 con 0x7f85540fe050 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8552d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 0x7f855410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8552d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 0x7f855410d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55216/0 (socket says 172.21.15.134:55216) 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8552d9d700 1 -- 172.21.15.134:0/3285824530 learned_addr learned my addr 172.21.15.134:0/3285824530 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f855259c700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540fe050 0x7f855410dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8552d9d700 1 -- 172.21.15.134:0/3285824530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540fe050 msgr2=0x7f855410dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8552d9d700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540fe050 0x7f855410dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.633+0000 7f8552d9d700 1 -- 172.21.15.134:0/3285824530 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548005040 con 0x7f85540fce50 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.634+0000 7f8552d9d700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 0x7f855410d9a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f854400b790 tx=0x7f8544009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.634+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854400f6f0 con 0x7f85540fce50 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.634+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f854400fd20 con 0x7f85540fce50 2024-03-22T07:35:12.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.634+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8554113120 con 0x7f85540fce50 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.634+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85440103a0 con 0x7f85540fce50 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.634+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8554113690 con 0x7f85540fce50 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.635+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855404c710 con 0x7f85540fce50 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.635+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f8544011400 con 0x7f85540fce50 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.636+0000 7f853b7fe700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f853c06d380 0x7f853c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.636+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f854408c6f0 con 0x7f85540fce50 2024-03-22T07:35:12.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.636+0000 7f855259c700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f853c06d380 0x7f853c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.636+0000 7f855259c700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f853c06d380 0x7f853c06f830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f854800b970 tx=0x7f8548009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:12.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.640+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8544059d30 con 0x7f85540fce50 2024-03-22T07:35:12.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:12 smithi134 ceph-mon[93947]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:12.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:12 smithi134 ceph-mon[93947]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:12.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:12 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 14/219 objects degraded (6.393%), 8 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:12.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:12 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/815179333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:12.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.853+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8554102330 con 0x7f853c06d380 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.854+0000 7f853b7fe700 1 -- 172.21.15.134:0/3285824530 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8554102330 con 0x7f853c06d380 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:35:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "11/21 daemons upgraded", 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading osd daemons", 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:35:12.856 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:35:12.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f853c06d380 msgr2=0x7f853c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f853c06d380 0x7f853c06f830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f854800b970 tx=0x7f8548009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:12.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 msgr2=0x7f855410d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 0x7f855410d9a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f854400b790 tx=0x7f8544009220 comp rx=0 tx=0).stop 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 shutdown_connections 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f853c06d380 0x7f853c06f830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85540fce50 0x7f855410d9a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 --2- 172.21.15.134:0/3285824530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85540fe050 0x7f855410dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 >> 172.21.15.134:0/3285824530 conn(0x7f85540f8580 msgr2=0x7f85540f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.856+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 shutdown_connections 2024-03-22T07:35:12.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.857+0000 7f8559144700 1 -- 172.21.15.134:0/3285824530 wait complete. 2024-03-22T07:35:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:12 smithi195 ceph-mon[82061]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:12 smithi195 ceph-mon[82061]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:12 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 14/219 objects degraded (6.393%), 8 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:12.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:12 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/815179333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 -- 172.21.15.134:0/3422093428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 msgr2=0x7f28e80fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/3422093428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e80fc0e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28d8004940 tx=0x7f28d8009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 -- 172.21.15.134:0/3422093428 shutdown_connections 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/3422093428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28e80fcf80 0x7f28e80fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/3422093428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e80fc0e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 -- 172.21.15.134:0/3422093428 >> 172.21.15.134:0/3422093428 conn(0x7f28e80f7450 msgr2=0x7f28e80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 -- 172.21.15.134:0/3422093428 shutdown_connections 2024-03-22T07:35:12.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 -- 172.21.15.134:0/3422093428 wait complete. 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 Processor -- start 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.957+0000 7f28ed3c2700 1 -- start start 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28ed3c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e8066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28ed3c2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28e80fcf80 0x7f28e8112710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28ed3c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8112c50 con 0x7f28e80fbcd0 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28ed3c2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8112d90 con 0x7f28e80fcf80 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e8066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e8066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55230/0 (socket says 172.21.15.134:55230) 2024-03-22T07:35:12.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 -- 172.21.15.134:0/4152776397 learned_addr learned my addr 172.21.15.134:0/4152776397 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e67fc700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28e80fcf80 0x7f28e8112710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 -- 172.21.15.134:0/4152776397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28e80fcf80 msgr2=0x7f28e8112710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28e80fcf80 0x7f28e8112710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 -- 172.21.15.134:0/4152776397 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d8005040 con 0x7f28e80fbcd0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28e6ffd700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e8066cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28d800b3b0 tx=0x7f28d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28d800e040 con 0x7f28e80fbcd0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f28d800bbf0 con 0x7f28e80fbcd0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28d801c630 con 0x7f28e80fbcd0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e8112fc0 con 0x7f28e80fbcd0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.958+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e81134a0 con 0x7f28e80fbcd0 2024-03-22T07:35:12.961 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.959+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e804c710 con 0x7f28e80fbcd0 2024-03-22T07:35:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.960+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f28d800bd60 con 0x7f28e80fbcd0 2024-03-22T07:35:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.960+0000 7f28cf7fe700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f28d006d380 0x7f28d006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.961+0000 7f28e67fc700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f28d006d380 0x7f28d006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.961+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f28d808d4c0 con 0x7f28e80fbcd0 2024-03-22T07:35:12.962 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.961+0000 7f28e67fc700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f28d006d380 0x7f28d006f830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28dc004f40 tx=0x7f28dc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:12.966 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:12.965+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f28d805aba0 con 0x7f28e80fbcd0 2024-03-22T07:35:13.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.240+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f28e8113a20 con 0x7f28e80fbcd0 2024-03-22T07:35:13.241 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.241+0000 7f28cf7fe700 1 -- 172.21.15.134:0/4152776397 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+624 (secure 0 0 0) 0x7f28d805a730 con 0x7f28e80fbcd0 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN Degraded data redundancy: 14/219 objects degraded (6.393%), 8 pgs degraded 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 14/219 objects degraded (6.393%), 8 pgs degraded 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-22T07:35:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-03-22T07:35:13.244 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f28d006d380 msgr2=0x7f28d006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f28d006d380 0x7f28d006f830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28dc004f40 tx=0x7f28dc00b040 comp rx=0 tx=0).stop 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 msgr2=0x7f28e8066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e8066cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28d800b3b0 tx=0x7f28d8009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 shutdown_connections 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f28d006d380 0x7f28d006f830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e80fbcd0 0x7f28e8066cf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 --2- 172.21.15.134:0/4152776397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f28e80fcf80 0x7f28e8112710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 >> 172.21.15.134:0/4152776397 conn(0x7f28e80f7450 msgr2=0x7f28e80f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 shutdown_connections 2024-03-22T07:35:13.245 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:13.244+0000 7f28ed3c2700 1 -- 172.21.15.134:0/4152776397 wait complete. 2024-03-22T07:35:13.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:13 smithi134 ceph-mon[93947]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:13.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:13 smithi134 ceph-mon[93947]: pgmap v145: 65 pgs: 14 peering, 1 active+undersized, 50 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:13.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:13 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1928210249' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:35:13.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:13 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/4152776397' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:35:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:13 smithi195 ceph-mon[82061]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:13 smithi195 ceph-mon[82061]: pgmap v145: 65 pgs: 14 peering, 1 active+undersized, 50 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:13 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1928210249' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:35:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:13 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/4152776397' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:35:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:14 smithi134 ceph-mon[93947]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:14 smithi134 ceph-mon[93947]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/219 objects degraded (6.393%), 8 pgs degraded) 2024-03-22T07:35:14.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:14 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:35:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:14 smithi195 ceph-mon[82061]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:14 smithi195 ceph-mon[82061]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/219 objects degraded (6.393%), 8 pgs degraded) 2024-03-22T07:35:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:14 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:35:15.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:15 smithi134 ceph-mon[93947]: pgmap v146: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:15 smithi195 ceph-mon[82061]: pgmap v146: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:17 smithi134 ceph-mon[93947]: pgmap v147: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:17 smithi195 ceph-mon[82061]: pgmap v147: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:19 smithi134 ceph-mon[93947]: pgmap v148: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:19.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:19 smithi195 ceph-mon[82061]: pgmap v148: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:21 smithi134 ceph-mon[93947]: pgmap v149: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:21.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:21 smithi195 ceph-mon[82061]: pgmap v149: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:23.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:23 smithi134 ceph-mon[93947]: pgmap v150: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:23.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:23 smithi195 ceph-mon[82061]: pgmap v150: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:24.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:24 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:24.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:24 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:24.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:24 smithi195 ceph-mon[82061]: Upgrade: osd.5 is safe to restart 2024-03-22T07:35:24.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:24 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:24.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:24.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:24 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-22T07:35:24.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:24 smithi134 ceph-mon[93947]: Upgrade: osd.5 is safe to restart 2024-03-22T07:35:24.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:24 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:25.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:25 smithi195 ceph-mon[82061]: pgmap v151: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:25.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:25.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-22T07:35:25.897 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:26.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:25 smithi134 ceph-mon[93947]: pgmap v151: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:26.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:26.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-22T07:35:26.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:26.838 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:26 smithi195 ceph-mon[82061]: Upgrade: Updating osd.5 2024-03-22T07:35:26.838 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:26 smithi195 ceph-mon[82061]: Deploying daemon osd.5 on smithi195 2024-03-22T07:35:27.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:26 smithi134 ceph-mon[93947]: Upgrade: Updating osd.5 2024-03-22T07:35:27.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:26 smithi134 ceph-mon[93947]: Deploying daemon osd.5 on smithi195 2024-03-22T07:35:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:27 smithi134 ceph-mon[93947]: pgmap v152: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:27.916 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:27 smithi195 ceph-mon[82061]: pgmap v152: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:28.530 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:28 smithi195 systemd[1]: Stopping Ceph osd.5 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:35:28.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:28 smithi134 ceph-mon[93947]: osd.5 marked itself down and dead 2024-03-22T07:35:28.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:28 smithi195 ceph-mon[82061]: osd.5 marked itself down and dead 2024-03-22T07:35:28.955 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:28 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[54932]: 2024-03-22T07:35:28.529+0000 7f30c5f03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:35:28.955 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:28 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[54932]: 2024-03-22T07:35:28.529+0000 7f30c5f03700 -1 osd.5 75 *** Got signal Terminated *** 2024-03-22T07:35:28.955 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:28 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[54932]: 2024-03-22T07:35:28.529+0000 7f30c5f03700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:35:29.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:29 smithi195 podman[102098]: 2024-03-22 07:35:29.081503801 +0000 UTC m=+0.661817875 container died e3a7fafbac7626d080cada495793809cb81ca450d8a66753c054dcd41afc1f00 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, RELEASE=quincy-9c4e0c3, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-22T07:35:29.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:29 smithi195 podman[102098]: 2024-03-22 07:35:29.320923875 +0000 UTC m=+0.901237948 container cleanup e3a7fafbac7626d080cada495793809cb81ca450d8a66753c054dcd41afc1f00 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, RELEASE=quincy-9c4e0c3, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-22T07:35:29.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:29 smithi195 bash[102098]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5 2024-03-22T07:35:29.922 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:29 smithi195 podman[102114]: 2024-03-22 07:35:29.505532921 +0000 UTC m=+0.418739649 container remove e3a7fafbac7626d080cada495793809cb81ca450d8a66753c054dcd41afc1f00 (image=quay.ceph.io/ceph-ci/ceph@sha256:e2ff0b9ff70b30131a16fd0ac4779c04eb8f80752618b4f4b744a02826313232, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-9c4e0c3) 2024-03-22T07:35:29.922 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:29 smithi195 ceph-mon[82061]: pgmap v153: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:29.922 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:29 smithi195 ceph-mon[82061]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:35:29.922 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:29 smithi195 ceph-mon[82061]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-22T07:35:29.922 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:29 smithi195 ceph-mon[82061]: osdmap e76: 6 total, 5 up, 6 in 2024-03-22T07:35:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:29 smithi134 ceph-mon[93947]: pgmap v153: 65 pgs: 65 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:29 smithi134 ceph-mon[93947]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-22T07:35:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:29 smithi134 ceph-mon[93947]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-22T07:35:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:29 smithi134 ceph-mon[93947]: osdmap e76: 6 total, 5 up, 6 in 2024-03-22T07:35:30.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:29 smithi195 podman[102207]: 2024-03-22 07:35:29.923133763 +0000 UTC m=+0.105526680 container create 4282730e94eb20816cc0ee9503ab5c90c3129eb3a44ab4eb2f327073570d81ac (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240307) 2024-03-22T07:35:30.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:29 smithi195 podman[102207]: 2024-03-22 07:35:29.835429572 +0000 UTC m=+0.017822490 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:35:30.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:30 smithi195 podman[102207]: 2024-03-22 07:35:30.159155243 +0000 UTC m=+0.341548166 container init 4282730e94eb20816cc0ee9503ab5c90c3129eb3a44ab4eb2f327073570d81ac (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS) 2024-03-22T07:35:30.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:30 smithi195 podman[102207]: 2024-03-22 07:35:30.163335977 +0000 UTC m=+0.345728897 container start 4282730e94eb20816cc0ee9503ab5c90c3129eb3a44ab4eb2f327073570d81ac (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-22T07:35:30.612 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:30 smithi195 podman[102207]: 2024-03-22 07:35:30.242599183 +0000 UTC m=+0.424992100 container attach 4282730e94eb20816cc0ee9503ab5c90c3129eb3a44ab4eb2f327073570d81ac (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-22T07:35:30.612 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:30 smithi195 podman[102207]: 2024-03-22 07:35:30.458316916 +0000 UTC m=+0.640709845 container died 4282730e94eb20816cc0ee9503ab5c90c3129eb3a44ab4eb2f327073570d81ac (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-db0330b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-22T07:35:30.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:30 smithi195 ceph-mon[82061]: osdmap e77: 6 total, 5 up, 6 in 2024-03-22T07:35:31.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:30 smithi134 ceph-mon[93947]: osdmap e77: 6 total, 5 up, 6 in 2024-03-22T07:35:31.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 podman[102233]: 2024-03-22 07:35:31.04614024 +0000 UTC m=+0.582539976 container remove 4282730e94eb20816cc0ee9503ab5c90c3129eb3a44ab4eb2f327073570d81ac (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-03-22T07:35:31.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5.service: Deactivated successfully. 2024-03-22T07:35:31.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 systemd[1]: Stopped Ceph osd.5 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:35:31.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5.service: Consumed 1min 3.679s CPU time. 2024-03-22T07:35:31.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 systemd[1]: Starting Ceph osd.5 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:35:31.732 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:31 smithi195 ceph-mon[82061]: pgmap v156: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:31.732 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:31 smithi195 ceph-mon[82061]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-22T07:35:31.732 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 podman[102338]: 2024-03-22 07:35:31.3777235 +0000 UTC m=+0.018276728 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:35:31.732 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 podman[102338]: 2024-03-22 07:35:31.497204304 +0000 UTC m=+0.137757574 container create 387ca1044d20fa5cffddfc6fc091cac20b34bbbd97b18407d68c74aec850e79a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:35:31.732 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 podman[102338]: 2024-03-22 07:35:31.733076605 +0000 UTC m=+0.373629827 container init 387ca1044d20fa5cffddfc6fc091cac20b34bbbd97b18407d68c74aec850e79a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-22T07:35:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:31 smithi134 ceph-mon[93947]: pgmap v156: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-22T07:35:32.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:31 smithi134 ceph-mon[93947]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-03-22T07:35:32.177 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 podman[102338]: 2024-03-22 07:35:31.736333047 +0000 UTC m=+0.376886258 container start 387ca1044d20fa5cffddfc6fc091cac20b34bbbd97b18407d68c74aec850e79a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-22T07:35:32.177 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:31 smithi195 podman[102338]: 2024-03-22 07:35:31.841285716 +0000 UTC m=+0.481838937 container attach 387ca1044d20fa5cffddfc6fc091cac20b34bbbd97b18407d68c74aec850e79a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-22T07:35:32.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 bash[102338]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-22T07:35:32.456 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-22T07:35:32.456 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-22T07:35:32.456 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-03-22T07:35:32.456 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-22T07:35:32.456 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate[102353]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-22T07:35:32.456 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 podman[102338]: 2024-03-22 07:35:32.202786209 +0000 UTC m=+0.843339412 container died 387ca1044d20fa5cffddfc6fc091cac20b34bbbd97b18407d68c74aec850e79a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:35:32.786 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:32 smithi195 ceph-mon[82061]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 5 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:33.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:32 smithi134 ceph-mon[93947]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 5 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:33.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 podman[102488]: 2024-03-22 07:35:32.786976012 +0000 UTC m=+0.578969904 container remove 387ca1044d20fa5cffddfc6fc091cac20b34bbbd97b18407d68c74aec850e79a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-22T07:35:33.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:32 smithi195 podman[102551]: 2024-03-22 07:35:32.900370617 +0000 UTC m=+0.018210693 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:35:33.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 podman[102551]: 2024-03-22 07:35:33.013087077 +0000 UTC m=+0.130927224 container create 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:35:33.666 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 podman[102551]: 2024-03-22 07:35:33.423687896 +0000 UTC m=+0.541527975 container init 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b) 2024-03-22T07:35:33.666 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 podman[102551]: 2024-03-22 07:35:33.42661748 +0000 UTC m=+0.544457550 container start 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, GIT_CLEAN=True) 2024-03-22T07:35:33.666 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-osd[102570]: -- 172.21.15.195:0/706696532 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562787cfd1e0 con 0x562787ccec00 2024-03-22T07:35:33.666 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 bash[102551]: 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 2024-03-22T07:35:33.667 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 systemd[1]: Started Ceph osd.5 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:35:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-mon[82061]: pgmap v157: 65 pgs: 5 active+undersized+degraded, 10 peering, 3 stale+active+clean, 8 active+undersized, 39 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-03-22T07:35:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:33 smithi134 ceph-mon[93947]: pgmap v157: 65 pgs: 5 active+undersized+degraded, 10 peering, 3 stale+active+clean, 8 active+undersized, 39 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-03-22T07:35:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:34.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:34.387 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:33 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:35:33.971+0000 7fec5376a7c0 -1 Falling back to public interface 2024-03-22T07:35:35.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:34 smithi134 ceph-mon[93947]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-03-22T07:35:35.103 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:34 smithi195 ceph-mon[82061]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-03-22T07:35:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:35 smithi134 ceph-mon[93947]: pgmap v158: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:36.058 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:35 smithi195 ceph-mon[82061]: pgmap v158: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:37.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:37 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:37.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:37 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:37.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:37 smithi195 ceph-mon[82061]: pgmap v159: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:37 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:37 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:37 smithi134 ceph-mon[93947]: pgmap v159: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:38.409 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:38 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:35:38.189+0000 7fec5376a7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-03-22T07:35:38.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:38 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:38.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:38 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:38.705 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:38 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:35:38.632+0000 7fec5376a7c0 -1 osd.5 75 log_to_monitors true 2024-03-22T07:35:38.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:38 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:38.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:38 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:39.705 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:35:39 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:35:39.557+0000 7fec44bc2700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-22T07:35:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:39 smithi195 ceph-mon[82061]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:39 smithi195 ceph-mon[82061]: from='osd.5 [v2:172.21.15.195:6816/381174269,v1:172.21.15.195:6817/381174269]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:35:39.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:39 smithi195 ceph-mon[82061]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:35:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:39 smithi134 ceph-mon[93947]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:39 smithi134 ceph-mon[93947]: from='osd.5 [v2:172.21.15.195:6816/381174269,v1:172.21.15.195:6817/381174269]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:35:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:39 smithi134 ceph-mon[93947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-22T07:35:40.840 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:40 smithi195 ceph-mon[82061]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-22T07:35:40.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:40 smithi195 ceph-mon[82061]: osdmap e78: 6 total, 5 up, 6 in 2024-03-22T07:35:40.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:40 smithi195 ceph-mon[82061]: from='osd.5 [v2:172.21.15.195:6816/381174269,v1:172.21.15.195:6817/381174269]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:40.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:40 smithi195 ceph-mon[82061]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:40.841 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:40 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 12 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:40 smithi134 ceph-mon[93947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-22T07:35:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:40 smithi134 ceph-mon[93947]: osdmap e78: 6 total, 5 up, 6 in 2024-03-22T07:35:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:40 smithi134 ceph-mon[93947]: from='osd.5 [v2:172.21.15.195:6816/381174269,v1:172.21.15.195:6817/381174269]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:40 smithi134 ceph-mon[93947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2024-03-22T07:35:41.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:40 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 12 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:41.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: pgmap v162: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: osd.5 [v2:172.21.15.195:6816/381174269,v1:172.21.15.195:6817/381174269] boot 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: osdmap e79: 6 total, 6 up, 6 in 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:41.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-22T07:35:41.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-22T07:35:41.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-22T07:35:41.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:41 smithi195 ceph-mon[82061]: osdmap e80: 6 total, 6 up, 6 in 2024-03-22T07:35:42.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: pgmap v162: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: osd.5 [v2:172.21.15.195:6816/381174269,v1:172.21.15.195:6817/381174269] boot 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: osdmap e79: 6 total, 6 up, 6 in 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:42.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-22T07:35:42.047 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-22T07:35:42.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-22T07:35:42.048 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:41 smithi134 ceph-mon[93947]: osdmap e80: 6 total, 6 up, 6 in 2024-03-22T07:35:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:42 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all osd 2024-03-22T07:35:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:42 smithi134 ceph-mon[93947]: Upgrade: Setting require_osd_release to 19 squid 2024-03-22T07:35:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.yxdtlb"]}]: dispatch 2024-03-22T07:35:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:42 smithi134 ceph-mon[93947]: Upgrade: It appears safe to stop mds.cephfs.smithi134.yxdtlb 2024-03-22T07:35:42.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:42 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all osd 2024-03-22T07:35:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:42 smithi195 ceph-mon[82061]: Upgrade: Setting require_osd_release to 19 squid 2024-03-22T07:35:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.yxdtlb"]}]: dispatch 2024-03-22T07:35:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:42 smithi195 ceph-mon[82061]: Upgrade: It appears safe to stop mds.cephfs.smithi134.yxdtlb 2024-03-22T07:35:43.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 -- 172.21.15.134:0/4008084715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 msgr2=0x7ffad80fc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/4008084715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad80fc210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffac0004940 tx=0x7ffac0009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 -- 172.21.15.134:0/4008084715 shutdown_connections 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/4008084715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 0x7ffad80fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/4008084715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad80fc210 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 -- 172.21.15.134:0/4008084715 >> 172.21.15.134:0/4008084715 conn(0x7ffad80f74e0 msgr2=0x7ffad80f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 -- 172.21.15.134:0/4008084715 shutdown_connections 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 -- 172.21.15.134:0/4008084715 wait complete. 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 Processor -- start 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.354+0000 7ffadc8c9700 1 -- start start 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffadc8c9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad8110750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffadc8c9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 0x7ffad8112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffadc8c9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8066be0 con 0x7ffad80fbe00 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffadc8c9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8066d20 con 0x7ffad80fcf70 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad8110750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad8110750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46922/0 (socket says 172.21.15.134:46922) 2024-03-22T07:35:43.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 -- 172.21.15.134:0/137550620 learned_addr learned my addr 172.21.15.134:0/137550620 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad5d9b700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 0x7ffad8112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 -- 172.21.15.134:0/137550620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 msgr2=0x7ffad8112ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 0x7ffad8112ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 -- 172.21.15.134:0/137550620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0005040 con 0x7ffad80fbe00 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad5d9b700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 0x7ffad8112ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffad659c700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad8110750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009150 tx=0x7ffac0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac000e040 con 0x7ffad80fbe00 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffac000bbf0 con 0x7ffad80fbe00 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.355+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad81131e0 con 0x7ffad80fbe00 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.356+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac001c630 con 0x7ffad80fbe00 2024-03-22T07:35:43.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.356+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad81137a0 con 0x7ffad80fbe00 2024-03-22T07:35:43.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.356+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad805f5f0 con 0x7ffad80fbe00 2024-03-22T07:35:43.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.357+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ffac000bd60 con 0x7ffad80fbe00 2024-03-22T07:35:43.358 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.358+0000 7ffaceffd700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffac406d390 0x7ffac406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.358+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffac008e7a0 con 0x7ffad80fbe00 2024-03-22T07:35:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.358+0000 7ffad5d9b700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffac406d390 0x7ffac406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:43.359 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.358+0000 7ffad5d9b700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffac406d390 0x7ffac406f840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009fd0 tx=0x7ffac800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:43.361 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.362+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffac00582d0 con 0x7ffad80fbe00 2024-03-22T07:35:43.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.583+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffad8101290 con 0x7ffac406d390 2024-03-22T07:35:43.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.585+0000 7ffaceffd700 1 -- 172.21.15.134:0/137550620 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffad8101290 con 0x7ffac406d390 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffac406d390 msgr2=0x7ffac406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffac406d390 0x7ffac406f840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009fd0 tx=0x7ffac800b040 comp rx=0 tx=0).stop 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 msgr2=0x7ffad8110750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad8110750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009150 tx=0x7ffac0009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 shutdown_connections 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffac406d390 0x7ffac406f840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80fbe00 0x7ffad8110750 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 --2- 172.21.15.134:0/137550620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffad80fcf70 0x7ffad8112ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 >> 172.21.15.134:0/137550620 conn(0x7ffad80f74e0 msgr2=0x7ffad80f8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:43.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 shutdown_connections 2024-03-22T07:35:43.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.587+0000 7ffadc8c9700 1 -- 172.21.15.134:0/137550620 wait complete. 2024-03-22T07:35:43.598 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:35:43.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 -- 172.21.15.134:0/2597388334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fe050 msgr2=0x7ff04c0fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 --2- 172.21.15.134:0/2597388334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fe050 0x7ff04c0fe4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff03c004940 tx=0x7ff03c009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 -- 172.21.15.134:0/2597388334 shutdown_connections 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 --2- 172.21.15.134:0/2597388334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fe050 0x7ff04c0fe4c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 --2- 172.21.15.134:0/2597388334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff04c0fce50 0x7ff04c0fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 -- 172.21.15.134:0/2597388334 >> 172.21.15.134:0/2597388334 conn(0x7ff04c0f8560 msgr2=0x7ff04c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 -- 172.21.15.134:0/2597388334 shutdown_connections 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.696+0000 7ff053b87700 1 -- 172.21.15.134:0/2597388334 wait complete. 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff053b87700 1 Processor -- start 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff053b87700 1 -- start start 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff053b87700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 0x7ff04c10fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff053b87700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff04c0fe050 0x7ff04c110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff053b87700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c110680 con 0x7ff04c0fce50 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff053b87700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1107f0 con 0x7ff04c0fe050 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff051923700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 0x7ff04c10fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:43.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff051923700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 0x7ff04c10fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37774/0 (socket says 172.21.15.134:37774) 2024-03-22T07:35:43.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff051923700 1 -- 172.21.15.134:0/3529627198 learned_addr learned my addr 172.21.15.134:0/3529627198 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:43.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.697+0000 7ff051122700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff04c0fe050 0x7ff04c110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:43.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff051923700 1 -- 172.21.15.134:0/3529627198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff04c0fe050 msgr2=0x7ff04c110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff051923700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff04c0fe050 0x7ff04c110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff051923700 1 -- 172.21.15.134:0/3529627198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c005040 con 0x7ff04c0fce50 2024-03-22T07:35:43.699 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff051923700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 0x7ff04c10fb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff048002a80 tx=0x7ff048004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:43.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff048007cc0 con 0x7ff04c0fce50 2024-03-22T07:35:43.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff04800f040 con 0x7ff04c0fce50 2024-03-22T07:35:43.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.698+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c115250 con 0x7ff04c0fce50 2024-03-22T07:35:43.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.699+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04800da30 con 0x7ff04c0fce50 2024-03-22T07:35:43.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.699+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c115810 con 0x7ff04c0fce50 2024-03-22T07:35:43.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.700+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff04800dc50 con 0x7ff04c0fce50 2024-03-22T07:35:43.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.700+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c1019e0 con 0x7ff04c0fce50 2024-03-22T07:35:43.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.700+0000 7ff0427fc700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff03806d380 0x7ff03806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:43.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.700+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff048090170 con 0x7ff04c0fce50 2024-03-22T07:35:43.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.700+0000 7ff051122700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff03806d380 0x7ff03806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:43.701 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.701+0000 7ff051122700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff03806d380 0x7ff03806f830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009fd0 tx=0x7ff03c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:43.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.706+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff048091060 con 0x7ff04c0fce50 2024-03-22T07:35:43.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:43 smithi134 ceph-mon[93947]: pgmap v165: 65 pgs: 1 peering, 9 active+undersized+degraded, 13 active+undersized, 42 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 27/219 objects degraded (12.329%) 2024-03-22T07:35:43.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:43.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:35:43.826 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:43.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.923+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff04c02b460 con 0x7ff03806d380 2024-03-22T07:35:43.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.924+0000 7ff0427fc700 1 -- 172.21.15.134:0/3529627198 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff04c02b460 con 0x7ff03806d380 2024-03-22T07:35:43.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff03806d380 msgr2=0x7ff03806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff03806d380 0x7ff03806f830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009fd0 tx=0x7ff03c009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 msgr2=0x7ff04c10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 0x7ff04c10fb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff048002a80 tx=0x7ff048004600 comp rx=0 tx=0).stop 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 shutdown_connections 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff03806d380 0x7ff03806f830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff04c0fce50 0x7ff04c10fb40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.926+0000 7ff053b87700 1 --2- 172.21.15.134:0/3529627198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff04c0fe050 0x7ff04c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.927+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 >> 172.21.15.134:0/3529627198 conn(0x7ff04c0f8560 msgr2=0x7ff04c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.927+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 shutdown_connections 2024-03-22T07:35:43.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:43.927+0000 7ff053b87700 1 -- 172.21.15.134:0/3529627198 wait complete. 2024-03-22T07:35:43.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:43 smithi195 ceph-mon[82061]: pgmap v165: 65 pgs: 1 peering, 9 active+undersized+degraded, 13 active+undersized, 42 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 27/219 objects degraded (12.329%) 2024-03-22T07:35:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.yxdtlb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:35:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:35:44.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 -- 172.21.15.134:0/3415808019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 msgr2=0x7f47cc0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.033 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 --2- 172.21.15.134:0/3415808019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc0fd3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47c8004940 tx=0x7f47c8009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 -- 172.21.15.134:0/3415808019 shutdown_connections 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 --2- 172.21.15.134:0/3415808019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc0fd3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 --2- 172.21.15.134:0/3415808019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47cc0fbcd0 0x7f47cc0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 -- 172.21.15.134:0/3415808019 >> 172.21.15.134:0/3415808019 conn(0x7f47cc0f7430 msgr2=0x7f47cc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 -- 172.21.15.134:0/3415808019 shutdown_connections 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.032+0000 7f47d4568700 1 -- 172.21.15.134:0/3415808019 wait complete. 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d4568700 1 Processor -- start 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d4568700 1 -- start start 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d4568700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47cc0fbcd0 0x7f47cc110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d4568700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d4568700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc066350 con 0x7f47cc0fcf80 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d4568700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc066490 con 0x7f47cc0fbcd0 2024-03-22T07:35:44.034 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc112cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37784/0 (socket says 172.21.15.134:37784) 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 -- 172.21.15.134:0/2045531482 learned_addr learned my addr 172.21.15.134:0/2045531482 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d2304700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47cc0fbcd0 0x7f47cc110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 -- 172.21.15.134:0/2045531482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47cc0fbcd0 msgr2=0x7f47cc110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47cc0fbcd0 0x7f47cc110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 -- 172.21.15.134:0/2045531482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c8005040 con 0x7f47cc0fcf80 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47d1b03700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc112cb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47c800b3b0 tx=0x7f47c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.033+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c800e040 con 0x7f47cc0fcf80 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.034+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47c800bcc0 con 0x7f47cc0fcf80 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.034+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc1131f0 con 0x7f47cc0fcf80 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.034+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c801c630 con 0x7f47cc0fcf80 2024-03-22T07:35:44.035 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.034+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc1137b0 con 0x7f47cc0fcf80 2024-03-22T07:35:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.035+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc05f5f0 con 0x7f47cc0fcf80 2024-03-22T07:35:44.036 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.035+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f47c8013980 con 0x7f47cc0fcf80 2024-03-22T07:35:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.035+0000 7f47c2ffd700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f47b806d380 0x7f47b806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.036+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f47c808d620 con 0x7f47cc0fcf80 2024-03-22T07:35:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.036+0000 7f47d2304700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f47b806d380 0x7f47b806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.037 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.036+0000 7f47d2304700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f47b806d380 0x7f47b806f830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009fd0 tx=0x7f47bc009f20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:44.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.040+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f47c80570b0 con 0x7f47cc0fcf80 2024-03-22T07:35:44.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.250+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47cc101340 con 0x7f47b806d380 2024-03-22T07:35:44.260 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.261+0000 7f47c2ffd700 1 -- 172.21.15.134:0/2045531482 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f47cc101340 con 0x7f47b806d380 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (6m) 106s ago 15m 25.0M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (3m) 106s ago 15m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (3m) 7s ago 14m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 106s ago 14m 81.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (9m) 106s ago 9m 147M - 17.2.7-726-g9c4e0c34 837124da804f 2441aabf6fe2 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (9m) 106s ago 9m 13.8M - 17.2.7-726-g9c4e0c34 837124da804f 07c2db9f41c2 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (9m) 7s ago 9m 15.5M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (9m) 7s ago 9m 14.9M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (5m) 106s ago 16m 503M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:35:44.261 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (4m) 7s ago 14m 450M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (4m) 106s ago 16m 48.8M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (4m) 7s ago 14m 38.8M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 106s ago 15m 15.5M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (5m) 7s ago 14m 15.2M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 106s ago 13m 96.2M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (2m) 106s ago 12m 103M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (112s) 106s ago 12m 15.1M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (77s) 7s ago 11m 116M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (44s) 7s ago 11m 108M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (11s) 7s ago 11m 11.7M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:35:44.262 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 106s ago 14m 52.0M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f47b806d380 msgr2=0x7f47b806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f47b806d380 0x7f47b806f830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009fd0 tx=0x7f47bc009f20 comp rx=0 tx=0).stop 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 msgr2=0x7f47cc112cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc112cb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47c800b3b0 tx=0x7f47c8009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 shutdown_connections 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f47b806d380 0x7f47b806f830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47cc0fbcd0 0x7f47cc110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 --2- 172.21.15.134:0/2045531482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47cc0fcf80 0x7f47cc112cb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 >> 172.21.15.134:0/2045531482 conn(0x7f47cc0f7430 msgr2=0x7f47cc0f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:44.263 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 shutdown_connections 2024-03-22T07:35:44.264 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.263+0000 7f47d4568700 1 -- 172.21.15.134:0/2045531482 wait complete. 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.363+0000 7f4d1b647700 1 -- 172.21.15.134:0/3015970053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 msgr2=0x7f4d140fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.363+0000 7f4d1b647700 1 --2- 172.21.15.134:0/3015970053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d140fd280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4d10004940 tx=0x7f4d10009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.363+0000 7f4d1b647700 1 -- 172.21.15.134:0/3015970053 shutdown_connections 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.363+0000 7f4d1b647700 1 --2- 172.21.15.134:0/3015970053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 0x7f4d140fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.363+0000 7f4d1b647700 1 --2- 172.21.15.134:0/3015970053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d140fd280 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.363+0000 7f4d1b647700 1 -- 172.21.15.134:0/3015970053 >> 172.21.15.134:0/3015970053 conn(0x7f4d140f8550 msgr2=0x7f4d140fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 -- 172.21.15.134:0/3015970053 shutdown_connections 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 -- 172.21.15.134:0/3015970053 wait complete. 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 Processor -- start 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 -- start start 2024-03-22T07:35:44.365 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d1410d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 0x7f4d1410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1410e490 con 0x7f4d140fce70 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d1b647700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1410e600 con 0x7f4d140fdfe0 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d193e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d1410d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d193e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d1410d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37794/0 (socket says 172.21.15.134:37794) 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d193e3700 1 -- 172.21.15.134:0/265374524 learned_addr learned my addr 172.21.15.134:0/265374524 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.364+0000 7f4d18be2700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 0x7f4d1410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d193e3700 1 -- 172.21.15.134:0/265374524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 msgr2=0x7f4d1410de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d193e3700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 0x7f4d1410de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d193e3700 1 -- 172.21.15.134:0/265374524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10005040 con 0x7f4d140fce70 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d18be2700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 0x7f4d1410de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d193e3700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d1410d950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000b3b0 tx=0x7f4d10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1000e040 con 0x7f4d140fce70 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d1000bcc0 con 0x7f4d140fce70 2024-03-22T07:35:44.366 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14113000 con 0x7f4d140fce70 2024-03-22T07:35:44.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1001c630 con 0x7f4d140fce70 2024-03-22T07:35:44.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.365+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d141135c0 con 0x7f4d140fce70 2024-03-22T07:35:44.367 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.366+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1404c710 con 0x7f4d140fce70 2024-03-22T07:35:44.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.367+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f4d10013980 con 0x7f4d140fce70 2024-03-22T07:35:44.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.367+0000 7f4d09ffb700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4d0006d380 0x7f4d0006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.367+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4d1008d620 con 0x7f4d140fce70 2024-03-22T07:35:44.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.367+0000 7f4d18be2700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4d0006d380 0x7f4d0006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.368 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.368+0000 7f4d18be2700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4d0006d380 0x7f4d0006f830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009fd0 tx=0x7f4d04009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:44.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.371+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d1005abe0 con 0x7f4d140fce70 2024-03-22T07:35:44.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.659+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d14113950 con 0x7f4d140fce70 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.660+0000 7f4d09ffb700 1 -- 172.21.15.134:0/265374524 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f4d1005a770 con 0x7f4d140fce70 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:35:44.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 4, 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 10 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:35:44.661 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4d0006d380 msgr2=0x7f4d0006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4d0006d380 0x7f4d0006f830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009fd0 tx=0x7f4d04009ee0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 msgr2=0x7f4d1410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d1410d950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000b3b0 tx=0x7f4d10009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 shutdown_connections 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4d0006d380 0x7f4d0006f830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d140fce70 0x7f4d1410d950 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 --2- 172.21.15.134:0/265374524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d140fdfe0 0x7f4d1410de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 >> 172.21.15.134:0/265374524 conn(0x7f4d140f8550 msgr2=0x7f4d140f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:44.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 shutdown_connections 2024-03-22T07:35:44.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.662+0000 7f4d1b647700 1 -- 172.21.15.134:0/265374524 wait complete. 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/1584994263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 msgr2=0x7ffb08102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/1584994263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb08102360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8004940 tx=0x7ffaf8009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/1584994263 shutdown_connections 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/1584994263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb08102360 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/1584994263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb08066260 0x7ffb080ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/1584994263 >> 172.21.15.134:0/1584994263 conn(0x7ffb080f7430 msgr2=0x7ffb080f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/1584994263 shutdown_connections 2024-03-22T07:35:44.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.764+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/1584994263 wait complete. 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0f3fb700 1 Processor -- start 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0f3fb700 1 -- start start 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0f3fb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb08066260 0x7ffb0810da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0f3fb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb0810dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0f3fb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0810e640 con 0x7ffb080fff80 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0f3fb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0810ee30 con 0x7ffb08066260 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0c996700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb0810dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0c996700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb0810dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37814/0 (socket says 172.21.15.134:37814) 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0c996700 1 -- 172.21.15.134:0/2658074302 learned_addr learned my addr 172.21.15.134:0/2658074302 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0d197700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb08066260 0x7ffb0810da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0c996700 1 -- 172.21.15.134:0/2658074302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb08066260 msgr2=0x7ffb0810da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0c996700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb08066260 0x7ffb0810da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:44.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.765+0000 7ffb0c996700 1 -- 172.21.15.134:0/2658074302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf8005040 con 0x7ffb080fff80 2024-03-22T07:35:44.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.766+0000 7ffb0c996700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb0810dfb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800b3b0 tx=0x7ffaf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:44.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.766+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf800e040 con 0x7ffb080fff80 2024-03-22T07:35:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.766+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0810f0b0 con 0x7ffb080fff80 2024-03-22T07:35:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.766+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaf800bcc0 con 0x7ffb080fff80 2024-03-22T07:35:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.766+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf801c630 con 0x7ffb080fff80 2024-03-22T07:35:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.766+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0810f670 con 0x7ffb080fff80 2024-03-22T07:35:44.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.767+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0805f5f0 con 0x7ffb080fff80 2024-03-22T07:35:44.768 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:44 smithi134 ceph-mon[93947]: Upgrade: Updating mds.cephfs.smithi134.yxdtlb 2024-03-22T07:35:44.768 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:44 smithi134 ceph-mon[93947]: Deploying daemon mds.cephfs.smithi134.yxdtlb on smithi134 2024-03-22T07:35:44.768 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:44 smithi134 ceph-mon[93947]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:44.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.767+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ffaf8013980 con 0x7ffb080fff80 2024-03-22T07:35:44.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.768+0000 7ffafdffb700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffaf406d380 0x7ffaf406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:44.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.768+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffaf808d620 con 0x7ffb080fff80 2024-03-22T07:35:44.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.768+0000 7ffb0d197700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffaf406d380 0x7ffaf406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:44.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.768+0000 7ffb0d197700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffaf406d380 0x7ffaf406f830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb04006fd0 tx=0x7ffb04008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:44.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:44.772+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffaf805abe0 con 0x7ffb080fff80 2024-03-22T07:35:44.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:44 smithi195 ceph-mon[82061]: Upgrade: Updating mds.cephfs.smithi134.yxdtlb 2024-03-22T07:35:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:44 smithi195 ceph-mon[82061]: Deploying daemon mds.cephfs.smithi134.yxdtlb on smithi134 2024-03-22T07:35:44.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:44 smithi195 ceph-mon[82061]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.017+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb0810f950 con 0x7ffb080fff80 2024-03-22T07:35:45.017 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.017+0000 7ffafdffb700 1 -- 172.21.15.134:0/2658074302 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1854 (secure 0 0 0) 0x7ffaf805a770 con 0x7ffb080fff80 2024-03-22T07:35:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:e14 2024-03-22T07:35:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:35:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 14 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:26:16.446375+0000 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:35:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 47 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=14474} 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:35:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.134:6828/2483774939,v1:172.21.15.134:6829/2483774939] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/1210336512,v1:172.21.15.134:6827/1210336512] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:24267} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.019+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffaf406d380 msgr2=0x7ffaf406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.019+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffaf406d380 0x7ffaf406f830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb04006fd0 tx=0x7ffb04008040 comp rx=0 tx=0).stop 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.019+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 msgr2=0x7ffb0810dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.019+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb0810dfb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800b3b0 tx=0x7ffaf8009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 shutdown_connections 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ffaf406d380 0x7ffaf406f830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb08066260 0x7ffb0810da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 --2- 172.21.15.134:0/2658074302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb080fff80 0x7ffb0810dfb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 >> 172.21.15.134:0/2658074302 conn(0x7ffb080f7430 msgr2=0x7ffb080f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 shutdown_connections 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.020+0000 7ffb0f3fb700 1 -- 172.21.15.134:0/2658074302 wait complete. 2024-03-22T07:35:45.021 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 14 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 -- 172.21.15.134:0/1903500967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 msgr2=0x7f65740fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 --2- 172.21.15.134:0/1903500967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f65740fc0f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6564004940 tx=0x7f6564009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 -- 172.21.15.134:0/1903500967 shutdown_connections 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 --2- 172.21.15.134:0/1903500967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65740fcf90 0x7f65740fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 --2- 172.21.15.134:0/1903500967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f65740fc0f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 -- 172.21.15.134:0/1903500967 >> 172.21.15.134:0/1903500967 conn(0x7f65740f7440 msgr2=0x7f65740f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:45.134 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 -- 172.21.15.134:0/1903500967 shutdown_connections 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.132+0000 7f6579098700 1 -- 172.21.15.134:0/1903500967 wait complete. 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6579098700 1 Processor -- start 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6579098700 1 -- start start 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6579098700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f657410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6579098700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65740fcf90 0x7f657410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6579098700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657410e5a0 con 0x7f65740fbce0 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6579098700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657410eda0 con 0x7f65740fcf90 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6572d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f657410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6572d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f657410da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37836/0 (socket says 172.21.15.134:37836) 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f6572d9d700 1 -- 172.21.15.134:0/2436347000 learned_addr learned my addr 172.21.15.134:0/2436347000 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.133+0000 7f657259c700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65740fcf90 0x7f657410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f6572d9d700 1 -- 172.21.15.134:0/2436347000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65740fcf90 msgr2=0x7f657410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f6572d9d700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65740fcf90 0x7f657410dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.135 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f6572d9d700 1 -- 172.21.15.134:0/2436347000 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564005040 con 0x7f65740fbce0 2024-03-22T07:35:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f6572d9d700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f657410da60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f656400b3b0 tx=0x7f6564009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656400e040 con 0x7f65740fbce0 2024-03-22T07:35:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f656400bbf0 con 0x7f65740fbce0 2024-03-22T07:35:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657410f020 con 0x7f65740fbce0 2024-03-22T07:35:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f656401c630 con 0x7f65740fbce0 2024-03-22T07:35:45.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.134+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657410f560 con 0x7f65740fbce0 2024-03-22T07:35:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.135+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657405f5f0 con 0x7f65740fbce0 2024-03-22T07:35:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.136+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f656400bd60 con 0x7f65740fbce0 2024-03-22T07:35:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.136+0000 7f655b7fe700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f655c06d380 0x7f655c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.136+0000 7f657259c700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f655c06d380 0x7f655c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.136+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f656408d500 con 0x7f65740fbce0 2024-03-22T07:35:45.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.137+0000 7f657259c700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f655c06d380 0x7f655c06f830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6568004f40 tx=0x7f656800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:45.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.141+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f656405ab40 con 0x7f65740fbce0 2024-03-22T07:35:45.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.374+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f657402b400 con 0x7f655c06d380 2024-03-22T07:35:45.375 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.376+0000 7f655b7fe700 1 -- 172.21.15.134:0/2436347000 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f657402b400 con 0x7f655c06d380 2024-03-22T07:35:45.375 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "12/21 daemons upgraded", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:35:45.376 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:35:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.378+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f655c06d380 msgr2=0x7f655c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.378+0000 7f6579098700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f655c06d380 0x7f655c06f830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6568004f40 tx=0x7f656800b040 comp rx=0 tx=0).stop 2024-03-22T07:35:45.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.378+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 msgr2=0x7f657410da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.378+0000 7f6579098700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f657410da60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f656400b3b0 tx=0x7f6564009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 shutdown_connections 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f655c06d380 0x7f655c06f830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65740fbce0 0x7f657410da60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 --2- 172.21.15.134:0/2436347000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65740fcf90 0x7f657410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 >> 172.21.15.134:0/2436347000 conn(0x7f65740f7440 msgr2=0x7f6574066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 shutdown_connections 2024-03-22T07:35:45.379 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.379+0000 7f6579098700 1 -- 172.21.15.134:0/2436347000 wait complete. 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 -- 172.21.15.134:0/3892384784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fdc10 msgr2=0x7fccb00fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3892384784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fdc10 0x7fccb00fc020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcc98004940 tx=0x7fcc98009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 -- 172.21.15.134:0/3892384784 shutdown_connections 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3892384784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fdc10 0x7fccb00fc020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3892384784 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fd2c0 0x7fccb00fd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 -- 172.21.15.134:0/3892384784 >> 172.21.15.134:0/3892384784 conn(0x7fccb00f6ba0 msgr2=0x7fccb00f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 -- 172.21.15.134:0/3892384784 shutdown_connections 2024-03-22T07:35:45.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 -- 172.21.15.134:0/3892384784 wait complete. 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 Processor -- start 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.489+0000 7fccb6aba700 1 -- start start 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb6aba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 0x7fccb010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb6aba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fdc10 0x7fccb010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb6aba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb010e630 con 0x7fccb00fd2c0 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb6aba700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb010ee20 con 0x7fccb00fdc10 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 0x7fccb010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:45.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 0x7fccb010da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37862/0 (socket says 172.21.15.134:37862) 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 -- 172.21.15.134:0/3242069537 learned_addr learned my addr 172.21.15.134:0/3242069537 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccaffff700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fdc10 0x7fccb010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 -- 172.21.15.134:0/3242069537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fdc10 msgr2=0x7fccb010dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fdc10 0x7fccb010dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 -- 172.21.15.134:0/3242069537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98005040 con 0x7fccb00fd2c0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccaffff700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fdc10 0x7fccb010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccb4856700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 0x7fccb010da60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcca800bbb0 tx=0x7fcca8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.490+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca80092e0 con 0x7fccb00fd2c0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.491+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcca800cbd0 con 0x7fccb00fd2c0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.491+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb010f100 con 0x7fccb00fd2c0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.491+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcca8007400 con 0x7fccb00fd2c0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.491+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb010f6c0 con 0x7fccb00fd2c0 2024-03-22T07:35:45.492 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.491+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb0101bc0 con 0x7fccb00fd2c0 2024-03-22T07:35:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.492+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fcca8012070 con 0x7fccb00fd2c0 2024-03-22T07:35:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.492+0000 7fccad7fa700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcc9c06d380 0x7fcc9c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:35:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.492+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcca808c5b0 con 0x7fccb00fd2c0 2024-03-22T07:35:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.493+0000 7fccaffff700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcc9c06d380 0x7fcc9c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:35:45.493 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.493+0000 7fccaffff700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcc9c06d380 0x7fcc9c06f830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800b970 tx=0x7fcc98009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:35:45.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.497+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcca8059b70 con 0x7fccb00fd2c0 2024-03-22T07:35:45.780 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.779+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fccb004bed0 con 0x7fccb00fd2c0 2024-03-22T07:35:45.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:45 smithi134 ceph-mon[93947]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:45.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:45 smithi134 ceph-mon[93947]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:45.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:45 smithi134 ceph-mon[93947]: pgmap v166: 65 pgs: 1 peering, 4 active+undersized+degraded, 9 active+undersized, 51 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-03-22T07:35:45.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:45 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/265374524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:45.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:45 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2658074302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:35:45.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:45 smithi134 ceph-mon[93947]: Health check update: Degraded data redundancy: 9/219 objects degraded (4.110%), 4 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.780+0000 7fccad7fa700 1 -- 172.21.15.134:0/3242069537 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+401 (secure 0 0 0) 0x7fcca8059700 con 0x7fccb00fd2c0 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_WARN Degraded data redundancy: 9/219 objects degraded (4.110%), 4 pgs degraded 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 9/219 objects degraded (4.110%), 4 pgs degraded 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-03-22T07:35:45.781 INFO:teuthology.orchestra.run.smithi134.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-03-22T07:35:45.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcc9c06d380 msgr2=0x7fcc9c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcc9c06d380 0x7fcc9c06f830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800b970 tx=0x7fcc98009e30 comp rx=0 tx=0).stop 2024-03-22T07:35:45.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 msgr2=0x7fccb010da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:35:45.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 0x7fccb010da60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcca800bbb0 tx=0x7fcca8009840 comp rx=0 tx=0).stop 2024-03-22T07:35:45.782 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 shutdown_connections 2024-03-22T07:35:45.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcc9c06d380 0x7fcc9c06f830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccb00fd2c0 0x7fccb010da60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 --2- 172.21.15.134:0/3242069537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fccb00fdc10 0x7fccb010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:35:45.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 >> 172.21.15.134:0/3242069537 conn(0x7fccb00f6ba0 msgr2=0x7fccb00f8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:35:45.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 shutdown_connections 2024-03-22T07:35:45.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:35:45.782+0000 7fccb6aba700 1 -- 172.21.15.134:0/3242069537 wait complete. 2024-03-22T07:35:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:45 smithi195 ceph-mon[82061]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:45 smithi195 ceph-mon[82061]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:45 smithi195 ceph-mon[82061]: pgmap v166: 65 pgs: 1 peering, 4 active+undersized+degraded, 9 active+undersized, 51 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 9/219 objects degraded (4.110%) 2024-03-22T07:35:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:45 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/265374524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:35:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:45 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2658074302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:35:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:45 smithi195 ceph-mon[82061]: Health check update: Degraded data redundancy: 9/219 objects degraded (4.110%), 4 pgs degraded (PG_DEGRADED) 2024-03-22T07:35:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:46 smithi195 ceph-mon[82061]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:46 smithi195 ceph-mon[82061]: osdmap e81: 6 total, 6 up, 6 in 2024-03-22T07:35:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:46 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 2 up:standby 2024-03-22T07:35:46.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:46 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3242069537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:35:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:46 smithi134 ceph-mon[93947]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:35:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:46 smithi134 ceph-mon[93947]: osdmap e81: 6 total, 6 up, 6 in 2024-03-22T07:35:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:46 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 2 up:standby 2024-03-22T07:35:47.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:46 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3242069537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:35:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:47 smithi134 ceph-mon[93947]: pgmap v168: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:47 smithi134 ceph-mon[93947]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 4 pgs degraded) 2024-03-22T07:35:47.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:47 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:35:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:47 smithi195 ceph-mon[82061]: pgmap v168: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:47 smithi195 ceph-mon[82061]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/219 objects degraded (4.110%), 4 pgs degraded) 2024-03-22T07:35:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:47 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:35:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:49 smithi134 ceph-mon[93947]: pgmap v169: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:49.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:35:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:49 smithi195 ceph-mon[82061]: pgmap v169: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:35:49.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:35:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:51 smithi134 ceph-mon[93947]: pgmap v170: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:51.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:51 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:51 smithi195 ceph-mon[82061]: pgmap v170: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:51.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:51 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:35:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:52 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:boot 2024-03-22T07:35:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:52 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:35:52.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:52 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:35:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:52 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:boot 2024-03-22T07:35:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:52 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi134.dexlss=up:active} 3 up:standby 2024-03-22T07:35:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:52 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:35:53.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:53 smithi134 ceph-mon[93947]: pgmap v171: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:53.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:53 smithi195 ceph-mon[82061]: pgmap v171: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:54.920 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:54 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:54.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:54 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:55.848 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:55 smithi134 ceph-mon[93947]: pgmap v172: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:55.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:55 smithi195 ceph-mon[82061]: pgmap v172: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:57.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:57 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:57.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:57 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:57.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:57 smithi134 ceph-mon[93947]: pgmap v173: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:57.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:57 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:57.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:57 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:57.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:57 smithi195 ceph-mon[82061]: pgmap v173: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:58.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:58.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:58 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:58.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:58.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:58 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:35:59.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:35:59 smithi134 ceph-mon[93947]: pgmap v174: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:35:59.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:35:59 smithi195 ceph-mon[82061]: pgmap v174: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: pgmap v175: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:01 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.dexlss"]}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: pgmap v175: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:01.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:01 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi134.dexlss"]}]: dispatch 2024-03-22T07:36:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:02 smithi195 ceph-mon[82061]: Detected new or changed devices on smithi134 2024-03-22T07:36:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:02 smithi195 ceph-mon[82061]: Upgrade: It appears safe to stop mds.cephfs.smithi134.dexlss 2024-03-22T07:36:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:36:02.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:03.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:02 smithi134 ceph-mon[93947]: Detected new or changed devices on smithi134 2024-03-22T07:36:03.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:02 smithi134 ceph-mon[93947]: Upgrade: It appears safe to stop mds.cephfs.smithi134.dexlss 2024-03-22T07:36:03.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:03.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.dexlss", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:36:03.005 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:03 smithi195 ceph-mon[82061]: Upgrade: Updating mds.cephfs.smithi134.dexlss 2024-03-22T07:36:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:03 smithi195 ceph-mon[82061]: Deploying daemon mds.cephfs.smithi134.dexlss on smithi134 2024-03-22T07:36:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:03 smithi195 ceph-mon[82061]: pgmap v176: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:03.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:03 smithi134 ceph-mon[93947]: Upgrade: Updating mds.cephfs.smithi134.dexlss 2024-03-22T07:36:03.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:03 smithi134 ceph-mon[93947]: Deploying daemon mds.cephfs.smithi134.dexlss on smithi134 2024-03-22T07:36:03.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:03 smithi134 ceph-mon[93947]: pgmap v176: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:03.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:04.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[93942]: 2024-03-22T07:36:04.486+0000 7f27b742e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:04.954 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:04.511+0000 7ffb3f9a0700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-03-22T07:36:04.955 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:04.511+0000 7ffb449aa700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-03-22T07:36:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:36:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: osdmap e82: 6 total, 6 up, 6 in 2024-03-22T07:36:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: Standby daemon mds.cephfs.smithi195.dayrmo assigned to filesystem cephfs as rank 0 2024-03-22T07:36:04.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:36:04.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-22T07:36:04.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:04 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi195.dayrmo=up:replay} 2 up:standby 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: osdmap e82: 6 total, 6 up, 6 in 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: Standby daemon mds.cephfs.smithi195.dayrmo assigned to filesystem cephfs as rank 0 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-22T07:36:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:04 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi195.dayrmo=up:replay} 2 up:standby 2024-03-22T07:36:05.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:05 smithi195 ceph-mon[82061]: pgmap v178: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:05 smithi134 ceph-mon[93947]: pgmap v178: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:36:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:07 smithi134 ceph-mon[93947]: pgmap v179: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 576 KiB/s rd, 0 op/s 2024-03-22T07:36:07.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:07 smithi195 ceph-mon[82061]: pgmap v179: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 576 KiB/s rd, 0 op/s 2024-03-22T07:36:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:09 smithi195 ceph-mon[82061]: pgmap v180: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 5.0 MiB/s rd, 2 op/s 2024-03-22T07:36:10.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:09 smithi134 ceph-mon[93947]: pgmap v180: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 5.0 MiB/s rd, 2 op/s 2024-03-22T07:36:11.853 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:11 smithi134 ceph-mon[93947]: pgmap v181: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-03-22T07:36:11.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:11 smithi195 ceph-mon[82061]: pgmap v181: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: pgmap v182: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: reconnect by client.24319 v1:192.168.0.1:0/439064909 after 0 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:reconnect 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi195.dayrmo=up:reconnect} 2 up:standby 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: reconnect by client.14526 v1:192.168.0.1:0/3944219376 after 0.00399992 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:13 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:14.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: pgmap v182: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-03-22T07:36:14.036 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: reconnect by client.24319 v1:192.168.0.1:0/439064909 after 0 2024-03-22T07:36:14.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:reconnect 2024-03-22T07:36:14.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi195.dayrmo=up:reconnect} 2 up:standby 2024-03-22T07:36:14.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: reconnect by client.14526 v1:192.168.0.1:0/3944219376 after 0.00399992 2024-03-22T07:36:14.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:14.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:14.037 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:13 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:14.870 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:14 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:rejoin 2024-03-22T07:36:14.871 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:14 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] up:boot 2024-03-22T07:36:14.871 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:14 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi195.dayrmo=up:rejoin} 3 up:standby 2024-03-22T07:36:14.871 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:14 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:36:14.871 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:14 smithi134 ceph-mon[93947]: daemon mds.cephfs.smithi195.dayrmo is now active in filesystem cephfs as rank 0 2024-03-22T07:36:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:14 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:rejoin 2024-03-22T07:36:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:14 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] up:boot 2024-03-22T07:36:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:14 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi195.dayrmo=up:rejoin} 3 up:standby 2024-03-22T07:36:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:14 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:36:14.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:14 smithi195 ceph-mon[82061]: daemon mds.cephfs.smithi195.dayrmo is now active in filesystem cephfs as rank 0 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 -- 172.21.15.134:0/130396871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 msgr2=0x7fee3c0fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 --2- 172.21.15.134:0/130396871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c0fe4b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fee2c004940 tx=0x7fee2c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 -- 172.21.15.134:0/130396871 shutdown_connections 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 --2- 172.21.15.134:0/130396871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c0fe4b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 --2- 172.21.15.134:0/130396871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 0x7fee3c0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 -- 172.21.15.134:0/130396871 >> 172.21.15.134:0/130396871 conn(0x7fee3c0f8510 msgr2=0x7fee3c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.887+0000 7fee4365f700 1 -- 172.21.15.134:0/130396871 shutdown_connections 2024-03-22T07:36:15.888 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 -- 172.21.15.134:0/130396871 wait complete. 2024-03-22T07:36:15.889 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:15 smithi134 ceph-mon[93947]: pgmap v183: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 204 B/s wr, 6 op/s 2024-03-22T07:36:15.889 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:15 smithi134 ceph-mon[93947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:36:15.889 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:15 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:36:15.889 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:15 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:active 2024-03-22T07:36:15.889 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:15 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi195.dayrmo=up:active} 3 up:standby 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 Processor -- start 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 -- start start 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 0x7fee3c10da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c10e560 con 0x7fee3c0fe040 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.888+0000 7fee4365f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c10edb0 con 0x7fee3c0fce40 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:15.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c10df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51054/0 (socket says 172.21.15.134:51054) 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 -- 172.21.15.134:0/863693515 learned_addr learned my addr 172.21.15.134:0/863693515 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee413fb700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 0x7fee3c10da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 -- 172.21.15.134:0/863693515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 msgr2=0x7fee3c10da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 0x7fee3c10da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 -- 172.21.15.134:0/863693515 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c005040 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee413fb700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 0x7fee3c10da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee40bfa700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c10df60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00b3b0 tx=0x7fee2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2c00e040 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee2c00bcc0 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c10f030 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2c01c630 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.889+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c10f570 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.890+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c05f5f0 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.891+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fee2c013980 con 0x7fee3c0fe040 2024-03-22T07:36:15.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.891+0000 7fee31ffb700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fee2806d380 0x7fee2806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:15.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.892+0000 7fee413fb700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fee2806d380 0x7fee2806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:15.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.892+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fee2c08d5a0 con 0x7fee3c0fe040 2024-03-22T07:36:15.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.892+0000 7fee413fb700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fee2806d380 0x7fee2806f830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee38009fd0 tx=0x7fee38009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:15.896 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:15.896+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee2c05ab80 con 0x7fee3c0fe040 2024-03-22T07:36:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:15 smithi195 ceph-mon[82061]: pgmap v183: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 204 B/s wr, 6 op/s 2024-03-22T07:36:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:15 smithi195 ceph-mon[82061]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:36:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:15 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:36:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:15 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] up:active 2024-03-22T07:36:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:15 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi195.dayrmo=up:active} 3 up:standby 2024-03-22T07:36:16.123 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.123+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee3c10f950 con 0x7fee2806d380 2024-03-22T07:36:16.124 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.124+0000 7fee31ffb700 1 -- 172.21.15.134:0/863693515 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fee3c10f950 con 0x7fee2806d380 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fee2806d380 msgr2=0x7fee2806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fee2806d380 0x7fee2806f830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee38009fd0 tx=0x7fee38009f00 comp rx=0 tx=0).stop 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 msgr2=0x7fee3c10df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c10df60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00b3b0 tx=0x7fee2c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 shutdown_connections 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fee2806d380 0x7fee2806f830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.126+0000 7fee4365f700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee3c0fce40 0x7fee3c10da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.127+0000 7fee4365f700 1 --2- 172.21.15.134:0/863693515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee3c0fe040 0x7fee3c10df60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.127+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 >> 172.21.15.134:0/863693515 conn(0x7fee3c0f8510 msgr2=0x7fee3c0f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.127+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 shutdown_connections 2024-03-22T07:36:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.127+0000 7fee4365f700 1 -- 172.21.15.134:0/863693515 wait complete. 2024-03-22T07:36:16.137 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:36:16.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 -- 172.21.15.134:0/777035811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 msgr2=0x7f15780fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 --2- 172.21.15.134:0/777035811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f15780fd310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1574004940 tx=0x7f1574009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 -- 172.21.15.134:0/777035811 shutdown_connections 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 --2- 172.21.15.134:0/777035811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15780fe0d0 0x7f15780fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 --2- 172.21.15.134:0/777035811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f15780fd310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 -- 172.21.15.134:0/777035811 >> 172.21.15.134:0/777035811 conn(0x7f15780f8560 msgr2=0x7f15780fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 -- 172.21.15.134:0/777035811 shutdown_connections 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.230+0000 7f157f31a700 1 -- 172.21.15.134:0/777035811 wait complete. 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157f31a700 1 Processor -- start 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157f31a700 1 -- start start 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157f31a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f1578071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157f31a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15780fe0d0 0x7f1578070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157f31a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1578070950 con 0x7f15780fcee0 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157f31a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1578070ac0 con 0x7f15780fe0d0 2024-03-22T07:36:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f1578071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f1578071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51058/0 (socket says 172.21.15.134:51058) 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 -- 172.21.15.134:0/3852804744 learned_addr learned my addr 172.21.15.134:0/3852804744 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157c8b5700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15780fe0d0 0x7f1578070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 -- 172.21.15.134:0/3852804744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15780fe0d0 msgr2=0x7f1578070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15780fe0d0 0x7f1578070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 -- 172.21.15.134:0/3852804744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1574005040 con 0x7f15780fcee0 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.231+0000 7f157d0b6700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f1578071e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f157400b3b0 tx=0x7f1574009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.232+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157400e040 con 0x7f15780fcee0 2024-03-22T07:36:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.232+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f157400bcc0 con 0x7f15780fcee0 2024-03-22T07:36:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.232+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1578070d40 con 0x7f15780fcee0 2024-03-22T07:36:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.232+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157401c630 con 0x7f15780fcee0 2024-03-22T07:36:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.232+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1578115a80 con 0x7f15780fcee0 2024-03-22T07:36:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.233+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157805f5f0 con 0x7f15780fcee0 2024-03-22T07:36:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.233+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f15740139f0 con 0x7f15780fcee0 2024-03-22T07:36:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.234+0000 7f156dffb700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f156406d380 0x7f156406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.234+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f157408d540 con 0x7f15780fcee0 2024-03-22T07:36:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.234+0000 7f157c8b5700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f156406d380 0x7f156406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.234+0000 7f157c8b5700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f156406d380 0x7f156406f830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1568009b10 tx=0x7f1568008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:16.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.238+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1574057090 con 0x7f15780fcee0 2024-03-22T07:36:16.463 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.463+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15781023f0 con 0x7f156406d380 2024-03-22T07:36:16.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.464+0000 7f156dffb700 1 -- 172.21.15.134:0/3852804744 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15781023f0 con 0x7f156406d380 2024-03-22T07:36:16.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f156406d380 msgr2=0x7f156406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f156406d380 0x7f156406f830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1568009b10 tx=0x7f1568008040 comp rx=0 tx=0).stop 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 msgr2=0x7f1578071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f1578071e40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f157400b3b0 tx=0x7f1574009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 shutdown_connections 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f156406d380 0x7f156406f830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15780fcee0 0x7f1578071e40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 --2- 172.21.15.134:0/3852804744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15780fe0d0 0x7f1578070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 >> 172.21.15.134:0/3852804744 conn(0x7f15780f8560 msgr2=0x7f15780f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 shutdown_connections 2024-03-22T07:36:16.470 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.467+0000 7f157f31a700 1 -- 172.21.15.134:0/3852804744 wait complete. 2024-03-22T07:36:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.575+0000 7ff3663e2700 1 -- 172.21.15.134:0/143892350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 msgr2=0x7ff3600fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.575+0000 7ff3663e2700 1 --2- 172.21.15.134:0/143892350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff3600fd3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff354004940 tx=0x7ff354009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- 172.21.15.134:0/143892350 shutdown_connections 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 --2- 172.21.15.134:0/143892350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff3600fd3f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 --2- 172.21.15.134:0/143892350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3600fbcd0 0x7ff3600fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- 172.21.15.134:0/143892350 >> 172.21.15.134:0/143892350 conn(0x7ff3600f7430 msgr2=0x7ff3600f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- 172.21.15.134:0/143892350 shutdown_connections 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- 172.21.15.134:0/143892350 wait complete. 2024-03-22T07:36:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 Processor -- start 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- start start 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3600fbcd0 0x7ff36010d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff36010de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36010e470 con 0x7ff3600fcf80 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.576+0000 7ff3663e2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36010e5e0 con 0x7ff3600fbcd0 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff36010de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff36010de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51068/0 (socket says 172.21.15.134:51068) 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 -- 172.21.15.134:0/1514242004 learned_addr learned my addr 172.21.15.134:0/1514242004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35ffff700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3600fbcd0 0x7ff36010d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 -- 172.21.15.134:0/1514242004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3600fbcd0 msgr2=0x7ff36010d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3600fbcd0 0x7ff36010d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 -- 172.21.15.134:0/1514242004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354005040 con 0x7ff3600fcf80 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35f7fe700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff36010de70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff354009150 tx=0x7ff354009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff35400e040 con 0x7ff3600fcf80 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff35400bbf0 con 0x7ff3600fcf80 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360112fe0 con 0x7ff3600fcf80 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff35401c630 con 0x7ff3600fcf80 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.577+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff360113520 con 0x7ff3600fcf80 2024-03-22T07:36:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.578+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36004c710 con 0x7ff3600fcf80 2024-03-22T07:36:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.579+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff35400bd60 con 0x7ff3600fcf80 2024-03-22T07:36:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.579+0000 7ff35cff9700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff34806d380 0x7ff34806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.579+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ff35408dc70 con 0x7ff3600fcf80 2024-03-22T07:36:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.579+0000 7ff35ffff700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff34806d380 0x7ff34806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.580+0000 7ff35ffff700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff34806d380 0x7ff34806f830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff350004f40 tx=0x7ff35000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:16.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.584+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff35405b250 con 0x7ff3600fcf80 2024-03-22T07:36:16.790 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.790+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff36002b5d0 con 0x7ff34806d380 2024-03-22T07:36:16.800 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.801+0000 7ff35cff9700 1 -- 172.21.15.134:0/1514242004 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff36002b5d0 con 0x7ff34806d380 2024-03-22T07:36:16.800 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:36:16.800 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 20s ago 15m 24.6M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (4m) 20s ago 15m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (3m) 40s ago 14m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (6m) 20s ago 15m 83.2M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 starting - - - - 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (26s) 20s ago 10m 14.7M - 19.0.0-1667-gdb0330b1 4f325f8440e9 8a0992eba74a 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (10m) 40s ago 10m 15.5M - 17.2.7-726-g9c4e0c34 837124da804f 2bd104bd0820 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (10m) 40s ago 10m 14.9M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (6m) 20s ago 16m 507M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (5m) 40s ago 14m 450M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (5m) 20s ago 17m 51.5M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (4m) 40s ago 14m 38.8M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 20s ago 15m 15.2M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 40s ago 14m 15.2M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:36:16.801 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (3m) 20s ago 13m 101M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:36:16.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 20s ago 13m 107M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:36:16.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 20s ago 12m 98.1M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:36:16.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (109s) 40s ago 12m 116M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:36:16.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (76s) 40s ago 12m 108M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:36:16.802 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (43s) 40s ago 11m 11.7M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:36:16.802 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 20s ago 15m 59.9M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff34806d380 msgr2=0x7ff34806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff34806d380 0x7ff34806f830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff350004f40 tx=0x7ff35000b040 comp rx=0 tx=0).stop 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 msgr2=0x7ff36010de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff36010de70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff354009150 tx=0x7ff354009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 shutdown_connections 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff34806d380 0x7ff34806f830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff3600fbcd0 0x7ff36010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 --2- 172.21.15.134:0/1514242004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3600fcf80 0x7ff36010de70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 >> 172.21.15.134:0/1514242004 conn(0x7ff3600f7430 msgr2=0x7ff3600667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 shutdown_connections 2024-03-22T07:36:16.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.803+0000 7ff3663e2700 1 -- 172.21.15.134:0/1514242004 wait complete. 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.929+0000 7fc347a91700 1 -- 172.21.15.134:0/233899716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fbcd0 msgr2=0x7fc3400fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.929+0000 7fc347a91700 1 --2- 172.21.15.134:0/233899716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fbcd0 0x7fc3400fc0e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc33c004940 tx=0x7fc33c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.929+0000 7fc347a91700 1 -- 172.21.15.134:0/233899716 shutdown_connections 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.929+0000 7fc347a91700 1 --2- 172.21.15.134:0/233899716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3400fcf80 0x7fc3400fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.929+0000 7fc347a91700 1 --2- 172.21.15.134:0/233899716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fbcd0 0x7fc3400fc0e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.929+0000 7fc347a91700 1 -- 172.21.15.134:0/233899716 >> 172.21.15.134:0/233899716 conn(0x7fc3400f7450 msgr2=0x7fc3400f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 -- 172.21.15.134:0/233899716 shutdown_connections 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 -- 172.21.15.134:0/233899716 wait complete. 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 Processor -- start 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 -- start start 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3400fbcd0 0x7fc34010d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 0x7fc34010de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34010e460 con 0x7fc3400fcf80 2024-03-22T07:36:16.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc347a91700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34010e5d0 con 0x7fc3400fbcd0 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc34502c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 0x7fc34010de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc34502c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 0x7fc34010de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51078/0 (socket says 172.21.15.134:51078) 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc34502c700 1 -- 172.21.15.134:0/1628428533 learned_addr learned my addr 172.21.15.134:0/1628428533 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.930+0000 7fc34582d700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3400fbcd0 0x7fc34010d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc34502c700 1 -- 172.21.15.134:0/1628428533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3400fbcd0 msgr2=0x7fc34010d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc34502c700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3400fbcd0 0x7fc34010d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc34502c700 1 -- 172.21.15.134:0/1628428533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c005040 con 0x7fc3400fcf80 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc34502c700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 0x7fc34010de60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc330002a50 tx=0x7fc3300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc330007cc0 con 0x7fc3400fcf80 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc33000f040 con 0x7fc3400fcf80 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc340113030 con 0x7fc3400fcf80 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc33000da30 con 0x7fc3400fcf80 2024-03-22T07:36:16.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.931+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3401135c0 con 0x7fc3400fcf80 2024-03-22T07:36:16.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.932+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34004c710 con 0x7fc3400fcf80 2024-03-22T07:36:16.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.932+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fc33000db90 con 0x7fc3400fcf80 2024-03-22T07:36:16.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.933+0000 7fc3367fc700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc32c06d380 0x7fc32c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:16.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.933+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc33008c600 con 0x7fc3400fcf80 2024-03-22T07:36:16.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.933+0000 7fc34582d700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc32c06d380 0x7fc32c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:16.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.933+0000 7fc34582d700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc32c06d380 0x7fc32c06f830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00b970 tx=0x7fc33c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:16.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:16.937+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc330059be0 con 0x7fc3400fcf80 2024-03-22T07:36:17.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.216+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3401058c0 con 0x7fc3400fcf80 2024-03-22T07:36:17.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.217+0000 7fc3367fc700 1 -- 172.21.15.134:0/1628428533 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fc330059770 con 0x7fc3400fcf80 2024-03-22T07:36:17.216 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2, 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:17.217 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:36:17.218 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 2, 2024-03-22T07:36:17.218 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 12 2024-03-22T07:36:17.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:36:17.218 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc32c06d380 msgr2=0x7fc32c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc32c06d380 0x7fc32c06f830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00b970 tx=0x7fc33c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 msgr2=0x7fc34010de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 0x7fc34010de60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc330002a50 tx=0x7fc3300046b0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 shutdown_connections 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc32c06d380 0x7fc32c06f830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc3400fbcd0 0x7fc34010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 --2- 172.21.15.134:0/1628428533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3400fcf80 0x7fc34010de60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 >> 172.21.15.134:0/1628428533 conn(0x7fc3400f7450 msgr2=0x7fc3400f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 shutdown_connections 2024-03-22T07:36:17.219 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.219+0000 7fc347a91700 1 -- 172.21.15.134:0/1628428533 wait complete. 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 -- 172.21.15.134:0/310759954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe554066f50 msgr2=0x7fe5540ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 --2- 172.21.15.134:0/310759954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe554066f50 0x7fe5540ff9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009ce0 tx=0x7fe54c004d10 comp rx=0 tx=0).stop 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 -- 172.21.15.134:0/310759954 shutdown_connections 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 --2- 172.21.15.134:0/310759954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5540fff00 0x7fe554102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 --2- 172.21.15.134:0/310759954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe554066f50 0x7fe5540ff9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 -- 172.21.15.134:0/310759954 >> 172.21.15.134:0/310759954 conn(0x7fe5540f7450 msgr2=0x7fe5540f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 -- 172.21.15.134:0/310759954 shutdown_connections 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.322+0000 7fe55bc74700 1 -- 172.21.15.134:0/310759954 wait complete. 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55bc74700 1 Processor -- start 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55bc74700 1 -- start start 2024-03-22T07:36:17.323 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55bc74700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe554066f50 0x7fe55410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55bc74700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 0x7fe554110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55bc74700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5541108b0 con 0x7fe5540fff00 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55bc74700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554115250 con 0x7fe554066f50 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55920f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 0x7fe554110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55920f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 0x7fe554110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51094/0 (socket says 172.21.15.134:51094) 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55920f700 1 -- 172.21.15.134:0/1853794675 learned_addr learned my addr 172.21.15.134:0/1853794675 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe559a10700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe554066f50 0x7fe55410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55920f700 1 -- 172.21.15.134:0/1853794675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe554066f50 msgr2=0x7fe55410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55920f700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe554066f50 0x7fe55410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.324 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.323+0000 7fe55920f700 1 -- 172.21.15.134:0/1853794675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009940 con 0x7fe5540fff00 2024-03-22T07:36:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.324+0000 7fe55920f700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 0x7fe554110260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe548002a50 tx=0x7fe5480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.324+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe548007cc0 con 0x7fe5540fff00 2024-03-22T07:36:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.324+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe54800f040 con 0x7fe5540fff00 2024-03-22T07:36:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.324+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5541153f0 con 0x7fe5540fff00 2024-03-22T07:36:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.324+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54800d9d0 con 0x7fe5540fff00 2024-03-22T07:36:17.325 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.324+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5541159b0 con 0x7fe5540fff00 2024-03-22T07:36:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.325+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fe54800dc40 con 0x7fe5540fff00 2024-03-22T07:36:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.325+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5540f8f80 con 0x7fe5540fff00 2024-03-22T07:36:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.326+0000 7fe5527fc700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe53c06d380 0x7fe53c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.326+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe54808c6e0 con 0x7fe5540fff00 2024-03-22T07:36:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.326+0000 7fe559a10700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe53c06d380 0x7fe53c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:17.326 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.326+0000 7fe559a10700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe53c06d380 0x7fe53c06f830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009cb0 tx=0x7fe54c004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:17.330 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.331+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe548056110 con 0x7fe5540fff00 2024-03-22T07:36:17.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.573+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe55402b340 con 0x7fe5540fff00 2024-03-22T07:36:17.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.574+0000 7fe5527fc700 1 -- 172.21.15.134:0/1853794675 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1856 (secure 0 0 0) 0x7fe5480597d0 con 0x7fe5540fff00 2024-03-22T07:36:17.573 INFO:teuthology.orchestra.run.smithi134.stdout:e21 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 21 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:36:13.656565+0000 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:36:17.574 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 82 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=24267} 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:36:17.575 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{0:24267} state up:active seq 155 join_fscid=1 addr [v2:172.21.15.195:6824/4087242582,v1:172.21.15.195:6825/4087242582] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:24279} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:34400} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:36:17.576 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe53c06d380 msgr2=0x7fe53c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe53c06d380 0x7fe53c06f830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009cb0 tx=0x7fe54c004d10 comp rx=0 tx=0).stop 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 msgr2=0x7fe554110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 0x7fe554110260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe548002a50 tx=0x7fe5480046b0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 shutdown_connections 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe53c06d380 0x7fe53c06f830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe554066f50 0x7fe55410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 --2- 172.21.15.134:0/1853794675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5540fff00 0x7fe554110260 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 >> 172.21.15.134:0/1853794675 conn(0x7fe5540f7450 msgr2=0x7fe5540fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:17.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 shutdown_connections 2024-03-22T07:36:17.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.577+0000 7fe55bc74700 1 -- 172.21.15.134:0/1853794675 wait complete. 2024-03-22T07:36:17.578 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 21 2024-03-22T07:36:17.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/4203829469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 msgr2=0x7f3b240fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/4203829469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b240fd400 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b18004940 tx=0x7f3b18009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:17.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/4203829469 shutdown_connections 2024-03-22T07:36:17.688 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/4203829469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b240fd400 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/4203829469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 0x7f3b240fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/4203829469 >> 172.21.15.134:0/4203829469 conn(0x7f3b240f7440 msgr2=0x7f3b240f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:17.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/4203829469 shutdown_connections 2024-03-22T07:36:17.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/4203829469 wait complete. 2024-03-22T07:36:17.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.688+0000 7f3b2a3a2700 1 Processor -- start 2024-03-22T07:36:17.689 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b2a3a2700 1 -- start start 2024-03-22T07:36:17.691 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b2a3a2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 0x7f3b2410c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:17.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b2a3a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b2410cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:17.693 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b2a3a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2410d3f0 con 0x7f3b240fcf90 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b2a3a2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2410dc40 con 0x7f3b240fbce0 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b237fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b2410cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b237fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b2410cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51110/0 (socket says 172.21.15.134:51110) 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b237fe700 1 -- 172.21.15.134:0/2860185957 learned_addr learned my addr 172.21.15.134:0/2860185957 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b23fff700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 0x7f3b2410c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b237fe700 1 -- 172.21.15.134:0/2860185957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 msgr2=0x7f3b2410c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b237fe700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 0x7f3b2410c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b237fe700 1 -- 172.21.15.134:0/2860185957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18005040 con 0x7f3b240fcf90 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.689+0000 7f3b23fff700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 0x7f3b2410c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.690+0000 7f3b237fe700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b2410cdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b18013870 tx=0x7f3b18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.690+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b18021070 con 0x7f3b240fcf90 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.690+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2410dec0 con 0x7f3b240fcf90 2024-03-22T07:36:17.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.690+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b1801c400 con 0x7f3b240fcf90 2024-03-22T07:36:17.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.690+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b1800e070 con 0x7f3b240fcf90 2024-03-22T07:36:17.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.690+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2410e400 con 0x7f3b240fcf90 2024-03-22T07:36:17.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.691+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2405f5f0 con 0x7f3b240fcf90 2024-03-22T07:36:17.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.692+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f3b1801ca20 con 0x7f3b240fcf90 2024-03-22T07:36:17.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.692+0000 7f3b20ff9700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b0c06d380 0x7f3b0c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:17.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.692+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f3b1808dbe0 con 0x7f3b240fcf90 2024-03-22T07:36:17.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.692+0000 7f3b23fff700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b0c06d380 0x7f3b0c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:17.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.693+0000 7f3b23fff700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b0c06d380 0x7f3b0c06f830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c004b90 tx=0x7f3b1c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:17.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.697+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3b1805b1c0 con 0x7f3b240fcf90 2024-03-22T07:36:17.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:17 smithi134 ceph-mon[93947]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:17.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:17 smithi134 ceph-mon[93947]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:17.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:17 smithi134 ceph-mon[93947]: pgmap v184: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:36:17.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:17 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1628428533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:17.875 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:17 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1853794675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:36:17.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.926+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b2410e6c0 con 0x7f3b0c06d380 2024-03-22T07:36:17.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.928+0000 7f3b20ff9700 1 -- 172.21.15.134:0/2860185957 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3b2410e6c0 con 0x7f3b0c06d380 2024-03-22T07:36:17.927 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:36:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:36:17.927 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "14/21 daemons upgraded", 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:36:17.928 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:36:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b0c06d380 msgr2=0x7f3b0c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b0c06d380 0x7f3b0c06f830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c004b90 tx=0x7f3b1c00b040 comp rx=0 tx=0).stop 2024-03-22T07:36:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 msgr2=0x7f3b2410cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b2410cdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b18013870 tx=0x7f3b18009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 shutdown_connections 2024-03-22T07:36:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3b0c06d380 0x7f3b0c06f830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3b240fbce0 0x7f3b2410c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 --2- 172.21.15.134:0/2860185957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b240fcf90 0x7f3b2410cdf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:17.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 >> 172.21.15.134:0/2860185957 conn(0x7f3b240f7440 msgr2=0x7f3b240f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:17.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 shutdown_connections 2024-03-22T07:36:17.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:17.930+0000 7f3b2a3a2700 1 -- 172.21.15.134:0/2860185957 wait complete. 2024-03-22T07:36:17.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:17 smithi195 ceph-mon[82061]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:17.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:17 smithi195 ceph-mon[82061]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:17 smithi195 ceph-mon[82061]: pgmap v184: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:36:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:17 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1628428533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:17 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1853794675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:36:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 -- 172.21.15.134:0/942795019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1710066b70 msgr2=0x7f17100ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 --2- 172.21.15.134:0/942795019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1710066b70 0x7f17100ffa50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1700004940 tx=0x7f1700009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 -- 172.21.15.134:0/942795019 shutdown_connections 2024-03-22T07:36:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 --2- 172.21.15.134:0/942795019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17100fff90 0x7f17101023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 --2- 172.21.15.134:0/942795019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1710066b70 0x7f17100ffa50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.038 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 -- 172.21.15.134:0/942795019 >> 172.21.15.134:0/942795019 conn(0x7f17100f74e0 msgr2=0x7f17100f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:18.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 -- 172.21.15.134:0/942795019 shutdown_connections 2024-03-22T07:36:18.039 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.038+0000 7f171579a700 1 -- 172.21.15.134:0/942795019 wait complete. 2024-03-22T07:36:18.040 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f171579a700 1 Processor -- start 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f171579a700 1 -- start start 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f171579a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710066b70 0x7f171010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f171579a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 0x7f171010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f171579a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171010e5a0 con 0x7f17100fff90 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f171579a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171010edf0 con 0x7f1710066b70 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 0x7f171010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 0x7f171010dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:51120/0 (socket says 172.21.15.134:51120) 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170e7fc700 1 -- 172.21.15.134:0/3878635118 learned_addr learned my addr 172.21.15.134:0/3878635118 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170effd700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710066b70 0x7f171010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170e7fc700 1 -- 172.21.15.134:0/3878635118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710066b70 msgr2=0x7f171010da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170e7fc700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710066b70 0x7f171010da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170e7fc700 1 -- 172.21.15.134:0/3878635118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700005040 con 0x7f17100fff90 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.039+0000 7f170effd700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710066b70 0x7f171010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:36:18.041 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.040+0000 7f170e7fc700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 0x7f171010dfa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1704002a50 tx=0x7f17040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.040+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1704007cc0 con 0x7f17100fff90 2024-03-22T07:36:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.040+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f170400f040 con 0x7f17100fff90 2024-03-22T07:36:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.040+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171010f0d0 con 0x7f17100fff90 2024-03-22T07:36:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.040+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1704009640 con 0x7f17100fff90 2024-03-22T07:36:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.040+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171010f610 con 0x7f17100fff90 2024-03-22T07:36:18.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.041+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171005f5f0 con 0x7f17100fff90 2024-03-22T07:36:18.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.042+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f17040097a0 con 0x7f17100fff90 2024-03-22T07:36:18.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.042+0000 7f16f77fe700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f16f80717a0 0x7f16f8073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:18.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.042+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f170408c680 con 0x7f17100fff90 2024-03-22T07:36:18.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.042+0000 7f170effd700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f16f80717a0 0x7f16f8073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:18.043 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.043+0000 7f170effd700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f16f80717a0 0x7f16f8073c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f170000b3b0 tx=0x7f1700009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:18.046 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.047+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1704059c60 con 0x7f17100fff90 2024-03-22T07:36:18.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.335+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f171004bed0 con 0x7f17100fff90 2024-03-22T07:36:18.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.335+0000 7f16f77fe700 1 -- 172.21.15.134:0/3878635118 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f17040597f0 con 0x7f17100fff90 2024-03-22T07:36:18.336 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:36:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f16f80717a0 msgr2=0x7f16f8073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f16f80717a0 0x7f16f8073c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f170000b3b0 tx=0x7f1700009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:18.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 msgr2=0x7f171010dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 0x7f171010dfa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1704002a50 tx=0x7f17040046b0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 shutdown_connections 2024-03-22T07:36:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f16f80717a0 0x7f16f8073c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1710066b70 0x7f171010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 --2- 172.21.15.134:0/3878635118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17100fff90 0x7f171010dfa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:18.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 >> 172.21.15.134:0/3878635118 conn(0x7f17100f74e0 msgr2=0x7f17100f78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:18.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 shutdown_connections 2024-03-22T07:36:18.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:18.338+0000 7f171579a700 1 -- 172.21.15.134:0/3878635118 wait complete. 2024-03-22T07:36:18.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:18 smithi195 ceph-mon[82061]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:18.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:18.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:18.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:18 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3878635118' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:36:18.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:19.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:18 smithi134 ceph-mon[93947]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:18 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3878635118' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:36:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:19.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:19 smithi134 ceph-mon[93947]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:19.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:19 smithi134 ceph-mon[93947]: pgmap v185: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 597 B/s wr, 7 op/s 2024-03-22T07:36:19.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:19.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:19.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:19 smithi195 ceph-mon[82061]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:19.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:19 smithi195 ceph-mon[82061]: pgmap v185: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 597 B/s wr, 7 op/s 2024-03-22T07:36:19.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:21.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:21 smithi195 ceph-mon[82061]: pgmap v186: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-03-22T07:36:22.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:21 smithi134 ceph-mon[93947]: pgmap v186: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-03-22T07:36:23.928 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: pgmap v187: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.dayrmo"]}]: dispatch 2024-03-22T07:36:23.929 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:23 smithi195 ceph-mon[82061]: Upgrade: It appears safe to stop mds.cephfs.smithi195.dayrmo 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: pgmap v187: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.dayrmo"]}]: dispatch 2024-03-22T07:36:24.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:23 smithi134 ceph-mon[93947]: Upgrade: It appears safe to stop mds.cephfs.smithi195.dayrmo 2024-03-22T07:36:25.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:25 smithi195 ceph-mon[82061]: Upgrade: Updating mds.cephfs.smithi195.dayrmo 2024-03-22T07:36:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:36:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:25 smithi195 ceph-mon[82061]: Deploying daemon mds.cephfs.smithi195.dayrmo on smithi195 2024-03-22T07:36:25.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:25 smithi195 ceph-mon[82061]: pgmap v188: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-22T07:36:25.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:25 smithi134 ceph-mon[93947]: Upgrade: Updating mds.cephfs.smithi195.dayrmo 2024-03-22T07:36:25.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:25.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.dayrmo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:36:25.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:25.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:25 smithi134 ceph-mon[93947]: Deploying daemon mds.cephfs.smithi195.dayrmo on smithi195 2024-03-22T07:36:25.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:25 smithi134 ceph-mon[93947]: pgmap v188: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: osdmap e83: 6 total, 6 up, 6 in 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: Standby daemon mds.cephfs.smithi195.jursxo assigned to filesystem cephfs as rank 0 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-22T07:36:26.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi195.jursxo=up:replay} 2 up:standby 2024-03-22T07:36:26.705 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:26.426+0000 7ffb3e19d700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2024-03-22T07:36:26.706 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:26.426+0000 7ffb419a4700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-03-22T07:36:26.706 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:26.427+0000 7ffb449aa700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2024-03-22T07:36:26.706 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:26.428+0000 7ffb3f9a0700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 10 2024-03-22T07:36:26.706 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:26 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:26.430+0000 7ffb3f19f700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 17 2024-03-22T07:36:26.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[93942]: 2024-03-22T07:36:26.407+0000 7f27b742e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:26.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:36:26.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:26.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: osdmap e83: 6 total, 6 up, 6 in 2024-03-22T07:36:26.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: Standby daemon mds.cephfs.smithi195.jursxo assigned to filesystem cephfs as rank 0 2024-03-22T07:36:26.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:36:26.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-22T07:36:26.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:26 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi195.jursxo=up:replay} 2 up:standby 2024-03-22T07:36:27.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:27 smithi134 ceph-mon[93947]: pgmap v190: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-03-22T07:36:27.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:27 smithi195 ceph-mon[82061]: pgmap v190: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-03-22T07:36:29.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:29 smithi195 ceph-mon[82061]: pgmap v191: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.3 KiB/s wr, 4 op/s 2024-03-22T07:36:29.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:36:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:29 smithi134 ceph-mon[93947]: pgmap v191: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.3 KiB/s wr, 4 op/s 2024-03-22T07:36:30.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:36:31.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:31 smithi134 ceph-mon[93947]: pgmap v192: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 3 op/s 2024-03-22T07:36:31.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:31 smithi195 ceph-mon[82061]: pgmap v192: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 3 op/s 2024-03-22T07:36:33.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:33 smithi195 ceph-mon[82061]: pgmap v193: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-03-22T07:36:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:33 smithi134 ceph-mon[93947]: pgmap v193: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-03-22T07:36:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:35 smithi195 ceph-mon[82061]: pgmap v194: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-22T07:36:36.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:35 smithi134 ceph-mon[93947]: pgmap v194: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-22T07:36:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:36 smithi195 ceph-mon[82061]: reconnect by client.24319 v1:192.168.0.1:0/439064909 after 0 2024-03-22T07:36:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:36 smithi195 ceph-mon[82061]: reconnect by client.14526 v1:192.168.0.1:0/3944219376 after 0.000999981 2024-03-22T07:36:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:36 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:reconnect 2024-03-22T07:36:36.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:36 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi195.jursxo=up:reconnect} 2 up:standby 2024-03-22T07:36:37.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:36 smithi134 ceph-mon[93947]: reconnect by client.24319 v1:192.168.0.1:0/439064909 after 0 2024-03-22T07:36:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:36 smithi134 ceph-mon[93947]: reconnect by client.14526 v1:192.168.0.1:0/3944219376 after 0.000999981 2024-03-22T07:36:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:36 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:reconnect 2024-03-22T07:36:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:36 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi195.jursxo=up:reconnect} 2 up:standby 2024-03-22T07:36:37.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:37 smithi134 ceph-mon[93947]: pgmap v195: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-03-22T07:36:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:37 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:rejoin 2024-03-22T07:36:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:37 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi195.jursxo=up:rejoin} 2 up:standby 2024-03-22T07:36:37.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:37 smithi134 ceph-mon[93947]: daemon mds.cephfs.smithi195.jursxo is now active in filesystem cephfs as rank 0 2024-03-22T07:36:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:37 smithi195 ceph-mon[82061]: pgmap v195: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-03-22T07:36:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:37 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:rejoin 2024-03-22T07:36:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:37 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi195.jursxo=up:rejoin} 2 up:standby 2024-03-22T07:36:37.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:37 smithi195 ceph-mon[82061]: daemon mds.cephfs.smithi195.jursxo is now active in filesystem cephfs as rank 0 2024-03-22T07:36:38.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:38 smithi195 ceph-mon[82061]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:36:38.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:38 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:36:38.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:38 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:active 2024-03-22T07:36:38.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:38 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi195.jursxo=up:active} 2 up:standby 2024-03-22T07:36:39.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:38 smithi134 ceph-mon[93947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:36:39.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:38 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:36:39.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:38 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] up:active 2024-03-22T07:36:39.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:38 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi195.jursxo=up:active} 2 up:standby 2024-03-22T07:36:39.697 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:39 smithi195 ceph-mon[82061]: pgmap v196: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-03-22T07:36:40.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:39 smithi134 ceph-mon[93947]: pgmap v196: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: pgmap v197: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6824/2563834080,v1:172.21.15.195:6825/2563834080] up:boot 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi195.jursxo=up:active} 3 up:standby 2024-03-22T07:36:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: pgmap v197: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6824/2563834080,v1:172.21.15.195:6825/2563834080] up:boot 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi195.jursxo=up:active} 3 up:standby 2024-03-22T07:36:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:36:43.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:43 smithi195 ceph-mon[82061]: pgmap v198: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 170 B/s wr, 4 op/s 2024-03-22T07:36:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:43 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:44.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:43 smithi134 ceph-mon[93947]: pgmap v198: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 170 B/s wr, 4 op/s 2024-03-22T07:36:44.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:44.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:43 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:45.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:45 smithi195 ceph-mon[82061]: pgmap v199: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-03-22T07:36:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:46.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:45 smithi134 ceph-mon[93947]: pgmap v199: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-03-22T07:36:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:47.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:47 smithi195 ceph-mon[82061]: pgmap v200: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-22T07:36:48.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:47 smithi134 ceph-mon[93947]: pgmap v200: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 -- 172.21.15.134:0/3428567448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fe040 msgr2=0x7f15500fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 --2- 172.21.15.134:0/3428567448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fe040 0x7f15500fe4b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f153c004940 tx=0x7f153c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 -- 172.21.15.134:0/3428567448 shutdown_connections 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 --2- 172.21.15.134:0/3428567448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fe040 0x7f15500fe4b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 --2- 172.21.15.134:0/3428567448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15500fce40 0x7f15500fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 -- 172.21.15.134:0/3428567448 >> 172.21.15.134:0/3428567448 conn(0x7f15500f8550 msgr2=0x7f15500fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:48.453 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 -- 172.21.15.134:0/3428567448 shutdown_connections 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.451+0000 7f1556c17700 1 -- 172.21.15.134:0/3428567448 wait complete. 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f1556c17700 1 Processor -- start 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f1556c17700 1 -- start start 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f1556c17700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 0x7f155010d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f1556c17700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15500fe040 0x7f155010ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f1556c17700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155010e4d0 con 0x7f15500fce40 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f1556c17700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155010e640 con 0x7f15500fe040 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f15549b3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 0x7f155010d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f15549b3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 0x7f155010d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53256/0 (socket says 172.21.15.134:53256) 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.452+0000 7f15549b3700 1 -- 172.21.15.134:0/2207560261 learned_addr learned my addr 172.21.15.134:0/2207560261 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f154ffff700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15500fe040 0x7f155010ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f15549b3700 1 -- 172.21.15.134:0/2207560261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15500fe040 msgr2=0x7f155010ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:48.454 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f15549b3700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15500fe040 0x7f155010ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f15549b3700 1 -- 172.21.15.134:0/2207560261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c005040 con 0x7f15500fce40 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f15549b3700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 0x7f155010d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1544002a80 tx=0x7f1544004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1544007cc0 con 0x7f15500fce40 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f154400f040 con 0x7f15500fce40 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1550112fa0 con 0x7f15500fce40 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154400da30 con 0x7f15500fce40 2024-03-22T07:36:48.455 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.453+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1550113530 con 0x7f15500fce40 2024-03-22T07:36:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.454+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155004c710 con 0x7f15500fce40 2024-03-22T07:36:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.455+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f154400db90 con 0x7f15500fce40 2024-03-22T07:36:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.455+0000 7f154d7fa700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f154006d380 0x7f154006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.455+0000 7f154ffff700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f154006d380 0x7f154006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.455+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f154408c710 con 0x7f15500fce40 2024-03-22T07:36:48.456 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.456+0000 7f154ffff700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f154006d380 0x7f154006f830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f153c00b970 tx=0x7f153c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:48.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.460+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1544059c20 con 0x7f15500fce40 2024-03-22T07:36:48.678 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.678+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15501137e0 con 0x7f154006d380 2024-03-22T07:36:48.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.679+0000 7f154d7fa700 1 -- 172.21.15.134:0/2207560261 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15501137e0 con 0x7f154006d380 2024-03-22T07:36:48.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f154006d380 msgr2=0x7f154006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:48.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f154006d380 0x7f154006f830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f153c00b970 tx=0x7f153c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:48.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 msgr2=0x7f155010d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:48.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 0x7f155010d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1544002a80 tx=0x7f1544004600 comp rx=0 tx=0).stop 2024-03-22T07:36:48.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 shutdown_connections 2024-03-22T07:36:48.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f154006d380 0x7f154006f830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15500fce40 0x7f155010d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 --2- 172.21.15.134:0/2207560261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f15500fe040 0x7f155010ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.681+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 >> 172.21.15.134:0/2207560261 conn(0x7f15500f8550 msgr2=0x7f15500f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:48.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.682+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 shutdown_connections 2024-03-22T07:36:48.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.682+0000 7f1556c17700 1 -- 172.21.15.134:0/2207560261 wait complete. 2024-03-22T07:36:48.692 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 -- 172.21.15.134:0/2478352515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 msgr2=0x7f70d80fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 --2- 172.21.15.134:0/2478352515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d80fd420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70d4004940 tx=0x7f70d4009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 -- 172.21.15.134:0/2478352515 shutdown_connections 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 --2- 172.21.15.134:0/2478352515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d80fd420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 --2- 172.21.15.134:0/2478352515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70d80fbd00 0x7f70d80fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 -- 172.21.15.134:0/2478352515 >> 172.21.15.134:0/2478352515 conn(0x7f70d80f7460 msgr2=0x7f70d80f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:48.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 -- 172.21.15.134:0/2478352515 shutdown_connections 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.784+0000 7f70df721700 1 -- 172.21.15.134:0/2478352515 wait complete. 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70df721700 1 Processor -- start 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70df721700 1 -- start start 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70df721700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70d80fbd00 0x7f70d8066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70df721700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d8112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70df721700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8112c70 con 0x7f70d80fcfb0 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70df721700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8112de0 con 0x7f70d80fbd00 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dccbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d8112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dccbc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d8112730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53280/0 (socket says 172.21.15.134:53280) 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dccbc700 1 -- 172.21.15.134:0/2358442304 learned_addr learned my addr 172.21.15.134:0/2358442304 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dd4bd700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70d80fbd00 0x7f70d8066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dccbc700 1 -- 172.21.15.134:0/2358442304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70d80fbd00 msgr2=0x7f70d8066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dccbc700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70d80fbd00 0x7f70d8066cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:48.786 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.785+0000 7f70dccbc700 1 -- 172.21.15.134:0/2358442304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4005040 con 0x7f70d80fcfb0 2024-03-22T07:36:48.787 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.786+0000 7f70dccbc700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d8112730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009150 tx=0x7f70d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.786+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d400e040 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.786+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70d4004290 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.786+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d8113060 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.786+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70d401c630 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.786+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d8113620 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.787+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d804c710 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.787+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f70d400bbf0 con 0x7f70d80fcfb0 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.788+0000 7f70cdffb700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f70c406d380 0x7f70c406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:48.788 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.788+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f70d408d470 con 0x7f70d80fcfb0 2024-03-22T07:36:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.788+0000 7f70dd4bd700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f70c406d380 0x7f70c406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:48.789 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.788+0000 7f70dd4bd700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f70c406d380 0x7f70c406f830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009bf0 tx=0x7f70c80091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:48.792 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:48.792+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f70d405aaa0 con 0x7f70d80fcfb0 2024-03-22T07:36:49.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.011+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70d81012a0 con 0x7f70c406d380 2024-03-22T07:36:49.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.012+0000 7f70cdffb700 1 -- 172.21.15.134:0/2358442304 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f70d81012a0 con 0x7f70c406d380 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f70c406d380 msgr2=0x7f70c406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f70c406d380 0x7f70c406f830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009bf0 tx=0x7f70c80091a0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 msgr2=0x7f70d8112730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d8112730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009150 tx=0x7f70d4009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 shutdown_connections 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f70c406d380 0x7f70c406f830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70d80fbd00 0x7f70d8066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 --2- 172.21.15.134:0/2358442304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70d80fcfb0 0x7f70d8112730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 >> 172.21.15.134:0/2358442304 conn(0x7f70d80f7460 msgr2=0x7f70d80f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 shutdown_connections 2024-03-22T07:36:49.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.014+0000 7f70df721700 1 -- 172.21.15.134:0/2358442304 wait complete. 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 -- 172.21.15.134:0/4109448710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fbce0 msgr2=0x7ff66c0fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 --2- 172.21.15.134:0/4109448710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fbce0 0x7ff66c0fc0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff65c004940 tx=0x7ff65c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 -- 172.21.15.134:0/4109448710 shutdown_connections 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 --2- 172.21.15.134:0/4109448710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fcf90 0x7ff66c0fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 --2- 172.21.15.134:0/4109448710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fbce0 0x7ff66c0fc0f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 -- 172.21.15.134:0/4109448710 >> 172.21.15.134:0/4109448710 conn(0x7ff66c0f7480 msgr2=0x7ff66c0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 -- 172.21.15.134:0/4109448710 shutdown_connections 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 -- 172.21.15.134:0/4109448710 wait complete. 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 Processor -- start 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.117+0000 7ff670ce6700 1 -- start start 2024-03-22T07:36:49.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff670ce6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fbce0 0x7ff66c066d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff670ce6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 0x7ff66c110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff670ce6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c110a90 con 0x7ff66c0fcf90 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff670ce6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c110c00 con 0x7ff66c0fbce0 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 0x7ff66c110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 0x7ff66c110550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53292/0 (socket says 172.21.15.134:53292) 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 -- 172.21.15.134:0/3261321327 learned_addr learned my addr 172.21.15.134:0/3261321327 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff66a59c700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fbce0 0x7ff66c066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 -- 172.21.15.134:0/3261321327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fbce0 msgr2=0x7ff66c066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fbce0 0x7ff66c066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 -- 172.21.15.134:0/3261321327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c005040 con 0x7ff66c0fcf90 2024-03-22T07:36:49.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.118+0000 7ff669d9b700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 0x7ff66c110550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff660002a50 tx=0x7ff6600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:49.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.120+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff660007cc0 con 0x7ff66c0fcf90 2024-03-22T07:36:49.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.120+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff66000f040 con 0x7ff66c0fcf90 2024-03-22T07:36:49.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.120+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66000da70 con 0x7ff66c0fcf90 2024-03-22T07:36:49.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.120+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c110ee0 con 0x7ff66c0fcf90 2024-03-22T07:36:49.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.120+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c1114a0 con 0x7ff66c0fcf90 2024-03-22T07:36:49.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.121+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c04c710 con 0x7ff66c0fcf90 2024-03-22T07:36:49.121 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.121+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff66000dc10 con 0x7ff66c0fcf90 2024-03-22T07:36:49.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.121+0000 7ff65affd700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65406d380 0x7ff65406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.122+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff66008bf80 con 0x7ff66c0fcf90 2024-03-22T07:36:49.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.122+0000 7ff66a59c700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65406d380 0x7ff65406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.122 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.122+0000 7ff66a59c700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65406d380 0x7ff65406f830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00b970 tx=0x7ff65c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:49.126 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.126+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff660059510 con 0x7ff66c0fcf90 2024-03-22T07:36:49.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.331+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff66c1012a0 con 0x7ff65406d380 2024-03-22T07:36:49.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.341+0000 7ff65affd700 1 -- 172.21.15.134:0/3261321327 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff66c1012a0 con 0x7ff65406d380 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (7m) 31s ago 16m 24.6M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (4m) 31s ago 16m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (4m) 5s ago 15m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 31s ago 15m 85.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (36s) 31s ago 10m 13.9M - 19.0.0-1667-gdb0330b1 4f325f8440e9 5b048ce7e8da 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (58s) 31s ago 10m 14.8M - 19.0.0-1667-gdb0330b1 4f325f8440e9 8a0992eba74a 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (9s) 5s ago 10m 11.5M - 19.0.0-1667-gdb0330b1 4f325f8440e9 e184e705472b 2024-03-22T07:36:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (10m) 5s ago 10m 82.9M - 17.2.7-726-g9c4e0c34 837124da804f 2c3939ba0961 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (6m) 31s ago 17m 507M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (5m) 5s ago 15m 451M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (5m) 31s ago 17m 52.5M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (5m) 5s ago 15m 37.6M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 31s ago 16m 15.6M - 1.5.0 0da6a335fe13 22f4f538062a 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (6m) 5s ago 15m 15.3M - 1.5.0 0da6a335fe13 f2712c248c61 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (4m) 31s ago 14m 104M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (3m) 31s ago 13m 116M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (2m) 31s ago 13m 105M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (2m) 5s ago 13m 129M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:36:49.342 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (109s) 5s ago 12m 112M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:36:49.343 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (76s) 5s ago 12m 97.3M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:36:49.343 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 31s ago 15m 59.9M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:36:49.343 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65406d380 msgr2=0x7ff65406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65406d380 0x7ff65406f830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00b970 tx=0x7ff65c009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 msgr2=0x7ff66c110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 0x7ff66c110550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff660002a50 tx=0x7ff6600046b0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 shutdown_connections 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff65406d380 0x7ff65406f830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff66c0fbce0 0x7ff66c066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 --2- 172.21.15.134:0/3261321327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff66c0fcf90 0x7ff66c110550 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 >> 172.21.15.134:0/3261321327 conn(0x7ff66c0f7480 msgr2=0x7ff66c0f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 shutdown_connections 2024-03-22T07:36:49.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.343+0000 7ff670ce6700 1 -- 172.21.15.134:0/3261321327 wait complete. 2024-03-22T07:36:49.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1324650883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fc2c0 msgr2=0x7fdec00fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1324650883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fc2c0 0x7fdec00fc730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0004940 tx=0x7fdeb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:49.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1324650883 shutdown_connections 2024-03-22T07:36:49.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1324650883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fc2c0 0x7fdec00fc730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1324650883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fb010 0x7fdec00fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1324650883 >> 172.21.15.134:0/1324650883 conn(0x7fdec00f6770 msgr2=0x7fdec00f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: Detected new or changed devices on smithi195 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.jursxo"]}]: dispatch 2024-03-22T07:36:49.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: Upgrade: It appears safe to stop mds.cephfs.smithi195.jursxo 2024-03-22T07:36:49.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: pgmap v201: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-22T07:36:49.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:49.444 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:49 smithi134 ceph-mon[93947]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1324650883 shutdown_connections 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.442+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1324650883 wait complete. 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec7c5a700 1 Processor -- start 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec7c5a700 1 -- start start 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec7c5a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 0x7fdec00f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec7c5a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fc2c0 0x7fdec0112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec7c5a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0112c60 con 0x7fdec00fb010 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec7c5a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0112da0 con 0x7fdec00fc2c0 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 0x7fdec00f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 0x7fdec00f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53316/0 (socket says 172.21.15.134:53316) 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 -- 172.21.15.134:0/1956508856 learned_addr learned my addr 172.21.15.134:0/1956508856 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec51f5700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fc2c0 0x7fdec0112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 -- 172.21.15.134:0/1956508856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fc2c0 msgr2=0x7fdec0112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fc2c0 0x7fdec0112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 -- 172.21.15.134:0/1956508856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0005040 con 0x7fdec00fb010 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec51f5700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fc2c0 0x7fdec0112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.443+0000 7fdec59f6700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 0x7fdec00f8340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c8c0 tx=0x7fdebc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.444+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdebc00a980 con 0x7fdec00fb010 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.444+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdebc00ce60 con 0x7fdec00fb010 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.444+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec0112fa0 con 0x7fdec00fb010 2024-03-22T07:36:49.447 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.444+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdebc0115e0 con 0x7fdec00fb010 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.444+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec0113530 con 0x7fdec00fb010 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.445+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec004c710 con 0x7fdec00fb010 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.445+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fdebc012400 con 0x7fdec00fb010 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.446+0000 7fdeb67fc700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdeac06d380 0x7fdeac06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.446+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdebc08c970 con 0x7fdec00fb010 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.446+0000 7fdec51f5700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdeac06d380 0x7fdeac06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.446+0000 7fdec51f5700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdeac06d380 0x7fdeac06f830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000b970 tx=0x7fdeb0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:49.450 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.451+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdebc059fa0 con 0x7fdec00fb010 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: Detected new or changed devices on smithi195 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi195.jursxo"]}]: dispatch 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: Upgrade: It appears safe to stop mds.cephfs.smithi195.jursxo 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: pgmap v201: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:36:49.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:49 smithi195 ceph-mon[82061]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:49.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.727+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdec0113ab0 con 0x7fdec00fb010 2024-03-22T07:36:49.727 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.727+0000 7fdeb67fc700 1 -- 172.21.15.134:0/1956508856 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fdebc0126b0 con 0x7fdec00fb010 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:36:49.728 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 3 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 17.2.7-726-g9c4e0c34 (9c4e0c34f1949e7d705fe7ff26a4f4b729df7a45) quincy (stable)": 1, 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 13 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:36:49.729 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.729+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdeac06d380 msgr2=0x7fdeac06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.729+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdeac06d380 0x7fdeac06f830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000b970 tx=0x7fdeb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 msgr2=0x7fdec00f8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 0x7fdec00f8340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c8c0 tx=0x7fdebc0044c0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 shutdown_connections 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdeac06d380 0x7fdeac06f830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec00fb010 0x7fdec00f8340 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 --2- 172.21.15.134:0/1956508856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdec00fc2c0 0x7fdec0112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 >> 172.21.15.134:0/1956508856 conn(0x7fdec00f6770 msgr2=0x7fdec00ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:49.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 shutdown_connections 2024-03-22T07:36:49.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.730+0000 7fdec7c5a700 1 -- 172.21.15.134:0/1956508856 wait complete. 2024-03-22T07:36:49.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.833+0000 7f48be9f4700 1 -- 172.21.15.134:0/3998992566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 msgr2=0x7f48b80fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.833+0000 7f48be9f4700 1 --2- 172.21.15.134:0/3998992566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b80fd280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f48a8004940 tx=0x7f48a8009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:49.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- 172.21.15.134:0/3998992566 shutdown_connections 2024-03-22T07:36:49.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 --2- 172.21.15.134:0/3998992566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48b80fdfe0 0x7f48b80fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 --2- 172.21.15.134:0/3998992566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b80fd280 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- 172.21.15.134:0/3998992566 >> 172.21.15.134:0/3998992566 conn(0x7f48b80f8550 msgr2=0x7f48b80fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- 172.21.15.134:0/3998992566 shutdown_connections 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- 172.21.15.134:0/3998992566 wait complete. 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 Processor -- start 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- start start 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48b80fdfe0 0x7f48b8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8072260 con 0x7f48b80fce70 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.834+0000 7f48be9f4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8070850 con 0x7f48b80fdfe0 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b8071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53320/0 (socket says 172.21.15.134:53320) 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 -- 172.21.15.134:0/4292251650 learned_addr learned my addr 172.21.15.134:0/4292251650 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:49.839 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b77fe700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48b80fdfe0 0x7f48b8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 -- 172.21.15.134:0/4292251650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48b80fdfe0 msgr2=0x7f48b8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48b80fdfe0 0x7f48b8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 -- 172.21.15.134:0/4292251650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8005040 con 0x7f48b80fce70 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b7fff700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b8071c60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f48a8013870 tx=0x7f48a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a800e070 con 0x7f48b80fce70 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48a8013de0 con 0x7f48b80fce70 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b8070aa0 con 0x7f48b80fce70 2024-03-22T07:36:49.840 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a801cea0 con 0x7f48b80fce70 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.835+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8070f80 con 0x7f48b80fce70 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.836+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b8106100 con 0x7f48b80fce70 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.837+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f48a801c690 con 0x7f48b80fce70 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.837+0000 7f48b4ff9700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48a006d380 0x7f48a006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.837+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f48a808e0c0 con 0x7f48b80fce70 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.837+0000 7f48b77fe700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48a006d380 0x7f48a006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.838+0000 7f48b77fe700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48a006d380 0x7f48a006f830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009b80 tx=0x7f48ac00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:49.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:49.842+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f48a805b650 con 0x7f48b80fce70 2024-03-22T07:36:50.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.083+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f48b8115b00 con 0x7f48b80fce70 2024-03-22T07:36:50.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.083+0000 7f48b4ff9700 1 -- 172.21.15.134:0/4292251650 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1856 (secure 0 0 0) 0x7f48a8004490 con 0x7f48b80fce70 2024-03-22T07:36:50.083 INFO:teuthology.orchestra.run.smithi134.stdout:e27 2024-03-22T07:36:50.083 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:36:50.083 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:36:50.083 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:36:50.083 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 26 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:36:36.662123+0000 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 83 2024-03-22T07:36:50.084 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=24279} 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{0:24279} state up:active seq 159 join_fscid=1 addr [v2:172.21.15.195:6826/2251029735,v1:172.21.15.195:6827/2251029735] compat {c=[1],r=[1],i=[7ff]}] 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:50.085 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:36:50.086 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:36:50.086 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{-1:34400} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:36:50.086 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:36:50.086 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/2563834080,v1:172.21.15.195:6825/2563834080] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48a006d380 msgr2=0x7f48a006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48a006d380 0x7f48a006f830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009b80 tx=0x7f48ac00b040 comp rx=0 tx=0).stop 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 msgr2=0x7f48b8071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b8071c60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f48a8013870 tx=0x7f48a8009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 shutdown_connections 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48a006d380 0x7f48a006f830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48b80fce70 0x7f48b8071c60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 --2- 172.21.15.134:0/4292251650 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48b80fdfe0 0x7f48b8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 >> 172.21.15.134:0/4292251650 conn(0x7f48b80f8550 msgr2=0x7f48b80f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 shutdown_connections 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.086+0000 7f48be9f4700 1 -- 172.21.15.134:0/4292251650 wait complete. 2024-03-22T07:36:50.087 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 27 2024-03-22T07:36:50.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.189+0000 7f762c295700 1 -- 172.21.15.134:0/4180752606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 msgr2=0x7f76240fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.189+0000 7f762c295700 1 --2- 172.21.15.134:0/4180752606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f76240fe450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7614004940 tx=0x7f7614009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:50.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- 172.21.15.134:0/4180752606 shutdown_connections 2024-03-22T07:36:50.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 --2- 172.21.15.134:0/4180752606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f76240fe450 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 --2- 172.21.15.134:0/4180752606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 0x7f76240fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- 172.21.15.134:0/4180752606 >> 172.21.15.134:0/4180752606 conn(0x7f76240f8550 msgr2=0x7f76240fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- 172.21.15.134:0/4180752606 shutdown_connections 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- 172.21.15.134:0/4180752606 wait complete. 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 Processor -- start 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- start start 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 0x7f762410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f762410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762410e450 con 0x7f76240fdfe0 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762c295700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762410e5c0 con 0x7f76240fce70 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f7629830700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f762410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762a031700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 0x7f762410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f7629830700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f762410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53336/0 (socket says 172.21.15.134:53336) 2024-03-22T07:36:50.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f762a031700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 0x7f762410d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.134:60088/0 (socket says 172.21.15.134:60088) 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.190+0000 7f7629830700 1 -- 172.21.15.134:0/2600256111 learned_addr learned my addr 172.21.15.134:0/2600256111 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f7629830700 1 -- 172.21.15.134:0/2600256111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 msgr2=0x7f762410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f7629830700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 0x7f762410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f7629830700 1 -- 172.21.15.134:0/2600256111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614005040 con 0x7f76240fdfe0 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f7629830700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f762410de50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f761400b3b0 tx=0x7f7614009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761400e040 con 0x7f76240fdfe0 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7624112fc0 con 0x7f76240fdfe0 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f761400bbf0 con 0x7f76240fdfe0 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761401c630 con 0x7f76240fdfe0 2024-03-22T07:36:50.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.191+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7624113550 con 0x7f76240fdfe0 2024-03-22T07:36:50.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.192+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762404c710 con 0x7f76240fdfe0 2024-03-22T07:36:50.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.193+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f761400bd60 con 0x7f76240fdfe0 2024-03-22T07:36:50.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.193+0000 7f761affd700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761006d380 0x7f761006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:50.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.193+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f761408d580 con 0x7f76240fdfe0 2024-03-22T07:36:50.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.193+0000 7f762a031700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761006d380 0x7f761006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:50.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.193+0000 7f762a031700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761006d380 0x7f761006f830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7620004f60 tx=0x7f762000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:50.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.198+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f761405ab10 con 0x7f76240fdfe0 2024-03-22T07:36:50.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.409+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7624102300 con 0x7f761006d380 2024-03-22T07:36:50.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:50.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1956508856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: Upgrade: Updating mds.cephfs.smithi195.jursxo 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: Deploying daemon mds.cephfs.smithi195.jursxo on smithi195 2024-03-22T07:36:50.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:50 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/4292251650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1956508856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: Upgrade: Updating mds.cephfs.smithi195.jursxo 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi195.jursxo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: Deploying daemon mds.cephfs.smithi195.jursxo on smithi195 2024-03-22T07:36:50.411 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:50 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/4292251650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:36:50.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.411+0000 7f761affd700 1 -- 172.21.15.134:0/2600256111 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7624102300 con 0x7f761006d380 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "crash" 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "15/21 daemons upgraded", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading mds daemons", 2024-03-22T07:36:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761006d380 msgr2=0x7f761006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761006d380 0x7f761006f830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7620004f60 tx=0x7f762000b040 comp rx=0 tx=0).stop 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 msgr2=0x7f762410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f762410de50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f761400b3b0 tx=0x7f7614009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 shutdown_connections 2024-03-22T07:36:50.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f761006d380 0x7f761006f830 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76240fce70 0x7f762410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 --2- 172.21.15.134:0/2600256111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76240fdfe0 0x7f762410de50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 >> 172.21.15.134:0/2600256111 conn(0x7f76240f8550 msgr2=0x7f76240f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:50.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 shutdown_connections 2024-03-22T07:36:50.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.413+0000 7f762c295700 1 -- 172.21.15.134:0/2600256111 wait complete. 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 -- 172.21.15.134:0/343037476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fdfe0 msgr2=0x7ff2840fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/343037476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fdfe0 0x7ff2840fe450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff270004940 tx=0x7ff270009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 -- 172.21.15.134:0/343037476 shutdown_connections 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/343037476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fdfe0 0x7ff2840fe450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/343037476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2840fce70 0x7ff2840fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 -- 172.21.15.134:0/343037476 >> 172.21.15.134:0/343037476 conn(0x7ff2840f8550 msgr2=0x7ff2840fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 -- 172.21.15.134:0/343037476 shutdown_connections 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.515+0000 7ff28aeb9700 1 -- 172.21.15.134:0/343037476 wait complete. 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff28aeb9700 1 Processor -- start 2024-03-22T07:36:50.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff28aeb9700 1 -- start start 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff28aeb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 0x7ff28410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff28aeb9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2840fdfe0 0x7ff28410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff28aeb9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28410e460 con 0x7ff2840fce70 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff28aeb9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28410e5d0 con 0x7ff2840fdfe0 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 0x7ff28410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 0x7ff28410d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:53368/0 (socket says 172.21.15.134:53368) 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 -- 172.21.15.134:0/2194508736 learned_addr learned my addr 172.21.15.134:0/2194508736 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff283fff700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2840fdfe0 0x7ff28410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 -- 172.21.15.134:0/2194508736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2840fdfe0 msgr2=0x7ff28410de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2840fdfe0 0x7ff28410de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 -- 172.21.15.134:0/2194508736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270005040 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.516+0000 7ff288c55700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 0x7ff28410d920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff278002a50 tx=0x7ff2780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.517+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff278007cc0 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.517+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff27800f040 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.517+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff284112fd0 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.517+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27800da30 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.517+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284113560 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.518+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28404c710 con 0x7ff2840fce70 2024-03-22T07:36:50.520 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.518+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff27800dbb0 con 0x7ff2840fce70 2024-03-22T07:36:50.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.519+0000 7ff2817fa700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff27406d380 0x7ff27406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:36:50.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.519+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff27808c650 con 0x7ff2840fce70 2024-03-22T07:36:50.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.519+0000 7ff283fff700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff27406d380 0x7ff27406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:36:50.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.519+0000 7ff283fff700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff27406d380 0x7ff27406f830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff270009fd0 tx=0x7ff270009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:36:50.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.523+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff278059be0 con 0x7ff2840fce70 2024-03-22T07:36:50.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.796+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff2841058d0 con 0x7ff2840fce70 2024-03-22T07:36:50.796 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.796+0000 7ff2817fa700 1 -- 172.21.15.134:0/2194508736 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff278059770 con 0x7ff2840fce70 2024-03-22T07:36:50.796 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:36:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff27406d380 msgr2=0x7ff27406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.798 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff27406d380 0x7ff27406f830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff270009fd0 tx=0x7ff270009e30 comp rx=0 tx=0).stop 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 msgr2=0x7ff28410d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 0x7ff28410d920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff278002a50 tx=0x7ff2780046b0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 shutdown_connections 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff27406d380 0x7ff27406f830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2840fce70 0x7ff28410d920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 --2- 172.21.15.134:0/2194508736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2840fdfe0 0x7ff28410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 >> 172.21.15.134:0/2194508736 conn(0x7ff2840f8550 msgr2=0x7ff2840f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 shutdown_connections 2024-03-22T07:36:50.799 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:36:50.799+0000 7ff28aeb9700 1 -- 172.21.15.134:0/2194508736 wait complete. 2024-03-22T07:36:51.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-mon[82061]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:51.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-mon[82061]: pgmap v202: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-22T07:36:51.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2194508736' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:36:51.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:51 smithi134 ceph-mon[93947]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:36:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:51 smithi134 ceph-mon[93947]: pgmap v202: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-03-22T07:36:51.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:51 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2194508736' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:36:52.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:51 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[93942]: 2024-03-22T07:36:51.728+0000 7f27b742e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:52.138 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:51.746+0000 7ffb421a5700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2024-03-22T07:36:52.138 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:51.747+0000 7ffb3f19f700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-03-22T07:36:52.138 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:51.747+0000 7ffb459ac700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 3 2024-03-22T07:36:52.138 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:51.747+0000 7ffb409a2700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 6 2024-03-22T07:36:52.138 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:36:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:36:51.749+0000 7ffb3f9a0700 -1 bdev(0x55697f1b0000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 13 2024-03-22T07:36:52.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:36:52.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:52.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: osdmap e84: 6 total, 6 up, 6 in 2024-03-22T07:36:52.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: Standby daemon mds.cephfs.smithi134.yxdtlb assigned to filesystem cephfs as rank 0 2024-03-22T07:36:52.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:36:52.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-22T07:36:52.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:52 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi134.yxdtlb=up:replay} 2 up:standby 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: osdmap e84: 6 total, 6 up, 6 in 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: Standby daemon mds.cephfs.smithi134.yxdtlb assigned to filesystem cephfs as rank 0 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-03-22T07:36:52.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:52 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi134.yxdtlb=up:replay} 2 up:standby 2024-03-22T07:36:53.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:53 smithi195 ceph-mon[82061]: pgmap v204: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-03-22T07:36:53.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:53 smithi134 ceph-mon[93947]: pgmap v204: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-03-22T07:36:54.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:54 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:36:54.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:54 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:36:55.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:55 smithi134 ceph-mon[93947]: pgmap v205: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-03-22T07:36:55.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:55 smithi195 ceph-mon[82061]: pgmap v205: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-03-22T07:36:57.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:57 smithi134 ceph-mon[93947]: pgmap v206: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s rd, 3 op/s 2024-03-22T07:36:57.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:57 smithi195 ceph-mon[82061]: pgmap v206: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s rd, 3 op/s 2024-03-22T07:36:59.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:36:59 smithi195 ceph-mon[82061]: pgmap v207: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-03-22T07:37:00.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:36:59 smithi134 ceph-mon[93947]: pgmap v207: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-03-22T07:37:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:01 smithi195 ceph-mon[82061]: pgmap v208: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-22T07:37:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:01 smithi195 ceph-mon[82061]: reconnect by client.14526 v1:192.168.0.1:0/3944219376 after 0.000999977 2024-03-22T07:37:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:01 smithi195 ceph-mon[82061]: reconnect by client.24319 v1:192.168.0.1:0/439064909 after 0.000999977 2024-03-22T07:37:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:01 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:reconnect 2024-03-22T07:37:01.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:01 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi134.yxdtlb=up:reconnect} 2 up:standby 2024-03-22T07:37:02.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:01 smithi134 ceph-mon[93947]: pgmap v208: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-03-22T07:37:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:01 smithi134 ceph-mon[93947]: reconnect by client.14526 v1:192.168.0.1:0/3944219376 after 0.000999977 2024-03-22T07:37:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:01 smithi134 ceph-mon[93947]: reconnect by client.24319 v1:192.168.0.1:0/439064909 after 0.000999977 2024-03-22T07:37:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:01 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:reconnect 2024-03-22T07:37:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:01 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi134.yxdtlb=up:reconnect} 2 up:standby 2024-03-22T07:37:02.670 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:02 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:rejoin 2024-03-22T07:37:02.670 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:02 smithi195 ceph-mon[82061]: fsmap cephfs:1/1 {0=cephfs.smithi134.yxdtlb=up:rejoin} 2 up:standby 2024-03-22T07:37:02.671 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:02 smithi195 ceph-mon[82061]: daemon mds.cephfs.smithi134.yxdtlb is now active in filesystem cephfs as rank 0 2024-03-22T07:37:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:02 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:rejoin 2024-03-22T07:37:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:02 smithi134 ceph-mon[93947]: fsmap cephfs:1/1 {0=cephfs.smithi134.yxdtlb=up:rejoin} 2 up:standby 2024-03-22T07:37:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:02 smithi134 ceph-mon[93947]: daemon mds.cephfs.smithi134.yxdtlb is now active in filesystem cephfs as rank 0 2024-03-22T07:37:03.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: pgmap v209: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: Cluster is now healthy 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:active 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 2 up:standby 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: pgmap v209: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: Cluster is now healthy 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] up:active 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 2 up:standby 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:04.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:04 smithi195 ceph-mon[82061]: mds.? [v2:172.21.15.195:6826/2724498229,v1:172.21.15.195:6827/2724498229] up:boot 2024-03-22T07:37:04.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:04 smithi195 ceph-mon[82061]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 3 up:standby 2024-03-22T07:37:04.879 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:04 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:37:05.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:04 smithi134 ceph-mon[93947]: mds.? [v2:172.21.15.195:6826/2724498229,v1:172.21.15.195:6827/2724498229] up:boot 2024-03-22T07:37:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:04 smithi134 ceph-mon[93947]: fsmap cephfs:1 {0=cephfs.smithi134.yxdtlb=up:active} 3 up:standby 2024-03-22T07:37:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:04 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:37:05.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:05 smithi195 ceph-mon[82061]: pgmap v210: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:37:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:05 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:05 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:05 smithi134 ceph-mon[93947]: pgmap v210: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:37:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:05 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:06.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:05 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:07.694 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:07.695 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:07 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:07.695 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:07 smithi195 ceph-mon[82061]: pgmap v211: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 4 op/s 2024-03-22T07:37:07.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:07 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:07.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:07 smithi134 ceph-mon[93947]: pgmap v211: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 170 B/s wr, 4 op/s 2024-03-22T07:37:09.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:09 smithi195 ceph-mon[82061]: pgmap v212: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 8.5 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:37:10.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:09 smithi134 ceph-mon[93947]: pgmap v212: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 8.5 MiB/s rd, 170 B/s wr, 5 op/s 2024-03-22T07:37:11.123 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all mds 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.dexlss"}]': finished 2024-03-22T07:37:11.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.yxdtlb"}]': finished 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.dayrmo"}]': finished 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.jursxo"}]': finished 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all rgw 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all rbd-mirror 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all ceph-exporter 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.125 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all iscsi 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all nfs 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: Upgrade: Setting container_image for all nvmeof 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:11 smithi134 ceph-mon[93947]: pgmap v213: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all mds 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.dexlss"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.dexlss"}]': finished 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.yxdtlb"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.yxdtlb"}]': finished 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.dayrmo"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.dayrmo"}]': finished 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.jursxo"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi195.jursxo"}]': finished 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.456 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all rgw 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all rbd-mirror 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all ceph-exporter 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all iscsi 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all nfs 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.457 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:11.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: Upgrade: Setting container_image for all nvmeof 2024-03-22T07:37:11.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:11.458 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:11 smithi195 ceph-mon[82061]: pgmap v213: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.4 KiB/s wr, 6 op/s 2024-03-22T07:37:13.827 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:13 smithi134 ceph-mon[93947]: Upgrade: Updating node-exporter.smithi134 (1/2) 2024-03-22T07:37:13.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:13 smithi134 ceph-mon[93947]: Deploying daemon node-exporter.smithi134 on smithi134 2024-03-22T07:37:13.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:13 smithi134 ceph-mon[93947]: pgmap v214: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-03-22T07:37:13.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:13 smithi195 ceph-mon[82061]: Upgrade: Updating node-exporter.smithi134 (1/2) 2024-03-22T07:37:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:13 smithi195 ceph-mon[82061]: Deploying daemon node-exporter.smithi134 on smithi134 2024-03-22T07:37:13.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:13 smithi195 ceph-mon[82061]: pgmap v214: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 686 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-03-22T07:37:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:15 smithi195 ceph-mon[82061]: pgmap v215: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-03-22T07:37:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:15 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:15.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:15 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:16.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:15 smithi134 ceph-mon[93947]: pgmap v215: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-03-22T07:37:16.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:15 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:16.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:15 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:17 smithi195 ceph-mon[82061]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-03-22T07:37:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:17 smithi195 ceph-mon[82061]: Deploying daemon node-exporter.smithi195 on smithi195 2024-03-22T07:37:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:17 smithi195 ceph-mon[82061]: pgmap v216: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-03-22T07:37:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:17 smithi134 ceph-mon[93947]: Upgrade: Updating node-exporter.smithi195 (2/2) 2024-03-22T07:37:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:17 smithi134 ceph-mon[93947]: Deploying daemon node-exporter.smithi195 on smithi195 2024-03-22T07:37:18.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:17 smithi134 ceph-mon[93947]: pgmap v216: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-03-22T07:37:18.897 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:18.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:19.891 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:19 smithi134 ceph-mon[93947]: pgmap v217: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-03-22T07:37:19.891 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:19.891 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:19.892 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:19 smithi195 ceph-mon[82061]: pgmap v217: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-03-22T07:37:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:19.948 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:20.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 -- 172.21.15.134:0/3649623028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c066280 msgr2=0x7fb54c0ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:20.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 --2- 172.21.15.134:0/3649623028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c066280 0x7fb54c0ffa20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb540004940 tx=0x7fb540009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:20.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 -- 172.21.15.134:0/3649623028 shutdown_connections 2024-03-22T07:37:20.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 --2- 172.21.15.134:0/3649623028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54c0fff60 0x7fb54c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:20.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 --2- 172.21.15.134:0/3649623028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c066280 0x7fb54c0ffa20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:20.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 -- 172.21.15.134:0/3649623028 >> 172.21.15.134:0/3649623028 conn(0x7fb54c0f7430 msgr2=0x7fb54c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:20.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 -- 172.21.15.134:0/3649623028 shutdown_connections 2024-03-22T07:37:20.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 -- 172.21.15.134:0/3649623028 wait complete. 2024-03-22T07:37:20.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.903+0000 7fb55312c700 1 Processor -- start 2024-03-22T07:37:20.905 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb55312c700 1 -- start start 2024-03-22T07:37:20.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb55312c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54c066280 0x7fb54c10da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:20.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb55312c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 0x7fb54c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:20.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb55312c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c10e5c0 con 0x7fb54c0fff60 2024-03-22T07:37:20.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb55312c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c10edc0 con 0x7fb54c066280 2024-03-22T07:37:20.906 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb54bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 0x7fb54c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb54bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 0x7fb54c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42092/0 (socket says 172.21.15.134:42092) 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb54bfff700 1 -- 172.21.15.134:0/1874039450 learned_addr learned my addr 172.21.15.134:0/1874039450 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb550ec8700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54c066280 0x7fb54c10da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb54bfff700 1 -- 172.21.15.134:0/1874039450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54c066280 msgr2=0x7fb54c10da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.904+0000 7fb54bfff700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54c066280 0x7fb54c10da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb54bfff700 1 -- 172.21.15.134:0/1874039450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540005040 con 0x7fb54c0fff60 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb54bfff700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 0x7fb54c10dfc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb538002a80 tx=0x7fb5380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb538007cc0 con 0x7fb54c0fff60 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c10f0a0 con 0x7fb54c0fff60 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb53800f040 con 0x7fb54c0fff60 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53800dac0 con 0x7fb54c0fff60 2024-03-22T07:37:20.907 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.905+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c10f5e0 con 0x7fb54c0fff60 2024-03-22T07:37:20.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.906+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c05f5f0 con 0x7fb54c0fff60 2024-03-22T07:37:20.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.906+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fb53800dc20 con 0x7fb54c0fff60 2024-03-22T07:37:20.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.907+0000 7fb5497fa700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb53c06d380 0x7fb53c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:20.908 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.907+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb53808c670 con 0x7fb54c0fff60 2024-03-22T07:37:20.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.907+0000 7fb550ec8700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb53c06d380 0x7fb53c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:20.909 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.907+0000 7fb550ec8700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb53c06d380 0x7fb53c06f830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb540004890 tx=0x7fb540009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:20.912 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:20.912+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb538059b30 con 0x7fb54c0fff60 2024-03-22T07:37:21.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.140+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb54c10f910 con 0x7fb53c06d380 2024-03-22T07:37:21.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.142+0000 7fb5497fa700 1 -- 172.21.15.134:0/1874039450 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fb54c10f910 con 0x7fb53c06d380 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb53c06d380 msgr2=0x7fb53c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb53c06d380 0x7fb53c06f830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb540004890 tx=0x7fb540009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 msgr2=0x7fb54c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 0x7fb54c10dfc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb538002a80 tx=0x7fb5380046b0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 shutdown_connections 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb53c06d380 0x7fb53c06f830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb54c066280 0x7fb54c10da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 --2- 172.21.15.134:0/1874039450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb54c0fff60 0x7fb54c10dfc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 >> 172.21.15.134:0/1874039450 conn(0x7fb54c0f7430 msgr2=0x7fb54c0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:21.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 shutdown_connections 2024-03-22T07:37:21.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.144+0000 7fb55312c700 1 -- 172.21.15.134:0/1874039450 wait complete. 2024-03-22T07:37:21.155 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 -- 172.21.15.134:0/343502100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fbd00 msgr2=0x7f3dcc0fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/343502100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fbd00 0x7f3dcc0fc110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8004940 tx=0x7f3dc8009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 -- 172.21.15.134:0/343502100 shutdown_connections 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/343502100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/343502100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fbd00 0x7f3dcc0fc110 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 -- 172.21.15.134:0/343502100 >> 172.21.15.134:0/343502100 conn(0x7f3dcc0f7440 msgr2=0x7f3dcc0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.250+0000 7f3dd40c1700 1 -- 172.21.15.134:0/343502100 shutdown_connections 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 -- 172.21.15.134:0/343502100 wait complete. 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 Processor -- start 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 -- start start 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dcc0fbd00 0x7f3dcc066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc1126c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc112c00 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd40c1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc112d40 con 0x7f3dcc0fbd00 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd165c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc1126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd165c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc1126c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42102/0 (socket says 172.21.15.134:42102) 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd165c700 1 -- 172.21.15.134:0/2855104119 learned_addr learned my addr 172.21.15.134:0/2855104119 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.251+0000 7f3dd1e5d700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dcc0fbd00 0x7f3dcc066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dd165c700 1 -- 172.21.15.134:0/2855104119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dcc0fbd00 msgr2=0x7f3dcc066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dd165c700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dcc0fbd00 0x7f3dcc066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dd165c700 1 -- 172.21.15.134:0/2855104119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8005040 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dd165c700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc1126c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00eb40 tx=0x7f3dbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dbc007cc0 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dbc00f040 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc112f40 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dbc00ca10 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.254 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.252+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc113450 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.253+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc04c710 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.253+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f3dbc00cc80 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.254+0000 7f3dc27fc700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3db806d380 0x7f3db806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.254+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f3dbc08c580 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.254+0000 7f3dd1e5d700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3db806d380 0x7f3db806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.256 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.254+0000 7f3dd1e5d700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3db806d380 0x7f3db806f830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009b30 tx=0x7f3dc8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:21.259 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.258+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3dbc059af0 con 0x7f3dcc0fcfb0 2024-03-22T07:37:21.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.500+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dcc101250 con 0x7f3db806d380 2024-03-22T07:37:21.502 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.502+0000 7f3dc27fc700 1 -- 172.21.15.134:0/2855104119 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3dcc101250 con 0x7f3db806d380 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3db806d380 msgr2=0x7f3db806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3db806d380 0x7f3db806f830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009b30 tx=0x7f3dc8009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 msgr2=0x7f3dcc1126c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc1126c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00eb40 tx=0x7f3dbc00b040 comp rx=0 tx=0).stop 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 shutdown_connections 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3db806d380 0x7f3db806f830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dcc0fbd00 0x7f3dcc066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 --2- 172.21.15.134:0/2855104119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc0fcfb0 0x7f3dcc1126c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 >> 172.21.15.134:0/2855104119 conn(0x7f3dcc0f7440 msgr2=0x7f3dcc0f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 shutdown_connections 2024-03-22T07:37:21.505 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.504+0000 7f3dd40c1700 1 -- 172.21.15.134:0/2855104119 wait complete. 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 -- 172.21.15.134:0/3708715601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fbce0 msgr2=0x7f55500fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 --2- 172.21.15.134:0/3708715601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fbce0 0x7f55500fc0f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5540004940 tx=0x7f5540009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 -- 172.21.15.134:0/3708715601 shutdown_connections 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 --2- 172.21.15.134:0/3708715601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55500fcf90 0x7f55500fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 --2- 172.21.15.134:0/3708715601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fbce0 0x7f55500fc0f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 -- 172.21.15.134:0/3708715601 >> 172.21.15.134:0/3708715601 conn(0x7f55500f7480 msgr2=0x7f55500f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 -- 172.21.15.134:0/3708715601 shutdown_connections 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.605+0000 7f5555888700 1 -- 172.21.15.134:0/3708715601 wait complete. 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f5555888700 1 Processor -- start 2024-03-22T07:37:21.608 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f5555888700 1 -- start start 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f5555888700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55500fbce0 0x7f55500ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f5555888700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 0x7f55500fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f5555888700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55500fe860 con 0x7f55500fcf90 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f5555888700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55500fe9a0 con 0x7f55500fbce0 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f554e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 0x7f55500fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f554e7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 0x7f55500fe2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42116/0 (socket says 172.21.15.134:42116) 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f554e7fc700 1 -- 172.21.15.134:0/2243855821 learned_addr learned my addr 172.21.15.134:0/2243855821 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.606+0000 7f554effd700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55500fbce0 0x7f55500ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f554e7fc700 1 -- 172.21.15.134:0/2243855821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55500fbce0 msgr2=0x7f55500ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f554e7fc700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55500fbce0 0x7f55500ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f554e7fc700 1 -- 172.21.15.134:0/2243855821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540005040 con 0x7f55500fcf90 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f554e7fc700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 0x7f55500fe2d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5544002a80 tx=0x7f55440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5544007cc0 con 0x7f55500fcf90 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55500fec80 con 0x7f55500fcf90 2024-03-22T07:37:21.609 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f554400f040 con 0x7f55500fcf90 2024-03-22T07:37:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f554400dac0 con 0x7f55500fcf90 2024-03-22T07:37:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.607+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55501159f0 con 0x7f55500fcf90 2024-03-22T07:37:21.610 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.608+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5550101b20 con 0x7f55500fcf90 2024-03-22T07:37:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.609+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f554400dc20 con 0x7f55500fcf90 2024-03-22T07:37:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.609+0000 7f55377fe700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f553806d380 0x7f553806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.609+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f554408c650 con 0x7f55500fcf90 2024-03-22T07:37:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.609+0000 7f554effd700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f553806d380 0x7f553806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.611 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.610+0000 7f554effd700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f553806d380 0x7f553806f830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55500ffb40 tx=0x7f5540009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:21.614 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.614+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5544055fe0 con 0x7f55500fcf90 2024-03-22T07:37:21.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:21 smithi134 ceph-mon[93947]: pgmap v218: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-03-22T07:37:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:21 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:21.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:21 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:21.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.833+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f555005e400 con 0x7f553806d380 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.843+0000 7f55377fe700 1 -- 172.21.15.134:0/2243855821 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f555005e400 con 0x7f553806d380 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (8m) 63s ago 16m 24.6M - 0.25.0 c8568f914cd2 f3a8670fd103 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 63s ago 16m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (5m) 0s ago 15m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (7m) 63s ago 16m 85.0M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (69s) 63s ago 11m 13.9M - 19.0.0-1667-gdb0330b1 4f325f8440e9 5b048ce7e8da 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (91s) 63s ago 11m 14.8M - 19.0.0-1667-gdb0330b1 4f325f8440e9 8a0992eba74a 2024-03-22T07:37:21.844 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (41s) 0s ago 11m 11.7M - 19.0.0-1667-gdb0330b1 4f325f8440e9 e184e705472b 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (19s) 0s ago 11m 14.8M - 19.0.0-1667-gdb0330b1 4f325f8440e9 229f2db1b811 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (7m) 63s ago 18m 507M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (6m) 0s ago 15m 451M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (6m) 63s ago 18m 52.5M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (5m) 0s ago 15m 37.7M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (3s) 0s ago 15m 3657k - 1.5.0 0da6a335fe13 376ba127b41a 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (4m) 63s ago 14m 104M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 63s ago 14m 116M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (3m) 63s ago 13m 105M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (2m) 0s ago 13m 131M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (2m) 0s ago 13m 113M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (108s) 0s ago 12m 99.2M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:37:21.845 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 63s ago 16m 59.9M - 2.43.0 a07b618ecd1d 3fa567f89f55 2024-03-22T07:37:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f553806d380 msgr2=0x7f553806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.846 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f553806d380 0x7f553806f830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55500ffb40 tx=0x7f5540009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 msgr2=0x7f55500fe2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 0x7f55500fe2d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5544002a80 tx=0x7f55440046b0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 shutdown_connections 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f553806d380 0x7f553806f830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55500fbce0 0x7f55500ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 --2- 172.21.15.134:0/2243855821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55500fcf90 0x7f55500fe2d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 >> 172.21.15.134:0/2243855821 conn(0x7f55500f7480 msgr2=0x7f5550066390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 shutdown_connections 2024-03-22T07:37:21.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.846+0000 7f5555888700 1 -- 172.21.15.134:0/2243855821 wait complete. 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 -- 172.21.15.134:0/1845213012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fcef0 msgr2=0x7faee80fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 --2- 172.21.15.134:0/1845213012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fcef0 0x7faee80fd300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faee4004940 tx=0x7faee4009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 -- 172.21.15.134:0/1845213012 shutdown_connections 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 --2- 172.21.15.134:0/1845213012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fe060 0x7faee80fe4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 --2- 172.21.15.134:0/1845213012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fcef0 0x7faee80fd300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 -- 172.21.15.134:0/1845213012 >> 172.21.15.134:0/1845213012 conn(0x7faee80f85b0 msgr2=0x7faee80fa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 -- 172.21.15.134:0/1845213012 shutdown_connections 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.946+0000 7faeef29b700 1 -- 172.21.15.134:0/1845213012 wait complete. 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeef29b700 1 Processor -- start 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeef29b700 1 -- start start 2024-03-22T07:37:21.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeef29b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fcef0 0x7faee810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeef29b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 0x7faee8110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeef29b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8110700 con 0x7faee80fe060 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeef29b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8110f50 con 0x7faee80fcef0 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 0x7faee8110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 0x7faee8110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42134/0 (socket says 172.21.15.134:42134) 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 -- 172.21.15.134:0/2385547654 learned_addr learned my addr 172.21.15.134:0/2385547654 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeed037700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fcef0 0x7faee810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 -- 172.21.15.134:0/2385547654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fcef0 msgr2=0x7faee810fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fcef0 0x7faee810fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 -- 172.21.15.134:0/2385547654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4005040 con 0x7faee80fe060 2024-03-22T07:37:21.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeed037700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fcef0 0x7faee810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.947+0000 7faeec836700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 0x7faee8110100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faed800eb40 tx=0x7faed800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.948+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed8007cc0 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.948+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faed800f040 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.948+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee81111d0 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.948+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faed800ca10 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.948+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee8111710 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.949+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee81019f0 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.949+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7faed800cb70 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.950+0000 7faeddffb700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faed406d390 0x7faed406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.950+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7faed808c500 con 0x7faee80fe060 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.950+0000 7faeed037700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faed406d390 0x7faed406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:21.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.950+0000 7faeed037700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faed406d390 0x7faed406f840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faee400b0d0 tx=0x7faee4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:21.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:21 smithi195 ceph-mon[82061]: pgmap v218: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-03-22T07:37:21.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:21 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:21.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:21 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:21.955 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:21.954+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faed8059af0 con 0x7faee80fe060 2024-03-22T07:37:22.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.248+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faee81059e0 con 0x7faee80fe060 2024-03-22T07:37:22.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.249+0000 7faeddffb700 1 -- 172.21.15.134:0/2385547654 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7faed8059680 con 0x7faee80fe060 2024-03-22T07:37:22.250 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:37:22.250 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:37:22.250 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:37:22.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:22.250 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 14 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:37:22.251 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faed406d390 msgr2=0x7faed406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faed406d390 0x7faed406f840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faee400b0d0 tx=0x7faee4009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 msgr2=0x7faee8110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 0x7faee8110100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faed800eb40 tx=0x7faed800b040 comp rx=0 tx=0).stop 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 shutdown_connections 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faed406d390 0x7faed406f840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faee80fcef0 0x7faee810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 --2- 172.21.15.134:0/2385547654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faee80fe060 0x7faee8110100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 >> 172.21.15.134:0/2385547654 conn(0x7faee80f85b0 msgr2=0x7faee80f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 shutdown_connections 2024-03-22T07:37:22.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.251+0000 7faeef29b700 1 -- 172.21.15.134:0/2385547654 wait complete. 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 -- 172.21.15.134:0/3884790422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 msgr2=0x7f67180fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 --2- 172.21.15.134:0/3884790422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f67180fe460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f670c004940 tx=0x7f670c009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 -- 172.21.15.134:0/3884790422 shutdown_connections 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 --2- 172.21.15.134:0/3884790422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f67180fe460 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 --2- 172.21.15.134:0/3884790422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67180fce80 0x7f67180fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 -- 172.21.15.134:0/3884790422 >> 172.21.15.134:0/3884790422 conn(0x7f67180f8580 msgr2=0x7f67180fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 -- 172.21.15.134:0/3884790422 shutdown_connections 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 -- 172.21.15.134:0/3884790422 wait complete. 2024-03-22T07:37:22.354 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 Processor -- start 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.352+0000 7f671c9f8700 1 -- start start 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671c9f8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67180fce80 0x7f671810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671c9f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f671810df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671c9f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671810e550 con 0x7f67180fdff0 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671c9f8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671810eda0 con 0x7f67180fce80 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f671810df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67180fce80 0x7f671810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f671810df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42146/0 (socket says 172.21.15.134:42146) 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 -- 172.21.15.134:0/2499307087 learned_addr learned my addr 172.21.15.134:0/2499307087 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 -- 172.21.15.134:0/2499307087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67180fce80 msgr2=0x7f671810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67180fce80 0x7f671810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 -- 172.21.15.134:0/2499307087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c005040 con 0x7f67180fdff0 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6715d9b700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f671810df50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f670c00b3b0 tx=0x7f670c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:22.355 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670c00e040 con 0x7f67180fdff0 2024-03-22T07:37:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f670c004290 con 0x7f67180fdff0 2024-03-22T07:37:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671810f020 con 0x7f67180fdff0 2024-03-22T07:37:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670c01c3f0 con 0x7f67180fdff0 2024-03-22T07:37:22.356 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.353+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671810f560 con 0x7f67180fdff0 2024-03-22T07:37:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.354+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671805f5f0 con 0x7f67180fdff0 2024-03-22T07:37:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.355+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f670c00bbf0 con 0x7f67180fdff0 2024-03-22T07:37:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.355+0000 7f6706ffd700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f670006d390 0x7f670006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.355+0000 7f671659c700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f670006d390 0x7f670006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.355+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f670c08dd50 con 0x7f67180fdff0 2024-03-22T07:37:22.357 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.356+0000 7f671659c700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f670006d390 0x7f670006f840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6710004fd0 tx=0x7f6710009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:22.360 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.360+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f670c05b290 con 0x7f67180fdff0 2024-03-22T07:37:22.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.617+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f671804bed0 con 0x7f67180fdff0 2024-03-22T07:37:22.618 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.618+0000 7f6706ffd700 1 -- 172.21.15.134:0/2499307087 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1877 (secure 0 0 0) 0x7f670c05ae20 con 0x7f67180fdff0 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:e33 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 32 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:37:01.692864+0000 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:37:22.619 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 84 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34400} 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:37:22.620 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{0:34400} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/2563834080,v1:172.21.15.195:6825/2563834080] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:22.621 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/2724498229,v1:172.21.15.195:6827/2724498229] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f670006d390 msgr2=0x7f670006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f670006d390 0x7f670006f840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6710004fd0 tx=0x7f6710009040 comp rx=0 tx=0).stop 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 msgr2=0x7f671810df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f671810df50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f670c00b3b0 tx=0x7f670c009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 shutdown_connections 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f670006d390 0x7f670006f840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67180fce80 0x7f671810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 --2- 172.21.15.134:0/2499307087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67180fdff0 0x7f671810df50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 >> 172.21.15.134:0/2499307087 conn(0x7f67180f8580 msgr2=0x7f67180f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 shutdown_connections 2024-03-22T07:37:22.622 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.621+0000 7f671c9f8700 1 -- 172.21.15.134:0/2499307087 wait complete. 2024-03-22T07:37:22.623 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 33 2024-03-22T07:37:22.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 -- 172.21.15.134:0/2065470786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 msgr2=0x7f6c080ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 --2- 172.21.15.134:0/2065470786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c080ffa40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8004940 tx=0x7f6bf8009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:22.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 -- 172.21.15.134:0/2065470786 shutdown_connections 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 --2- 172.21.15.134:0/2065470786 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080fff80 0x7f6c08102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 --2- 172.21.15.134:0/2065470786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c080ffa40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 -- 172.21.15.134:0/2065470786 >> 172.21.15.134:0/2065470786 conn(0x7f6c080f7450 msgr2=0x7f6c080f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 -- 172.21.15.134:0/2065470786 shutdown_connections 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.724+0000 7f6c1014d700 1 -- 172.21.15.134:0/2065470786 wait complete. 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c1014d700 1 Processor -- start 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c1014d700 1 -- start start 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c1014d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c0810d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c1014d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080fff80 0x7f6c0810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c1014d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0810e490 con 0x7f6c08066ed0 2024-03-22T07:37:22.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c1014d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0810e600 con 0x7f6c080fff80 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0dee9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c0810d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0dee9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c0810d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42164/0 (socket says 172.21.15.134:42164) 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0dee9700 1 -- 172.21.15.134:0/3115400214 learned_addr learned my addr 172.21.15.134:0/3115400214 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0d6e8700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080fff80 0x7f6c0810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0dee9700 1 -- 172.21.15.134:0/3115400214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080fff80 msgr2=0x7f6c0810de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0dee9700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080fff80 0x7f6c0810de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.725+0000 7f6c0dee9700 1 -- 172.21.15.134:0/3115400214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8005040 con 0x7f6c08066ed0 2024-03-22T07:37:22.728 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.726+0000 7f6c0dee9700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c0810d950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b3b0 tx=0x7f6bf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.726+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf800e040 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.726+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bf800bbf0 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.726+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf801c630 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.726+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c08113000 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.726+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c081135c0 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.727+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0804c710 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.727+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f6bf800bd60 con 0x7f6c08066ed0 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.728+0000 7f6bfe7fc700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6bf406d380 0x7f6bf406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:22.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.728+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f6bf808d470 con 0x7f6c08066ed0 2024-03-22T07:37:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.728+0000 7f6c0d6e8700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6bf406d380 0x7f6bf406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:22.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.728+0000 7f6c0d6e8700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6bf406d380 0x7f6bf406f830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c04004f40 tx=0x7f6c0400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:22.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.732+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6bf805aa70 con 0x7f6c08066ed0 2024-03-22T07:37:22.915 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:22 smithi134 ceph-mon[93947]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:22.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:22 smithi134 ceph-mon[93947]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:22.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:22 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2385547654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:22.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:22 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:22.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:22 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:22.916 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:22 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2499307087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:37:22.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:22 smithi195 ceph-mon[82061]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:22 smithi195 ceph-mon[82061]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:22 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2385547654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:22 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:22 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:22.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:22 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2499307087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:37:22.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.958+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c080f8f40 con 0x7f6bf406d380 2024-03-22T07:37:22.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.959+0000 7f6bfe7fc700 1 -- 172.21.15.134:0/3115400214 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f6c080f8f40 con 0x7f6bf406d380 2024-03-22T07:37:22.960 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:37:22.960 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:37:22.960 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:37:22.960 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "mds" 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "16/21 daemons upgraded", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading node-exporter daemons", 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:37:22.961 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6bf406d380 msgr2=0x7f6bf406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6bf406d380 0x7f6bf406f830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c04004f40 tx=0x7f6c0400b040 comp rx=0 tx=0).stop 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 msgr2=0x7f6c0810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c0810d950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b3b0 tx=0x7f6bf8009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 shutdown_connections 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6bf406d380 0x7f6bf406f830 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c08066ed0 0x7f6c0810d950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 --2- 172.21.15.134:0/3115400214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080fff80 0x7f6c0810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 >> 172.21.15.134:0/3115400214 conn(0x7f6c080f7450 msgr2=0x7f6c080f7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 shutdown_connections 2024-03-22T07:37:22.963 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:22.962+0000 7f6c1014d700 1 -- 172.21.15.134:0/3115400214 wait complete. 2024-03-22T07:37:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 -- 172.21.15.134:0/2037691307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fce40 msgr2=0x7fe0140fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2037691307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fce40 0x7fe0140fd250 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe010009ce0 tx=0x7fe010004d10 comp rx=0 tx=0).stop 2024-03-22T07:37:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 -- 172.21.15.134:0/2037691307 shutdown_connections 2024-03-22T07:37:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2037691307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0140fe040 0x7fe0140fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2037691307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fce40 0x7fe0140fd250 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 -- 172.21.15.134:0/2037691307 >> 172.21.15.134:0/2037691307 conn(0x7fe0140f8550 msgr2=0x7fe0140fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 -- 172.21.15.134:0/2037691307 shutdown_connections 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 -- 172.21.15.134:0/2037691307 wait complete. 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 Processor -- start 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.064+0000 7fe01bac1700 1 -- start start 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01bac1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0140fce40 0x7fe01410dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01bac1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 0x7fe01410e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01bac1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01410e6f0 con 0x7fe0140fe040 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01bac1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01410ef40 con 0x7fe0140fce40 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 0x7fe01410e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 0x7fe01410e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42188/0 (socket says 172.21.15.134:42188) 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 -- 172.21.15.134:0/2728412581 learned_addr learned my addr 172.21.15.134:0/2728412581 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01985d700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0140fce40 0x7fe01410dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 -- 172.21.15.134:0/2728412581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0140fce40 msgr2=0x7fe01410dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:23.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0140fce40 0x7fe01410dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 -- 172.21.15.134:0/2728412581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe010009940 con 0x7fe0140fe040 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01905c700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 0x7fe01410e0f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe004002a50 tx=0x7fe0040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe004007cc0 con 0x7fe0140fe040 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe00400f040 con 0x7fe0140fe040 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01410f220 con 0x7fe0140fe040 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00400da30 con 0x7fe0140fe040 2024-03-22T07:37:23.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.065+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01410f760 con 0x7fe0140fe040 2024-03-22T07:37:23.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.066+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01405f5f0 con 0x7fe0140fe040 2024-03-22T07:37:23.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.067+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fe00400db90 con 0x7fe0140fe040 2024-03-22T07:37:23.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.067+0000 7fe00a7fc700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe00006d380 0x7fe00006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:23.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.067+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fe00408c7b0 con 0x7fe0140fe040 2024-03-22T07:37:23.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.067+0000 7fe01985d700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe00006d380 0x7fe00006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:23.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.068+0000 7fe01985d700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe00006d380 0x7fe00006f830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe010009470 tx=0x7fe010004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:23.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.072+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe004059c70 con 0x7fe0140fe040 2024-03-22T07:37:23.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.373+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe01410fa20 con 0x7fe0140fe040 2024-03-22T07:37:23.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.374+0000 7fe00a7fc700 1 -- 172.21.15.134:0/2728412581 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe004059800 con 0x7fe0140fe040 2024-03-22T07:37:23.375 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:37:23.377 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe00006d380 msgr2=0x7fe00006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe00006d380 0x7fe00006f830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe010009470 tx=0x7fe010004d10 comp rx=0 tx=0).stop 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 msgr2=0x7fe01410e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 0x7fe01410e0f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe004002a50 tx=0x7fe0040046b0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 shutdown_connections 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe00006d380 0x7fe00006f830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe0140fce40 0x7fe01410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 --2- 172.21.15.134:0/2728412581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0140fe040 0x7fe01410e0f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 >> 172.21.15.134:0/2728412581 conn(0x7fe0140f8550 msgr2=0x7fe0140f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 shutdown_connections 2024-03-22T07:37:23.378 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:23.377+0000 7fe01bac1700 1 -- 172.21.15.134:0/2728412581 wait complete. 2024-03-22T07:37:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:23 smithi195 ceph-mon[82061]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:23 smithi195 ceph-mon[82061]: pgmap v219: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:23 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2728412581' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:37:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:23.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:23 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:24.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:23 smithi134 ceph-mon[93947]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:23 smithi134 ceph-mon[93947]: pgmap v219: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:23 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2728412581' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:37:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:24.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:23 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:24.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:24 smithi195 ceph-mon[82061]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:25.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:24 smithi134 ceph-mon[93947]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:25.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:25 smithi195 ceph-mon[82061]: pgmap v220: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:25.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:25.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:25 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:26.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:25 smithi134 ceph-mon[93947]: pgmap v220: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:26.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:26.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:25 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:27 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:27.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:27 smithi134 ceph-mon[93947]: pgmap v221: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:27 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:27.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:27 smithi195 ceph-mon[82061]: pgmap v221: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.545 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:29 smithi134 ceph-mon[93947]: pgmap v222: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:29.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:29 smithi195 ceph-mon[82061]: pgmap v222: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:31.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:31 smithi195 ceph-mon[82061]: Upgrade: Updating prometheus.smithi134 2024-03-22T07:37:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:31 smithi195 ceph-mon[82061]: Deploying daemon prometheus.smithi134 on smithi134 2024-03-22T07:37:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:31 smithi195 ceph-mon[82061]: pgmap v223: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:32.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:31 smithi134 ceph-mon[93947]: Upgrade: Updating prometheus.smithi134 2024-03-22T07:37:32.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:31 smithi134 ceph-mon[93947]: Deploying daemon prometheus.smithi134 on smithi134 2024-03-22T07:37:32.003 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:31 smithi134 ceph-mon[93947]: pgmap v223: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:33.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:33 smithi134 ceph-mon[93947]: pgmap v224: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:33.780 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:33.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:33 smithi195 ceph-mon[82061]: pgmap v224: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:35.737 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:35 smithi134 ceph-mon[93947]: pgmap v225: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:35.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:35 smithi195 ceph-mon[82061]: pgmap v225: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:36 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:36 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:36 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:37.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:36 smithi134 ceph-mon[93947]: pgmap v226: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:37.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:36 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:37.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:36 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:37.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:36 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:37.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:36 smithi195 ceph-mon[82061]: pgmap v226: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:39.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:39 smithi134 ceph-mon[93947]: pgmap v227: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:39.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:39 smithi195 ceph-mon[82061]: pgmap v227: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:41 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:41.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:41 smithi195 ceph-mon[82061]: pgmap v228: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:41.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:41 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:41.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:41 smithi134 ceph-mon[93947]: pgmap v228: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:42.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:42.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:42 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:42.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:42.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:42 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:43.718 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:43 smithi134 ceph-mon[93947]: pgmap v229: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:43 smithi195 ceph-mon[82061]: pgmap v229: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:45.857 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: pgmap v230: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:45.857 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:45.857 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.858 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:45 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: pgmap v230: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:37:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:37:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.956 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:45.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:45 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:46.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:46 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:37:46.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:46 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-22T07:37:47.851 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:47 smithi134 ceph-mon[93947]: pgmap v231: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:47.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:47 smithi195 ceph-mon[82061]: pgmap v231: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:48.941 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:48 smithi134 ceph-mon[93947]: Upgrade: Updating alertmanager.smithi134 2024-03-22T07:37:48.941 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:48 smithi134 ceph-mon[93947]: Deploying daemon alertmanager.smithi134 on smithi134 2024-03-22T07:37:48.941 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:48.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:48 smithi195 ceph-mon[82061]: Upgrade: Updating alertmanager.smithi134 2024-03-22T07:37:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:48 smithi195 ceph-mon[82061]: Deploying daemon alertmanager.smithi134 on smithi134 2024-03-22T07:37:48.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:37:49.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:49 smithi195 ceph-mon[82061]: pgmap v232: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:50.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:49 smithi134 ceph-mon[93947]: pgmap v232: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:51.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:51 smithi134 ceph-mon[93947]: pgmap v233: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:51.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:51 smithi195 ceph-mon[82061]: pgmap v233: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 -- 172.21.15.134:0/1269917234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fbcd0 msgr2=0x7fa4a80fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:53.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1269917234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fbcd0 0x7fa4a80fc0e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa490004940 tx=0x7fa490009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:53.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 -- 172.21.15.134:0/1269917234 shutdown_connections 2024-03-22T07:37:53.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1269917234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4a80fcf80 0x7fa4a80fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1269917234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fbcd0 0x7fa4a80fc0e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 -- 172.21.15.134:0/1269917234 >> 172.21.15.134:0/1269917234 conn(0x7fa4a80f7430 msgr2=0x7fa4a80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:53.490 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 -- 172.21.15.134:0/1269917234 shutdown_connections 2024-03-22T07:37:53.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.484+0000 7fa4ad296700 1 -- 172.21.15.134:0/1269917234 wait complete. 2024-03-22T07:37:53.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4ad296700 1 Processor -- start 2024-03-22T07:37:53.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4ad296700 1 -- start start 2024-03-22T07:37:53.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4ad296700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4a80fbcd0 0x7fa4a81106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:53.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4ad296700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 0x7fa4a8112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:53.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4ad296700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8066440 con 0x7fa4a80fcf80 2024-03-22T07:37:53.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4ad296700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8066580 con 0x7fa4a80fbcd0 2024-03-22T07:37:53.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 0x7fa4a8112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:53.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 0x7fa4a8112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43420/0 (socket says 172.21.15.134:43420) 2024-03-22T07:37:53.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a67fc700 1 -- 172.21.15.134:0/1005791472 learned_addr learned my addr 172.21.15.134:0/1005791472 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:53.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a6ffd700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4a80fbcd0 0x7fa4a81106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a67fc700 1 -- 172.21.15.134:0/1005791472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4a80fbcd0 msgr2=0x7fa4a81106d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a67fc700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4a80fbcd0 0x7fa4a81106d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.485+0000 7fa4a67fc700 1 -- 172.21.15.134:0/1005791472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490005040 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.486+0000 7fa4a67fc700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 0x7fa4a8112c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b790 tx=0x7fa498009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.486+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa49800f6f0 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.486+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa49800fd20 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.486+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a81132b0 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.486+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4980103a0 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.486+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a8113870 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.487+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a805f5f0 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.487+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fa498011400 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.488+0000 7fa49f7fe700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa49406d380 0x7fa49406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.488+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa49808c800 con 0x7fa4a80fcf80 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.488+0000 7fa4a6ffd700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa49406d380 0x7fa49406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:53.496 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.488+0000 7fa4a6ffd700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa49406d380 0x7fa49406f830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa49000b970 tx=0x7fa490009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.492+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa498056210 con 0x7fa4a80fcf80 2024-03-22T07:37:53.721 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.721+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a8101220 con 0x7fa49406d380 2024-03-22T07:37:53.722 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.722+0000 7fa49f7fe700 1 -- 172.21.15.134:0/1005791472 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fa4a8101220 con 0x7fa49406d380 2024-03-22T07:37:53.724 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa49406d380 msgr2=0x7fa49406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:53.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa49406d380 0x7fa49406f830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa49000b970 tx=0x7fa490009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:53.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 msgr2=0x7fa4a8112c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:53.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 0x7fa4a8112c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b790 tx=0x7fa498009250 comp rx=0 tx=0).stop 2024-03-22T07:37:53.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 shutdown_connections 2024-03-22T07:37:53.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa49406d380 0x7fa49406f830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa4a80fbcd0 0x7fa4a81106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 --2- 172.21.15.134:0/1005791472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fcf80 0x7fa4a8112c20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 >> 172.21.15.134:0/1005791472 conn(0x7fa4a80f7430 msgr2=0x7fa4a80f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:53.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 shutdown_connections 2024-03-22T07:37:53.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.724+0000 7fa4ad296700 1 -- 172.21.15.134:0/1005791472 wait complete. 2024-03-22T07:37:53.734 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:37:53.762 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:53 smithi134 ceph-mon[93947]: pgmap v234: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:53.762 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:53.762 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:53.762 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:53 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:53.831 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 -- 172.21.15.134:0/1192043104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fcf00 msgr2=0x7f8ea80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:53.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/1192043104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fcf00 0x7f8ea80fd310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004940 tx=0x7f8ea4009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:53.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 -- 172.21.15.134:0/1192043104 shutdown_connections 2024-03-22T07:37:53.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/1192043104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ea80fe070 0x7f8ea80fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/1192043104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fcf00 0x7f8ea80fd310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 -- 172.21.15.134:0/1192043104 >> 172.21.15.134:0/1192043104 conn(0x7f8ea80f85a0 msgr2=0x7f8ea80fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:53.832 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 -- 172.21.15.134:0/1192043104 shutdown_connections 2024-03-22T07:37:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 -- 172.21.15.134:0/1192043104 wait complete. 2024-03-22T07:37:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 Processor -- start 2024-03-22T07:37:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.829+0000 7f8eb03f3700 1 -- start start 2024-03-22T07:37:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eb03f3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ea80fcf00 0x7f8ea8071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eb03f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 0x7f8ea8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eb03f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80708a0 con 0x7f8ea80fe070 2024-03-22T07:37:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eb03f3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80709e0 con 0x7f8ea80fcf00 2024-03-22T07:37:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 0x7f8ea8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 0x7f8ea8070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46454/0 (socket says 172.21.15.134:46454) 2024-03-22T07:37:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 -- 172.21.15.134:0/192871939 learned_addr learned my addr 172.21.15.134:0/192871939 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eae18f700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ea80fcf00 0x7f8ea8071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 -- 172.21.15.134:0/192871939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ea80fcf00 msgr2=0x7f8ea8071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ea80fcf00 0x7f8ea8071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 -- 172.21.15.134:0/192871939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4005040 con 0x7f8ea80fe070 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8ead98e700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 0x7f8ea8070310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e98002a50 tx=0x7f8e980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e98007cc0 con 0x7f8ea80fe070 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e9800f040 con 0x7f8ea80fe070 2024-03-22T07:37:53.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9800da30 con 0x7f8ea80fe070 2024-03-22T07:37:53.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea8070cc0 con 0x7f8ea80fe070 2024-03-22T07:37:53.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.830+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8115ac0 con 0x7f8ea80fe070 2024-03-22T07:37:53.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.831+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea805f5f0 con 0x7f8ea80fe070 2024-03-22T07:37:53.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.832+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f8e9800dbb0 con 0x7f8ea80fe070 2024-03-22T07:37:53.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.832+0000 7f8e9effd700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8e9406d380 0x7f8e9406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:53.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.832+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f8e9808c6c0 con 0x7f8ea80fe070 2024-03-22T07:37:53.837 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.832+0000 7f8eae18f700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8e9406d380 0x7f8e9406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:53.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.833+0000 7f8eae18f700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8e9406d380 0x7f8e9406f830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004890 tx=0x7f8ea4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:53.838 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:53.837+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8e980560d0 con 0x7f8ea80fe070 2024-03-22T07:37:53.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:53 smithi195 ceph-mon[82061]: pgmap v234: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:53.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:53.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:53.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:53 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:37:54.072 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.072+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ea81023e0 con 0x7f8e9406d380 2024-03-22T07:37:54.073 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.074+0000 7f8e9effd700 1 -- 172.21.15.134:0/192871939 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f8ea81023e0 con 0x7f8e9406d380 2024-03-22T07:37:54.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8e9406d380 msgr2=0x7f8e9406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8e9406d380 0x7f8e9406f830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004890 tx=0x7f8ea4009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:54.076 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 msgr2=0x7f8ea8070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 0x7f8ea8070310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e98002a50 tx=0x7f8e980046b0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 shutdown_connections 2024-03-22T07:37:54.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f8e9406d380 0x7f8e9406f830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ea80fcf00 0x7f8ea8071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 --2- 172.21.15.134:0/192871939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ea80fe070 0x7f8ea8070310 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 >> 172.21.15.134:0/192871939 conn(0x7f8ea80f85a0 msgr2=0x7f8ea80f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:54.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 shutdown_connections 2024-03-22T07:37:54.078 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.076+0000 7f8eb03f3700 1 -- 172.21.15.134:0/192871939 wait complete. 2024-03-22T07:37:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 -- 172.21.15.134:0/401743596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fce70 msgr2=0x7fdd440fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 --2- 172.21.15.134:0/401743596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fce70 0x7fdd440fd280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd40004940 tx=0x7fdd40009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 -- 172.21.15.134:0/401743596 shutdown_connections 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 --2- 172.21.15.134:0/401743596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd440fdfe0 0x7fdd440fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 --2- 172.21.15.134:0/401743596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fce70 0x7fdd440fd280 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 -- 172.21.15.134:0/401743596 >> 172.21.15.134:0/401743596 conn(0x7fdd440f8550 msgr2=0x7fdd440fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 -- 172.21.15.134:0/401743596 shutdown_connections 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.190+0000 7fdd4c664700 1 -- 172.21.15.134:0/401743596 wait complete. 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4c664700 1 Processor -- start 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4c664700 1 -- start start 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4c664700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd440fce70 0x7fdd4410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4c664700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 0x7fdd4410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4c664700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4410e4b0 con 0x7fdd440fdfe0 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4c664700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4410e620 con 0x7fdd440fce70 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 0x7fdd4410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 0x7fdd4410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46462/0 (socket says 172.21.15.134:46462) 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 -- 172.21.15.134:0/2112506981 learned_addr learned my addr 172.21.15.134:0/2112506981 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd4a400700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd440fce70 0x7fdd4410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 -- 172.21.15.134:0/2112506981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd440fce70 msgr2=0x7fdd4410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd440fce70 0x7fdd4410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 -- 172.21.15.134:0/2112506981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40005040 con 0x7fdd440fdfe0 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.191+0000 7fdd49bff700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 0x7fdd4410deb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400c810 tx=0x7fdd34004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.192+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd34012810 con 0x7fdd440fdfe0 2024-03-22T07:37:54.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.192+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd34012e40 con 0x7fdd440fdfe0 2024-03-22T07:37:54.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.192+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd44113080 con 0x7fdd440fdfe0 2024-03-22T07:37:54.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.192+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3400a370 con 0x7fdd440fdfe0 2024-03-22T07:37:54.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.192+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44113640 con 0x7fdd440fdfe0 2024-03-22T07:37:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.193+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4404c710 con 0x7fdd440fdfe0 2024-03-22T07:37:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.193+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fdd34011810 con 0x7fdd440fdfe0 2024-03-22T07:37:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.193+0000 7fdd3affd700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdd3006d380 0x7fdd3006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.194+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fdd3408cda0 con 0x7fdd440fdfe0 2024-03-22T07:37:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.194+0000 7fdd4a400700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdd3006d380 0x7fdd3006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.194+0000 7fdd4a400700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdd3006d380 0x7fdd3006f830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd40004f90 tx=0x7fdd40009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:54.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.198+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdd3405a2e0 con 0x7fdd440fdfe0 2024-03-22T07:37:54.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.407+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd44102340 con 0x7fdd3006d380 2024-03-22T07:37:54.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.420+0000 7fdd3affd700 1 -- 172.21.15.134:0/2112506981 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdd44102340 con 0x7fdd3006d380 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 starting - - - - 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (5m) 14s ago 17m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (5m) 33s ago 16m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (8m) 14s ago 16m 84.4M - 9.4.7 954c08fa6188 37b4660373c8 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (101s) 14s ago 11m 14.3M - 19.0.0-1667-gdb0330b1 4f325f8440e9 5b048ce7e8da 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (2m) 14s ago 11m 85.0M - 19.0.0-1667-gdb0330b1 4f325f8440e9 8a0992eba74a 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (74s) 33s ago 11m 11.7M - 19.0.0-1667-gdb0330b1 4f325f8440e9 e184e705472b 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (51s) 33s ago 11m 14.8M - 19.0.0-1667-gdb0330b1 4f325f8440e9 229f2db1b811 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (7m) 14s ago 18m 511M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (6m) 33s ago 16m 451M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:37:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (6m) 14s ago 18m 54.5M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (6m) 33s ago 16m 37.7M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (40s) 14s ago 17m 7717k - 1.5.0 0da6a335fe13 db92926a32c3 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (35s) 33s ago 16m 3657k - 1.5.0 0da6a335fe13 376ba127b41a 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 14s ago 15m 105M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (4m) 14s ago 14m 119M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 14s ago 14m 108M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (3m) 33s ago 14m 131M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (2m) 33s ago 13m 113M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (2m) 33s ago 13m 99.2M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:37:54.421 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (18s) 14s ago 16m 37.7M - 2.43.0 a07b618ecd1d b80ee14b32d6 2024-03-22T07:37:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.422+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdd3006d380 msgr2=0x7fdd3006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.422+0000 7fdd4c664700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdd3006d380 0x7fdd3006f830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd40004f90 tx=0x7fdd40009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.422+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 msgr2=0x7fdd4410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.422+0000 7fdd4c664700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 0x7fdd4410deb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400c810 tx=0x7fdd34004470 comp rx=0 tx=0).stop 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.422+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 shutdown_connections 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.423+0000 7fdd4c664700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdd3006d380 0x7fdd3006f830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.423+0000 7fdd4c664700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd440fce70 0x7fdd4410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.423+0000 7fdd4c664700 1 --2- 172.21.15.134:0/2112506981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd440fdfe0 0x7fdd4410deb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.423+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 >> 172.21.15.134:0/2112506981 conn(0x7fdd440f8550 msgr2=0x7fdd440f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.423+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 shutdown_connections 2024-03-22T07:37:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.423+0000 7fdd4c664700 1 -- 172.21.15.134:0/2112506981 wait complete. 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 -- 172.21.15.134:0/2074482673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 msgr2=0x7f4e38102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 --2- 172.21.15.134:0/2074482673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e38102320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c004940 tx=0x7f4e2c009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 -- 172.21.15.134:0/2074482673 shutdown_connections 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 --2- 172.21.15.134:0/2074482673 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e38102320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 --2- 172.21.15.134:0/2074482673 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380662e0 0x7f4e380ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 -- 172.21.15.134:0/2074482673 >> 172.21.15.134:0/2074482673 conn(0x7f4e380f7430 msgr2=0x7f4e380f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 -- 172.21.15.134:0/2074482673 shutdown_connections 2024-03-22T07:37:54.525 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.525+0000 7f4e3d615700 1 -- 172.21.15.134:0/2074482673 wait complete. 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e3d615700 1 Processor -- start 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e3d615700 1 -- start start 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e3d615700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380662e0 0x7f4e3810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e3d615700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e3810df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e3d615700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3810e580 con 0x7f4e380fff00 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e3d615700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3810ed80 con 0x7f4e380662e0 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e3810df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e3810df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46478/0 (socket says 172.21.15.134:46478) 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 -- 172.21.15.134:0/1555723401 learned_addr learned my addr 172.21.15.134:0/1555723401 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e36ffd700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380662e0 0x7f4e3810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 -- 172.21.15.134:0/1555723401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380662e0 msgr2=0x7f4e3810da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380662e0 0x7f4e3810da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 -- 172.21.15.134:0/1555723401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c005040 con 0x7f4e380fff00 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.526+0000 7f4e367fc700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e3810df80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009150 tx=0x7f4e2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.527+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2c00e040 con 0x7f4e380fff00 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.527+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e2c00bbf0 con 0x7f4e380fff00 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.527+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2c01c630 con 0x7f4e380fff00 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.527+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3810f000 con 0x7f4e380fff00 2024-03-22T07:37:54.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.527+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3810f540 con 0x7f4e380fff00 2024-03-22T07:37:54.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.528+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3805f5f0 con 0x7f4e380fff00 2024-03-22T07:37:54.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.528+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f4e2c00bd60 con 0x7f4e380fff00 2024-03-22T07:37:54.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.529+0000 7f4e1f7fe700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4e2006d390 0x7f4e2006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.529+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f4e2c08dc60 con 0x7f4e380fff00 2024-03-22T07:37:54.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.529+0000 7f4e36ffd700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4e2006d390 0x7f4e2006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.529 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.529+0000 7f4e36ffd700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4e2006d390 0x7f4e2006f840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4e38066020 tx=0x7f4e30009e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:54.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.533+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4e2c05b260 con 0x7f4e380fff00 2024-03-22T07:37:54.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.821+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e3810f850 con 0x7f4e380fff00 2024-03-22T07:37:54.821 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.821+0000 7f4e1f7fe700 1 -- 172.21.15.134:0/1555723401 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4e2c013e60 con 0x7f4e380fff00 2024-03-22T07:37:54.821 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:37:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 14 2024-03-22T07:37:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:37:54.824 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4e2006d390 msgr2=0x7f4e2006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4e2006d390 0x7f4e2006f840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4e38066020 tx=0x7f4e30009e20 comp rx=0 tx=0).stop 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 msgr2=0x7f4e3810df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e3810df80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009150 tx=0x7f4e2c009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 shutdown_connections 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4e2006d390 0x7f4e2006f840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.825 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380662e0 0x7f4e3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 --2- 172.21.15.134:0/1555723401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380fff00 0x7f4e3810df80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 >> 172.21.15.134:0/1555723401 conn(0x7f4e380f7430 msgr2=0x7f4e380f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:54.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 shutdown_connections 2024-03-22T07:37:54.826 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.824+0000 7f4e3d615700 1 -- 172.21.15.134:0/1555723401 wait complete. 2024-03-22T07:37:54.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963110692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fcf90 msgr2=0x7ff0400fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963110692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fcf90 0x7ff0400fd400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff034004940 tx=0x7ff034009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:54.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963110692 shutdown_connections 2024-03-22T07:37:54.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963110692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fcf90 0x7ff0400fd400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963110692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fbce0 0x7ff0400fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963110692 >> 172.21.15.134:0/1963110692 conn(0x7ff0400f7440 msgr2=0x7ff0400f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963110692 shutdown_connections 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963110692 wait complete. 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 Processor -- start 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- start start 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 0x7ff040066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fcf90 0x7ff040114b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04010e520 con 0x7ff0400fbce0 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.926+0000 7ff044e0d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040115080 con 0x7ff0400fcf90 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 0x7ff040066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 0x7ff040066d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46486/0 (socket says 172.21.15.134:46486) 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 -- 172.21.15.134:0/1963934755 learned_addr learned my addr 172.21.15.134:0/1963934755 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03dd9b700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fcf90 0x7ff040114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 -- 172.21.15.134:0/1963934755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fcf90 msgr2=0x7ff040114b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:54.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fcf90 0x7ff040114b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 -- 172.21.15.134:0/1963934755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034005040 con 0x7ff0400fbce0 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03dd9b700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fcf90 0x7ff040114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff03e59c700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 0x7ff040066d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff030002a80 tx=0x7ff0300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff030007cc0 con 0x7ff0400fbce0 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff03000f040 con 0x7ff0400fbce0 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff040115280 con 0x7ff0400fbce0 2024-03-22T07:37:54.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff030009640 con 0x7ff0400fbce0 2024-03-22T07:37:54.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.927+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0401157f0 con 0x7ff0400fbce0 2024-03-22T07:37:54.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.928+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04004c710 con 0x7ff0400fbce0 2024-03-22T07:37:54.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.929+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7ff0300097a0 con 0x7ff0400fbce0 2024-03-22T07:37:54.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.929+0000 7ff02effd700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff02806d380 0x7ff02806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:54.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.929+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7ff03008c6e0 con 0x7ff0400fbce0 2024-03-22T07:37:54.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.929+0000 7ff03dd9b700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff02806d380 0x7ff02806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:54.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.929+0000 7ff03dd9b700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff02806d380 0x7ff02806f830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff03400b3b0 tx=0x7ff034009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:54.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:54.934+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff030059c20 con 0x7ff0400fbce0 2024-03-22T07:37:54.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:54 smithi195 ceph-mon[82061]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:55.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:54 smithi134 ceph-mon[93947]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:55.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.189+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff040115d20 con 0x7ff0400fbce0 2024-03-22T07:37:55.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.189+0000 7ff02effd700 1 -- 172.21.15.134:0/1963934755 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1877 (secure 0 0 0) 0x7ff0300597b0 con 0x7ff0400fbce0 2024-03-22T07:37:55.190 INFO:teuthology.orchestra.run.smithi134.stdout:e33 2024-03-22T07:37:55.190 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:37:55.191 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:37:55.191 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:37:55.191 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:55.191 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:37:55.191 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:37:55.192 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 32 2024-03-22T07:37:55.192 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:37:55.192 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:37:55.192 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:37:01.692864+0000 2024-03-22T07:37:55.192 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:37:55.193 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:37:55.193 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:37:55.193 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:37:55.193 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:37:55.193 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:37:55.194 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:37:55.194 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:37:55.194 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 84 2024-03-22T07:37:55.194 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-22T07:37:55.194 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:37:55.195 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:37:55.195 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34400} 2024-03-22T07:37:55.195 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:37:55.195 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:37:55.195 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:37:55.196 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:37:55.196 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:37:55.196 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:37:55.196 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:37:55.196 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:37:55.197 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:37:55.197 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{0:34400} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:55.197 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:55.197 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:55.197 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:37:55.197 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:37:55.198 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:55.198 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/2563834080,v1:172.21.15.195:6825/2563834080] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:55.198 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/2724498229,v1:172.21.15.195:6827/2724498229] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:37:55.199 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.191+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff02806d380 msgr2=0x7ff02806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.191+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff02806d380 0x7ff02806f830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff03400b3b0 tx=0x7ff034009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.191+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 msgr2=0x7ff040066d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.191+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 0x7ff040066d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff030002a80 tx=0x7ff0300046b0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 shutdown_connections 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7ff02806d380 0x7ff02806f830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0400fbce0 0x7ff040066d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.200 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 --2- 172.21.15.134:0/1963934755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0400fcf90 0x7ff040114b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 >> 172.21.15.134:0/1963934755 conn(0x7ff0400f7440 msgr2=0x7ff0400f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:55.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 shutdown_connections 2024-03-22T07:37:55.201 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.192+0000 7ff044e0d700 1 -- 172.21.15.134:0/1963934755 wait complete. 2024-03-22T07:37:55.201 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 33 2024-03-22T07:37:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.298+0000 7f6fa4d91700 1 -- 172.21.15.134:0/2633851745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 msgr2=0x7f6fa00fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.302 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.298+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/2633851745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa00fe450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f94004940 tx=0x7f6f94009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.298+0000 7f6fa4d91700 1 -- 172.21.15.134:0/2633851745 shutdown_connections 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.298+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/2633851745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa00fe450 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.298+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/2633851745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa00fce70 0x7f6fa00fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.298+0000 7f6fa4d91700 1 -- 172.21.15.134:0/2633851745 >> 172.21.15.134:0/2633851745 conn(0x7f6fa00f8550 msgr2=0x7f6fa00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 -- 172.21.15.134:0/2633851745 shutdown_connections 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 -- 172.21.15.134:0/2633851745 wait complete. 2024-03-22T07:37:55.303 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 Processor -- start 2024-03-22T07:37:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 -- start start 2024-03-22T07:37:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa00fce70 0x7f6fa010d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa010ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa010e3d0 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6fa4d91700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa010e540 con 0x7f6fa00fce70 2024-03-22T07:37:55.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6f9dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa010ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6f9dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa010ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46496/0 (socket says 172.21.15.134:46496) 2024-03-22T07:37:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6f9dd9b700 1 -- 172.21.15.134:0/1897226324 learned_addr learned my addr 172.21.15.134:0/1897226324 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.299+0000 7f6f9e59c700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa00fce70 0x7f6fa010d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f9dd9b700 1 -- 172.21.15.134:0/1897226324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa00fce70 msgr2=0x7f6fa010d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.305 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f9dd9b700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa00fce70 0x7f6fa010d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f9dd9b700 1 -- 172.21.15.134:0/1897226324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94005040 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f9dd9b700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa010ddd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009150 tx=0x7f6f94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9400e040 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f9400bbf0 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa0112f40 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9401c630 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.300+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01134d0 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.301+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa004c710 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.301+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f6f9400bd60 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.302+0000 7f6f8effd700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6f8806d380 0x7f6f8806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:55.307 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.302+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f6f9408dc30 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.302+0000 7f6f9e59c700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6f8806d380 0x7f6f8806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:55.308 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.302+0000 7f6f9e59c700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6f8806d380 0x7f6f8806f830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009fd0 tx=0x7f6f9000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:55.309 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.306+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6f9405b230 con 0x7f6fa00fdfe0 2024-03-22T07:37:55.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.527+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa01022b0 con 0x7f6f8806d380 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.528+0000 7f6f8effd700 1 -- 172.21.15.134:0/1897226324 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f6fa01022b0 con 0x7f6f8806d380 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10", 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": true, 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [ 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr", 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "crash", 2024-03-22T07:37:55.528 INFO:teuthology.orchestra.run.smithi134.stdout: "mon", 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout: "osd", 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout: "mds" 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": "16/21 daemons upgraded", 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "Currently upgrading alertmanager daemons", 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:37:55.529 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:37:55.533 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6f8806d380 msgr2=0x7f6f8806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6f8806d380 0x7f6f8806f830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009fd0 tx=0x7f6f9000b040 comp rx=0 tx=0).stop 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 msgr2=0x7f6fa010ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa010ddd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009150 tx=0x7f6f94009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 shutdown_connections 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6f8806d380 0x7f6f8806f830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa00fce70 0x7f6fa010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 --2- 172.21.15.134:0/1897226324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6fa00fdfe0 0x7f6fa010ddd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 >> 172.21.15.134:0/1897226324 conn(0x7f6fa00f8550 msgr2=0x7f6fa00f9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 shutdown_connections 2024-03-22T07:37:55.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.532+0000 7f6fa4d91700 1 -- 172.21.15.134:0/1897226324 wait complete. 2024-03-22T07:37:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- 172.21.15.134:0/1044017266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 msgr2=0x7f3bd00fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 --2- 172.21.15.134:0/1044017266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd00fe450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0004940 tx=0x7f3bc0009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:55.637 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- 172.21.15.134:0/1044017266 shutdown_connections 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 --2- 172.21.15.134:0/1044017266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd00fe450 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 --2- 172.21.15.134:0/1044017266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 0x7f3bd00fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- 172.21.15.134:0/1044017266 >> 172.21.15.134:0/1044017266 conn(0x7f3bd00f8550 msgr2=0x7f3bd00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- 172.21.15.134:0/1044017266 shutdown_connections 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- 172.21.15.134:0/1044017266 wait complete. 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 Processor -- start 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- start start 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 0x7f3bd010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd010e4e0 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.636+0000 7f3bd768b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0112e80 con 0x7f3bd00fce70 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:55.638 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd010de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46512/0 (socket says 172.21.15.134:46512) 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 -- 172.21.15.134:0/2769724459 learned_addr learned my addr 172.21.15.134:0/2769724459 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd5427700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 0x7f3bd010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 -- 172.21.15.134:0/2769724459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 msgr2=0x7f3bd010d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 0x7f3bd010d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 -- 172.21.15.134:0/2769724459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0005040 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd5427700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 0x7f3bd010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd4c26700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd010de50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009150 tx=0x7f3bc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bc000e040 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bc000bbf0 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd0113080 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.637+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bc001c630 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.639 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.638+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd01135f0 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.639+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd004c710 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.639+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f3bc000bd60 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.639+0000 7f3bc5ffb700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bbc06d380 0x7f3bbc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:37:55.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.640+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f3bc008dcc0 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.640 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.640+0000 7f3bd5427700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bbc06d380 0x7f3bbc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:37:55.641 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.640+0000 7f3bd5427700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bbc06d380 0x7f3bbc06f830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc006fd0 tx=0x7f3bcc008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:37:55.643 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.644+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3bc005b2c0 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.937+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3bd0105950 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.937+0000 7f3bc5ffb700 1 -- 172.21.15.134:0/2769724459 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3bc005ae50 con 0x7f3bd00fdfe0 2024-03-22T07:37:55.937 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:37:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bbc06d380 msgr2=0x7f3bbc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bbc06d380 0x7f3bbc06f830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc006fd0 tx=0x7f3bcc008040 comp rx=0 tx=0).stop 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 msgr2=0x7f3bd010de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd010de50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009150 tx=0x7f3bc0009e30 comp rx=0 tx=0).stop 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 shutdown_connections 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bbc06d380 0x7f3bbc06f830 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bd00fce70 0x7f3bd010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.939+0000 7f3bd768b700 1 --2- 172.21.15.134:0/2769724459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bd00fdfe0 0x7f3bd010de50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.940+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 >> 172.21.15.134:0/2769724459 conn(0x7f3bd00f8550 msgr2=0x7f3bd00f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.940+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 shutdown_connections 2024-03-22T07:37:55.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:37:55.940+0000 7f3bd768b700 1 -- 172.21.15.134:0/2769724459 wait complete. 2024-03-22T07:37:56.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:55 smithi134 ceph-mon[93947]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:56.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:55 smithi134 ceph-mon[93947]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:56.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:55 smithi134 ceph-mon[93947]: pgmap v235: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:56.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:55 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1555723401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:56.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:55 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1963934755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:37:56.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:55 smithi195 ceph-mon[82061]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:56.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:55 smithi195 ceph-mon[82061]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:56.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:55 smithi195 ceph-mon[82061]: pgmap v235: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:56.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:55 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1555723401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:37:56.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:55 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1963934755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:37:57.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:56 smithi134 ceph-mon[93947]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:57.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:56 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2769724459' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:37:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:56 smithi195 ceph-mon[82061]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:37:57.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:56 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2769724459' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:37:58.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:57 smithi134 ceph-mon[93947]: pgmap v236: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:57 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:58.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:57 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:57 smithi195 ceph-mon[82061]: pgmap v236: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:57 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:58.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:57 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:59.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:59.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:59 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:59.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:37:59 smithi134 ceph-mon[93947]: pgmap v237: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:37:59.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:59 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:37:59.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:37:59 smithi195 ceph-mon[82061]: pgmap v237: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:01.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:01 smithi195 ceph-mon[82061]: pgmap v238: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:02.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:01 smithi134 ceph-mon[93947]: pgmap v238: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:02.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.706 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:02.707 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:02 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.046 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:02 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:03.922 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:03 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:38:03.922 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:03 smithi134 ceph-mon[93947]: pgmap v239: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:03.922 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:03 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-22T07:38:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:03 smithi195 ceph-mon[82061]: pgmap v239: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:03.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:04 smithi195 ceph-mon[82061]: Upgrade: Updating grafana.smithi134 2024-03-22T07:38:04.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:04 smithi195 ceph-mon[82061]: Deploying daemon grafana.smithi134 on smithi134 2024-03-22T07:38:05.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:04 smithi134 ceph-mon[93947]: Upgrade: Updating grafana.smithi134 2024-03-22T07:38:05.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:04 smithi134 ceph-mon[93947]: Deploying daemon grafana.smithi134 on smithi134 2024-03-22T07:38:05.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:05 smithi134 ceph-mon[93947]: pgmap v240: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:05.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:05 smithi195 ceph-mon[82061]: pgmap v240: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:07.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:07 smithi195 ceph-mon[82061]: pgmap v241: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:08.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:07 smithi134 ceph-mon[93947]: pgmap v241: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:09.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:09.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:09.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:09 smithi134 ceph-mon[93947]: pgmap v242: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:09.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:09 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:09 smithi195 ceph-mon[82061]: pgmap v242: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:09.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:09 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:11.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:11 smithi134 ceph-mon[93947]: pgmap v243: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:11.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:11 smithi195 ceph-mon[82061]: pgmap v243: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:13.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:13 smithi195 ceph-mon[82061]: pgmap v244: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:13.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:13 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:13.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:13 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:14.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:13 smithi134 ceph-mon[93947]: pgmap v244: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:14.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:13 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:14.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:13 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:15.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:15 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:15.454 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:15 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:15.455 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:15 smithi195 ceph-mon[82061]: pgmap v245: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:15.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:15 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:15.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:15 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:15.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:15 smithi134 ceph-mon[93947]: pgmap v245: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:17.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:17 smithi134 ceph-mon[93947]: pgmap v246: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:17 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:17 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:17 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:17 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:17.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:17 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:17.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:17 smithi195 ceph-mon[82061]: pgmap v246: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:17 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:17 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:17 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:17 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:17.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:17 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:38:18.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:38:18.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:18.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: Upgrade: Finalizing container_image settings 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-22T07:38:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:18.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:38:18.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-22T07:38:18.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:18.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.958 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: Upgrade: Finalizing container_image settings 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-22T07:38:18.959 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-22T07:38:18.960 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:38:18.961 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:38:18.962 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:38:18.962 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:18.962 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:19.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:19 smithi195 ceph-mon[82061]: Upgrade: Complete! 2024-03-22T07:38:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:19 smithi195 ceph-mon[82061]: pgmap v247: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:19.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:19 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:20.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:19 smithi134 ceph-mon[93947]: Upgrade: Complete! 2024-03-22T07:38:20.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:19 smithi134 ceph-mon[93947]: pgmap v247: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:20.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:19 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:38:21.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:21 smithi195 ceph-mon[82061]: pgmap v248: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:22.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:21 smithi134 ceph-mon[93947]: pgmap v248: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:23.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:23 smithi195 ceph-mon[82061]: pgmap v249: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:24.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:23 smithi134 ceph-mon[93947]: pgmap v249: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:25.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:25 smithi195 ceph-mon[82061]: pgmap v250: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:26.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:25 smithi134 ceph-mon[93947]: pgmap v250: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 -- 172.21.15.134:0/1977384560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 msgr2=0x7fed200fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 --2- 172.21.15.134:0/1977384560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed200fd280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fed1c004940 tx=0x7fed1c009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 -- 172.21.15.134:0/1977384560 shutdown_connections 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 --2- 172.21.15.134:0/1977384560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed200fdfe0 0x7fed200fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 --2- 172.21.15.134:0/1977384560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed200fd280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 -- 172.21.15.134:0/1977384560 >> 172.21.15.134:0/1977384560 conn(0x7fed200f8550 msgr2=0x7fed200fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 -- 172.21.15.134:0/1977384560 shutdown_connections 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.055+0000 7fed27249700 1 -- 172.21.15.134:0/1977384560 wait complete. 2024-03-22T07:38:26.056 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed27249700 1 Processor -- start 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed27249700 1 -- start start 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed27249700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed20071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed27249700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed200fdfe0 0x7fed20070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed27249700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20070850 con 0x7fed200fce70 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed27249700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200709c0 con 0x7fed200fdfe0 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed24fe5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed20071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed24fe5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed20071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54352/0 (socket says 172.21.15.134:54352) 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.056+0000 7fed24fe5700 1 -- 172.21.15.134:0/538214108 learned_addr learned my addr 172.21.15.134:0/538214108 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed17fff700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed200fdfe0 0x7fed20070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed24fe5700 1 -- 172.21.15.134:0/538214108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed200fdfe0 msgr2=0x7fed20070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed24fe5700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed200fdfe0 0x7fed20070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:26.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed24fe5700 1 -- 172.21.15.134:0/538214108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c005040 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed24fe5700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed20071c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009150 tx=0x7fed1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1c00e040 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed1c00bcc0 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed20070c40 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1c01c630 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.057+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed20115a50 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.058+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2004c710 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.059+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fed1c026440 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.059+0000 7fed157fa700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fed0806d380 0x7fed0806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.059+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fed1c08d720 con 0x7fed200fce70 2024-03-22T07:38:26.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.059+0000 7fed17fff700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fed0806d380 0x7fed0806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:26.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.060+0000 7fed17fff700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fed0806d380 0x7fed0806f830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed10006fd0 tx=0x7fed10008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:26.063 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.064+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fed1c05ac60 con 0x7fed200fce70 2024-03-22T07:38:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.276+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed20070dd0 con 0x7fed0806d380 2024-03-22T07:38:26.276 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.277+0000 7fed157fa700 1 -- 172.21.15.134:0/538214108 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fed20070dd0 con 0x7fed0806d380 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fed0806d380 msgr2=0x7fed0806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fed0806d380 0x7fed0806f830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed10006fd0 tx=0x7fed10008040 comp rx=0 tx=0).stop 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 msgr2=0x7fed20071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed20071c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009150 tx=0x7fed1c009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 shutdown_connections 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fed0806d380 0x7fed0806f830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed200fce70 0x7fed20071c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:26.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 --2- 172.21.15.134:0/538214108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed200fdfe0 0x7fed20070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:26.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.279+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 >> 172.21.15.134:0/538214108 conn(0x7fed200f8550 msgr2=0x7fed200f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:26.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.280+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 shutdown_connections 2024-03-22T07:38:26.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:26.280+0000 7fed27249700 1 -- 172.21.15.134:0/538214108 wait complete. 2024-03-22T07:38:27.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph orch ps' 2024-03-22T07:38:27.302 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:38:27.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:27 smithi134 ceph-mon[93947]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:38:27.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:27 smithi134 ceph-mon[93947]: pgmap v251: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:27.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:27 smithi195 ceph-mon[82061]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:38:27.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:27 smithi195 ceph-mon[82061]: pgmap v251: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 -- 172.21.15.134:0/145051711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fdee0 msgr2=0x7fc9940fe2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 --2- 172.21.15.134:0/145051711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fdee0 0x7fc9940fe2b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc984004940 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 -- 172.21.15.134:0/145051711 shutdown_connections 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 --2- 172.21.15.134:0/145051711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9940fe880 0x7fc994106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 --2- 172.21.15.134:0/145051711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fdee0 0x7fc9940fe2b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 -- 172.21.15.134:0/145051711 >> 172.21.15.134:0/145051711 conn(0x7fc9940f78f0 msgr2=0x7fc9940f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 -- 172.21.15.134:0/145051711 shutdown_connections 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.996+0000 7fc99a37d700 1 -- 172.21.15.134:0/145051711 wait complete. 2024-03-22T07:38:28.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc99a37d700 1 Processor -- start 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc99a37d700 1 -- start start 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc99a37d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9940fdee0 0x7fc9941138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc99a37d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 0x7fc994113e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc99a37d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994114450 con 0x7fc9940fe880 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc99a37d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99410da50 con 0x7fc9940fdee0 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc9937fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 0x7fc994113e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc9937fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 0x7fc994113e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54372/0 (socket says 172.21.15.134:54372) 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc9937fe700 1 -- 172.21.15.134:0/2296713419 learned_addr learned my addr 172.21.15.134:0/2296713419 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.997+0000 7fc993fff700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9940fdee0 0x7fc9941138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc9937fe700 1 -- 172.21.15.134:0/2296713419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9940fdee0 msgr2=0x7fc9941138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc9937fe700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9940fdee0 0x7fc9941138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc9937fe700 1 -- 172.21.15.134:0/2296713419 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984005040 con 0x7fc9940fe880 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc9937fe700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 0x7fc994113e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc988002a50 tx=0x7fc9880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc988007cc0 con 0x7fc9940fe880 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99410dd30 con 0x7fc9940fe880 2024-03-22T07:38:28.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc98800f040 con 0x7fc9940fe880 2024-03-22T07:38:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98800da30 con 0x7fc9940fe880 2024-03-22T07:38:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.998+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99410e270 con 0x7fc9940fe880 2024-03-22T07:38:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:28.999+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc994066a90 con 0x7fc9940fe880 2024-03-22T07:38:29.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.000+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fc98800db90 con 0x7fc9940fe880 2024-03-22T07:38:29.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.000+0000 7fc990ff9700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc97c06d380 0x7fc97c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:29.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.000+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fc98808c7b0 con 0x7fc9940fe880 2024-03-22T07:38:29.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.000+0000 7fc993fff700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc97c06d380 0x7fc97c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:29.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.001+0000 7fc993fff700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc97c06d380 0x7fc97c06f830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc984004f90 tx=0x7fc984009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:29.005 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.005+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc988059c70 con 0x7fc9940fe880 2024-03-22T07:38:29.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.212+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc994109f10 con 0x7fc97c06d380 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.222+0000 7fc990ff9700 1 -- 172.21.15.134:0/2296713419 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc994109f10 con 0x7fc97c06d380 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (37s) 16s ago 17m 16.2M - 0.25.0 c8568f914cd2 867cf1a1be7a 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (6m) 16s ago 18m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (6m) 67s ago 17m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (21s) 16s ago 17m 53.3M - 9.4.12 a0ea5e3c46d9 2eb05e7eec06 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (2m) 16s ago 12m 14.5M - 19.0.0-1667-gdb0330b1 4f325f8440e9 5b048ce7e8da 2024-03-22T07:38:29.222 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (2m) 16s ago 12m 85.0M - 19.0.0-1667-gdb0330b1 4f325f8440e9 8a0992eba74a 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (109s) 67s ago 12m 11.7M - 19.0.0-1667-gdb0330b1 4f325f8440e9 e184e705472b 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (86s) 67s ago 12m 14.8M - 19.0.0-1667-gdb0330b1 4f325f8440e9 229f2db1b811 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (8m) 16s ago 19m 511M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (7m) 67s ago 16m 451M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (7m) 16s ago 19m 56.9M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (6m) 67s ago 16m 37.7M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (75s) 16s ago 17m 8720k - 1.5.0 0da6a335fe13 db92926a32c3 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (70s) 67s ago 16m 3657k - 1.5.0 0da6a335fe13 376ba127b41a 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (5m) 16s ago 16m 105M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (5m) 16s ago 15m 119M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (4m) 16s ago 15m 108M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (4m) 67s ago 14m 131M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (3m) 67s ago 14m 113M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (2m) 67s ago 13m 99.2M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:38:29.223 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (53s) 16s ago 17m 44.8M - 2.43.0 a07b618ecd1d b80ee14b32d6 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc97c06d380 msgr2=0x7fc97c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc97c06d380 0x7fc97c06f830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc984004f90 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 msgr2=0x7fc994113e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 0x7fc994113e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc988002a50 tx=0x7fc9880046b0 comp rx=0 tx=0).stop 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 shutdown_connections 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc97c06d380 0x7fc97c06f830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:29.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9940fdee0 0x7fc9941138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 --2- 172.21.15.134:0/2296713419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9940fe880 0x7fc994113e00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.224+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 >> 172.21.15.134:0/2296713419 conn(0x7fc9940f78f0 msgr2=0x7fc994103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.225+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 shutdown_connections 2024-03-22T07:38:29.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:29.225+0000 7fc99a37d700 1 -- 172.21.15.134:0/2296713419 wait complete. 2024-03-22T07:38:29.905 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:29 smithi134 ceph-mon[93947]: pgmap v252: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:29.931 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph orch upgrade status' 2024-03-22T07:38:29.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:29 smithi195 ceph-mon[82061]: pgmap v252: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:30.189 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:38:30.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:30 smithi195 ceph-mon[82061]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:38:31.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:30 smithi134 ceph-mon[93947]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:38:31.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.866+0000 7f30a3633700 1 -- 172.21.15.134:0/449573114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c101d10 msgr2=0x7f309c1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:31.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 --2- 172.21.15.134:0/449573114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c101d10 0x7f309c1020e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3098004940 tx=0x7f3098009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:31.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 -- 172.21.15.134:0/449573114 shutdown_connections 2024-03-22T07:38:31.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 --2- 172.21.15.134:0/449573114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f309c1026b0 0x7f309c0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:31.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 --2- 172.21.15.134:0/449573114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c101d10 0x7f309c1020e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 -- 172.21.15.134:0/449573114 >> 172.21.15.134:0/449573114 conn(0x7f309c0f7880 msgr2=0x7f309c0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 -- 172.21.15.134:0/449573114 shutdown_connections 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 -- 172.21.15.134:0/449573114 wait complete. 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 Processor -- start 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.867+0000 7f30a3633700 1 -- start start 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a3633700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f309c101d10 0x7f309c10ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a3633700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 0x7f309c10f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a3633700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c10f550 con 0x7f309c1026b0 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a3633700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c10f690 con 0x7f309c101d10 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 0x7f309c10f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 0x7f309c10f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:54404/0 (socket says 172.21.15.134:54404) 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 -- 172.21.15.134:0/2406389595 learned_addr learned my addr 172.21.15.134:0/2406389595 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a13cf700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f309c101d10 0x7f309c10ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:31.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 -- 172.21.15.134:0/2406389595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f309c101d10 msgr2=0x7f309c10ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f309c101d10 0x7f309c10ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 -- 172.21.15.134:0/2406389595 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098005040 con 0x7f309c1026b0 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a0bce700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 0x7f309c10f010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c7e0 tx=0x7f308c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308c012810 con 0x7f309c1026b0 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f308c012e40 con 0x7f309c1026b0 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c117b40 con 0x7f309c1026b0 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.868+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308c00a550 con 0x7f309c1026b0 2024-03-22T07:38:31.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.869+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c117f60 con 0x7f309c1026b0 2024-03-22T07:38:31.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.870+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c0fd460 con 0x7f309c1026b0 2024-03-22T07:38:31.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.870+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f308c012970 con 0x7f309c1026b0 2024-03-22T07:38:31.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.870+0000 7f3091ffb700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f308806d380 0x7f308806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:31.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.870+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f308c08ce00 con 0x7f309c1026b0 2024-03-22T07:38:31.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.870+0000 7f30a13cf700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f308806d380 0x7f308806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:31.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.871+0000 7f30a13cf700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f308806d380 0x7f308806f830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3098004f90 tx=0x7f3098009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:31.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:31.875+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f308c056790 con 0x7f309c1026b0 2024-03-22T07:38:31.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:31 smithi195 ceph-mon[82061]: pgmap v253: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:32.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:31 smithi134 ceph-mon[93947]: pgmap v253: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:32.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.088+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f309c108ea0 con 0x7f308806d380 2024-03-22T07:38:32.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.090+0000 7f3091ffb700 1 -- 172.21.15.134:0/2406389595 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f309c108ea0 con 0x7f308806d380 2024-03-22T07:38:32.089 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:38:32.089 INFO:teuthology.orchestra.run.smithi134.stdout: "target_image": null, 2024-03-22T07:38:32.089 INFO:teuthology.orchestra.run.smithi134.stdout: "in_progress": false, 2024-03-22T07:38:32.090 INFO:teuthology.orchestra.run.smithi134.stdout: "which": "", 2024-03-22T07:38:32.090 INFO:teuthology.orchestra.run.smithi134.stdout: "services_complete": [], 2024-03-22T07:38:32.090 INFO:teuthology.orchestra.run.smithi134.stdout: "progress": null, 2024-03-22T07:38:32.090 INFO:teuthology.orchestra.run.smithi134.stdout: "message": "", 2024-03-22T07:38:32.090 INFO:teuthology.orchestra.run.smithi134.stdout: "is_paused": false 2024-03-22T07:38:32.090 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:38:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f308806d380 msgr2=0x7f308806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:32.091 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f308806d380 0x7f308806f830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3098004f90 tx=0x7f3098009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 msgr2=0x7f309c10f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 0x7f309c10f010 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c7e0 tx=0x7f308c007f90 comp rx=0 tx=0).stop 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 shutdown_connections 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f308806d380 0x7f308806f830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f309c101d10 0x7f309c10ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 --2- 172.21.15.134:0/2406389595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f309c1026b0 0x7f309c10f010 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 >> 172.21.15.134:0/2406389595 conn(0x7f309c0f7880 msgr2=0x7f309c0f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 shutdown_connections 2024-03-22T07:38:32.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:32.092+0000 7f30a3633700 1 -- 172.21.15.134:0/2406389595 wait complete. 2024-03-22T07:38:32.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph health detail' 2024-03-22T07:38:32.970 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:38:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:33 smithi195 ceph-mon[82061]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:38:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:33 smithi195 ceph-mon[82061]: pgmap v254: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:33.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:33 smithi134 ceph-mon[93947]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:38:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:33 smithi134 ceph-mon[93947]: pgmap v254: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:34.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:34.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 -- 172.21.15.134:0/18222133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 msgr2=0x7fd044103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 --2- 172.21.15.134:0/18222133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044103240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd038004940 tx=0x7fd038009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 -- 172.21.15.134:0/18222133 shutdown_connections 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 --2- 172.21.15.134:0/18222133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440fb4a0 0x7fd0440fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 --2- 172.21.15.134:0/18222133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044103240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 -- 172.21.15.134:0/18222133 >> 172.21.15.134:0/18222133 conn(0x7fd0440714c0 msgr2=0x7fd0440718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 -- 172.21.15.134:0/18222133 shutdown_connections 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.595+0000 7fd04aebd700 1 -- 172.21.15.134:0/18222133 wait complete. 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd04aebd700 1 Processor -- start 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd04aebd700 1 -- start start 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd04aebd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440fb4a0 0x7fd044113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd04aebd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd04aebd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0441146e0 con 0x7fd044102e70 2024-03-22T07:38:34.597 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd04aebd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04410dad0 con 0x7fd0440fb4a0 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd043fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd043fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42772/0 (socket says 172.21.15.134:42772) 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.596+0000 7fd043fff700 1 -- 172.21.15.134:0/210606386 learned_addr learned my addr 172.21.15.134:0/210606386 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd048c59700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440fb4a0 0x7fd044113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd043fff700 1 -- 172.21.15.134:0/210606386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440fb4a0 msgr2=0x7fd044113b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd043fff700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440fb4a0 0x7fd044113b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd043fff700 1 -- 172.21.15.134:0/210606386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038005040 con 0x7fd044102e70 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd043fff700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044114090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c830 tx=0x7fd030004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0300106f0 con 0x7fd044102e70 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04410ddb0 con 0x7fd044102e70 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd030010d20 con 0x7fd044102e70 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0300113a0 con 0x7fd044102e70 2024-03-22T07:38:34.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.597+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04410e370 con 0x7fd044102e70 2024-03-22T07:38:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.598+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044100110 con 0x7fd044102e70 2024-03-22T07:38:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.599+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fd030012400 con 0x7fd044102e70 2024-03-22T07:38:34.599 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.599+0000 7fd0417fa700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd03406d380 0x7fd03406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.599+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fd03008c970 con 0x7fd044102e70 2024-03-22T07:38:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.599+0000 7fd048c59700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd03406d380 0x7fd03406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:34.600 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.599+0000 7fd048c59700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd03406d380 0x7fd03406f830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd038004f90 tx=0x7fd038009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:34.603 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.604+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd030059eb0 con 0x7fd044102e70 2024-03-22T07:38:34.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.877+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd04410f1a0 con 0x7fd044102e70 2024-03-22T07:38:34.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.878+0000 7fd0417fa700 1 -- 172.21.15.134:0/210606386 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd030059a40 con 0x7fd044102e70 2024-03-22T07:38:34.877 INFO:teuthology.orchestra.run.smithi134.stdout:HEALTH_OK 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd03406d380 msgr2=0x7fd03406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd03406d380 0x7fd03406f830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd038004f90 tx=0x7fd038009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 msgr2=0x7fd044114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044114090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c830 tx=0x7fd030004470 comp rx=0 tx=0).stop 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 shutdown_connections 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd03406d380 0x7fd03406f830 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0440fb4a0 0x7fd044113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 --2- 172.21.15.134:0/210606386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd044102e70 0x7fd044114090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 >> 172.21.15.134:0/210606386 conn(0x7fd0440714c0 msgr2=0x7fd0440fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 shutdown_connections 2024-03-22T07:38:34.880 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:34.880+0000 7fd04aebd700 1 -- 172.21.15.134:0/210606386 wait complete. 2024-03-22T07:38:35.727 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph versions' 2024-03-22T07:38:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:35 smithi195 ceph-mon[82061]: pgmap v255: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:35.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:35 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/210606386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:38:35.984 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:38:36.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:35 smithi134 ceph-mon[93947]: pgmap v255: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:36.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:35 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/210606386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-22T07:38:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/3629113297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 msgr2=0x7f3bbc0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:37.571 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/3629113297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc0fbd80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0004940 tx=0x7f3bb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/3629113297 shutdown_connections 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/3629113297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc0fbd80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/3629113297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bbc101d70 0x7f3bbc102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/3629113297 >> 172.21.15.134:0/3629113297 conn(0x7f3bbc072bc0 msgr2=0x7f3bbc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/3629113297 shutdown_connections 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.570+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/3629113297 wait complete. 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.571+0000 7f3bc1ea4700 1 Processor -- start 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.571+0000 7f3bc1ea4700 1 -- start start 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.571+0000 7f3bc1ea4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bbc101d70 0x7f3bbc113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.571+0000 7f3bc1ea4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.571+0000 7f3bc1ea4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc114660 con 0x7f3bbc102710 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.571+0000 7f3bc1ea4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc10da50 con 0x7f3bbc101d70 2024-03-22T07:38:37.572 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:37.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc114010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:42802/0 (socket says 172.21.15.134:42802) 2024-03-22T07:38:37.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 -- 172.21.15.134:0/2184252294 learned_addr learned my addr 172.21.15.134:0/2184252294 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:38:37.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbb7fe700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bbc101d70 0x7f3bbc113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:37.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 -- 172.21.15.134:0/2184252294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bbc101d70 msgr2=0x7f3bbc113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:37.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bbc101d70 0x7f3bbc113ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 -- 172.21.15.134:0/2184252294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0005040 con 0x7f3bbc102710 2024-03-22T07:38:37.574 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bbaffd700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc114010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009100 tx=0x7f3bb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb000e040 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc10dcd0 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bb0013420 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.572+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc10e290 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.573+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb001c610 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.573+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc0fd4c0 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.574+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f3bb000baf0 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.574+0000 7f3ba3fff700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3ba406d380 0x7f3ba406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.574+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f3bb008dc90 con 0x7f3bbc102710 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.574+0000 7f3bbb7fe700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3ba406d380 0x7f3ba406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:38:37.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.575+0000 7f3bbb7fe700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3ba406d380 0x7f3ba406f830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bac004a30 tx=0x7f3bac009ed0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:38:37.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.579+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3bb005b1d0 con 0x7f3bbc102710 2024-03-22T07:38:37.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.854+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3bbc108e50 con 0x7f3bbc102710 2024-03-22T07:38:37.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.855+0000 7f3ba3fff700 1 -- 172.21.15.134:0/2184252294 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f3bb005ad60 con 0x7f3bbc102710 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:38:37.855 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:38:37.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:38:37.856 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:38:37.856 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 14 2024-03-22T07:38:37.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:38:37.856 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3ba406d380 msgr2=0x7f3ba406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3ba406d380 0x7f3ba406f830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3bac004a30 tx=0x7f3bac009ed0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 msgr2=0x7f3bbc114010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc114010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009100 tx=0x7f3bb0009e30 comp rx=0 tx=0).stop 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 shutdown_connections 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3ba406d380 0x7f3ba406f830 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bbc101d70 0x7f3bbc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 --2- 172.21.15.134:0/2184252294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bbc102710 0x7f3bbc114010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 >> 172.21.15.134:0/2184252294 conn(0x7f3bbc072bc0 msgr2=0x7f3bbc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:38:37.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 shutdown_connections 2024-03-22T07:38:37.858 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:38:37.857+0000 7f3bc1ea4700 1 -- 172.21.15.134:0/2184252294 wait complete. 2024-03-22T07:38:37.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:37 smithi195 ceph-mon[82061]: pgmap v256: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:38.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:37 smithi134 ceph-mon[93947]: pgmap v256: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:38.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-03-22T07:38:38.703 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:38:38.794 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:38 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2184252294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:38.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:38 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2184252294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:38:39.795 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:39 smithi134 ceph-mon[93947]: pgmap v257: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:39.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:39 smithi195 ceph-mon[82061]: pgmap v257: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:40.333 INFO:teuthology.orchestra.run.smithi134.stdout:wait for servicemap items w/ changing names to refresh 2024-03-22T07:38:41.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'sleep 60' 2024-03-22T07:38:41.288 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:38:41.732 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:41 smithi134 ceph-mon[93947]: pgmap v258: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:41.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:41 smithi195 ceph-mon[82061]: pgmap v258: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:43.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:43 smithi195 ceph-mon[82061]: pgmap v259: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:44.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:43 smithi134 ceph-mon[93947]: pgmap v259: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:45.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:45 smithi195 ceph-mon[82061]: pgmap v260: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:46.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:45 smithi134 ceph-mon[93947]: pgmap v260: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:47.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:47 smithi195 ceph-mon[82061]: pgmap v261: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:48.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:47 smithi134 ceph-mon[93947]: pgmap v261: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:48.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:49.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:38:50.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:50 smithi195 ceph-mon[82061]: pgmap v262: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:51.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:50 smithi134 ceph-mon[93947]: pgmap v262: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:52.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:52 smithi195 ceph-mon[82061]: pgmap v263: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:53.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:52 smithi134 ceph-mon[93947]: pgmap v263: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:54.955 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:54 smithi195 ceph-mon[82061]: pgmap v264: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:55.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:54 smithi134 ceph-mon[93947]: pgmap v264: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:56.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:56 smithi195 ceph-mon[82061]: pgmap v265: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:57.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:56 smithi134 ceph-mon[93947]: pgmap v265: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:58.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:38:58 smithi195 ceph-mon[82061]: pgmap v266: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:38:59.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:38:58 smithi134 ceph-mon[93947]: pgmap v266: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:00.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:00 smithi195 ceph-mon[82061]: pgmap v267: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:01.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:00 smithi134 ceph-mon[93947]: pgmap v267: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:02.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:02 smithi195 ceph-mon[82061]: pgmap v268: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:02 smithi134 ceph-mon[93947]: pgmap v268: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:03.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:04.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:04.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:04 smithi195 ceph-mon[82061]: pgmap v269: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:05.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:04 smithi134 ceph-mon[93947]: pgmap v269: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:06.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:06 smithi195 ceph-mon[82061]: pgmap v270: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:07.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:06 smithi134 ceph-mon[93947]: pgmap v270: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:08.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:08 smithi195 ceph-mon[82061]: pgmap v271: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:09.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:08 smithi134 ceph-mon[93947]: pgmap v271: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:10.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:10 smithi195 ceph-mon[82061]: pgmap v272: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:11.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:10 smithi134 ceph-mon[93947]: pgmap v272: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:12.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:12 smithi195 ceph-mon[82061]: pgmap v273: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:13.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:12 smithi134 ceph-mon[93947]: pgmap v273: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:14.957 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:14 smithi195 ceph-mon[82061]: pgmap v274: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:15.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:14 smithi134 ceph-mon[93947]: pgmap v274: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:17.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:16 smithi134 ceph-mon[93947]: pgmap v275: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:17.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:16 smithi195 ceph-mon[82061]: pgmap v275: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:19.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:18 smithi134 ceph-mon[93947]: pgmap v276: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:39:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:39:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:39:19.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:18 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:39:19.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:18 smithi195 ceph-mon[82061]: pgmap v276: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-22T07:39:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-22T07:39:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-22T07:39:19.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:18 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' 2024-03-22T07:39:21.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:20 smithi134 ceph-mon[93947]: pgmap v277: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:21.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:20 smithi195 ceph-mon[82061]: pgmap v277: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:23.007 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:22 smithi195 ceph-mon[82061]: pgmap v278: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:23.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:22 smithi134 ceph-mon[93947]: pgmap v278: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:25.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:24 smithi134 ceph-mon[93947]: pgmap v279: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:25.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:24 smithi195 ceph-mon[82061]: pgmap v279: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:27.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:26 smithi134 ceph-mon[93947]: pgmap v280: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:27.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:26 smithi195 ceph-mon[82061]: pgmap v280: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:29.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:28 smithi134 ceph-mon[93947]: pgmap v281: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:29.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:28 smithi195 ceph-mon[82061]: pgmap v281: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:31.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:30 smithi134 ceph-mon[93947]: pgmap v282: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:31.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:30 smithi195 ceph-mon[82061]: pgmap v282: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:33.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:32 smithi134 ceph-mon[93947]: pgmap v283: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:33.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:32 smithi195 ceph-mon[82061]: pgmap v283: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:33.954 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:33 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:34.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:33 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:35.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:34 smithi134 ceph-mon[93947]: pgmap v284: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:35.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:34 smithi195 ceph-mon[82061]: pgmap v284: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:37.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:36 smithi134 ceph-mon[93947]: pgmap v285: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:37.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:36 smithi195 ceph-mon[82061]: pgmap v285: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:39.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:38 smithi134 ceph-mon[93947]: pgmap v286: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:39.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:38 smithi195 ceph-mon[82061]: pgmap v286: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:41.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:40 smithi134 ceph-mon[93947]: pgmap v287: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:41.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:40 smithi195 ceph-mon[82061]: pgmap v287: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:43.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:42 smithi134 ceph-mon[93947]: pgmap v288: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:43.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:42 smithi195 ceph-mon[82061]: pgmap v288: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:43.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph orch ps' 2024-03-22T07:39:43.869 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:39:44.996 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:44 smithi134 ceph-mon[93947]: pgmap v289: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:45.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:44 smithi195 ceph-mon[82061]: pgmap v289: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 -- 172.21.15.134:0/524750977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 msgr2=0x7f50840fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 --2- 172.21.15.134:0/524750977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f50840fbd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5074004940 tx=0x7f5074009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 -- 172.21.15.134:0/524750977 shutdown_connections 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 --2- 172.21.15.134:0/524750977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f50840fbd80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 --2- 172.21.15.134:0/524750977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5084101d70 0x7f5084102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 -- 172.21.15.134:0/524750977 >> 172.21.15.134:0/524750977 conn(0x7f5084072bc0 msgr2=0x7f5084072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 -- 172.21.15.134:0/524750977 shutdown_connections 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.552+0000 7f508c184700 1 -- 172.21.15.134:0/524750977 wait complete. 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508c184700 1 Processor -- start 2024-03-22T07:39:45.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508c184700 1 -- start start 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508c184700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5084101d70 0x7f5084112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508c184700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f5084112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508c184700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841136b0 con 0x7f5084102710 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508c184700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508410ca10 con 0x7f5084101d70 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508971f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f5084112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508971f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f5084112fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43958/0 (socket says 172.21.15.134:43958) 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508971f700 1 -- 172.21.15.134:0/3156304821 learned_addr learned my addr 172.21.15.134:0/3156304821 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f5089f20700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5084101d70 0x7f5084112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508971f700 1 -- 172.21.15.134:0/3156304821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5084101d70 msgr2=0x7f5084112a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508971f700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5084101d70 0x7f5084112a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.553+0000 7f508971f700 1 -- 172.21.15.134:0/3156304821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074005040 con 0x7f5084102710 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.554+0000 7f508971f700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f5084112fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5074009180 tx=0x7f5074009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.554+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507400e040 con 0x7f5084102710 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.554+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f507400bbc0 con 0x7f5084102710 2024-03-22T07:39:45.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.554+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508410cc90 con 0x7f5084102710 2024-03-22T07:39:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.554+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f507401c3f0 con 0x7f5084102710 2024-03-22T07:39:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.554+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508410d250 con 0x7f5084102710 2024-03-22T07:39:45.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.555+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50840fd4c0 con 0x7f5084102710 2024-03-22T07:39:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.555+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f507400bd30 con 0x7f5084102710 2024-03-22T07:39:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.556+0000 7f507a7fc700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f507006d380 0x7f507006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.556+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f507408dc30 con 0x7f5084102710 2024-03-22T07:39:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.556+0000 7f5089f20700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f507006d380 0x7f507006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:45.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.556+0000 7f5089f20700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f507006d380 0x7f507006f830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5080006fd0 tx=0x7f5080008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:45.560 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.560+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f507405b230 con 0x7f5084102710 2024-03-22T07:39:45.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.763+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 --> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5084108f30 con 0x7f507006d380 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.773+0000 7f507a7fc700 1 -- 172.21.15.134:0/3156304821 <== mgr.34102 v2:172.21.15.134:6800/326636880 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5084108f30 con 0x7f507006d380 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:alertmanager.smithi134 smithi134 *:9093,9094 running (113s) 92s ago 19m 16.2M - 0.25.0 c8568f914cd2 867cf1a1be7a 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi134 smithi134 running (7m) 92s ago 19m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 124da244677b 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:crash.smithi195 smithi195 running (7m) 2m ago 18m 6656k - 19.0.0-1667-gdb0330b1 4f325f8440e9 958c1e3d2c73 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:grafana.smithi134 smithi134 *:3000 running (97s) 92s ago 18m 53.3M - 9.4.12 a0ea5e3c46d9 2eb05e7eec06 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.dexlss smithi134 running (3m) 92s ago 13m 14.5M - 19.0.0-1667-gdb0330b1 4f325f8440e9 5b048ce7e8da 2024-03-22T07:39:45.773 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi134.yxdtlb smithi134 running (3m) 92s ago 13m 85.0M - 19.0.0-1667-gdb0330b1 4f325f8440e9 8a0992eba74a 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.dayrmo smithi195 running (3m) 2m ago 13m 11.7M - 19.0.0-1667-gdb0330b1 4f325f8440e9 e184e705472b 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:mds.cephfs.smithi195.jursxo smithi195 running (2m) 2m ago 13m 14.8M - 19.0.0-1667-gdb0330b1 4f325f8440e9 229f2db1b811 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi134.wtwqre smithi134 *:8443,9283,8765 running (9m) 92s ago 20m 511M - 19.0.0-1667-gdb0330b1 4f325f8440e9 45d4fbc2d4d3 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:mgr.smithi195.jxfsnc smithi195 *:8443,9283,8765 running (8m) 2m ago 18m 451M - 19.0.0-1667-gdb0330b1 4f325f8440e9 ab777394b79c 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi134 smithi134 running (8m) 92s ago 20m 56.9M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 6529604eecda 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:mon.smithi195 smithi195 running (8m) 2m ago 18m 37.7M 2048M 19.0.0-1667-gdb0330b1 4f325f8440e9 0921563bc4dc 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 92s ago 19m 8720k - 1.5.0 0da6a335fe13 db92926a32c3 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:node-exporter.smithi195 smithi195 *:9100 running (2m) 2m ago 18m 3657k - 1.5.0 0da6a335fe13 376ba127b41a 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.0 smithi134 running (7m) 92s ago 17m 105M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 94026c2c00cb 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.1 smithi134 running (6m) 92s ago 16m 119M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 3d51608e5d6d 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.2 smithi134 running (5m) 92s ago 16m 108M 1557M 19.0.0-1667-gdb0330b1 4f325f8440e9 505f8d57592d 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.3 smithi195 running (5m) 2m ago 16m 131M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 0c89d39751da 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.4 smithi195 running (4m) 2m ago 15m 113M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 b36ec1b7a8f7 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:osd.5 smithi195 running (4m) 2m ago 15m 99.2M 2581M 19.0.0-1667-gdb0330b1 4f325f8440e9 81581d5a70da 2024-03-22T07:39:45.774 INFO:teuthology.orchestra.run.smithi134.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 92s ago 18m 44.8M - 2.43.0 a07b618ecd1d b80ee14b32d6 2024-03-22T07:39:45.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f507006d380 msgr2=0x7f507006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:45.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f507006d380 0x7f507006f830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5080006fd0 tx=0x7f5080008040 comp rx=0 tx=0).stop 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 msgr2=0x7f5084112fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f5084112fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5074009180 tx=0x7f5074009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 shutdown_connections 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f507006d380 0x7f507006f830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5084101d70 0x7f5084112a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 --2- 172.21.15.134:0/3156304821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5084102710 0x7f5084112fd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 >> 172.21.15.134:0/3156304821 conn(0x7f5084072bc0 msgr2=0x7f50840faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 shutdown_connections 2024-03-22T07:39:45.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:45.776+0000 7f508c184700 1 -- 172.21.15.134:0/3156304821 wait complete. 2024-03-22T07:39:46.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph versions' 2024-03-22T07:39:46.638 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:39:46.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:46 smithi134 ceph-mon[93947]: pgmap v290: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:46.903 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:46 smithi134 ceph-mon[93947]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:39:47.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:46 smithi195 ceph-mon[82061]: pgmap v290: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:47.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:46 smithi195 ceph-mon[82061]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-22T07:39:48.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 -- 172.21.15.134:0/2689431631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 msgr2=0x7f21a80fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:48.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 --2- 172.21.15.134:0/2689431631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a80fb990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f219c004940 tx=0x7f219c009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:48.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 -- 172.21.15.134:0/2689431631 shutdown_connections 2024-03-22T07:39:48.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 --2- 172.21.15.134:0/2689431631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a80fb990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 --2- 172.21.15.134:0/2689431631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21a8102fd0 0x7f21a81033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 -- 172.21.15.134:0/2689431631 >> 172.21.15.134:0/2689431631 conn(0x7f21a8071530 msgr2=0x7f21a8071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 -- 172.21.15.134:0/2689431631 shutdown_connections 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.279+0000 7f21af848700 1 -- 172.21.15.134:0/2689431631 wait complete. 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21af848700 1 Processor -- start 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21af848700 1 -- start start 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21af848700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a81138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21af848700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21a8102fd0 0x7f21a8113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21af848700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a8114480 con 0x7f21a80fb540 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21af848700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a810dac0 con 0x7f21a8102fd0 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21ad5e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a81138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21ad5e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a81138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43982/0 (socket says 172.21.15.134:43982) 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21ad5e4700 1 -- 172.21.15.134:0/3713404849 learned_addr learned my addr 172.21.15.134:0/3713404849 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.280+0000 7f21acde3700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21a8102fd0 0x7f21a8113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:48.282 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21ad5e4700 1 -- 172.21.15.134:0/3713404849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21a8102fd0 msgr2=0x7f21a8113e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21ad5e4700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21a8102fd0 0x7f21a8113e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21ad5e4700 1 -- 172.21.15.134:0/3713404849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c005040 con 0x7f21a80fb540 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21ad5e4700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a81138f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f21a0001d80 tx=0x7f21a0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a0007d10 con 0x7f21a80fb540 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21a0001e80 con 0x7f21a80fb540 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a0014640 con 0x7f21a80fb540 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a810dda0 con 0x7f21a80fb540 2024-03-22T07:39:48.283 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.281+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a810e330 con 0x7f21a80fb540 2024-03-22T07:39:48.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.282+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a81053b0 con 0x7f21a80fb540 2024-03-22T07:39:48.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.282+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f21a000e960 con 0x7f21a80fb540 2024-03-22T07:39:48.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.283+0000 7f21a5ffb700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f219006d380 0x7f219006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:48.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.283+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f21a008c7c0 con 0x7f21a80fb540 2024-03-22T07:39:48.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.283+0000 7f21acde3700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f219006d380 0x7f219006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:48.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.283+0000 7f21acde3700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f219006d380 0x7f219006f830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21a810f1d0 tx=0x7f219c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:48.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.288+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f21a0059d30 con 0x7f21a80fb540 2024-03-22T07:39:48.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.580+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21a810a010 con 0x7f21a80fb540 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.581+0000 7f21a5ffb700 1 -- 172.21.15.134:0/3713404849 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f21a00097e0 con 0x7f21a80fb540 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout: "mon": { 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout: "mgr": { 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 2 2024-03-22T07:39:48.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: "osd": { 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 6 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 4 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: "overall": { 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)": 14 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-22T07:39:48.582 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-22T07:39:48.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f219006d380 msgr2=0x7f219006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:48.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f219006d380 0x7f219006f830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21a810f1d0 tx=0x7f219c009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:48.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 msgr2=0x7f21a81138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a81138f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f21a0001d80 tx=0x7f21a0009ec0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 shutdown_connections 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f219006d380 0x7f219006f830 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a80fb540 0x7f21a81138f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 --2- 172.21.15.134:0/3713404849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21a8102fd0 0x7f21a8113e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 >> 172.21.15.134:0/3713404849 conn(0x7f21a8071530 msgr2=0x7f21a80fa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.583+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 shutdown_connections 2024-03-22T07:39:48.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:48.584+0000 7f21af848700 1 -- 172.21.15.134:0/3713404849 wait complete. 2024-03-22T07:39:48.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:48 smithi134 ceph-mon[93947]: pgmap v291: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:48.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:48 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:48.901 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:48 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3713404849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:39:49.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:48 smithi195 ceph-mon[82061]: pgmap v291: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:48 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:39:49.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:48 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3713404849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:39:49.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-03-22T07:39:49.643 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:39:50.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:50 smithi134 ceph-mon[93947]: pgmap v292: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:51.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 -- 172.21.15.134:0/2374568868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 msgr2=0x7fe5ac102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 --2- 172.21.15.134:0/2374568868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac102140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0004940 tx=0x7fe5a0009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 -- 172.21.15.134:0/2374568868 shutdown_connections 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 --2- 172.21.15.134:0/2374568868 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 0x7fe5ac0fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 --2- 172.21.15.134:0/2374568868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac102140 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 -- 172.21.15.134:0/2374568868 >> 172.21.15.134:0/2374568868 conn(0x7fe5ac072bc0 msgr2=0x7fe5ac072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 -- 172.21.15.134:0/2374568868 shutdown_connections 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 -- 172.21.15.134:0/2374568868 wait complete. 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 Processor -- start 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.202+0000 7fe5b3014700 1 -- start start 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b3014700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac10eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:51.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b3014700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 0x7fe5ac10f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b3014700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac10f670 con 0x7fe5ac101d70 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b3014700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac10f7b0 con 0x7fe5ac102710 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac10eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac10eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43994/0 (socket says 172.21.15.134:43994) 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 -- 172.21.15.134:0/98362045 learned_addr learned my addr 172.21.15.134:0/98362045 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5abfff700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 0x7fe5ac10f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 -- 172.21.15.134:0/98362045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 msgr2=0x7fe5ac10f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 0x7fe5ac10f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 -- 172.21.15.134:0/98362045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0005040 con 0x7fe5ac101d70 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5abfff700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 0x7fe5ac10f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b0db0700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac10eae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009b30 tx=0x7fe5a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a000e070 con 0x7fe5ac101d70 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5a0013cd0 con 0x7fe5ac101d70 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac117b50 con 0x7fe5ac101d70 2024-03-22T07:39:51.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a000b720 con 0x7fe5ac101d70 2024-03-22T07:39:51.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.203+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac117fb0 con 0x7fe5ac101d70 2024-03-22T07:39:51.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:50 smithi195 ceph-mon[82061]: pgmap v292: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.204+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac0ff080 con 0x7fe5ac101d70 2024-03-22T07:39:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.205+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fe5a001c400 con 0x7fe5ac101d70 2024-03-22T07:39:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.205+0000 7fe5a97fa700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe59c06d380 0x7fe59c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.205+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fe5a008e280 con 0x7fe5ac101d70 2024-03-22T07:39:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.205+0000 7fe5abfff700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe59c06d380 0x7fe59c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:51.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.206+0000 7fe5abfff700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe59c06d380 0x7fe59c06f830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe598004600 tx=0x7fe59800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:51.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.210+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe5a0057d50 con 0x7fe5ac101d70 2024-03-22T07:39:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.486+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe5ac108ec0 con 0x7fe5ac101d70 2024-03-22T07:39:51.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.486+0000 7fe5a97fa700 1 -- 172.21.15.134:0/98362045 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe5a005b410 con 0x7fe5ac101d70 2024-03-22T07:39:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe59c06d380 msgr2=0x7fe59c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe59c06d380 0x7fe59c06f830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe598004600 tx=0x7fe59800b040 comp rx=0 tx=0).stop 2024-03-22T07:39:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 msgr2=0x7fe5ac10eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac10eae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009b30 tx=0x7fe5a0009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 shutdown_connections 2024-03-22T07:39:51.488 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe59c06d380 0x7fe59c06f830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac101d70 0x7fe5ac10eae0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 --2- 172.21.15.134:0/98362045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5ac102710 0x7fe5ac10f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 >> 172.21.15.134:0/98362045 conn(0x7fe5ac072bc0 msgr2=0x7fe5ac0faec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 shutdown_connections 2024-03-22T07:39:51.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:51.488+0000 7fe5b3014700 1 -- 172.21.15.134:0/98362045 wait complete. 2024-03-22T07:39:51.498 INFO:teuthology.orchestra.run.smithi134.stdout:true 2024-03-22T07:39:52.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:51 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/98362045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:39:52.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -e sha1=db0330b1e4e2470d52b750e251e55a522b4f7d69 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-03-22T07:39:52.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:51 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/98362045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:39:52.346 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:39:53.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:52 smithi134 ceph-mon[93947]: pgmap v293: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:53.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:52 smithi195 ceph-mon[82061]: pgmap v293: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:53.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 -- 172.21.15.134:0/3488710572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4101037a0 msgr2=0x7fc4100fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:53.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 --2- 172.21.15.134:0/3488710572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4101037a0 0x7fc4100fce10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc400004940 tx=0x7fc400009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:53.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 -- 172.21.15.134:0/3488710572 shutdown_connections 2024-03-22T07:39:53.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 --2- 172.21.15.134:0/3488710572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4101037a0 0x7fc4100fce10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:53.891 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 --2- 172.21.15.134:0/3488710572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc410102e00 0x7fc4101031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 -- 172.21.15.134:0/3488710572 >> 172.21.15.134:0/3488710572 conn(0x7fc4100f89b0 msgr2=0x7fc4100fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 -- 172.21.15.134:0/3488710572 shutdown_connections 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.889+0000 7fc416ae2700 1 -- 172.21.15.134:0/3488710572 wait complete. 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc416ae2700 1 Processor -- start 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc416ae2700 1 -- start start 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc416ae2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 0x7fc410113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc416ae2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4101037a0 0x7fc410113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc416ae2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410114510 con 0x7fc410102e00 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc416ae2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41010db10 con 0x7fc4101037a0 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc41487e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 0x7fc410113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc41487e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 0x7fc410113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33382/0 (socket says 172.21.15.134:33382) 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.890+0000 7fc41487e700 1 -- 172.21.15.134:0/622916338 learned_addr learned my addr 172.21.15.134:0/622916338 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:53.892 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc40ffff700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4101037a0 0x7fc410113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc41487e700 1 -- 172.21.15.134:0/622916338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4101037a0 msgr2=0x7fc410113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc41487e700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4101037a0 0x7fc410113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc41487e700 1 -- 172.21.15.134:0/622916338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400005040 con 0x7fc410102e00 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc41487e700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 0x7fc410113980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc408001d80 tx=0x7fc408009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc408007d10 con 0x7fc410102e00 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc408001e80 con 0x7fc410102e00 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc408014640 con 0x7fc410102e00 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41010ddf0 con 0x7fc410102e00 2024-03-22T07:39:53.893 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.891+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41010e380 con 0x7fc410102e00 2024-03-22T07:39:53.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.892+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4101052d0 con 0x7fc410102e00 2024-03-22T07:39:53.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.893+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fc40800e960 con 0x7fc410102e00 2024-03-22T07:39:53.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.893+0000 7fc40d7fa700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc3fc06d380 0x7fc3fc06f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:53.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.893+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fc40808c7c0 con 0x7fc410102e00 2024-03-22T07:39:53.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.893+0000 7fc40ffff700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc3fc06d380 0x7fc3fc06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:53.894 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.893+0000 7fc40ffff700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc3fc06d380 0x7fc3fc06f830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc400004890 tx=0x7fc400009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:53.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:53.898+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc408059d30 con 0x7fc410102e00 2024-03-22T07:39:54.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.169+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc41010efd0 con 0x7fc410102e00 2024-03-22T07:39:54.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.170+0000 7fc40d7fa700 1 -- 172.21.15.134:0/622916338 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fc4080097e0 con 0x7fc410102e00 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc3fc06d380 msgr2=0x7fc3fc06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc3fc06d380 0x7fc3fc06f830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc400004890 tx=0x7fc400009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 msgr2=0x7fc410113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 0x7fc410113980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc408001d80 tx=0x7fc408009ec0 comp rx=0 tx=0).stop 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 shutdown_connections 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc3fc06d380 0x7fc3fc06f830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc410102e00 0x7fc410113980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 --2- 172.21.15.134:0/622916338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4101037a0 0x7fc410113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 >> 172.21.15.134:0/622916338 conn(0x7fc4100f89b0 msgr2=0x7fc4101021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 shutdown_connections 2024-03-22T07:39:54.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:54.172+0000 7fc416ae2700 1 -- 172.21.15.134:0/622916338 wait complete. 2024-03-22T07:39:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph version 19.0.0-1667-gdb0330b1 (db0330b1e4e2470d52b750e251e55a522b4f7d69) squid (dev)" 2024-03-22T07:39:54.834 DEBUG:teuthology.parallel:result is None 2024-03-22T07:39:54.835 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-22T07:39:54.847 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:39:54.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-22T07:39:55.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:54 smithi134 ceph-mon[93947]: pgmap v294: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:55.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:54 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/622916338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:39:55.108 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/mon.smithi134/config 2024-03-22T07:39:55.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:54 smithi195 ceph-mon[82061]: pgmap v294: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:55.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:54 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/622916338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-22T07:39:56.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 -- 172.21.15.134:0/2972290416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 msgr2=0x7fa228106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/2972290416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa228106f00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa210004940 tx=0x7fa210009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 -- 172.21.15.134:0/2972290416 shutdown_connections 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/2972290416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa228106f00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/2972290416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fde90 0x7fa2280fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 -- 172.21.15.134:0/2972290416 >> 172.21.15.134:0/2972290416 conn(0x7fa228072bc0 msgr2=0x7fa228072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 -- 172.21.15.134:0/2972290416 shutdown_connections 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.708+0000 7fa22e1b8700 1 -- 172.21.15.134:0/2972290416 wait complete. 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa22e1b8700 1 Processor -- start 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa22e1b8700 1 -- start start 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa22e1b8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fde90 0x7fa228113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa22e1b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa2281140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa22e1b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281147b0 con 0x7fa2280fe830 2024-03-22T07:39:56.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa22e1b8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22810db10 con 0x7fa2280fde90 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa2281140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa2281140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33408/0 (socket says 172.21.15.134:33408) 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa226ffd700 1 -- 172.21.15.134:0/846208996 learned_addr learned my addr 172.21.15.134:0/846208996 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa2277fe700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fde90 0x7fa228113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa226ffd700 1 -- 172.21.15.134:0/846208996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fde90 msgr2=0x7fa228113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa226ffd700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fde90 0x7fa228113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.709+0000 7fa226ffd700 1 -- 172.21.15.134:0/846208996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210005040 con 0x7fa2280fe830 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.710+0000 7fa226ffd700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa2281140d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa21000b3b0 tx=0x7fa210009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.710+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa21000e040 con 0x7fa2280fe830 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.710+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22810dd90 con 0x7fa2280fe830 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.710+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa210013420 con 0x7fa2280fe830 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.710+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa21001c610 con 0x7fa2280fe830 2024-03-22T07:39:56.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.710+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22810e2d0 con 0x7fa2280fe830 2024-03-22T07:39:56.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.711+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228065e30 con 0x7fa2280fe830 2024-03-22T07:39:56.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.711+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fa210013590 con 0x7fa2280fe830 2024-03-22T07:39:56.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.712+0000 7fa21ffff700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa21406d380 0x7fa21406f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:56.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.712+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa21008dd20 con 0x7fa2280fe830 2024-03-22T07:39:56.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.712+0000 7fa2277fe700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa21406d380 0x7fa21406f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:56.713 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.712+0000 7fa2277fe700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa21406d380 0x7fa21406f830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa220001250 tx=0x7fa220009620 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:56.716 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.716+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa21005b1e0 con 0x7fa2280fe830 2024-03-22T07:39:56.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.956+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa22810df20 con 0x7fa2280fe830 2024-03-22T07:39:56.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.956+0000 7fa21ffff700 1 -- 172.21.15.134:0/846208996 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1877 (secure 0 0 0) 0x7fa22810df20 con 0x7fa2280fe830 2024-03-22T07:39:56.956 INFO:teuthology.orchestra.run.smithi134.stdout:e33 2024-03-22T07:39:56.956 INFO:teuthology.orchestra.run.smithi134.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-22T07:39:56.956 INFO:teuthology.orchestra.run.smithi134.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-22T07:39:56.956 INFO:teuthology.orchestra.run.smithi134.stdout:legacy client fscid: 1 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:Filesystem 'cephfs' (1) 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:fs_name cephfs 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 32 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:created 2024-03-22T07:25:59.580047+0000 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:modified 2024-03-22T07:37:01.692864+0000 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:tableserver 0 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:root 0 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:session_timeout 60 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:session_autoclose 300 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:max_file_size 1099511627776 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:max_xattr_size 65536 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:required_client_features {} 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure 0 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:last_failure_osd_epoch 84 2024-03-22T07:39:56.957 INFO:teuthology.orchestra.run.smithi134.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:max_mds 1 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:in 0 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:up {0=34400} 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:failed 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:damaged 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:stopped 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:data_pools [3] 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:metadata_pool 2 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:inline_data disabled 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:balancer 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:bal_rank_mask -1 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:standby_count_wanted 1 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.yxdtlb{0:34400} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.134:6826/4256617124,v1:172.21.15.134:6827/4256617124] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:56.958 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:56.959 INFO:teuthology.orchestra.run.smithi134.stdout:Standby daemons: 2024-03-22T07:39:56.959 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:56.959 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi134.dexlss{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6828/1238843159,v1:172.21.15.134:6829/1238843159] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:39:56.959 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.dayrmo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6824/2563834080,v1:172.21.15.195:6825/2563834080] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:39:56.959 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.cephfs.smithi195.jursxo{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.195:6826/2724498229,v1:172.21.15.195:6827/2724498229] compat {c=[1],r=[1],i=[fff]}] 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa21406d380 msgr2=0x7fa21406f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa21406d380 0x7fa21406f830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa220001250 tx=0x7fa220009620 comp rx=0 tx=0).stop 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 msgr2=0x7fa2281140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa2281140d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa21000b3b0 tx=0x7fa210009e30 comp rx=0 tx=0).stop 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 shutdown_connections 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa21406d380 0x7fa21406f830 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280fde90 0x7fa228113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 --2- 172.21.15.134:0/846208996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2280fe830 0x7fa2281140d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 >> 172.21.15.134:0/846208996 conn(0x7fa228072bc0 msgr2=0x7fa228103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 shutdown_connections 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:56.958+0000 7fa22e1b8700 1 -- 172.21.15.134:0/846208996 wait complete. 2024-03-22T07:39:56.960 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 33 2024-03-22T07:39:57.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:56 smithi134 ceph-mon[93947]: pgmap v295: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:57.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:56 smithi195 ceph-mon[82061]: pgmap v295: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:57.578 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-03-22T07:39:57.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-22T07:39:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 -- 172.21.15.134:0/1140496597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 msgr2=0x7f6a50101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:57.694 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 --2- 172.21.15.134:0/1140496597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50101510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009c50 tx=0x7f6a4c004d10 comp rx=0 tx=0).stop 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 -- 172.21.15.134:0/1140496597 shutdown_connections 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 --2- 172.21.15.134:0/1140496597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 0x7f6a500fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 --2- 172.21.15.134:0/1140496597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50101510 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 -- 172.21.15.134:0/1140496597 >> 172.21.15.134:0/1140496597 conn(0x7f6a50071130 msgr2=0x7f6a50071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 -- 172.21.15.134:0/1140496597 shutdown_connections 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 -- 172.21.15.134:0/1140496597 wait complete. 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 Processor -- start 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.693+0000 7f6a5822e640 1 -- start start 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a5822e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 0x7f6a50111bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a5822e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a5822e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50112710 con 0x7f6a50101140 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a5822e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5010bd60 con 0x7f6a500fb110 2024-03-22T07:39:57.695 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33422/0 (socket says 172.21.15.134:33422) 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 -- 172.21.15.134:0/225253931 learned_addr learned my addr 172.21.15.134:0/225253931 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a55fca640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 0x7f6a50111bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 -- 172.21.15.134:0/225253931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 msgr2=0x7f6a50111bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 0x7f6a50111bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 -- 172.21.15.134:0/225253931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0098b0 con 0x7f6a50101140 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a55fca640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 0x7f6a50111bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a557c9640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50112110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a40002a50 tx=0x7f6a40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a40007c30 con 0x7f6a50101140 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a4000f040 con 0x7f6a50101140 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5010c040 con 0x7f6a50101140 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a4000db50 con 0x7f6a50101140 2024-03-22T07:39:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.694+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5010c5e0 con 0x7f6a50101140 2024-03-22T07:39:57.697 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.695+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a500fc800 con 0x7f6a50101140 2024-03-22T07:39:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.696+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f6a4001c400 con 0x7f6a50101140 2024-03-22T07:39:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.696+0000 7f6a467fc640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6a3c06d2f0 0x7f6a3c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.696+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f6a4008c2f0 con 0x7f6a50101140 2024-03-22T07:39:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.696+0000 7f6a55fca640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6a3c06d2f0 0x7f6a3c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.697+0000 7f6a55fca640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6a3c06d2f0 0x7f6a3c06f7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c000f80 tx=0x7f6a4c02e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:57.700 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.701+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6a40055c80 con 0x7f6a50101140 2024-03-22T07:39:57.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.878+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a50108220 con 0x7f6a50101140 2024-03-22T07:39:57.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.880+0000 7f6a467fc640 1 -- 172.21.15.134:0/225253931 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16971 (secure 0 0 0) 0x7f6a40059340 con 0x7f6a50101140 2024-03-22T07:39:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:57.880 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":84,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:36:51.728399+0000","last_up_change":"2024-03-22T07:35:40.539227+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-22T07:25:58.466557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-22T07:25:58.807715+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6803","nonce":2109678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6805","nonce":2109678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6809","nonce":2109678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6807","nonce":2109678408}]},"public_addr":"172.21.15.134:6803/2109678408","cluster_addr":"172.21.15.134:6805/2109678408","heartbeat_back_addr":"172.21.15.134:6809/2109678408","heartbeat_front_addr":"172.21.15.134:6807/2109678408","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6811","nonce":3479896473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6813","nonce":3479896473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6817","nonce":3479896473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6815","nonce":3479896473}]},"public_addr":"172.21.15.134:6811/3479896473","cluster_addr":"172.21.15.134:6813/3479896473","heartbeat_back_addr":"172.21.15.134:6817/3479896473","heartbeat_front_addr":"172.21.15.134:6815/3479896473","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6819","nonce":2283292896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6821","nonce":2283292896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6825","nonce":2283292896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6823","nonce":2283292896}]},"public_addr":"172.21.15.134:6819/2283292896","cluster_addr":"172.21.15.134:6821/2283292896","heartbeat_back_addr":"172.21.15.134:6825/2283292896","heartbeat_front_addr":"172.21.15.134:6823/2283292896","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6801","nonce":3515380558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6803","nonce":3515380558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6807","nonce":3515380558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6805","nonce":3515380558}]},"public_addr":"172.21.15.195:6801/3515380558","cluster_addr":"172.21.15.195:6803/3515380558","heartbeat_back_addr":"172.21.15.195:6807/3515380558","heartbeat_front_addr":"172.21.15.195:6805/3515380558","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6809","nonce":848656048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6811","nonce":848656048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6815","nonce":848656048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6813","nonce":848656048}]},"public_addr":"172.21.15.195:6809/848656048","cluster_addr":"172.21.15.195:6811/848656048","heartbeat_back_addr":"172.21.15.195:6815/848656048","heartbeat_front_addr":"172.21.15.195:6813/848656048","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6817","nonce":381174269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6819","nonce":381174269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6823","nonce":381174269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6821","nonce":381174269}]},"public_addr":"172.21.15.195:6817/381174269","cluster_addr":"172.21.15.195:6819/381174269","heartbeat_back_addr":"172.21.15.195:6823/381174269","heartbeat_front_addr":"172.21.15.195:6821/381174269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6827/2251029735":"2024-03-23T07:36:51.728370+0000","172.21.15.195:6826/2251029735":"2024-03-23T07:36:51.728370+0000","172.21.15.195:6824/4087242582":"2024-03-23T07:36:26.407793+0000","172.21.15.134:6828/2483774939":"2024-03-23T07:36:04.486783+0000","172.21.15.134:0/169043287":"2024-03-23T07:28:33.656989+0000","172.21.15.134:6800/1730667826":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.195:0/3154577194":"2024-03-23T07:30:34.122632+0000","172.21.15.134:0/3237607204":"2024-03-23T07:28:33.656989+0000","172.21.15.134:6827/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/1532072225":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.195:0/1754301192":"2024-03-23T07:30:34.122632+0000","172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6826/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/3072794259":"2024-03-23T07:31:18.446749+0000","172.21.15.195:0/1159345258":"2024-03-23T07:30:34.122632+0000","172.21.15.195:0/827054233":"2024-03-23T07:30:34.122632+0000","172.21.15.195:6828/3830729441":"2024-03-23T07:30:34.122632+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/1309282181":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/1730667826":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/114139606":"2024-03-23T07:28:33.656989+0000","172.21.15.195:6825/4087242582":"2024-03-23T07:36:26.407793+0000","172.21.15.134:6801/2106493148":"2024-03-23T07:31:18.446749+0000","172.21.15.195:6829/3830729441":"2024-03-23T07:30:34.122632+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/2951685949":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2738175078":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/3567862151":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3419384748":"2024-03-23T07:31:18.446749+0000","172.21.15.134:6829/2483774939":"2024-03-23T07:36:04.486783+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/2106493148":"2024-03-23T07:31:18.446749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:39:57.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6a3c06d2f0 msgr2=0x7f6a3c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6a3c06d2f0 0x7f6a3c06f7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c000f80 tx=0x7f6a4c02e040 comp rx=0 tx=0).stop 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 msgr2=0x7f6a50112110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50112110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6a40002a50 tx=0x7f6a40004600 comp rx=0 tx=0).stop 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 shutdown_connections 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f6a3c06d2f0 0x7f6a3c06f7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a50101140 0x7f6a50112110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 --2- 172.21.15.134:0/225253931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6a500fb110 0x7f6a50111bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 >> 172.21.15.134:0/225253931 conn(0x7f6a50071130 msgr2=0x7f6a500f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 shutdown_connections 2024-03-22T07:39:57.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.882+0000 7f6a5822e640 1 -- 172.21.15.134:0/225253931 wait complete. 2024-03-22T07:39:57.891 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:57 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/846208996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:39:57.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-22T07:23:31.660944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-22T07:25:58.466557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-22T07:25:58.807715+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-22T07:39:57.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-22T07:39:57.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 -- 172.21.15.134:0/3733462415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c101c80 msgr2=0x7fde9c0fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:57.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/3733462415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c101c80 0x7fde9c0fb310 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fde880048d0 tx=0x7fde88009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 -- 172.21.15.134:0/3733462415 shutdown_connections 2024-03-22T07:39:57.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/3733462415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c101c80 0x7fde9c0fb310 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.996 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/3733462415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c1012e0 0x7fde9c1016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 -- 172.21.15.134:0/3733462415 >> 172.21.15.134:0/3733462415 conn(0x7fde9c0f6eb0 msgr2=0x7fde9c0f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.994+0000 7fdea2e2e640 1 -- 172.21.15.134:0/3733462415 shutdown_connections 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.995+0000 7fdea2e2e640 1 -- 172.21.15.134:0/3733462415 wait complete. 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.995+0000 7fdea2e2e640 1 Processor -- start 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.995+0000 7fdea2e2e640 1 -- start start 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.995+0000 7fdea2e2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 0x7fde9c10e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea2e2e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c101c80 0x7fde9c10e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea2e2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c066530 con 0x7fde9c1012e0 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea2e2e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c10eb90 con 0x7fde9c101c80 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 0x7fde9c10e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 0x7fde9c10e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33436/0 (socket says 172.21.15.134:33436) 2024-03-22T07:39:57.997 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 -- 172.21.15.134:0/930007810 learned_addr learned my addr 172.21.15.134:0/930007810 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fde9bfff640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c101c80 0x7fde9c10e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 -- 172.21.15.134:0/930007810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c101c80 msgr2=0x7fde9c10e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c101c80 0x7fde9c10e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 -- 172.21.15.134:0/930007810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde88005040 con 0x7fde9c1012e0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fde9bfff640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c101c80 0x7fde9c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea0bca640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 0x7fde9c10e0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c830 tx=0x7fde90004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde9000a850 con 0x7fde9c1012e0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde9000ae80 con 0x7fde9c1012e0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c10ee70 con 0x7fde9c1012e0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde90012ea0 con 0x7fde9c1012e0 2024-03-22T07:39:57.998 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.996+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c117400 con 0x7fde9c1012e0 2024-03-22T07:39:57.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.997+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c0fca50 con 0x7fde9c1012e0 2024-03-22T07:39:57.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.998+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fde90012400 con 0x7fde9c1012e0 2024-03-22T07:39:57.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.998+0000 7fde997fa640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fde8c06d2f0 0x7fde8c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:57.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.998+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fde9008cc80 con 0x7fde9c1012e0 2024-03-22T07:39:57.999 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.998+0000 7fde9bfff640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fde8c06d2f0 0x7fde8c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:57.999+0000 7fde9bfff640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fde8c06d2f0 0x7fde8c06f7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde88000c00 tx=0x7fde88009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.002 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.003+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde90056690 con 0x7fde9c1012e0 2024-03-22T07:39:58.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.174+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde9c065b30 con 0x7fde9c1012e0 2024-03-22T07:39:58.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.174+0000 7fde997fa640 1 -- 172.21.15.134:0/930007810 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde900126b0 con 0x7fde9c1012e0 2024-03-22T07:39:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-03-22T07:39:58.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fde8c06d2f0 msgr2=0x7fde8c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fde8c06d2f0 0x7fde8c06f7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde88000c00 tx=0x7fde88009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 msgr2=0x7fde9c10e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 0x7fde9c10e0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c830 tx=0x7fde90004430 comp rx=0 tx=0).stop 2024-03-22T07:39:58.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 shutdown_connections 2024-03-22T07:39:58.176 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fde8c06d2f0 0x7fde8c06f7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde9c101c80 0x7fde9c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 --2- 172.21.15.134:0/930007810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c1012e0 0x7fde9c10e0e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 >> 172.21.15.134:0/930007810 conn(0x7fde9c0f6eb0 msgr2=0x7fde9c0f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:58.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.176+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 shutdown_connections 2024-03-22T07:39:58.177 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.177+0000 7fdea2e2e640 1 -- 172.21.15.134:0/930007810 wait complete. 2024-03-22T07:39:58.187 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-22T07:39:58.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:57 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/846208996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 -- 172.21.15.134:0/3080087109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 msgr2=0x7fc4b01025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 --2- 172.21.15.134:0/3080087109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b01025d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0048d0 tx=0x7fc4ac009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 -- 172.21.15.134:0/3080087109 shutdown_connections 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 --2- 172.21.15.134:0/3080087109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4b0102ba0 0x7fc4b00fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 --2- 172.21.15.134:0/3080087109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b01025d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 -- 172.21.15.134:0/3080087109 >> 172.21.15.134:0/3080087109 conn(0x7fc4b00708f0 msgr2=0x7fc4b0070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 -- 172.21.15.134:0/3080087109 shutdown_connections 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.287+0000 7fc4b835d640 1 -- 172.21.15.134:0/3080087109 wait complete. 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b835d640 1 Processor -- start 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b835d640 1 -- start start 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b835d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b0112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b835d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4b0102ba0 0x7fc4b0113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b835d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0113970 con 0x7fc4b0102200 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b835d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b010cfc0 con 0x7fc4b0102ba0 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b0112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b0112e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33450/0 (socket says 172.21.15.134:33450) 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 -- 172.21.15.134:0/1875832956 learned_addr learned my addr 172.21.15.134:0/1875832956 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b58f8640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4b0102ba0 0x7fc4b0113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 -- 172.21.15.134:0/1875832956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4b0102ba0 msgr2=0x7fc4b0113370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4b0102ba0 0x7fc4b0113370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 -- 172.21.15.134:0/1875832956 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac005040 con 0x7fc4b0102200 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4b60f9640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b0112e30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac004930 tx=0x7fc4ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.288+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ac0094c0 con 0x7fc4b0102200 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.289+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4ac032e50 con 0x7fc4b0102200 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.289+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b010d240 con 0x7fc4b0102200 2024-03-22T07:39:58.290 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.289+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ac0433b0 con 0x7fc4b0102200 2024-03-22T07:39:58.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.289+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b010d700 con 0x7fc4b0102200 2024-03-22T07:39:58.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.289+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b00652a0 con 0x7fc4b0102200 2024-03-22T07:39:58.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.290+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fc4ac02f070 con 0x7fc4b0102200 2024-03-22T07:39:58.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.290+0000 7fc4a6ffd640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc49c06d2f0 0x7fc49c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.290+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fc4ac0ae870 con 0x7fc4b0102200 2024-03-22T07:39:58.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.290+0000 7fc4b58f8640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc49c06d2f0 0x7fc49c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.291+0000 7fc4b58f8640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc49c06d2f0 0x7fc49c06f7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0007fd0 tx=0x7fc4a0009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.294 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.295+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc4ac078200 con 0x7fc4b0102200 2024-03-22T07:39:58.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.465+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc4b010e4a0 con 0x7fc4b0102200 2024-03-22T07:39:58.465 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.466+0000 7fc4a6ffd640 1 -- 172.21.15.134:0/1875832956 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc4ac07b8c0 con 0x7fc4b0102200 2024-03-22T07:39:58.466 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:39:58.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc49c06d2f0 msgr2=0x7fc49c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc49c06d2f0 0x7fc49c06f7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0007fd0 tx=0x7fc4a0009e90 comp rx=0 tx=0).stop 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 msgr2=0x7fc4b0112e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b0112e30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac004930 tx=0x7fc4ac009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 shutdown_connections 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fc49c06d2f0 0x7fc49c06f7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4b0102ba0 0x7fc4b0113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 --2- 172.21.15.134:0/1875832956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4b0102200 0x7fc4b0112e30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 >> 172.21.15.134:0/1875832956 conn(0x7fc4b00708f0 msgr2=0x7fc4b0104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 shutdown_connections 2024-03-22T07:39:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.468+0000 7fc4b835d640 1 -- 172.21.15.134:0/1875832956 wait complete. 2024-03-22T07:39:58.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 -- 172.21.15.134:0/1789892243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 msgr2=0x7fcfd80fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/1789892243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fd5d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004900 tx=0x7fcfd4009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 -- 172.21.15.134:0/1789892243 shutdown_connections 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/1789892243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 0x7fcfd8106270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/1789892243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fd5d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 -- 172.21.15.134:0/1789892243 >> 172.21.15.134:0/1789892243 conn(0x7fcfd80f6cc0 msgr2=0x7fcfd80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:58.581 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 -- 172.21.15.134:0/1789892243 shutdown_connections 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.579+0000 7fcfdf62e640 1 -- 172.21.15.134:0/1789892243 wait complete. 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdf62e640 1 Processor -- start 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdf62e640 1 -- start start 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdf62e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdf62e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 0x7fcfd80fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdf62e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80fcfa0 con 0x7fcfd80fd200 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdf62e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80fbb40 con 0x7fcfd80fdba0 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33478/0 (socket says 172.21.15.134:33478) 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 -- 172.21.15.134:0/517347521 learned_addr learned my addr 172.21.15.134:0/517347521 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdcbc9640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 0x7fcfd80fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 -- 172.21.15.134:0/517347521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 msgr2=0x7fcfd80fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.582 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 0x7fcfd80fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 -- 172.21.15.134:0/517347521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4005040 con 0x7fcfd80fd200 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdcbc9640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 0x7fcfd80fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.580+0000 7fcfdd3ca640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fb0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4000c00 tx=0x7fcfd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.581+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd40094c0 con 0x7fcfd80fd200 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.581+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfd403d920 con 0x7fcfd80fd200 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.581+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd80fbdc0 con 0x7fcfd80fd200 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.581+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd403b930 con 0x7fcfd80fd200 2024-03-22T07:39:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.581+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd8119750 con 0x7fcfd80fd200 2024-03-22T07:39:58.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.582+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd8065dd0 con 0x7fcfd80fd200 2024-03-22T07:39:58.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.582+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fcfd403da90 con 0x7fcfd80fd200 2024-03-22T07:39:58.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.583+0000 7fcfcdffb640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfc406d2f0 0x7fcfc406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.583+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fcfd40af3b0 con 0x7fcfd80fd200 2024-03-22T07:39:58.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.583+0000 7fcfdcbc9640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfc406d2f0 0x7fcfc406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.584 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.583+0000 7fcfdcbc9640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfc406d2f0 0x7fcfc406f7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80fc7f0 tx=0x7fcfc8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.587 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.587+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcfd4078e00 con 0x7fcfd80fd200 2024-03-22T07:39:58.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.762+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fcfd804bcc0 con 0x7fcfd80fd200 2024-03-22T07:39:58.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.762+0000 7fcfcdffb640 1 -- 172.21.15.134:0/517347521 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcfd407c4c0 con 0x7fcfd80fd200 2024-03-22T07:39:58.762 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfc406d2f0 msgr2=0x7fcfc406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfc406d2f0 0x7fcfc406f7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80fc7f0 tx=0x7fcfc8009040 comp rx=0 tx=0).stop 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 msgr2=0x7fcfd80fb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fb0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4000c00 tx=0x7fcfd4009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 shutdown_connections 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcfc406d2f0 0x7fcfc406f7a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcfd80fdba0 0x7fcfd80fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 --2- 172.21.15.134:0/517347521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfd80fd200 0x7fcfd80fb0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 >> 172.21.15.134:0/517347521 conn(0x7fcfd80f6cc0 msgr2=0x7fcfd80f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:58.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 shutdown_connections 2024-03-22T07:39:58.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.764+0000 7fcfdf62e640 1 -- 172.21.15.134:0/517347521 wait complete. 2024-03-22T07:39:58.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 -- 172.21.15.134:0/354018798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 msgr2=0x7faf98102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/354018798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98102550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0048d0 tx=0x7faf8c009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 -- 172.21.15.134:0/354018798 shutdown_connections 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/354018798 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf98102b20 0x7faf980fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/354018798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98102550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 -- 172.21.15.134:0/354018798 >> 172.21.15.134:0/354018798 conn(0x7faf980f7d10 msgr2=0x7faf980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 -- 172.21.15.134:0/354018798 shutdown_connections 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 -- 172.21.15.134:0/354018798 wait complete. 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 Processor -- start 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.872+0000 7faf9ed9d640 1 -- start start 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9ed9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9ed9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf98102b20 0x7faf981131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9ed9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981137b0 con 0x7faf98102180 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9ed9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf98113920 con 0x7faf98102b20 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98112c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33490/0 (socket says 172.21.15.134:33490) 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 -- 172.21.15.134:0/221232040 learned_addr learned my addr 172.21.15.134:0/221232040 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 -- 172.21.15.134:0/221232040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf98102b20 msgr2=0x7faf981131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf98102b20 0x7faf981131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 -- 172.21.15.134:0/221232040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c005040 con 0x7faf98102180 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9cb39640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98112c70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf8c004930 tx=0x7faf8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c0094c0 con 0x7faf98102180 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9810cf50 con 0x7faf98102180 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf8c032e50 con 0x7faf98102180 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8c0433b0 con 0x7faf98102180 2024-03-22T07:39:58.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.873+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9810d410 con 0x7faf98102180 2024-03-22T07:39:58.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.874+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980fd8f0 con 0x7faf98102180 2024-03-22T07:39:58.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.875+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7faf8c02f070 con 0x7faf98102180 2024-03-22T07:39:58.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.875+0000 7faf957fa640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf8806d2f0 0x7faf8806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:58.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.875+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7faf8c0ae870 con 0x7faf98102180 2024-03-22T07:39:58.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.875+0000 7faf97fff640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf8806d2f0 0x7faf8806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:58.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.876+0000 7faf97fff640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf8806d2f0 0x7faf8806f7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf84009af0 tx=0x7faf84009cd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:58.879 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:58.880+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faf8c078200 con 0x7faf98102180 2024-03-22T07:39:59.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:58 smithi134 ceph-mon[93947]: pgmap v296: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:58 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/225253931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:39:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:58 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/930007810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:39:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:58 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1875832956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:39:59.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:58 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/517347521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:39:59.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.090+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf9810d690 con 0x7faf98102180 2024-03-22T07:39:59.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.090+0000 7faf957fa640 1 -- 172.21.15.134:0/221232040 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+5008 (secure 0 0 0) 0x7faf8c07b8c0 con 0x7faf98102180 2024-03-22T07:39:59.090 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:59.090 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44309,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2563834080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2563834080},{"type":"v1","addr":"172.21.15.195:6825","nonce":2563834080}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":44335,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6827/2724498229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2724498229},{"type":"v1","addr":"172.21.15.195:6827","nonce":2724498229}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:37:01.692864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":0,"incarnation":29,"state":"up:active","state_seq":21,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:39:59.090 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 33 2024-03-22T07:39:59.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf8806d2f0 msgr2=0x7faf8806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf8806d2f0 0x7faf8806f7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf84009af0 tx=0x7faf84009cd0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 msgr2=0x7faf98112c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98112c70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf8c004930 tx=0x7faf8c009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 shutdown_connections 2024-03-22T07:39:59.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7faf8806d2f0 0x7faf8806f7a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf98102b20 0x7faf981131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 --2- 172.21.15.134:0/221232040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf98102180 0x7faf98112c70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.092+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 >> 172.21.15.134:0/221232040 conn(0x7faf980f7d10 msgr2=0x7faf980f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:59.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.093+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 shutdown_connections 2024-03-22T07:39:59.093 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.093+0000 7faf9ed9d640 1 -- 172.21.15.134:0/221232040 wait complete. 2024-03-22T07:39:59.103 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-03-22T07:39:59.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 -- 172.21.15.134:0/3870707781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c102d70 msgr2=0x7fad7c0fc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 --2- 172.21.15.134:0/3870707781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c102d70 0x7fad7c0fc400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fad700048d0 tx=0x7fad70009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 -- 172.21.15.134:0/3870707781 shutdown_connections 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 --2- 172.21.15.134:0/3870707781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c102d70 0x7fad7c0fc400 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 --2- 172.21.15.134:0/3870707781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad7c1023d0 0x7fad7c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 -- 172.21.15.134:0/3870707781 >> 172.21.15.134:0/3870707781 conn(0x7fad7c0f7fe0 msgr2=0x7fad7c0fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 -- 172.21.15.134:0/3870707781 shutdown_connections 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.202+0000 7fad8206e640 1 -- 172.21.15.134:0/3870707781 wait complete. 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad8206e640 1 Processor -- start 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad8206e640 1 -- start start 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad8206e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 0x7fad7c112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad8206e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad7c102d70 0x7fad7c1134c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad8206e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c113b50 con 0x7fad7c1023d0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad8206e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c10d110 con 0x7fad7c102d70 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad7b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 0x7fad7c112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad7b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 0x7fad7c112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33514/0 (socket says 172.21.15.134:33514) 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad7b7fe640 1 -- 172.21.15.134:0/1494841598 learned_addr learned my addr 172.21.15.134:0/1494841598 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad7b7fe640 1 -- 172.21.15.134:0/1494841598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad7c102d70 msgr2=0x7fad7c1134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad7b7fe640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad7c102d70 0x7fad7c1134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.203+0000 7fad7b7fe640 1 -- 172.21.15.134:0/1494841598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70005040 con 0x7fad7c1023d0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.204+0000 7fad7b7fe640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 0x7fad7c112f80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00b790 tx=0x7fad6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.204+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6c00c700 con 0x7fad7c1023d0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.204+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad6c00cd30 con 0x7fad7c1023d0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.204+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c10d3f0 con 0x7fad7c1023d0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.204+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6c013370 con 0x7fad7c1023d0 2024-03-22T07:39:59.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.204+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c10d910 con 0x7fad7c1023d0 2024-03-22T07:39:59.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:58 smithi195 ceph-mon[82061]: pgmap v296: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:39:59.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:58 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/225253931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:39:59.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:58 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/930007810' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:39:59.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:58 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1875832956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:39:59.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:58 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/517347521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:39:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.205+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c0fdb40 con 0x7fad7c1023d0 2024-03-22T07:39:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.205+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fad6c012070 con 0x7fad7c1023d0 2024-03-22T07:39:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.206+0000 7fad63fff640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fad6406d2f0 0x7fad6406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.206+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fad6c08c660 con 0x7fad7c1023d0 2024-03-22T07:39:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.206+0000 7fad7affd640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fad6406d2f0 0x7fad6406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.206+0000 7fad7affd640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fad6406d2f0 0x7fad6406f7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad700043d0 tx=0x7fad70009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:59.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.210+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad6c055ff0 con 0x7fad7c1023d0 2024-03-22T07:39:59.435 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.436+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7fad7c109620 con 0x7fad7c1023d0 2024-03-22T07:39:59.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.436+0000 7fad63fff640 1 -- 172.21.15.134:0/1494841598 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v33) v1 ==== 107+0+4055 (secure 0 0 0) 0x7fad6c0596b0 con 0x7fad7c1023d0 2024-03-22T07:39:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:59.436 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:26:16.446375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi134.dexlss","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/2483774939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2483774939},{"type":"v1","addr":"172.21.15.134:6829","nonce":2483774939}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:39:59.437 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 15 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fad6406d2f0 msgr2=0x7fad6406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fad6406d2f0 0x7fad6406f7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad700043d0 tx=0x7fad70009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 msgr2=0x7fad7c112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 0x7fad7c112f80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00b790 tx=0x7fad6c0091d0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 shutdown_connections 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fad6406d2f0 0x7fad6406f7a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad7c102d70 0x7fad7c1134c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 --2- 172.21.15.134:0/1494841598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7c1023d0 0x7fad7c112f80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 >> 172.21.15.134:0/1494841598 conn(0x7fad7c0f7fe0 msgr2=0x7fad7c0f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 shutdown_connections 2024-03-22T07:39:59.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.439+0000 7fad8206e640 1 -- 172.21.15.134:0/1494841598 wait complete. 2024-03-22T07:39:59.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-03-22T07:39:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.550+0000 7f3bf631d640 1 -- 172.21.15.134:0/2387182001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 msgr2=0x7f3bf00fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.550+0000 7f3bf631d640 1 --2- 172.21.15.134:0/2387182001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf00fd7b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3be40048d0 tx=0x7f3be4009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- 172.21.15.134:0/2387182001 shutdown_connections 2024-03-22T07:39:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 --2- 172.21.15.134:0/2387182001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 0x7f3bf01063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 --2- 172.21.15.134:0/2387182001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf00fd7b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- 172.21.15.134:0/2387182001 >> 172.21.15.134:0/2387182001 conn(0x7f3bf00f6eb0 msgr2=0x7f3bf00f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- 172.21.15.134:0/2387182001 shutdown_connections 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- 172.21.15.134:0/2387182001 wait complete. 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 Processor -- start 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- start start 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf0112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 0x7f3bf01134b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0113ab0 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.551+0000 7f3bf631d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf010d100 con 0x7f3bf00fdd80 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf0112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf0112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33538/0 (socket says 172.21.15.134:33538) 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 -- 172.21.15.134:0/1057804253 learned_addr learned my addr 172.21.15.134:0/1057804253 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3bef7fe640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 0x7f3bf01134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 -- 172.21.15.134:0/1057804253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 msgr2=0x7f3bf01134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 0x7f3bf01134b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 -- 172.21.15.134:0/1057804253 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4005040 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3bef7fe640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 0x7f3bf01134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3beffff640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf0112f70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3be4004930 tx=0x7f3be4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be40094c0 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3be4032e50 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf010d380 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be40433b0 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.552+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf010d840 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.553+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0065eb0 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.554+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f3be402f070 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.554+0000 7f3becff9640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bd806d2f0 0x7f3bd806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.554+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f3be40ae870 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.554+0000 7f3bef7fe640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bd806d2f0 0x7f3bd806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.554+0000 7f3bef7fe640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bd806d2f0 0x7f3bd806f7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3bf010e830 tx=0x7f3be000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:59.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.558+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3be4078200 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.767+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f3bf00638c0 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.768+0000 7f3becff9640 1 -- 172.21.15.134:0/1057804253 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) v1 ==== 107+0+4871 (secure 0 0 0) 0x7f3be407b8c0 con 0x7f3bf00fd3e0 2024-03-22T07:39:59.768 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:39:59.768 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:26:16.446375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi134.dexlss","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.134:6829/2483774939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":2483774939},{"type":"v1","addr":"172.21.15.134:6829","nonce":2483774939}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:39:59.768 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 16 2024-03-22T07:39:59.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bd806d2f0 msgr2=0x7f3bd806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bd806d2f0 0x7f3bd806f7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3bf010e830 tx=0x7f3be000b040 comp rx=0 tx=0).stop 2024-03-22T07:39:59.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 msgr2=0x7f3bf0112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf0112f70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3be4004930 tx=0x7f3be4009da0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 shutdown_connections 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f3bd806d2f0 0x7f3bd806f7a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bf00fdd80 0x7f3bf01134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 --2- 172.21.15.134:0/1057804253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bf00fd3e0 0x7f3bf0112f70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 >> 172.21.15.134:0/1057804253 conn(0x7f3bf00f6eb0 msgr2=0x7f3bf00f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 shutdown_connections 2024-03-22T07:39:59.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.770+0000 7f3bf631d640 1 -- 172.21.15.134:0/1057804253 wait complete. 2024-03-22T07:39:59.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-03-22T07:39:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 -- 172.21.15.134:0/1035668105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c1012e0 msgr2=0x7f213c1016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 --2- 172.21.15.134:0/1035668105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c1012e0 0x7f213c1016b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2134009c50 tx=0x7f2134004d10 comp rx=0 tx=0).stop 2024-03-22T07:39:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 -- 172.21.15.134:0/1035668105 shutdown_connections 2024-03-22T07:39:59.881 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 --2- 172.21.15.134:0/1035668105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f213c101c80 0x7f213c0fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 --2- 172.21.15.134:0/1035668105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c1012e0 0x7f213c1016b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 -- 172.21.15.134:0/1035668105 >> 172.21.15.134:0/1035668105 conn(0x7f213c0f6e70 msgr2=0x7f213c0f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 -- 172.21.15.134:0/1035668105 shutdown_connections 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 -- 172.21.15.134:0/1035668105 wait complete. 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 Processor -- start 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.880+0000 7f2142c2e640 1 -- start start 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f2142c2e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f213c1012e0 0x7f213c10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f2142c2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 0x7f213c10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f2142c2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c066510 con 0x7f213c101c80 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f2142c2e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c10eb40 con 0x7f213c1012e0 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 0x7f213c10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 0x7f213c10e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33544/0 (socket says 172.21.15.134:33544) 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 -- 172.21.15.134:0/3552869667 learned_addr learned my addr 172.21.15.134:0/3552869667 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f21409ca640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f213c1012e0 0x7f213c10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.882 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 -- 172.21.15.134:0/3552869667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f213c1012e0 msgr2=0x7f213c10e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f213c1012e0 0x7f213c10e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 -- 172.21.15.134:0/3552869667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340098b0 con 0x7f213c101c80 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f213bfff640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 0x7f213c10e5d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f212400c830 tx=0x7f2124004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f212400a850 con 0x7f213c101c80 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f212400ae80 con 0x7f213c101c80 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c10ee20 con 0x7f213c101c80 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2124012ea0 con 0x7f213c101c80 2024-03-22T07:39:59.883 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.881+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c117430 con 0x7f213c101c80 2024-03-22T07:39:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.882+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c0fca50 con 0x7f213c101c80 2024-03-22T07:39:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.883+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f2124012400 con 0x7f213c101c80 2024-03-22T07:39:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.883+0000 7f21397fa640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f212806d2f0 0x7f212806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:39:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.883+0000 7f21409ca640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f212806d2f0 0x7f212806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:39:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.883+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f212408cc80 con 0x7f213c101c80 2024-03-22T07:39:59.884 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.884+0000 7f21409ca640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f212806d2f0 0x7f212806f7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2134004a30 tx=0x7f213402e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:39:59.887 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:39:59.888+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2124056690 con 0x7f213c101c80 2024-03-22T07:40:00.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:59 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/221232040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-22T07:40:00.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:59 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1494841598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-03-22T07:40:00.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:39:59 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1057804253' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-03-22T07:40:00.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.097+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f213c04bcc0 con 0x7f213c101c80 2024-03-22T07:40:00.097 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.098+0000 7f21397fa640 1 -- 172.21.15.134:0/3552869667 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) v1 ==== 107+0+4078 (secure 0 0 0) 0x7f21240126b0 con 0x7f213c101c80 2024-03-22T07:40:00.098 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:00.098 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:04.486797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:00.098 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 17 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f212806d2f0 msgr2=0x7f212806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f212806d2f0 0x7f212806f7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2134004a30 tx=0x7f213402e040 comp rx=0 tx=0).stop 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 msgr2=0x7f213c10e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 0x7f213c10e5d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f212400c830 tx=0x7f2124004430 comp rx=0 tx=0).stop 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 shutdown_connections 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f212806d2f0 0x7f212806f7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f213c101c80 0x7f213c10e5d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 --2- 172.21.15.134:0/3552869667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f213c1012e0 0x7f213c10e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 >> 172.21.15.134:0/3552869667 conn(0x7f213c0f6e70 msgr2=0x7f213c0f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 shutdown_connections 2024-03-22T07:40:00.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.100+0000 7f2142c2e640 1 -- 172.21.15.134:0/3552869667 wait complete. 2024-03-22T07:40:00.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-03-22T07:40:00.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:59 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/221232040' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-22T07:40:00.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:59 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1494841598' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-03-22T07:40:00.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:39:59 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1057804253' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-03-22T07:40:00.212 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 -- 172.21.15.134:0/1189180028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05441008c0 msgr2=0x7f0544100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 --2- 172.21.15.134:0/1189180028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05441008c0 0x7f0544100c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f053c0048d0 tx=0x7f053c009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 -- 172.21.15.134:0/1189180028 shutdown_connections 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 --2- 172.21.15.134:0/1189180028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05440fa8d0 0x7f05440fad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 --2- 172.21.15.134:0/1189180028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05441008c0 0x7f0544100c90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 -- 172.21.15.134:0/1189180028 >> 172.21.15.134:0/1189180028 conn(0x7f05440708f0 msgr2=0x7f0544070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 -- 172.21.15.134:0/1189180028 shutdown_connections 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 -- 172.21.15.134:0/1189180028 wait complete. 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.211+0000 7f0549114640 1 Processor -- start 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0549114640 1 -- start start 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0549114640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 0x7f0544111c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0549114640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05441008c0 0x7f0544112170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0549114640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544112770 con 0x7f05440fa8d0 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0549114640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054410bdc0 con 0x7f05441008c0 2024-03-22T07:40:00.213 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 0x7f0544111c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 0x7f0544111c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33558/0 (socket says 172.21.15.134:33558) 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 -- 172.21.15.134:0/1966239004 learned_addr learned my addr 172.21.15.134:0/1966239004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f054259c640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05441008c0 0x7f0544112170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 -- 172.21.15.134:0/1966239004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05441008c0 msgr2=0x7f0544112170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05441008c0 0x7f0544112170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 -- 172.21.15.134:0/1966239004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c005040 con 0x7f05440fa8d0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f054259c640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05441008c0 0x7f0544112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0542d9d640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 0x7f0544111c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f053c034040 tx=0x7f053c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053c0092b0 con 0x7f05440fa8d0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f053c03b400 con 0x7f05440fa8d0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054410c040 con 0x7f05440fa8d0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.212+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053c0435d0 con 0x7f05440fa8d0 2024-03-22T07:40:00.214 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.213+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054410c500 con 0x7f05440fa8d0 2024-03-22T07:40:00.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.214+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05440fbfe0 con 0x7f05440fa8d0 2024-03-22T07:40:00.215 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.214+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f053c02f070 con 0x7f05440fa8d0 2024-03-22T07:40:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.214+0000 7f052b7fe640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f052c06d2f0 0x7f052c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.214+0000 7f054259c640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f052c06d2f0 0x7f052c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.214+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f053c0ae7d0 con 0x7f05440fa8d0 2024-03-22T07:40:00.216 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.215+0000 7f054259c640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f052c06d2f0 0x7f052c06f7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f05380049a0 tx=0x7f053800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:00.218 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.219+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f053c078160 con 0x7f05440fa8d0 2024-03-22T07:40:00.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.427+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f054410d2a0 con 0x7f05440fa8d0 2024-03-22T07:40:00.427 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.428+0000 7f052b7fe640 1 -- 172.21.15.134:0/1966239004 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) v1 ==== 107+0+4089 (secure 0 0 0) 0x7f053c07b820 con 0x7f05440fa8d0 2024-03-22T07:40:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:00.428 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:04.491498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":0,"incarnation":18,"state":"up:replay","state_seq":3,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:00.428 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 18 2024-03-22T07:40:00.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.430+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f052c06d2f0 msgr2=0x7f052c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.430+0000 7f0549114640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f052c06d2f0 0x7f052c06f7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f05380049a0 tx=0x7f053800b040 comp rx=0 tx=0).stop 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.430+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 msgr2=0x7f0544111c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.430+0000 7f0549114640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 0x7f0544111c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f053c034040 tx=0x7f053c009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 shutdown_connections 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f052c06d2f0 0x7f052c06f7a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05441008c0 0x7f0544112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 --2- 172.21.15.134:0/1966239004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05440fa8d0 0x7f0544111c30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 >> 172.21.15.134:0/1966239004 conn(0x7f05440708f0 msgr2=0x7f05441035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 shutdown_connections 2024-03-22T07:40:00.431 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.431+0000 7f0549114640 1 -- 172.21.15.134:0/1966239004 wait complete. 2024-03-22T07:40:00.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-03-22T07:40:00.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- 172.21.15.134:0/2909537212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00643a0 msgr2=0x7f21d00647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/2909537212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00643a0 0x7f21d00647d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f21c00048d0 tx=0x7f21c0009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- 172.21.15.134:0/2909537212 shutdown_connections 2024-03-22T07:40:00.542 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/2909537212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00643a0 0x7f21d00647d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/2909537212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d0102240 0x7f21d0102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- 172.21.15.134:0/2909537212 >> 172.21.15.134:0/2909537212 conn(0x7f21d00710b0 msgr2=0x7f21d00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- 172.21.15.134:0/2909537212 shutdown_connections 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- 172.21.15.134:0/2909537212 wait complete. 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 Processor -- start 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- start start 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00643a0 0x7f21d0112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 0x7f21d0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0113810 con 0x7f21d0102240 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.541+0000 7f21d7f5d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d010ce60 con 0x7f21d00643a0 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 0x7f21d0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 0x7f21d0113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33572/0 (socket says 172.21.15.134:33572) 2024-03-22T07:40:00.543 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 -- 172.21.15.134:0/1115854967 learned_addr learned my addr 172.21.15.134:0/1115854967 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d5cf9640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00643a0 0x7f21d0112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 -- 172.21.15.134:0/1115854967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00643a0 msgr2=0x7f21d0112cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00643a0 0x7f21d0112cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 -- 172.21.15.134:0/1115854967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0005040 con 0x7f21d0102240 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d5cf9640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00643a0 0x7f21d0112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d54f8640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 0x7f21d0113210 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004930 tx=0x7f21c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c00094c0 con 0x7f21d0102240 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21c0032e50 con 0x7f21d0102240 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d010d0e0 con 0x7f21d0102240 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c00433b0 con 0x7f21d0102240 2024-03-22T07:40:00.544 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.542+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d010d5a0 con 0x7f21d0102240 2024-03-22T07:40:00.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.543+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d00fd940 con 0x7f21d0102240 2024-03-22T07:40:00.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.544+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f21c002f070 con 0x7f21d0102240 2024-03-22T07:40:00.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.544+0000 7f21c67fc640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f21bc06d2f0 0x7f21bc06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.544+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f21c00aea50 con 0x7f21d0102240 2024-03-22T07:40:00.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.544+0000 7f21d5cf9640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f21bc06d2f0 0x7f21bc06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.545 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.545+0000 7f21d5cf9640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f21bc06d2f0 0x7f21bc06f7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21c8004550 tx=0x7f21c8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:00.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.549+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f21c00783e0 con 0x7f21d0102240 2024-03-22T07:40:00.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.758+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f21d0109320 con 0x7f21d0102240 2024-03-22T07:40:00.758 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.759+0000 7f21c67fc640 1 -- 172.21.15.134:0/1115854967 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) v1 ==== 107+0+4094 (secure 0 0 0) 0x7f21c007baa0 con 0x7f21d0102240 2024-03-22T07:40:00.759 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:00.759 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:12.409193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":153,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:00.759 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 19 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f21bc06d2f0 msgr2=0x7f21bc06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f21bc06d2f0 0x7f21bc06f7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21c8004550 tx=0x7f21c8009040 comp rx=0 tx=0).stop 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 msgr2=0x7f21d0113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 0x7f21d0113210 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004930 tx=0x7f21c0009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 shutdown_connections 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f21bc06d2f0 0x7f21bc06f7a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d0102240 0x7f21d0113210 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 --2- 172.21.15.134:0/1115854967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f21d00643a0 0x7f21d0112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 >> 172.21.15.134:0/1115854967 conn(0x7f21d00710b0 msgr2=0x7f21d00f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 shutdown_connections 2024-03-22T07:40:00.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.761+0000 7f21d7f5d640 1 -- 172.21.15.134:0/1115854967 wait complete. 2024-03-22T07:40:00.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2341970114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 msgr2=0x7fa0f40fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2341970114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f40fb310 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40048d0 tx=0x7fa0e4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2341970114 shutdown_connections 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2341970114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f40fb310 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2341970114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 0x7fa0f41016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2341970114 >> 172.21.15.134:0/2341970114 conn(0x7fa0f40f6eb0 msgr2=0x7fa0f40f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2341970114 shutdown_connections 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.871+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2341970114 wait complete. 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0fb8ae640 1 Processor -- start 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0fb8ae640 1 -- start start 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0fb8ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 0x7fa0f410e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0fb8ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f410e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0fb8ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4066510 con 0x7fa0f4101c80 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0fb8ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f410ebb0 con 0x7fa0f41012e0 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f410e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f410e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33590/0 (socket says 172.21.15.134:33590) 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 -- 172.21.15.134:0/2746420470 learned_addr learned my addr 172.21.15.134:0/2746420470 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f964a640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 0x7fa0f410e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 -- 172.21.15.134:0/2746420470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 msgr2=0x7fa0f410e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 0x7fa0f410e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 -- 172.21.15.134:0/2746420470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4005040 con 0x7fa0f4101c80 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f964a640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 0x7fa0f410e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.872+0000 7fa0f8e49640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f410e670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4034040 tx=0x7fa0e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.873+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0e40092b0 con 0x7fa0f4101c80 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.873+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0e403b400 con 0x7fa0f4101c80 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.873+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f410ee30 con 0x7fa0f4101c80 2024-03-22T07:40:00.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.873+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0e40435d0 con 0x7fa0f4101c80 2024-03-22T07:40:00.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.873+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4117390 con 0x7fa0f4101c80 2024-03-22T07:40:00.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.874+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f40fca50 con 0x7fa0f4101c80 2024-03-22T07:40:00.875 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.874+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fa0e402f070 con 0x7fa0f4101c80 2024-03-22T07:40:00.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.874+0000 7fa0e9ffb640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa0e006d2f0 0x7fa0e006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:00.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.875+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fa0e40ae6d0 con 0x7fa0f4101c80 2024-03-22T07:40:00.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.875+0000 7fa0f964a640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa0e006d2f0 0x7fa0e006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:00.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.875+0000 7fa0f964a640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa0e006d2f0 0x7fa0e006f7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0004ab0 tx=0x7fa0f000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:00.878 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:00.879+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa0e40780e0 con 0x7fa0f4101c80 2024-03-22T07:40:01.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:00 smithi134 ceph-mon[93947]: pgmap v297: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:01.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:00 smithi134 ceph-mon[93947]: overall HEALTH_OK 2024-03-22T07:40:01.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:00 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3552869667' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-03-22T07:40:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:00 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1966239004' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-03-22T07:40:01.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:00 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1115854967' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-03-22T07:40:01.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.089+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fa0f404bcc0 con 0x7fa0f4101c80 2024-03-22T07:40:01.089 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.090+0000 7fa0e9ffb640 1 -- 172.21.15.134:0/2746420470 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) v1 ==== 107+0+4907 (secure 0 0 0) 0x7fa0e407b7a0 con 0x7fa0f4101c80 2024-03-22T07:40:01.090 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:01.090 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:12.598913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":154,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:01.090 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 20 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa0e006d2f0 msgr2=0x7fa0e006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa0e006d2f0 0x7fa0e006f7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0004ab0 tx=0x7fa0f000b040 comp rx=0 tx=0).stop 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 msgr2=0x7fa0f410e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f410e670 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4034040 tx=0x7fa0e4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 shutdown_connections 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fa0e006d2f0 0x7fa0e006f7a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa0f4101c80 0x7fa0f410e670 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 --2- 172.21.15.134:0/2746420470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f41012e0 0x7fa0f410e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 >> 172.21.15.134:0/2746420470 conn(0x7fa0f40f6eb0 msgr2=0x7fa0f40f7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 shutdown_connections 2024-03-22T07:40:01.092 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.092+0000 7fa0fb8ae640 1 -- 172.21.15.134:0/2746420470 wait complete. 2024-03-22T07:40:01.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.201+0000 7f67694ae640 1 -- 172.21.15.134:0/268933882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6764101c80 msgr2=0x7f67640fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.201+0000 7f67694ae640 1 --2- 172.21.15.134:0/268933882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6764101c80 0x7f67640fb310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6758009c50 tx=0x7f6758004d10 comp rx=0 tx=0).stop 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.201+0000 7f67694ae640 1 -- 172.21.15.134:0/268933882 shutdown_connections 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.201+0000 7f67694ae640 1 --2- 172.21.15.134:0/268933882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6764101c80 0x7f67640fb310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.201+0000 7f67694ae640 1 --2- 172.21.15.134:0/268933882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67641012e0 0x7f67641016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.201+0000 7f67694ae640 1 -- 172.21.15.134:0/268933882 >> 172.21.15.134:0/268933882 conn(0x7f67640f6e70 msgr2=0x7f67640f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:01.203 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 -- 172.21.15.134:0/268933882 shutdown_connections 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 -- 172.21.15.134:0/268933882 wait complete. 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 Processor -- start 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 -- start start 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 0x7f6764112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6764101c80 0x7f6764113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764113a50 con 0x7f67641012e0 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f67694ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764113bc0 con 0x7f6764101c80 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f6762ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 0x7f6764112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f6762ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 0x7f6764112f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33618/0 (socket says 172.21.15.134:33618) 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.202+0000 7f6762ffd640 1 -- 172.21.15.134:0/631651890 learned_addr learned my addr 172.21.15.134:0/631651890 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f67627fc640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6764101c80 0x7f6764113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f6762ffd640 1 -- 172.21.15.134:0/631651890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6764101c80 msgr2=0x7f6764113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f6762ffd640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6764101c80 0x7f6764113450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f6762ffd640 1 -- 172.21.15.134:0/631651890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580098b0 con 0x7f67641012e0 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f67627fc640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6764101c80 0x7f6764113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:40:01.204 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f6762ffd640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 0x7f6764112f10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c790 tx=0x7f675c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675c00a820 con 0x7f67641012e0 2024-03-22T07:40:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f675c00ae50 con 0x7f67641012e0 2024-03-22T07:40:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676410d250 con 0x7f67641012e0 2024-03-22T07:40:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f675c0115e0 con 0x7f67641012e0 2024-03-22T07:40:01.205 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.203+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676410d7f0 con 0x7f67641012e0 2024-03-22T07:40:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:00 smithi195 ceph-mon[82061]: pgmap v297: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:01.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:00 smithi195 ceph-mon[82061]: overall HEALTH_OK 2024-03-22T07:40:01.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:00 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3552869667' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-03-22T07:40:01.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:00 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1966239004' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-03-22T07:40:01.206 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:00 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1115854967' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-03-22T07:40:01.206 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.204+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640fca50 con 0x7f67641012e0 2024-03-22T07:40:01.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.204+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f675c012400 con 0x7f67641012e0 2024-03-22T07:40:01.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.205+0000 7f674b7fe640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f674c06d2f0 0x7f674c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.205+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f675c08cb90 con 0x7f67641012e0 2024-03-22T07:40:01.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.205+0000 7f67627fc640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f674c06d2f0 0x7f674c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.207 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.205+0000 7f67627fc640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f674c06d2f0 0x7f674c06f7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6758000f80 tx=0x7f675802e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:01.209 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.209+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f675c0565a0 con 0x7f67641012e0 2024-03-22T07:40:01.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.419+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f676404bcc0 con 0x7f67641012e0 2024-03-22T07:40:01.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.420+0000 7f674b7fe640 1 -- 172.21.15.134:0/631651890 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) v1 ==== 107+0+4907 (secure 0 0 0) 0x7f675c059c60 con 0x7f67641012e0 2024-03-22T07:40:01.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:01.420 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:13.656565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi195.dayrmo","rank":0,"incarnation":18,"state":"up:active","state_seq":155,"addr":"172.21.15.195:6825/4087242582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":4087242582},{"type":"v1","addr":"172.21.15.195:6825","nonce":4087242582}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:01.420 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 21 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f674c06d2f0 msgr2=0x7f674c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f674c06d2f0 0x7f674c06f7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6758000f80 tx=0x7f675802e040 comp rx=0 tx=0).stop 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 msgr2=0x7f6764112f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 0x7f6764112f10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c790 tx=0x7f675c0043c0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 shutdown_connections 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f674c06d2f0 0x7f674c06f7a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6764101c80 0x7f6764113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 --2- 172.21.15.134:0/631651890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67641012e0 0x7f6764112f10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 >> 172.21.15.134:0/631651890 conn(0x7f67640f6e70 msgr2=0x7f67640f7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:01.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 shutdown_connections 2024-03-22T07:40:01.423 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.422+0000 7f67694ae640 1 -- 172.21.15.134:0/631651890 wait complete. 2024-03-22T07:40:01.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-03-22T07:40:01.531 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- 172.21.15.134:0/2585267305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec1012d0 msgr2=0x7fd9ec1016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 --2- 172.21.15.134:0/2585267305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec1012d0 0x7fd9ec1016a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40048d0 tx=0x7fd9e4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- 172.21.15.134:0/2585267305 shutdown_connections 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 --2- 172.21.15.134:0/2585267305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec101c70 0x7fd9ec0fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 --2- 172.21.15.134:0/2585267305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec1012d0 0x7fd9ec1016a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- 172.21.15.134:0/2585267305 >> 172.21.15.134:0/2585267305 conn(0x7fd9ec0f6ec0 msgr2=0x7fd9ec0f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- 172.21.15.134:0/2585267305 shutdown_connections 2024-03-22T07:40:01.532 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- 172.21.15.134:0/2585267305 wait complete. 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 Processor -- start 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- start start 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1012d0 0x7fd9ec10e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 0x7fd9ec10e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.532+0000 7fd9f119d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec066590 con 0x7fd9ec101c70 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9f119d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec10eb70 con 0x7fd9ec1012d0 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 0x7fd9ec10e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 0x7fd9ec10e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33622/0 (socket says 172.21.15.134:33622) 2024-03-22T07:40:01.534 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 -- 172.21.15.134:0/1477456453 learned_addr learned my addr 172.21.15.134:0/1477456453 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ead9d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1012d0 0x7fd9ec10e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 -- 172.21.15.134:0/1477456453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1012d0 msgr2=0x7fd9ec10e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1012d0 0x7fd9ec10e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 -- 172.21.15.134:0/1477456453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4005040 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9ea59c640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 0x7fd9ec10e600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000ece0 tx=0x7fd9e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9e000ee40 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9e000f040 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec10ee50 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9e0009750 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.533+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec1173e0 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.534+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec0fca40 con 0x7fd9ec101c70 2024-03-22T07:40:01.535 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.535+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fd9e0007890 con 0x7fd9ec101c70 2024-03-22T07:40:01.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.535+0000 7fd9d37fe640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd9d406d2f0 0x7fd9d406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.535+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fd9e008d180 con 0x7fd9ec101c70 2024-03-22T07:40:01.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.535+0000 7fd9ead9d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd9d406d2f0 0x7fd9d406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.536 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.536+0000 7fd9ead9d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd9d406d2f0 0x7fd9d406f7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4003080 tx=0x7fd9e4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:01.539 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.540+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9e0056b90 con 0x7fd9ec101c70 2024-03-22T07:40:01.749 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.750+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fd9ec04bcc0 con 0x7fd9ec101c70 2024-03-22T07:40:01.750 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.750+0000 7fd9d37fe640 1 -- 172.21.15.134:0/1477456453 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) v1 ==== 107+0+4112 (secure 0 0 0) 0x7fd9e005a250 con 0x7fd9ec101c70 2024-03-22T07:40:01.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:01.750 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:26.407808+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:01.751 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 22 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd9d406d2f0 msgr2=0x7fd9d406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd9d406d2f0 0x7fd9d406f7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4003080 tx=0x7fd9e4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 msgr2=0x7fd9ec10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 0x7fd9ec10e600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000ece0 tx=0x7fd9e000b040 comp rx=0 tx=0).stop 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 shutdown_connections 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd9d406d2f0 0x7fd9d406f7a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.752 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9ec101c70 0x7fd9ec10e600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 --2- 172.21.15.134:0/1477456453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9ec1012d0 0x7fd9ec10e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 >> 172.21.15.134:0/1477456453 conn(0x7fd9ec0f6ec0 msgr2=0x7fd9ec0f7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:01.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.752+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 shutdown_connections 2024-03-22T07:40:01.753 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.753+0000 7fd9f119d640 1 -- 172.21.15.134:0/1477456453 wait complete. 2024-03-22T07:40:01.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- 172.21.15.134:0/305845735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea80102d70 msgr2=0x7fea800fc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 --2- 172.21.15.134:0/305845735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea80102d70 0x7fea800fc400 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fea700048d0 tx=0x7fea70009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- 172.21.15.134:0/305845735 shutdown_connections 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 --2- 172.21.15.134:0/305845735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea80102d70 0x7fea800fc400 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 --2- 172.21.15.134:0/305845735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea801023d0 0x7fea801027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- 172.21.15.134:0/305845735 >> 172.21.15.134:0/305845735 conn(0x7fea800f7fe0 msgr2=0x7fea800fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- 172.21.15.134:0/305845735 shutdown_connections 2024-03-22T07:40:01.863 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- 172.21.15.134:0/305845735 wait complete. 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 Processor -- start 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- start start 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 0x7fea80112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea80102d70 0x7fea80113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80113a60 con 0x7fea801023d0 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.862+0000 7fea87d9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8010d0b0 con 0x7fea80102d70 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 0x7fea80112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 0x7fea80112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33636/0 (socket says 172.21.15.134:33636) 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 -- 172.21.15.134:0/1198676510 learned_addr learned my addr 172.21.15.134:0/1198676510 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85338640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea80102d70 0x7fea80113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 -- 172.21.15.134:0/1198676510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea80102d70 msgr2=0x7fea80113460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea80102d70 0x7fea80113460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 -- 172.21.15.134:0/1198676510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70005040 con 0x7fea801023d0 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea85b39640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 0x7fea80112f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea7c002a50 tx=0x7fea7c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7c007c30 con 0x7fea801023d0 2024-03-22T07:40:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea7c00f040 con 0x7fea801023d0 2024-03-22T07:40:01.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8010d390 con 0x7fea801023d0 2024-03-22T07:40:01.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7c00db50 con 0x7fea801023d0 2024-03-22T07:40:01.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.863+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8010d880 con 0x7fea801023d0 2024-03-22T07:40:01.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.864+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea800fdb40 con 0x7fea801023d0 2024-03-22T07:40:01.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.864+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fea7c00dcf0 con 0x7fea801023d0 2024-03-22T07:40:01.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.865+0000 7fea767fc640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fea6c06d2f0 0x7fea6c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:01.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.865+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fea7c08c1c0 con 0x7fea801023d0 2024-03-22T07:40:01.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.865+0000 7fea85338640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fea6c06d2f0 0x7fea6c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:01.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.865+0000 7fea85338640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fea6c06d2f0 0x7fea6c06f7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea800faad0 tx=0x7fea70009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:01.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:01.869+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea7c055c80 con 0x7fea801023d0 2024-03-22T07:40:02.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:01 smithi134 ceph-mon[93947]: pgmap v298: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:01 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2746420470' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-03-22T07:40:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:01 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/631651890' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-03-22T07:40:02.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:01 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1477456453' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-03-22T07:40:02.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.077+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fea800638c0 con 0x7fea801023d0 2024-03-22T07:40:02.077 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.078+0000 7fea767fc640 1 -- 172.21.15.134:0/1198676510 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) v1 ==== 107+0+4123 (secure 0 0 0) 0x7fea7c059340 con 0x7fea801023d0 2024-03-22T07:40:02.078 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:02.078 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:26.415350+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":0,"incarnation":23,"state":"up:replay","state_seq":2,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:02.078 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 23 2024-03-22T07:40:02.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fea6c06d2f0 msgr2=0x7fea6c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fea6c06d2f0 0x7fea6c06f7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea800faad0 tx=0x7fea70009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 msgr2=0x7fea80112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 0x7fea80112f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea7c002a50 tx=0x7fea7c004600 comp rx=0 tx=0).stop 2024-03-22T07:40:02.080 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 shutdown_connections 2024-03-22T07:40:02.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fea6c06d2f0 0x7fea6c06f7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea80102d70 0x7fea80113460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 --2- 172.21.15.134:0/1198676510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea801023d0 0x7fea80112f20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 >> 172.21.15.134:0/1198676510 conn(0x7fea800f7fe0 msgr2=0x7fea800f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:02.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 shutdown_connections 2024-03-22T07:40:02.081 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.080+0000 7fea87d9d640 1 -- 172.21.15.134:0/1198676510 wait complete. 2024-03-22T07:40:02.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-03-22T07:40:02.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 -- 172.21.15.134:0/3020924806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 msgr2=0x7f779c1016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 --2- 172.21.15.134:0/3020924806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c1016b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f77980048d0 tx=0x7f7798009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 -- 172.21.15.134:0/3020924806 shutdown_connections 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 --2- 172.21.15.134:0/3020924806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f779c101c80 0x7f779c0fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 --2- 172.21.15.134:0/3020924806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c1016b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 -- 172.21.15.134:0/3020924806 >> 172.21.15.134:0/3020924806 conn(0x7f779c0f6e70 msgr2=0x7f779c0f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 -- 172.21.15.134:0/3020924806 shutdown_connections 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.190+0000 7f77a415d640 1 -- 172.21.15.134:0/3020924806 wait complete. 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 Processor -- start 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 -- start start 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f779c101c80 0x7f779c10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c066510 con 0x7f779c1012e0 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c10eb40 con 0x7f779c101c80 2024-03-22T07:40:02.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c10e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33648/0 (socket says 172.21.15.134:33648) 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 -- 172.21.15.134:0/2357469496 learned_addr learned my addr 172.21.15.134:0/2357469496 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 -- 172.21.15.134:0/2357469496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f779c101c80 msgr2=0x7f779c10e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f779c101c80 0x7f779c10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 -- 172.21.15.134:0/2357469496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798005040 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a1ef9640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c10e090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7798004930 tx=0x7f7798009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77980094c0 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7798032e50 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c10edc0 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.191+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77980433b0 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.192+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c1172f0 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.192+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c0fca50 con 0x7f779c1012e0 2024-03-22T07:40:02.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.193+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f779802f070 con 0x7f779c1012e0 2024-03-22T07:40:02.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.193+0000 7f77927fc640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f778806d2f0 0x7f778806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.193+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f77980ae870 con 0x7f779c1012e0 2024-03-22T07:40:02.195 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.193+0000 7f77a16f8640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f778806d2f0 0x7f778806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.194+0000 7f77a16f8640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f778806d2f0 0x7f778806f7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f778c009af0 tx=0x7f778c009cd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:02.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.198+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7798078200 con 0x7f779c1012e0 2024-03-22T07:40:02.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:01 smithi195 ceph-mon[82061]: pgmap v298: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:02.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:01 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2746420470' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-03-22T07:40:02.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:01 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/631651890' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-03-22T07:40:02.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:01 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1477456453' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-03-22T07:40:02.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.407+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f779c04bcc0 con 0x7f779c1012e0 2024-03-22T07:40:02.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.408+0000 7f77927fc640 1 -- 172.21.15.134:0/2357469496 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) v1 ==== 107+0+4128 (secure 0 0 0) 0x7f779807b8c0 con 0x7f779c1012e0 2024-03-22T07:40:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:02.408 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:34.607034+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":157,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:02.408 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 24 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f778806d2f0 msgr2=0x7f778806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f778806d2f0 0x7f778806f7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f778c009af0 tx=0x7f778c009cd0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 msgr2=0x7f779c10e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c10e090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7798004930 tx=0x7f7798009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 shutdown_connections 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f778806d2f0 0x7f778806f7a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f779c101c80 0x7f779c10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 --2- 172.21.15.134:0/2357469496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f779c1012e0 0x7f779c10e090 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 >> 172.21.15.134:0/2357469496 conn(0x7f779c0f6e70 msgr2=0x7f779c0f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:02.410 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 shutdown_connections 2024-03-22T07:40:02.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.410+0000 7f77a415d640 1 -- 172.21.15.134:0/2357469496 wait complete. 2024-03-22T07:40:02.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-03-22T07:40:02.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 -- 172.21.15.134:0/1814657761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 msgr2=0x7fe8741025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 --2- 172.21.15.134:0/1814657761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8741025d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009c50 tx=0x7fe86c004d10 comp rx=0 tx=0).stop 2024-03-22T07:40:02.521 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 -- 172.21.15.134:0/1814657761 shutdown_connections 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 --2- 172.21.15.134:0/1814657761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe874102ba0 0x7fe8740fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 --2- 172.21.15.134:0/1814657761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8741025d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 -- 172.21.15.134:0/1814657761 >> 172.21.15.134:0/1814657761 conn(0x7fe8740708f0 msgr2=0x7fe874070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 -- 172.21.15.134:0/1814657761 shutdown_connections 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 -- 172.21.15.134:0/1814657761 wait complete. 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 Processor -- start 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.520+0000 7fe878e6e640 1 -- start start 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe878e6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8740fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe878e6e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe874102ba0 0x7fe8740fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe878e6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740fd990 con 0x7fe874102200 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe878e6e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740fc530 con 0x7fe874102ba0 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8740fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8740fbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33658/0 (socket says 172.21.15.134:33658) 2024-03-22T07:40:02.522 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 -- 172.21.15.134:0/2949943962 learned_addr learned my addr 172.21.15.134:0/2949943962 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe871d9b640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe874102ba0 0x7fe8740fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 -- 172.21.15.134:0/2949943962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe874102ba0 msgr2=0x7fe8740fbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe874102ba0 0x7fe8740fbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 -- 172.21.15.134:0/2949943962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c0098b0 con 0x7fe874102200 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe87259c640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8740fbab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe86c004a30 tx=0x7fe86c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86c03a070 con 0x7fe874102200 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe86c035b20 con 0x7fe874102200 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86c03ea70 con 0x7fe874102200 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8740fc7b0 con 0x7fe874102200 2024-03-22T07:40:02.523 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.521+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe874119500 con 0x7fe874102200 2024-03-22T07:40:02.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.522+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8740652a0 con 0x7fe874102200 2024-03-22T07:40:02.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.523+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fe86c032070 con 0x7fe874102200 2024-03-22T07:40:02.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.523+0000 7fe86affd640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe86006d2f0 0x7fe86006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.523+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fe86c0aeae0 con 0x7fe874102200 2024-03-22T07:40:02.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.523+0000 7fe871d9b640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe86006d2f0 0x7fe86006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.523+0000 7fe871d9b640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe86006d2f0 0x7fe86006f7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007fd0 tx=0x7fe85c009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:02.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.527+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe86c0785a0 con 0x7fe874102200 2024-03-22T07:40:02.736 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.737+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fe874119740 con 0x7fe874102200 2024-03-22T07:40:02.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.738+0000 7fe86affd640 1 -- 172.21.15.134:0/2949943962 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) v1 ==== 107+0+4125 (secure 0 0 0) 0x7fe86c07bc60 con 0x7fe874102200 2024-03-22T07:40:02.737 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:02.737 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:35.596778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":158,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:02.738 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 25 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe86006d2f0 msgr2=0x7fe86006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe86006d2f0 0x7fe86006f7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007fd0 tx=0x7fe85c009e90 comp rx=0 tx=0).stop 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 msgr2=0x7fe8740fbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8740fbab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe86c004a30 tx=0x7fe86c004d10 comp rx=0 tx=0).stop 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 shutdown_connections 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fe86006d2f0 0x7fe86006f7a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe874102ba0 0x7fe8740fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 --2- 172.21.15.134:0/2949943962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe874102200 0x7fe8740fbab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 >> 172.21.15.134:0/2949943962 conn(0x7fe8740708f0 msgr2=0x7fe874104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 shutdown_connections 2024-03-22T07:40:02.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.740+0000 7fe878e6e640 1 -- 172.21.15.134:0/2949943962 wait complete. 2024-03-22T07:40:02.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-03-22T07:40:02.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 -- 172.21.15.134:0/2416437206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 msgr2=0x7fb8781025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 --2- 172.21.15.134:0/2416437206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb8781025d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb8680048d0 tx=0x7fb868009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 -- 172.21.15.134:0/2416437206 shutdown_connections 2024-03-22T07:40:02.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 --2- 172.21.15.134:0/2416437206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb878102ba0 0x7fb8780fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 --2- 172.21.15.134:0/2416437206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb8781025d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 -- 172.21.15.134:0/2416437206 >> 172.21.15.134:0/2416437206 conn(0x7fb8780708f0 msgr2=0x7fb878070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 -- 172.21.15.134:0/2416437206 shutdown_connections 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.849+0000 7fb88022e640 1 -- 172.21.15.134:0/2416437206 wait complete. 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb88022e640 1 Processor -- start 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb88022e640 1 -- start start 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb88022e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb878112de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb88022e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb878102ba0 0x7fb878113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb88022e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb878113920 con 0x7fb878102200 2024-03-22T07:40:02.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb88022e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87810cfc0 con 0x7fb878102ba0 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb878112de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb878112de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33684/0 (socket says 172.21.15.134:33684) 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 -- 172.21.15.134:0/2774629054 learned_addr learned my addr 172.21.15.134:0/2774629054 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87d7c9640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb878102ba0 0x7fb878113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 -- 172.21.15.134:0/2774629054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb878102ba0 msgr2=0x7fb878113320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb878102ba0 0x7fb878113320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 -- 172.21.15.134:0/2774629054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868005040 con 0x7fb878102200 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.850+0000 7fb87dfca640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb878112de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb8680047f0 tx=0x7fb868009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.851+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8680094c0 con 0x7fb878102200 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.851+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb868032e50 con 0x7fb878102200 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.851+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87810d240 con 0x7fb878102200 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.851+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8680433b0 con 0x7fb878102200 2024-03-22T07:40:02.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.851+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87810d700 con 0x7fb878102200 2024-03-22T07:40:02.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.852+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8780652a0 con 0x7fb878102200 2024-03-22T07:40:02.855 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.852+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fb86802f070 con 0x7fb878102200 2024-03-22T07:40:02.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.853+0000 7fb86e7fc640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb86406d300 0x7fb86406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:02.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.853+0000 7fb87d7c9640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb86406d300 0x7fb86406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:02.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.853+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fb8680ae810 con 0x7fb878102200 2024-03-22T07:40:02.856 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.853+0000 7fb87d7c9640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb86406d300 0x7fb86406f7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb87810e6a0 tx=0x7fb87400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:02.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:02.857+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb868078250 con 0x7fb878102200 2024-03-22T07:40:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:02 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1198676510' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-03-22T07:40:03.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:02 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2357469496' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-03-22T07:40:03.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:02 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2949943962' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-03-22T07:40:03.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.066+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fb87810e450 con 0x7fb878102200 2024-03-22T07:40:03.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.067+0000 7fb86e7fc640 1 -- 172.21.15.134:0/2774629054 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) v1 ==== 107+0+4125 (secure 0 0 0) 0x7fb86807b910 con 0x7fb878102200 2024-03-22T07:40:03.066 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:03.067 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:36.662123+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":0,"incarnation":23,"state":"up:active","state_seq":159,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:03.067 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 26 2024-03-22T07:40:03.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb86406d300 msgr2=0x7fb86406f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb86406d300 0x7fb86406f7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb87810e6a0 tx=0x7fb87400b040 comp rx=0 tx=0).stop 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 msgr2=0x7fb878112de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb878112de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb8680047f0 tx=0x7fb868009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 shutdown_connections 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fb86406d300 0x7fb86406f7b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb878102ba0 0x7fb878113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 --2- 172.21.15.134:0/2774629054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb878102200 0x7fb878112de0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 >> 172.21.15.134:0/2774629054 conn(0x7fb8780708f0 msgr2=0x7fb878104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 shutdown_connections 2024-03-22T07:40:03.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.069+0000 7fb88022e640 1 -- 172.21.15.134:0/2774629054 wait complete. 2024-03-22T07:40:03.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.178+0000 7f1c87e58640 1 -- 172.21.15.134:0/1507103275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 msgr2=0x7f1c800fc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.178+0000 7f1c87e58640 1 --2- 172.21.15.134:0/1507103275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c800fc410 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1c700048d0 tx=0x7f1c70009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.178+0000 7f1c87e58640 1 -- 172.21.15.134:0/1507103275 shutdown_connections 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.178+0000 7f1c87e58640 1 --2- 172.21.15.134:0/1507103275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c800fc410 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.178+0000 7f1c87e58640 1 --2- 172.21.15.134:0/1507103275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c801023e0 0x7f1c801027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.178+0000 7f1c87e58640 1 -- 172.21.15.134:0/1507103275 >> 172.21.15.134:0/1507103275 conn(0x7f1c800f7fb0 msgr2=0x7f1c800fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 -- 172.21.15.134:0/1507103275 shutdown_connections 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 -- 172.21.15.134:0/1507103275 wait complete. 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 Processor -- start 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 -- start start 2024-03-22T07:40:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c801023e0 0x7f1c80112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c80113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80113a70 con 0x7f1c80102d80 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c87e58640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8010d0c0 con 0x7f1c801023e0 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c853f3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c80113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c853f3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c80113470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33692/0 (socket says 172.21.15.134:33692) 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c853f3640 1 -- 172.21.15.134:0/3408512033 learned_addr learned my addr 172.21.15.134:0/3408512033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.179+0000 7f1c85bf4640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c801023e0 0x7f1c80112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c853f3640 1 -- 172.21.15.134:0/3408512033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c801023e0 msgr2=0x7f1c80112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c853f3640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c801023e0 0x7f1c80112f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c853f3640 1 -- 172.21.15.134:0/3408512033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70005040 con 0x7f1c80102d80 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c853f3640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c80113470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004930 tx=0x7f1c70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c700094c0 con 0x7f1c80102d80 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8010d340 con 0x7f1c80102d80 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c70032e50 con 0x7f1c80102d80 2024-03-22T07:40:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c700433b0 con 0x7f1c80102d80 2024-03-22T07:40:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.180+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8010d800 con 0x7f1c80102d80 2024-03-22T07:40:03.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.181+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c800fdb50 con 0x7f1c80102d80 2024-03-22T07:40:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.181+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f1c7002f070 con 0x7f1c80102d80 2024-03-22T07:40:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.182+0000 7f1c767fc640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c6c06d2f0 0x7f1c6c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.182+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f1c700ae840 con 0x7f1c80102d80 2024-03-22T07:40:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.182+0000 7f1c85bf4640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c6c06d2f0 0x7f1c6c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.182+0000 7f1c85bf4640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c6c06d2f0 0x7f1c6c06f7a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c004ed0 tx=0x7f1c7c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:03.186 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.186+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c70078280 con 0x7f1c80102d80 2024-03-22T07:40:03.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:02 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1198676510' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-03-22T07:40:03.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:02 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2357469496' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-03-22T07:40:03.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:02 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2949943962' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-03-22T07:40:03.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.395+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f1c80109540 con 0x7f1c80102d80 2024-03-22T07:40:03.395 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.396+0000 7f1c767fc640 1 -- 172.21.15.134:0/3408512033 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) v1 ==== 107+0+4941 (secure 0 0 0) 0x7f1c7007b940 con 0x7f1c80102d80 2024-03-22T07:40:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:03.396 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44309,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2563834080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2563834080},{"type":"v1","addr":"172.21.15.195:6825","nonce":2563834080}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:36.662123+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24279":{"gid":24279,"name":"cephfs.smithi195.jursxo","rank":0,"incarnation":23,"state":"up:active","state_seq":159,"addr":"172.21.15.195:6827/2251029735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2251029735},{"type":"v1","addr":"172.21.15.195:6827","nonce":2251029735}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:03.396 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 27 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c6c06d2f0 msgr2=0x7f1c6c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c6c06d2f0 0x7f1c6c06f7a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c004ed0 tx=0x7f1c7c00b040 comp rx=0 tx=0).stop 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 msgr2=0x7f1c80113470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c80113470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004930 tx=0x7f1c70009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 shutdown_connections 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c6c06d2f0 0x7f1c6c06f7a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.398 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c80102d80 0x7f1c80113470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 --2- 172.21.15.134:0/3408512033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c801023e0 0x7f1c80112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 >> 172.21.15.134:0/3408512033 conn(0x7f1c800f7fb0 msgr2=0x7f1c800f8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:03.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 shutdown_connections 2024-03-22T07:40:03.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.398+0000 7f1c87e58640 1 -- 172.21.15.134:0/3408512033 wait complete. 2024-03-22T07:40:03.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-03-22T07:40:03.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.507+0000 7efbfd59d640 1 -- 172.21.15.134:0/3518613758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 msgr2=0x7efbf8101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.507+0000 7efbfd59d640 1 --2- 172.21.15.134:0/3518613758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf8101510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efbe80048d0 tx=0x7efbe8009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- 172.21.15.134:0/3518613758 shutdown_connections 2024-03-22T07:40:03.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 --2- 172.21.15.134:0/3518613758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80fb110 0x7efbf80fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 --2- 172.21.15.134:0/3518613758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf8101510 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- 172.21.15.134:0/3518613758 >> 172.21.15.134:0/3518613758 conn(0x7efbf80710b0 msgr2=0x7efbf80714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- 172.21.15.134:0/3518613758 shutdown_connections 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- 172.21.15.134:0/3518613758 wait complete. 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 Processor -- start 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- start start 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80fb110 0x7efbf8111bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf81120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81126f0 con 0x7efbf8101140 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.508+0000 7efbfd59d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf810bd40 con 0x7efbf80fb110 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf81120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf81120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33700/0 (socket says 172.21.15.134:33700) 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 -- 172.21.15.134:0/437617477 learned_addr learned my addr 172.21.15.134:0/437617477 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf6ffd640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80fb110 0x7efbf8111bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 -- 172.21.15.134:0/437617477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80fb110 msgr2=0x7efbf8111bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80fb110 0x7efbf8111bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 -- 172.21.15.134:0/437617477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8005040 con 0x7efbf8101140 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbf67fc640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf81120f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efbec00eb70 tx=0x7efbec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbec007c30 con 0x7efbf8101140 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efbec00f040 con 0x7efbf8101140 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf810bfc0 con 0x7efbf8101140 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbec0095b0 con 0x7efbf8101140 2024-03-22T07:40:03.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.509+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf810c4e0 con 0x7efbf8101140 2024-03-22T07:40:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.510+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80fc800 con 0x7efbf8101140 2024-03-22T07:40:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.511+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7efbec009710 con 0x7efbf8101140 2024-03-22T07:40:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.511+0000 7efbdf7fe640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7efbe006d2f0 0x7efbe006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.511+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7efbec08c620 con 0x7efbf8101140 2024-03-22T07:40:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.511+0000 7efbf6ffd640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7efbe006d2f0 0x7efbe006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.511+0000 7efbf6ffd640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7efbe006d2f0 0x7efbe006f7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009990 tx=0x7efbe8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:03.515 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.516+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efbec0560e0 con 0x7efbf8101140 2024-03-22T07:40:03.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.726+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7efbf8108220 con 0x7efbf8101140 2024-03-22T07:40:03.726 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.727+0000 7efbdf7fe640 1 -- 172.21.15.134:0/437617477 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) v1 ==== 107+0+4146 (secure 0 0 0) 0x7efbec0597a0 con 0x7efbf8101140 2024-03-22T07:40:03.727 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:03.727 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44309,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2563834080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2563834080},{"type":"v1","addr":"172.21.15.195:6825","nonce":2563834080}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:51.728383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:03.727 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 28 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7efbe006d2f0 msgr2=0x7efbe006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7efbe006d2f0 0x7efbe006f7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009990 tx=0x7efbe8009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 msgr2=0x7efbf81120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf81120f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efbec00eb70 tx=0x7efbec00b040 comp rx=0 tx=0).stop 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 shutdown_connections 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7efbe006d2f0 0x7efbe006f7a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efbf8101140 0x7efbf81120f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 --2- 172.21.15.134:0/437617477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efbf80fb110 0x7efbf8111bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 >> 172.21.15.134:0/437617477 conn(0x7efbf80710b0 msgr2=0x7efbf80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 shutdown_connections 2024-03-22T07:40:03.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.729+0000 7efbfd59d640 1 -- 172.21.15.134:0/437617477 wait complete. 2024-03-22T07:40:03.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.839+0000 7f4f722ae640 1 -- 172.21.15.134:0/401333366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 msgr2=0x7f4f6c102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.839+0000 7f4f722ae640 1 --2- 172.21.15.134:0/401333366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c102610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0048d0 tx=0x7f4f5c009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.839+0000 7f4f722ae640 1 -- 172.21.15.134:0/401333366 shutdown_connections 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.839+0000 7f4f722ae640 1 --2- 172.21.15.134:0/401333366 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c0643a0 0x7f4f6c0647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.839+0000 7f4f722ae640 1 --2- 172.21.15.134:0/401333366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c102610 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.839+0000 7f4f722ae640 1 -- 172.21.15.134:0/401333366 >> 172.21.15.134:0/401333366 conn(0x7f4f6c0710b0 msgr2=0x7f4f6c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 -- 172.21.15.134:0/401333366 shutdown_connections 2024-03-22T07:40:03.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 -- 172.21.15.134:0/401333366 wait complete. 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 Processor -- start 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 -- start start 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c0643a0 0x7f4f6c112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c113850 con 0x7f4f6c102240 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f722ae640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c10cea0 con 0x7f4f6c0643a0 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f6b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f6b7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50372/0 (socket says 172.21.15.134:50372) 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.840+0000 7f4f6b7fe640 1 -- 172.21.15.134:0/74753774 learned_addr learned my addr 172.21.15.134:0/74753774 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f6bfff640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c0643a0 0x7f4f6c112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f6b7fe640 1 -- 172.21.15.134:0/74753774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c0643a0 msgr2=0x7f4f6c112d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f6b7fe640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c0643a0 0x7f4f6c112d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f6b7fe640 1 -- 172.21.15.134:0/74753774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c005040 con 0x7f4f6c102240 2024-03-22T07:40:03.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f6b7fe640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c113250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f60002a80 tx=0x7f4f60004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:03.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f60007c30 con 0x7f4f6c102240 2024-03-22T07:40:03.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c10d180 con 0x7f4f6c102240 2024-03-22T07:40:03.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f6000f040 con 0x7f4f6c102240 2024-03-22T07:40:03.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f600096b0 con 0x7f4f6c102240 2024-03-22T07:40:03.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.841+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c10d6a0 con 0x7f4f6c102240 2024-03-22T07:40:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.842+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c0fd940 con 0x7f4f6c102240 2024-03-22T07:40:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.842+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f4f6000d6b0 con 0x7f4f6c102240 2024-03-22T07:40:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.843+0000 7f4f68ff9640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4f5406d2f0 0x7f4f5406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.843+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f4f6008c480 con 0x7f4f6c102240 2024-03-22T07:40:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.843+0000 7f4f6bfff640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4f5406d2f0 0x7f4f5406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:03.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.843+0000 7f4f6bfff640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4f5406d2f0 0x7f4f5406f7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c003080 tx=0x7f4f5c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:03.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:03.847+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4f60055dd0 con 0x7f4f6c102240 2024-03-22T07:40:04.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:03 smithi134 ceph-mon[93947]: pgmap v299: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:04.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:03 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2774629054' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-03-22T07:40:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:03 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3408512033' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-03-22T07:40:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:03 smithi134 ceph-mon[93947]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:40:04.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:03 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/437617477' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-03-22T07:40:04.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.057+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f4f6c04bcc0 con 0x7f4f6c102240 2024-03-22T07:40:04.057 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.057+0000 7f4f68ff9640 1 -- 172.21.15.134:0/74753774 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) v1 ==== 107+0+4191 (secure 0 0 0) 0x7f4f60059490 con 0x7f4f6c102240 2024-03-22T07:40:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:04.058 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44309,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2563834080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2563834080},{"type":"v1","addr":"172.21.15.195:6825","nonce":2563834080}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:51.733831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:04.058 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 29 2024-03-22T07:40:04.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.059+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4f5406d2f0 msgr2=0x7f4f5406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.059+0000 7f4f722ae640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4f5406d2f0 0x7f4f5406f7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c003080 tx=0x7f4f5c009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.059+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 msgr2=0x7f4f6c113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.059+0000 7f4f722ae640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c113250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f60002a80 tx=0x7f4f60004600 comp rx=0 tx=0).stop 2024-03-22T07:40:04.059 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.059+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 shutdown_connections 2024-03-22T07:40:04.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.059+0000 7f4f722ae640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f4f5406d2f0 0x7f4f5406f7a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.060+0000 7f4f722ae640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f6c102240 0x7f4f6c113250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.060+0000 7f4f722ae640 1 --2- 172.21.15.134:0/74753774 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f6c0643a0 0x7f4f6c112d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.060+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 >> 172.21.15.134:0/74753774 conn(0x7f4f6c0710b0 msgr2=0x7f4f6c0f9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:04.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.060+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 shutdown_connections 2024-03-22T07:40:04.060 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.060+0000 7f4f722ae640 1 -- 172.21.15.134:0/74753774 wait complete. 2024-03-22T07:40:04.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-03-22T07:40:04.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 -- 172.21.15.134:0/817261505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 msgr2=0x7f09080fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 --2- 172.21.15.134:0/817261505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f09080fb310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0048d0 tx=0x7f08fc009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 -- 172.21.15.134:0/817261505 shutdown_connections 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 --2- 172.21.15.134:0/817261505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f09080fb310 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 --2- 172.21.15.134:0/817261505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09081012e0 0x7f09081016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 -- 172.21.15.134:0/817261505 >> 172.21.15.134:0/817261505 conn(0x7f09080f6e70 msgr2=0x7f09080f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 -- 172.21.15.134:0/817261505 shutdown_connections 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.168+0000 7f090d025640 1 -- 172.21.15.134:0/817261505 wait complete. 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090d025640 1 Processor -- start 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090d025640 1 -- start start 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090d025640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09081012e0 0x7f0908111dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090d025640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f0908112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090d025640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908112900 con 0x7f0908101c80 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090d025640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908112a70 con 0x7f09081012e0 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f0908112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f0908112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50392/0 (socket says 172.21.15.134:50392) 2024-03-22T07:40:04.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 -- 172.21.15.134:0/53893577 learned_addr learned my addr 172.21.15.134:0/53893577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f0906d9d640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09081012e0 0x7f0908111dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 -- 172.21.15.134:0/53893577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09081012e0 msgr2=0x7f0908111dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09081012e0 0x7f0908111dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 -- 172.21.15.134:0/53893577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc005040 con 0x7f0908101c80 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.169+0000 7f090659c640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f0908112300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f08fc004930 tx=0x7f08fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.170+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08fc0094c0 con 0x7f0908101c80 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.170+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090810c0a0 con 0x7f0908101c80 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.170+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08fc032e50 con 0x7f0908101c80 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.170+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08fc0433b0 con 0x7f0908101c80 2024-03-22T07:40:04.171 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.170+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090810c560 con 0x7f0908101c80 2024-03-22T07:40:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.171+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09080fca50 con 0x7f0908101c80 2024-03-22T07:40:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.171+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f08fc02f070 con 0x7f0908101c80 2024-03-22T07:40:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.171+0000 7f08ef7fe640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f08f006f500 0x7f08f00719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.172+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f08fc0ae840 con 0x7f0908101c80 2024-03-22T07:40:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.172+0000 7f0906d9d640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f08f006f500 0x7f08f00719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.172+0000 7f0906d9d640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f08f006f500 0x7f08f00719b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0900004eb0 tx=0x7f090000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:04.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.176+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f08fc078280 con 0x7f0908101c80 2024-03-22T07:40:04.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:03 smithi195 ceph-mon[82061]: pgmap v299: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:03 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2774629054' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-03-22T07:40:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:03 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3408512033' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-03-22T07:40:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:03 smithi195 ceph-mon[82061]: from='mgr.34102 172.21.15.134:0/4169474278' entity='mgr.smithi134.wtwqre' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-22T07:40:04.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:03 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/437617477' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-03-22T07:40:04.382 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.383+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f090804bcc0 con 0x7f0908101c80 2024-03-22T07:40:04.383 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.384+0000 7f08ef7fe640 1 -- 172.21.15.134:0/53893577 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) v1 ==== 107+0+4195 (secure 0 0 0) 0x7f08fc07b940 con 0x7f0908101c80 2024-03-22T07:40:04.383 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:04.383 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44309,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2563834080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2563834080},{"type":"v1","addr":"172.21.15.195:6825","nonce":2563834080}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:36:59.846123+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:04.384 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 30 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f08f006f500 msgr2=0x7f08f00719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f08f006f500 0x7f08f00719b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0900004eb0 tx=0x7f090000b040 comp rx=0 tx=0).stop 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 msgr2=0x7f0908112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f0908112300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f08fc004930 tx=0x7f08fc009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 shutdown_connections 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f08f006f500 0x7f08f00719b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0908101c80 0x7f0908112300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 --2- 172.21.15.134:0/53893577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09081012e0 0x7f0908111dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 >> 172.21.15.134:0/53893577 conn(0x7f09080f6e70 msgr2=0x7f09080f7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 shutdown_connections 2024-03-22T07:40:04.386 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.386+0000 7f090d025640 1 -- 172.21.15.134:0/53893577 wait complete. 2024-03-22T07:40:04.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 -- 172.21.15.134:0/1025865541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 msgr2=0x7f1c180647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/1025865541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c180647d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1c040048d0 tx=0x7f1c04009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 -- 172.21.15.134:0/1025865541 shutdown_connections 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/1025865541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c180647d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/1025865541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 0x7f1c18102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 -- 172.21.15.134:0/1025865541 >> 172.21.15.134:0/1025865541 conn(0x7f1c180710b0 msgr2=0x7f1c180714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 -- 172.21.15.134:0/1025865541 shutdown_connections 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.495+0000 7f1c1f19d640 1 -- 172.21.15.134:0/1025865541 wait complete. 2024-03-22T07:40:04.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1f19d640 1 Processor -- start 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1f19d640 1 -- start start 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1f19d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c18112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1f19d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 0x7f1c18113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1f19d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18113810 con 0x7f1c180643a0 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1f19d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1810ce60 con 0x7f1c18102240 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1cf39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c18112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1cf39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c18112cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50406/0 (socket says 172.21.15.134:50406) 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1cf39640 1 -- 172.21.15.134:0/3814294086 learned_addr learned my addr 172.21.15.134:0/3814294086 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c17fff640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 0x7f1c18113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1cf39640 1 -- 172.21.15.134:0/3814294086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 msgr2=0x7f1c18113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1cf39640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 0x7f1c18113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.496+0000 7f1c1cf39640 1 -- 172.21.15.134:0/3814294086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04005040 con 0x7f1c180643a0 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c17fff640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 0x7f1c18113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c1cf39640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c18112cd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00c790 tx=0x7f1c0c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c00a820 con 0x7f1c180643a0 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c0c00ae50 con 0x7f1c180643a0 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c0115e0 con 0x7f1c180643a0 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1810d140 con 0x7f1c180643a0 2024-03-22T07:40:04.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.497+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1810d660 con 0x7f1c180643a0 2024-03-22T07:40:04.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.498+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c180fd940 con 0x7f1c180643a0 2024-03-22T07:40:04.500 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.498+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f1c0c012400 con 0x7f1c180643a0 2024-03-22T07:40:04.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.499+0000 7f1c157fa640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c0806d2f0 0x7f1c0806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.499+0000 7f1c17fff640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c0806d2f0 0x7f1c0806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.499+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f1c0c08cb90 con 0x7f1c180643a0 2024-03-22T07:40:04.501 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.499+0000 7f1c17fff640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c0806d2f0 0x7f1c0806f7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c04009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:04.503 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.503+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c0c0565a0 con 0x7f1c180643a0 2024-03-22T07:40:04.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.712+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f1c1804bcc0 con 0x7f1c180643a0 2024-03-22T07:40:04.712 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.713+0000 7f1c157fa640 1 -- 172.21.15.134:0/3814294086 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) v1 ==== 107+0+4192 (secure 0 0 0) 0x7f1c0c059c60 con 0x7f1c180643a0 2024-03-22T07:40:04.713 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:04.713 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi134.dexlss","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6829/1238843159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1238843159},{"type":"v1","addr":"172.21.15.134:6829","nonce":1238843159}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":44309,"name":"cephfs.smithi195.dayrmo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6825/2563834080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2563834080},{"type":"v1","addr":"172.21.15.195:6825","nonce":2563834080}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-22T07:25:59.580047+0000","modified":"2024-03-22T07:37:00.599667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi134.yxdtlb","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.134:6827/4256617124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":4256617124},{"type":"v1","addr":"172.21.15.134:6827","nonce":4256617124}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-22T07:40:04.713 INFO:teuthology.orchestra.run.smithi134.stderr:dumped fsmap epoch 31 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c0806d2f0 msgr2=0x7f1c0806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c0806d2f0 0x7f1c0806f7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c04000c00 tx=0x7f1c04009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 msgr2=0x7f1c18112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c18112cd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00c790 tx=0x7f1c0c0043c0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 shutdown_connections 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f1c0806d2f0 0x7f1c0806f7a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1c18102240 0x7f1c18113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 --2- 172.21.15.134:0/3814294086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c180643a0 0x7f1c18112cd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 >> 172.21.15.134:0/3814294086 conn(0x7f1c180710b0 msgr2=0x7f1c180f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 shutdown_connections 2024-03-22T07:40:04.715 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.715+0000 7f1c1f19d640 1 -- 172.21.15.134:0/3814294086 wait complete. 2024-03-22T07:40:04.726 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-22T07:40:04.737 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-22T07:40:04.738 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:40:04.738 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-22T07:40:04.755 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-22T07:40:04.755 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-22T07:40:04.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-22T07:40:04.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 -- 172.21.15.134:0/2688562340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 msgr2=0x7f99b41026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 --2- 172.21.15.134:0/2688562340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41026c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f99a40048d0 tx=0x7f99a4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 -- 172.21.15.134:0/2688562340 shutdown_connections 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 --2- 172.21.15.134:0/2688562340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99b40fa940 0x7f99b40fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 --2- 172.21.15.134:0/2688562340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41026c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 -- 172.21.15.134:0/2688562340 >> 172.21.15.134:0/2688562340 conn(0x7f99b40708f0 msgr2=0x7f99b4070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 -- 172.21.15.134:0/2688562340 shutdown_connections 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 -- 172.21.15.134:0/2688562340 wait complete. 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 Processor -- start 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.950+0000 7f99bc39d640 1 -- start start 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99bc39d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99b40fa940 0x7f99b4112da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99bc39d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99bc39d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41138e0 con 0x7f99b41022f0 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99bc39d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b410cf30 con 0x7f99b40fa940 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50434/0 (socket says 172.21.15.134:50434) 2024-03-22T07:40:04.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 -- 172.21.15.134:0/4059423793 learned_addr learned my addr 172.21.15.134:0/4059423793 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 -- 172.21.15.134:0/4059423793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99b40fa940 msgr2=0x7f99b4112da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99b40fa940 0x7f99b4112da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 -- 172.21.15.134:0/4059423793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4005040 con 0x7f99b41022f0 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99b9938640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41132e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f99b0002a50 tx=0x7f99b0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b0007c30 con 0x7f99b41022f0 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b410d210 con 0x7f99b41022f0 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99b000f040 con 0x7f99b41022f0 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b000db50 con 0x7f99b41022f0 2024-03-22T07:40:04.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.951+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b410d730 con 0x7f99b41022f0 2024-03-22T07:40:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.952+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b4065310 con 0x7f99b41022f0 2024-03-22T07:40:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.953+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f99b001c400 con 0x7f99b41022f0 2024-03-22T07:40:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.953+0000 7f99aaffd640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f99a006d2f0 0x7f99a006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.953+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f99b008c2f0 con 0x7f99b41022f0 2024-03-22T07:40:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.953+0000 7f99ba139640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f99a006d2f0 0x7f99a006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:04.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.954+0000 7f99ba139640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f99a006d2f0 0x7f99a006f7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f99a40043d0 tx=0x7f99a4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:04.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:04.958+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f99b0055c80 con 0x7f99b41022f0 2024-03-22T07:40:05.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:04 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/74753774' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-03-22T07:40:05.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:04 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/53893577' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-03-22T07:40:05.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:04 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3814294086' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-03-22T07:40:05.132 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.132+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b4109460 con 0x7f99b41022f0 2024-03-22T07:40:05.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.134+0000 7f99aaffd640 1 -- 172.21.15.134:0/4059423793 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16971 (secure 0 0 0) 0x7f99b0059340 con 0x7f99b41022f0 2024-03-22T07:40:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:05.134 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":84,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:36:51.728399+0000","last_up_change":"2024-03-22T07:35:40.539227+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-22T07:25:58.466557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-22T07:25:58.807715+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6803","nonce":2109678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6805","nonce":2109678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6809","nonce":2109678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6807","nonce":2109678408}]},"public_addr":"172.21.15.134:6803/2109678408","cluster_addr":"172.21.15.134:6805/2109678408","heartbeat_back_addr":"172.21.15.134:6809/2109678408","heartbeat_front_addr":"172.21.15.134:6807/2109678408","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6811","nonce":3479896473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6813","nonce":3479896473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6817","nonce":3479896473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6815","nonce":3479896473}]},"public_addr":"172.21.15.134:6811/3479896473","cluster_addr":"172.21.15.134:6813/3479896473","heartbeat_back_addr":"172.21.15.134:6817/3479896473","heartbeat_front_addr":"172.21.15.134:6815/3479896473","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6819","nonce":2283292896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6821","nonce":2283292896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6825","nonce":2283292896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6823","nonce":2283292896}]},"public_addr":"172.21.15.134:6819/2283292896","cluster_addr":"172.21.15.134:6821/2283292896","heartbeat_back_addr":"172.21.15.134:6825/2283292896","heartbeat_front_addr":"172.21.15.134:6823/2283292896","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6801","nonce":3515380558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6803","nonce":3515380558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6807","nonce":3515380558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6805","nonce":3515380558}]},"public_addr":"172.21.15.195:6801/3515380558","cluster_addr":"172.21.15.195:6803/3515380558","heartbeat_back_addr":"172.21.15.195:6807/3515380558","heartbeat_front_addr":"172.21.15.195:6805/3515380558","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6809","nonce":848656048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6811","nonce":848656048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6815","nonce":848656048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6813","nonce":848656048}]},"public_addr":"172.21.15.195:6809/848656048","cluster_addr":"172.21.15.195:6811/848656048","heartbeat_back_addr":"172.21.15.195:6815/848656048","heartbeat_front_addr":"172.21.15.195:6813/848656048","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6817","nonce":381174269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6819","nonce":381174269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6823","nonce":381174269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6821","nonce":381174269}]},"public_addr":"172.21.15.195:6817/381174269","cluster_addr":"172.21.15.195:6819/381174269","heartbeat_back_addr":"172.21.15.195:6823/381174269","heartbeat_front_addr":"172.21.15.195:6821/381174269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6827/2251029735":"2024-03-23T07:36:51.728370+0000","172.21.15.195:6826/2251029735":"2024-03-23T07:36:51.728370+0000","172.21.15.195:6824/4087242582":"2024-03-23T07:36:26.407793+0000","172.21.15.134:6828/2483774939":"2024-03-23T07:36:04.486783+0000","172.21.15.134:0/169043287":"2024-03-23T07:28:33.656989+0000","172.21.15.134:6800/1730667826":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.195:0/3154577194":"2024-03-23T07:30:34.122632+0000","172.21.15.134:0/3237607204":"2024-03-23T07:28:33.656989+0000","172.21.15.134:6827/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/1532072225":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.195:0/1754301192":"2024-03-23T07:30:34.122632+0000","172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6826/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/3072794259":"2024-03-23T07:31:18.446749+0000","172.21.15.195:0/1159345258":"2024-03-23T07:30:34.122632+0000","172.21.15.195:0/827054233":"2024-03-23T07:30:34.122632+0000","172.21.15.195:6828/3830729441":"2024-03-23T07:30:34.122632+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/1309282181":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/1730667826":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/114139606":"2024-03-23T07:28:33.656989+0000","172.21.15.195:6825/4087242582":"2024-03-23T07:36:26.407793+0000","172.21.15.134:6801/2106493148":"2024-03-23T07:31:18.446749+0000","172.21.15.195:6829/3830729441":"2024-03-23T07:30:34.122632+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/2951685949":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2738175078":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/3567862151":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3419384748":"2024-03-23T07:31:18.446749+0000","172.21.15.134:6829/2483774939":"2024-03-23T07:36:04.486783+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/2106493148":"2024-03-23T07:31:18.446749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f99a006d2f0 msgr2=0x7f99a006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f99a006d2f0 0x7f99a006f7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f99a40043d0 tx=0x7f99a4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 msgr2=0x7f99b41132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41132e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f99b0002a50 tx=0x7f99b0004600 comp rx=0 tx=0).stop 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 shutdown_connections 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f99a006d2f0 0x7f99a006f7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99b41022f0 0x7f99b41132e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.136 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 --2- 172.21.15.134:0/4059423793 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99b40fa940 0x7f99b4112da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 >> 172.21.15.134:0/4059423793 conn(0x7f99b40708f0 msgr2=0x7f99b40f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:05.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 shutdown_connections 2024-03-22T07:40:05.137 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.136+0000 7f99bc39d640 1 -- 172.21.15.134:0/4059423793 wait complete. 2024-03-22T07:40:05.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-22T07:23:31.660944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-22T07:25:58.466557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-22T07:25:58.807715+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-22T07:40:05.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-22T07:40:05.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:04 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/74753774' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-03-22T07:40:05.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:04 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/53893577' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-03-22T07:40:05.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:04 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3814294086' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-03-22T07:40:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 -- 172.21.15.134:0/2235783762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 msgr2=0x7fdc500fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 --2- 172.21.15.134:0/2235783762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc500fb310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdc400048d0 tx=0x7fdc40009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.249 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 -- 172.21.15.134:0/2235783762 shutdown_connections 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 --2- 172.21.15.134:0/2235783762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc500fb310 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 --2- 172.21.15.134:0/2235783762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 0x7fdc501016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 -- 172.21.15.134:0/2235783762 >> 172.21.15.134:0/2235783762 conn(0x7fdc500f6eb0 msgr2=0x7fdc500f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 -- 172.21.15.134:0/2235783762 shutdown_connections 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.248+0000 7fdc5815d640 1 -- 172.21.15.134:0/2235783762 wait complete. 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 Processor -- start 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 -- start start 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 0x7fdc50112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc50113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50113a20 con 0x7fdc50101c80 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5010d070 con 0x7fdc501012e0 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc50113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc50113420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50452/0 (socket says 172.21.15.134:50452) 2024-03-22T07:40:05.250 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 -- 172.21.15.134:0/1487256290 learned_addr learned my addr 172.21.15.134:0/1487256290 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc55ef9640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 0x7fdc50112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 -- 172.21.15.134:0/1487256290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 msgr2=0x7fdc50112ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 0x7fdc50112ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 -- 172.21.15.134:0/1487256290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40005040 con 0x7fdc50101c80 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc55ef9640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 0x7fdc50112ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc556f8640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc50113420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdc40004930 tx=0x7fdc40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc400094c0 con 0x7fdc50101c80 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc40032e50 con 0x7fdc50101c80 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc400433b0 con 0x7fdc50101c80 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.249+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5010d2f0 con 0x7fdc50101c80 2024-03-22T07:40:05.251 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.250+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5010d7b0 con 0x7fdc50101c80 2024-03-22T07:40:05.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.251+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc500fca50 con 0x7fdc50101c80 2024-03-22T07:40:05.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.251+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fdc4002f070 con 0x7fdc50101c80 2024-03-22T07:40:05.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.251+0000 7fdc467fc640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc3c06d2f0 0x7fdc3c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.251+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fdc400ae8f0 con 0x7fdc50101c80 2024-03-22T07:40:05.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.251+0000 7fdc55ef9640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc3c06d2f0 0x7fdc3c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.252+0000 7fdc55ef9640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc3c06d2f0 0x7fdc3c06f7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc48007ee0 tx=0x7fdc4800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:05.255 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.256+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdc40078280 con 0x7fdc50101c80 2024-03-22T07:40:05.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.430+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc50108440 con 0x7fdc50101c80 2024-03-22T07:40:05.430 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.431+0000 7fdc467fc640 1 -- 172.21.15.134:0/1487256290 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc4007b940 con 0x7fdc50101c80 2024-03-22T07:40:05.431 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc3c06d2f0 msgr2=0x7fdc3c06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc3c06d2f0 0x7fdc3c06f7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc48007ee0 tx=0x7fdc4800b040 comp rx=0 tx=0).stop 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 msgr2=0x7fdc50113420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc50113420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdc40004930 tx=0x7fdc40009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 shutdown_connections 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fdc3c06d2f0 0x7fdc3c06f7a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc50101c80 0x7fdc50113420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 --2- 172.21.15.134:0/1487256290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdc501012e0 0x7fdc50112ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 >> 172.21.15.134:0/1487256290 conn(0x7fdc500f6eb0 msgr2=0x7fdc500f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:05.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 shutdown_connections 2024-03-22T07:40:05.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.433+0000 7fdc5815d640 1 -- 172.21.15.134:0/1487256290 wait complete. 2024-03-22T07:40:05.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-22T07:40:05.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 -- 172.21.15.134:0/2995311131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a80643a0 msgr2=0x7f34a80647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 --2- 172.21.15.134:0/2995311131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a80643a0 0x7f34a80647d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34980048d0 tx=0x7f3498009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 -- 172.21.15.134:0/2995311131 shutdown_connections 2024-03-22T07:40:05.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 --2- 172.21.15.134:0/2995311131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a80643a0 0x7f34a80647d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 --2- 172.21.15.134:0/2995311131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a8102240 0x7f34a8102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 -- 172.21.15.134:0/2995311131 >> 172.21.15.134:0/2995311131 conn(0x7f34a80710b0 msgr2=0x7f34a80714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:05.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 -- 172.21.15.134:0/2995311131 shutdown_connections 2024-03-22T07:40:05.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.547+0000 7f34aef5d640 1 -- 172.21.15.134:0/2995311131 wait complete. 2024-03-22T07:40:05.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34aef5d640 1 Processor -- start 2024-03-22T07:40:05.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34aef5d640 1 -- start start 2024-03-22T07:40:05.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34aef5d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a80643a0 0x7f34a8112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34aef5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 0x7f34a8113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34aef5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8113800 con 0x7f34a8102240 2024-03-22T07:40:05.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34aef5d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a810ce50 con 0x7f34a80643a0 2024-03-22T07:40:05.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34a7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 0x7f34a8113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34a7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 0x7f34a8113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50476/0 (socket says 172.21.15.134:50476) 2024-03-22T07:40:05.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34a7fff640 1 -- 172.21.15.134:0/314306808 learned_addr learned my addr 172.21.15.134:0/314306808 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:05.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.548+0000 7f34accf9640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a80643a0 0x7f34a8112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a7fff640 1 -- 172.21.15.134:0/314306808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a80643a0 msgr2=0x7f34a8112cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a7fff640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a80643a0 0x7f34a8112cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a7fff640 1 -- 172.21.15.134:0/314306808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498005040 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a7fff640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 0x7f34a8113200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3498004930 tx=0x7f3498009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34980094c0 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a810d0d0 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3498032e50 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34980433b0 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.549+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a810d590 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.550+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a80fd940 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.550+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f349802f070 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.551+0000 7f34a57fa640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f349006d2f0 0x7f349006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.551+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f34980ae830 con 0x7f34a8102240 2024-03-22T07:40:05.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.551+0000 7f34accf9640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f349006d2f0 0x7f349006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.551+0000 7f34accf9640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f349006d2f0 0x7f349006f7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f349c004eb0 tx=0x7f349c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:05.555 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.555+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f34980782e0 con 0x7f34a8102240 2024-03-22T07:40:05.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.730+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f34a8109300 con 0x7f34a8102240 2024-03-22T07:40:05.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.731+0000 7f34a57fa640 1 -- 172.21.15.134:0/314306808 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f349807b9a0 con 0x7f34a8102240 2024-03-22T07:40:05.731 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f349006d2f0 msgr2=0x7f349006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f349006d2f0 0x7f349006f7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f349c004eb0 tx=0x7f349c00b040 comp rx=0 tx=0).stop 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 msgr2=0x7f34a8113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 0x7f34a8113200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3498004930 tx=0x7f3498009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 shutdown_connections 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f349006d2f0 0x7f349006f7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8102240 0x7f34a8113200 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 --2- 172.21.15.134:0/314306808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34a80643a0 0x7f34a8112cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 >> 172.21.15.134:0/314306808 conn(0x7f34a80710b0 msgr2=0x7f34a80f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 shutdown_connections 2024-03-22T07:40:05.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.733+0000 7f34aef5d640 1 -- 172.21.15.134:0/314306808 wait complete. 2024-03-22T07:40:05.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-22T07:40:05.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- 172.21.15.134:0/3125494855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 msgr2=0x7f37d41016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 --2- 172.21.15.134:0/3125494855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d41016b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37c40048d0 tx=0x7f37c4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- 172.21.15.134:0/3125494855 shutdown_connections 2024-03-22T07:40:05.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 --2- 172.21.15.134:0/3125494855 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d4101c80 0x7f37d40fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 --2- 172.21.15.134:0/3125494855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d41016b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- 172.21.15.134:0/3125494855 >> 172.21.15.134:0/3125494855 conn(0x7f37d40f6e70 msgr2=0x7f37d40f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- 172.21.15.134:0/3125494855 shutdown_connections 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- 172.21.15.134:0/3125494855 wait complete. 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 Processor -- start 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- start start 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d4111de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d4101c80 0x7f37d4112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4112920 con 0x7f37d41012e0 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.846+0000 7f37da71d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d410bf70 con 0x7f37d4101c80 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d4111de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d4111de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50494/0 (socket says 172.21.15.134:50494) 2024-03-22T07:40:05.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 -- 172.21.15.134:0/3429775824 learned_addr learned my addr 172.21.15.134:0/3429775824 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d37fe640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d4101c80 0x7f37d4112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 -- 172.21.15.134:0/3429775824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d4101c80 msgr2=0x7f37d4112320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d4101c80 0x7f37d4112320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 -- 172.21.15.134:0/3429775824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4005040 con 0x7f37d41012e0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d3fff640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d4111de0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004930 tx=0x7f37c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c40094c0 con 0x7f37d41012e0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37c4032e50 con 0x7f37d41012e0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d410c1f0 con 0x7f37d41012e0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c40433b0 con 0x7f37d41012e0 2024-03-22T07:40:05.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.847+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d410c6b0 con 0x7f37d41012e0 2024-03-22T07:40:05.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.848+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d40fca50 con 0x7f37d41012e0 2024-03-22T07:40:05.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.848+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f37c402f070 con 0x7f37d41012e0 2024-03-22T07:40:05.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.849+0000 7f37d0ff9640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f37bc06d2f0 0x7f37bc06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:05.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.849+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f37c40ae870 con 0x7f37d41012e0 2024-03-22T07:40:05.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.849+0000 7f37d37fe640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f37bc06d2f0 0x7f37bc06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:05.850 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.849+0000 7f37d37fe640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f37bc06d2f0 0x7f37bc06f7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37d410d6a0 tx=0x7f37c8009ed0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:05.853 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:05.853+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f37c4078200 con 0x7f37d41012e0 2024-03-22T07:40:06.026 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.027+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f37d40638c0 con 0x7f37d41012e0 2024-03-22T07:40:06.027 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.027+0000 7f37d0ff9640 1 -- 172.21.15.134:0/3429775824 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f37c407b8c0 con 0x7f37d41012e0 2024-03-22T07:40:06.027 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:40:06.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f37bc06d2f0 msgr2=0x7f37bc06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f37bc06d2f0 0x7f37bc06f7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37d410d6a0 tx=0x7f37c8009ed0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 msgr2=0x7f37d4111de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.029 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d4111de0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004930 tx=0x7f37c4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 shutdown_connections 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f37bc06d2f0 0x7f37bc06f7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f37d4101c80 0x7f37d4112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 --2- 172.21.15.134:0/3429775824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37d41012e0 0x7f37d4111de0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.029+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 >> 172.21.15.134:0/3429775824 conn(0x7f37d40f6e70 msgr2=0x7f37d40f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.030+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 shutdown_connections 2024-03-22T07:40:06.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.030+0000 7f37da71d640 1 -- 172.21.15.134:0/3429775824 wait complete. 2024-03-22T07:40:06.039 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:05 smithi134 ceph-mon[93947]: pgmap v300: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:06.039 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:05 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/4059423793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:40:06.039 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:05 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1487256290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:40:06.039 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:05 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/314306808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:40:06.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-22T07:40:06.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.138+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/3107769186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb40fb110 msgr2=0x7fcbb40fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.140 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.138+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/3107769186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb40fb110 0x7fcbb40fb560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcba40048d0 tx=0x7fcba4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/3107769186 shutdown_connections 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/3107769186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb40fb110 0x7fcbb40fb560 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/3107769186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb4101140 0x7fcbb4101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/3107769186 >> 172.21.15.134:0/3107769186 conn(0x7fcbb40710b0 msgr2=0x7fcbb40714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/3107769186 shutdown_connections 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/3107769186 wait complete. 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 Processor -- start 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- start start 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb40fb110 0x7fcbb410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 0x7fcbb410e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4065330 con 0x7fcbb4101140 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.139+0000 7fcbb9b5d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb410e960 con 0x7fcbb40fb110 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 0x7fcbb410e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 0x7fcbb410e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50508/0 (socket says 172.21.15.134:50508) 2024-03-22T07:40:06.141 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 -- 172.21.15.134:0/12113940 learned_addr learned my addr 172.21.15.134:0/12113940 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb37fe640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb40fb110 0x7fcbb410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 -- 172.21.15.134:0/12113940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb40fb110 msgr2=0x7fcbb410deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb40fb110 0x7fcbb410deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 -- 172.21.15.134:0/12113940 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4005040 con 0x7fcbb4101140 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb37fe640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb40fb110 0x7fcbb410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb2ffd640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 0x7fcbb410e3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcba40041d0 tx=0x7fcba4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba40092e0 con 0x7fcbb4101140 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb410ebe0 con 0x7fcbb4101140 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcba4009440 con 0x7fcbb4101140 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba4043640 con 0x7fcbb4101140 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.140+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb4117170 con 0x7fcbb4101140 2024-03-22T07:40:06.142 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.141+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40fc800 con 0x7fcbb4101140 2024-03-22T07:40:06.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.142+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fcba403b9f0 con 0x7fcbb4101140 2024-03-22T07:40:06.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.142+0000 7fcbabfff640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcba006d2f0 0x7fcba006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.142+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fcba40af8b0 con 0x7fcbb4101140 2024-03-22T07:40:06.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.142+0000 7fcbb37fe640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcba006d2f0 0x7fcba006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.143 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.142+0000 7fcbb37fe640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcba006d2f0 0x7fcba006f7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0041d0 tx=0x7fcb9c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:06.146 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.146+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcba4079380 con 0x7fcbb4101140 2024-03-22T07:40:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:05 smithi195 ceph-mon[82061]: pgmap v300: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:05 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/4059423793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:40:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:05 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1487256290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:40:06.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:05 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/314306808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:40:06.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.329+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcbb4108280 con 0x7fcbb4101140 2024-03-22T07:40:06.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.330+0000 7fcbabfff640 1 -- 172.21.15.134:0/12113940 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2587 (secure 0 0 0) 0x7fcba407ca40 con 0x7fcbb4101140 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6827/2251029735 2024-03-23T07:36:51.728370+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6826/2251029735 2024-03-23T07:36:51.728370+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6824/4087242582 2024-03-23T07:36:26.407793+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6828/2483774939 2024-03-23T07:36:04.486783+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/169043287 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/1730667826 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4224877320 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/3154577194 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:06.330 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3237607204 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6827/189976344 2024-03-23T07:26:13.436011+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1532072225 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2810840668 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/1754301192 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/1050133516 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3465812625 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1093426489 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3908111038 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6826/189976344 2024-03-23T07:26:13.436011+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3072794259 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/1159345258 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/827054233 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6828/3830729441 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2227222575 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:06.331 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/255231307 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3465812625 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1309282181 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2592404388 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/55103982 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/1730667826 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3871716788 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/114139606 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6825/4087242582 2024-03-23T07:36:26.407793+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2106493148 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6829/3830729441 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/55103982 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2951685949 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2738175078 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3567862151 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1093426212 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3419384748 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6829/2483774939 2024-03-23T07:36:04.486783+0000 2024-03-22T07:40:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/1050133516 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:06.333 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2106493148 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:listed 43 entries 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcba006d2f0 msgr2=0x7fcba006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcba006d2f0 0x7fcba006f7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0041d0 tx=0x7fcb9c009040 comp rx=0 tx=0).stop 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 msgr2=0x7fcbb410e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 0x7fcbb410e3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcba40041d0 tx=0x7fcba4009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 shutdown_connections 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fcba006d2f0 0x7fcba006f7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb4101140 0x7fcbb410e3f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 --2- 172.21.15.134:0/12113940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbb40fb110 0x7fcbb410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 >> 172.21.15.134:0/12113940 conn(0x7fcbb40710b0 msgr2=0x7fcbb40f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:06.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 shutdown_connections 2024-03-22T07:40:06.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.332+0000 7fcbb9b5d640 1 -- 172.21.15.134:0/12113940 wait complete. 2024-03-22T07:40:06.343 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-22T07:40:06.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:06.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-22T07:40:06.371 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:40:06.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:06.371 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-22T07:40:06.446 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:40:06.446 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-22T07:40:06.466 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-22T07:40:06.466 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-22T07:40:06.525 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 -- 172.21.15.134:0/2999642611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 msgr2=0x7f48e00fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 --2- 172.21.15.134:0/2999642611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e00fb560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f48d00048d0 tx=0x7f48d0009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 -- 172.21.15.134:0/2999642611 shutdown_connections 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 --2- 172.21.15.134:0/2999642611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e00fb560 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 --2- 172.21.15.134:0/2999642611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48e0101140 0x7f48e0101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 -- 172.21.15.134:0/2999642611 >> 172.21.15.134:0/2999642611 conn(0x7f48e0071130 msgr2=0x7f48e0071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 -- 172.21.15.134:0/2999642611 shutdown_connections 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.623+0000 7f48e759d640 1 -- 172.21.15.134:0/2999642611 wait complete. 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e759d640 1 Processor -- start 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e759d640 1 -- start start 2024-03-22T07:40:06.625 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e759d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e0111be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e759d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48e0101140 0x7f48e0112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e759d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0112720 con 0x7f48e00fb110 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e759d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e010bd70 con 0x7f48e0101140 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e0111be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e0111be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50524/0 (socket says 172.21.15.134:50524) 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 -- 172.21.15.134:0/2621059400 learned_addr learned my addr 172.21.15.134:0/2621059400 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 -- 172.21.15.134:0/2621059400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48e0101140 msgr2=0x7f48e0112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48e0101140 0x7f48e0112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 -- 172.21.15.134:0/2621059400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0005040 con 0x7f48e00fb110 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.624+0000 7f48e5339640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e0111be0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00c790 tx=0x7f48dc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.625+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48dc00a820 con 0x7f48e00fb110 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.625+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48dc00ae50 con 0x7f48e00fb110 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.625+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e010c050 con 0x7f48e00fb110 2024-03-22T07:40:06.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.625+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48dc0115e0 con 0x7f48e00fb110 2024-03-22T07:40:06.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.625+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e010c570 con 0x7f48e00fb110 2024-03-22T07:40:06.627 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.626+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00fc800 con 0x7f48e00fb110 2024-03-22T07:40:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.626+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f48dc012400 con 0x7f48e00fb110 2024-03-22T07:40:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.627+0000 7f48d5ffb640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48cc06d2f0 0x7f48cc06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.627+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f48dc08caa0 con 0x7f48e00fb110 2024-03-22T07:40:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.627+0000 7f48e4b38640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48cc06d2f0 0x7f48cc06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.628 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.627+0000 7f48e4b38640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48cc06d2f0 0x7f48cc06f7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009990 tx=0x7f48d0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:06.630 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.631+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f48dc056570 con 0x7f48e00fb110 2024-03-22T07:40:06.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.806+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48e004bcc0 con 0x7f48e00fb110 2024-03-22T07:40:06.806 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.807+0000 7f48d5ffb640 1 -- 172.21.15.134:0/2621059400 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16971 (secure 0 0 0) 0x7f48dc059c30 con 0x7f48e00fb110 2024-03-22T07:40:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-22T07:40:06.807 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":84,"fsid":"5a05dc38-e81c-11ee-95cd-87774f69a715","created":"2024-03-22T07:19:13.322859+0000","modified":"2024-03-22T07:36:51.728399+0000","last_up_change":"2024-03-22T07:35:40.539227+0000","last_in_change":"2024-03-22T07:24:23.170778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-22T07:23:31.660944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-22T07:25:58.466557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-22T07:25:58.807715+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d94cb408-7d62-4f5e-bdff-6f6ae36ddeae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6803","nonce":2109678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6805","nonce":2109678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6809","nonce":2109678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2109678408},{"type":"v1","addr":"172.21.15.134:6807","nonce":2109678408}]},"public_addr":"172.21.15.134:6803/2109678408","cluster_addr":"172.21.15.134:6805/2109678408","heartbeat_back_addr":"172.21.15.134:6809/2109678408","heartbeat_front_addr":"172.21.15.134:6807/2109678408","state":["exists","up"]},{"osd":1,"uuid":"33128647-5aab-4f43-96e0-18c2a7d73b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6811","nonce":3479896473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6813","nonce":3479896473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6817","nonce":3479896473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3479896473},{"type":"v1","addr":"172.21.15.134:6815","nonce":3479896473}]},"public_addr":"172.21.15.134:6811/3479896473","cluster_addr":"172.21.15.134:6813/3479896473","heartbeat_back_addr":"172.21.15.134:6817/3479896473","heartbeat_front_addr":"172.21.15.134:6815/3479896473","state":["exists","up"]},{"osd":2,"uuid":"df340703-7826-485c-87d0-8bfb34d1b89c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6819","nonce":2283292896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6821","nonce":2283292896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6825","nonce":2283292896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2283292896},{"type":"v1","addr":"172.21.15.134:6823","nonce":2283292896}]},"public_addr":"172.21.15.134:6819/2283292896","cluster_addr":"172.21.15.134:6821/2283292896","heartbeat_back_addr":"172.21.15.134:6825/2283292896","heartbeat_front_addr":"172.21.15.134:6823/2283292896","state":["exists","up"]},{"osd":3,"uuid":"442688be-c820-422d-9d00-9a68a8b2c235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6801","nonce":3515380558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6803","nonce":3515380558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6807","nonce":3515380558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3515380558},{"type":"v1","addr":"172.21.15.195:6805","nonce":3515380558}]},"public_addr":"172.21.15.195:6801/3515380558","cluster_addr":"172.21.15.195:6803/3515380558","heartbeat_back_addr":"172.21.15.195:6807/3515380558","heartbeat_front_addr":"172.21.15.195:6805/3515380558","state":["exists","up"]},{"osd":4,"uuid":"a5f01cda-18b0-49b6-ab64-cc3c2b2b1154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6809","nonce":848656048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6811","nonce":848656048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6815","nonce":848656048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":848656048},{"type":"v1","addr":"172.21.15.195:6813","nonce":848656048}]},"public_addr":"172.21.15.195:6809/848656048","cluster_addr":"172.21.15.195:6811/848656048","heartbeat_back_addr":"172.21.15.195:6815/848656048","heartbeat_front_addr":"172.21.15.195:6813/848656048","state":["exists","up"]},{"osd":5,"uuid":"4539de25-fcab-4fd8-b9e2-e19009c1948c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6817","nonce":381174269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6819","nonce":381174269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6823","nonce":381174269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":381174269},{"type":"v1","addr":"172.21.15.195:6821","nonce":381174269}]},"public_addr":"172.21.15.195:6817/381174269","cluster_addr":"172.21.15.195:6819/381174269","heartbeat_back_addr":"172.21.15.195:6823/381174269","heartbeat_front_addr":"172.21.15.195:6821/381174269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:22:29.241704+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:00.043089+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:27.712571+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:23:50.486721+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:15.175667+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-22T07:24:39.745909+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6827/2251029735":"2024-03-23T07:36:51.728370+0000","172.21.15.195:6826/2251029735":"2024-03-23T07:36:51.728370+0000","172.21.15.195:6824/4087242582":"2024-03-23T07:36:26.407793+0000","172.21.15.134:6828/2483774939":"2024-03-23T07:36:04.486783+0000","172.21.15.134:0/169043287":"2024-03-23T07:28:33.656989+0000","172.21.15.134:6800/1730667826":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/4224877320":"2024-03-23T07:20:11.796905+0000","172.21.15.195:0/3154577194":"2024-03-23T07:30:34.122632+0000","172.21.15.134:0/3237607204":"2024-03-23T07:28:33.656989+0000","172.21.15.134:6827/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/1532072225":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2810840668":"2024-03-23T07:21:15.331687+0000","172.21.15.195:0/1754301192":"2024-03-23T07:30:34.122632+0000","172.21.15.134:6801/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/1093426489":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3908111038":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6826/189976344":"2024-03-23T07:26:13.436011+0000","172.21.15.134:0/3072794259":"2024-03-23T07:31:18.446749+0000","172.21.15.195:0/1159345258":"2024-03-23T07:30:34.122632+0000","172.21.15.195:0/827054233":"2024-03-23T07:30:34.122632+0000","172.21.15.195:6828/3830729441":"2024-03-23T07:30:34.122632+0000","172.21.15.134:0/2227222575":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/255231307":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/3465812625":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/1309282181":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2592404388":"2024-03-23T07:21:15.331687+0000","172.21.15.134:6800/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:6801/1730667826":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/3871716788":"2024-03-23T07:21:15.331687+0000","172.21.15.134:0/114139606":"2024-03-23T07:28:33.656989+0000","172.21.15.195:6825/4087242582":"2024-03-23T07:36:26.407793+0000","172.21.15.134:6801/2106493148":"2024-03-23T07:31:18.446749+0000","172.21.15.195:6829/3830729441":"2024-03-23T07:30:34.122632+0000","172.21.15.134:6801/55103982":"2024-03-23T07:20:11.796905+0000","172.21.15.134:0/2951685949":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/2738175078":"2024-03-23T07:28:33.656989+0000","172.21.15.134:0/3567862151":"2024-03-23T07:31:18.446749+0000","172.21.15.134:0/1093426212":"2024-03-23T07:19:40.482901+0000","172.21.15.134:0/3419384748":"2024-03-23T07:31:18.446749+0000","172.21.15.134:6829/2483774939":"2024-03-23T07:36:04.486783+0000","172.21.15.134:6800/1050133516":"2024-03-23T07:19:40.482901+0000","172.21.15.134:6800/2106493148":"2024-03-23T07:31:18.446749+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48cc06d2f0 msgr2=0x7f48cc06f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48cc06d2f0 0x7f48cc06f7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009990 tx=0x7f48d0009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 msgr2=0x7f48e0111be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e0111be0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00c790 tx=0x7f48dc0043c0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 shutdown_connections 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f48cc06d2f0 0x7f48cc06f7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.809 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48e0101140 0x7f48e0112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 --2- 172.21.15.134:0/2621059400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48e00fb110 0x7f48e0111be0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 >> 172.21.15.134:0/2621059400 conn(0x7f48e0071130 msgr2=0x7f48e00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:06.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 shutdown_connections 2024-03-22T07:40:06.810 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.809+0000 7f48e759d640 1 -- 172.21.15.134:0/2621059400 wait complete. 2024-03-22T07:40:06.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-22T07:23:31.660944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-22T07:25:58.466557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-22T07:25:58.807715+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-22T07:40:06.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 -- 172.21.15.134:0/3511514314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a01021d0 msgr2=0x7f45a01025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/3511514314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a01021d0 0x7f45a01025a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f45900048d0 tx=0x7f4590009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 -- 172.21.15.134:0/3511514314 shutdown_connections 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/3511514314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45a0102b70 0x7f45a00fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/3511514314 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a01021d0 0x7f45a01025a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 -- 172.21.15.134:0/3511514314 >> 172.21.15.134:0/3511514314 conn(0x7f45a00f7dc0 msgr2=0x7f45a00fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 -- 172.21.15.134:0/3511514314 shutdown_connections 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.921+0000 7f45a6c6e640 1 -- 172.21.15.134:0/3511514314 wait complete. 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f45a6c6e640 1 Processor -- start 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f45a6c6e640 1 -- start start 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f45a6c6e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45a01021d0 0x7f45a0112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.923 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f45a6c6e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 0x7f45a0113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f45a6c6e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0113850 con 0x7f45a0102b70 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f45a6c6e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a010cea0 con 0x7f45a01021d0 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f459ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 0x7f45a0113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f459ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 0x7f45a0113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50530/0 (socket says 172.21.15.134:50530) 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.922+0000 7f459ffff640 1 -- 172.21.15.134:0/2883273670 learned_addr learned my addr 172.21.15.134:0/2883273670 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f45a4a0a640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45a01021d0 0x7f45a0112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459ffff640 1 -- 172.21.15.134:0/2883273670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45a01021d0 msgr2=0x7f45a0112d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459ffff640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45a01021d0 0x7f45a0112d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459ffff640 1 -- 172.21.15.134:0/2883273670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590005040 con 0x7f45a0102b70 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459ffff640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 0x7f45a0113250 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4594002a50 tx=0x7f4594004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4594007c30 con 0x7f45a0102b70 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a010d180 con 0x7f45a0102b70 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f459400f040 con 0x7f45a0102b70 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459400db50 con 0x7f45a0102b70 2024-03-22T07:40:06.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.923+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a010d6a0 con 0x7f45a0102b70 2024-03-22T07:40:06.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.924+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a00fd940 con 0x7f45a0102b70 2024-03-22T07:40:06.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.924+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f459401c400 con 0x7f45a0102b70 2024-03-22T07:40:06.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.925+0000 7f459d7fa640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f458806d2f0 0x7f458806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:06.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.925+0000 7f45a4a0a640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f458806d2f0 0x7f458806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:06.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.925+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f459408c2f0 con 0x7f45a0102b70 2024-03-22T07:40:06.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.925+0000 7f45a4a0a640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f458806d2f0 0x7f458806f7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4590003080 tx=0x7f4590009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:06.929 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:06.930+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4594055c80 con 0x7f45a0102b70 2024-03-22T07:40:07.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.101+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45a0109330 con 0x7f45a0102b70 2024-03-22T07:40:07.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.102+0000 7f459d7fa640 1 -- 172.21.15.134:0/2883273670 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4594059340 con 0x7f45a0102b70 2024-03-22T07:40:07.174 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 1 2024-03-22T07:40:07.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f458806d2f0 msgr2=0x7f458806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f458806d2f0 0x7f458806f7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4590003080 tx=0x7f4590009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 msgr2=0x7f45a0113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 0x7f45a0113250 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4594002a50 tx=0x7f4594004600 comp rx=0 tx=0).stop 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 shutdown_connections 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f458806d2f0 0x7f458806f7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45a0102b70 0x7f45a0113250 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 --2- 172.21.15.134:0/2883273670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45a01021d0 0x7f45a0112d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 >> 172.21.15.134:0/2883273670 conn(0x7f45a00f7dc0 msgr2=0x7f45a00f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 shutdown_connections 2024-03-22T07:40:07.175 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.104+0000 7f45a6c6e640 1 -- 172.21.15.134:0/2883273670 wait complete. 2024-03-22T07:40:07.175 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:06 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/3429775824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:40:07.175 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:06 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/12113940' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-22T07:40:07.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-22T07:40:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:06 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/3429775824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:40:07.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:06 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/12113940' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-22T07:40:07.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 -- 172.21.15.134:0/3207268255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 msgr2=0x7f08900faac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 --2- 172.21.15.134:0/3207268255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f08900faac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f08840048d0 tx=0x7f0884009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 -- 172.21.15.134:0/3207268255 shutdown_connections 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 --2- 172.21.15.134:0/3207268255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f08900faac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 --2- 172.21.15.134:0/3207268255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 0x7f0890102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 -- 172.21.15.134:0/3207268255 >> 172.21.15.134:0/3207268255 conn(0x7f08900714a0 msgr2=0x7f08900f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 -- 172.21.15.134:0/3207268255 shutdown_connections 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.276+0000 7f089666e640 1 -- 172.21.15.134:0/3207268255 wait complete. 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f089666e640 1 Processor -- start 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f089666e640 1 -- start start 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f089666e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f0890112d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f089666e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 0x7f0890113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f089666e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890113880 con 0x7f08900fa650 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f089666e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089010ced0 con 0x7f0890102260 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f088ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f0890112d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f088ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f0890112d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50544/0 (socket says 172.21.15.134:50544) 2024-03-22T07:40:07.279 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f088ffff640 1 -- 172.21.15.134:0/272146373 learned_addr learned my addr 172.21.15.134:0/272146373 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.277+0000 7f088f7fe640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 0x7f0890113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088ffff640 1 -- 172.21.15.134:0/272146373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 msgr2=0x7f0890113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088ffff640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 0x7f0890113280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088ffff640 1 -- 172.21.15.134:0/272146373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884005040 con 0x7f08900fa650 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088f7fe640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 0x7f0890113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088ffff640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f0890112d40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0880002840 tx=0x7f0880004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0880007c30 con 0x7f08900fa650 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089010d1b0 con 0x7f08900fa650 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f088000f040 con 0x7f08900fa650 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0880009590 con 0x7f08900fa650 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.278+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089010d6a0 con 0x7f08900fa650 2024-03-22T07:40:07.280 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.279+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08900fd970 con 0x7f08900fa650 2024-03-22T07:40:07.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.279+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f088000d6b0 con 0x7f08900fa650 2024-03-22T07:40:07.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.280+0000 7f088cff9640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f087806d2f0 0x7f087806f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.280+0000 7f088f7fe640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f087806d2f0 0x7f087806f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.280+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f088008c920 con 0x7f08900fa650 2024-03-22T07:40:07.281 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.280+0000 7f088f7fe640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f087806d2f0 0x7f087806f7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f08900f9870 tx=0x7f0884009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:07.284 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.284+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f08800562b0 con 0x7f08900fa650 2024-03-22T07:40:07.458 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.459+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f08900ff4a0 con 0x7f08900fa650 2024-03-22T07:40:07.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.459+0000 7f088cff9640 1 -- 172.21.15.134:0/272146373 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0880059970 con 0x7f08900fa650 2024-03-22T07:40:07.459 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:40:07.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f087806d2f0 msgr2=0x7f087806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f087806d2f0 0x7f087806f7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f08900f9870 tx=0x7f0884009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.461 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 msgr2=0x7f0890112d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f0890112d40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0880002840 tx=0x7f0880004570 comp rx=0 tx=0).stop 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 shutdown_connections 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f087806d2f0 0x7f087806f7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0890102260 0x7f0890113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 --2- 172.21.15.134:0/272146373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08900fa650 0x7f0890112d40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.461+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 >> 172.21.15.134:0/272146373 conn(0x7f08900714a0 msgr2=0x7f0890072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.462+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 shutdown_connections 2024-03-22T07:40:07.462 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.462+0000 7f089666e640 1 -- 172.21.15.134:0/272146373 wait complete. 2024-03-22T07:40:07.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-22T07:40:07.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.572+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1159655699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102250 msgr2=0x7fd1b8102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.572+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1159655699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102250 0x7fd1b8102620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009c50 tx=0x7fd1a8004d10 comp rx=0 tx=0).stop 2024-03-22T07:40:07.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1159655699 shutdown_connections 2024-03-22T07:40:07.575 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1159655699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1b8102bf0 0x7fd1b80fc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1159655699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102250 0x7fd1b8102620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1159655699 >> 172.21.15.134:0/1159655699 conn(0x7fd1b80f7e60 msgr2=0x7fd1b80fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1159655699 shutdown_connections 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1159655699 wait complete. 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 Processor -- start 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- start start 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1b8102250 0x7fd1b8112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 0x7fd1b81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81137f0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1bcb9d640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b810ce40 con 0x7fd1b8102250 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1b5d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 0x7fd1b81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1b5d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 0x7fd1b81131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50560/0 (socket says 172.21.15.134:50560) 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.573+0000 7fd1b5d9b640 1 -- 172.21.15.134:0/1073155477 learned_addr learned my addr 172.21.15.134:0/1073155477 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1b659c640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1b8102250 0x7fd1b8112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1b5d9b640 1 -- 172.21.15.134:0/1073155477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1b8102250 msgr2=0x7fd1b8112cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1b5d9b640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1b8102250 0x7fd1b8112cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1b5d9b640 1 -- 172.21.15.134:0/1073155477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80098b0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1b5d9b640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 0x7fd1b81131f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00eb70 tx=0x7fd1ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ac007c30 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1ac00f040 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b810d0c0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ac0095b0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.574+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b810d660 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.575+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b80fd9c0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.575+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7fd1ac009730 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.576+0000 7fd1a6ffd640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd1a006d300 0x7fd1a006f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.576+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fd1ac08c7a0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.577 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.576+0000 7fd1b659c640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd1a006d300 0x7fd1a006f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.578 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.576+0000 7fd1b659c640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd1a006d300 0x7fd1a006f7b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8005010 tx=0x7fd1a802e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:07.580 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.580+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd1ac056130 con 0x7fd1b8102bf0 2024-03-22T07:40:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.756+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd1b810e320 con 0x7fd1b8102bf0 2024-03-22T07:40:07.756 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.757+0000 7fd1a6ffd640 1 -- 172.21.15.134:0/1073155477 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd1ac0597f0 con 0x7fd1b8102bf0 2024-03-22T07:40:07.756 INFO:teuthology.orchestra.run.smithi134.stdout:pg_num: 32 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd1a006d300 msgr2=0x7fd1a006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd1a006d300 0x7fd1a006f7b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8005010 tx=0x7fd1a802e040 comp rx=0 tx=0).stop 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 msgr2=0x7fd1b81131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 0x7fd1b81131f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00eb70 tx=0x7fd1ac00b040 comp rx=0 tx=0).stop 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 shutdown_connections 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7fd1a006d300 0x7fd1a006f7b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1b8102bf0 0x7fd1b81131f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 --2- 172.21.15.134:0/1073155477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1b8102250 0x7fd1b8112cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 >> 172.21.15.134:0/1073155477 conn(0x7fd1b80f7e60 msgr2=0x7fd1b80f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 shutdown_connections 2024-03-22T07:40:07.759 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.759+0000 7fd1bcb9d640 1 -- 172.21.15.134:0/1073155477 wait complete. 2024-03-22T07:40:07.770 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-22T07:40:07.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.868+0000 7f7d5f86e640 1 -- 172.21.15.134:0/3841476297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d58101c80 msgr2=0x7f7d580fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.868+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/3841476297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d58101c80 0x7f7d580fb310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7d540048d0 tx=0x7f7d54009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- 172.21.15.134:0/3841476297 shutdown_connections 2024-03-22T07:40:07.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/3841476297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d58101c80 0x7f7d580fb310 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/3841476297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d581012e0 0x7f7d581016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- 172.21.15.134:0/3841476297 >> 172.21.15.134:0/3841476297 conn(0x7f7d580f6eb0 msgr2=0x7f7d580f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- 172.21.15.134:0/3841476297 shutdown_connections 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- 172.21.15.134:0/3841476297 wait complete. 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 Processor -- start 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- start start 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 0x7f7d58111e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d58101c80 0x7f7d581123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d581129a0 con 0x7f7d581012e0 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5f86e640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5810bff0 con 0x7f7d58101c80 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5d60a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 0x7f7d58111e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5d60a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 0x7f7d58111e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:50572/0 (socket says 172.21.15.134:50572) 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.869+0000 7f7d5d60a640 1 -- 172.21.15.134:0/2312511035 learned_addr learned my addr 172.21.15.134:0/2312511035 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d5d60a640 1 -- 172.21.15.134:0/2312511035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d58101c80 msgr2=0x7f7d581123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:07.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d5d60a640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d58101c80 0x7f7d581123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d5d60a640 1 -- 172.21.15.134:0/2312511035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54005040 con 0x7f7d581012e0 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d5d60a640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 0x7f7d58111e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800eb70 tx=0x7f7d4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d48007c30 con 0x7f7d581012e0 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d4800f040 con 0x7f7d581012e0 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5810c270 con 0x7f7d581012e0 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d480095b0 con 0x7f7d581012e0 2024-03-22T07:40:07.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.870+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5810c790 con 0x7f7d581012e0 2024-03-22T07:40:07.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.871+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d580fca50 con 0x7f7d581012e0 2024-03-22T07:40:07.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.872+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 91169+0+0 (secure 0 0 0) 0x7f7d48009710 con 0x7f7d581012e0 2024-03-22T07:40:07.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.872+0000 7f7d4dffb640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7d4406d2f0 0x7f7d4406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-22T07:40:07.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.872+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f7d4808c6d0 con 0x7f7d581012e0 2024-03-22T07:40:07.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.872+0000 7f7d5ce09640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7d4406d2f0 0x7f7d4406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-22T07:40:07.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.872+0000 7f7d5ce09640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7d4406d2f0 0x7f7d4406f7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d540043d0 tx=0x7f7d54009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-22T07:40:07.876 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:07.877+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7d480560e0 con 0x7f7d581012e0 2024-03-22T07:40:08.044 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:07 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2621059400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:40:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:07 smithi134 ceph-mon[93947]: pgmap v301: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:07 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2883273670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:40:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:07 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/272146373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:40:08.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:07 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/1073155477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:40:08.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.062+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7d5810d4d0 con 0x7f7d581012e0 2024-03-22T07:40:08.061 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.062+0000 7f7d4dffb640 1 -- 172.21.15.134:0/2312511035 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v84) v1 ==== 81+0+2587 (secure 0 0 0) 0x7f7d480597a0 con 0x7f7d581012e0 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6827/2251029735 2024-03-23T07:36:51.728370+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6826/2251029735 2024-03-23T07:36:51.728370+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6824/4087242582 2024-03-23T07:36:26.407793+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6828/2483774939 2024-03-23T07:36:04.486783+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/169043287 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/1730667826 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/4224877320 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/3154577194 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3237607204 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6827/189976344 2024-03-23T07:26:13.436011+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1532072225 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2810840668 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/1754301192 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/1050133516 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/3465812625 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1093426489 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3908111038 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6826/189976344 2024-03-23T07:26:13.436011+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3072794259 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/1159345258 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:0/827054233 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6828/3830729441 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2227222575 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/255231307 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/3465812625 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1309282181 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2592404388 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:08.063 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/55103982 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/1730667826 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3871716788 2024-03-23T07:21:15.331687+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/114139606 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6825/4087242582 2024-03-23T07:36:26.407793+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/2106493148 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.195:6829/3830729441 2024-03-23T07:30:34.122632+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6801/55103982 2024-03-23T07:20:11.796905+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2951685949 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/2738175078 2024-03-23T07:28:33.656989+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3567862151 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/1093426212 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:0/3419384748 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6829/2483774939 2024-03-23T07:36:04.486783+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/1050133516 2024-03-23T07:19:40.482901+0000 2024-03-22T07:40:08.064 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134:6800/2106493148 2024-03-23T07:31:18.446749+0000 2024-03-22T07:40:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:listed 43 entries 2024-03-22T07:40:08.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7d4406d2f0 msgr2=0x7f7d4406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7d4406d2f0 0x7f7d4406f7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d540043d0 tx=0x7f7d54009da0 comp rx=0 tx=0).stop 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 msgr2=0x7f7d58111e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 0x7f7d58111e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800eb70 tx=0x7f7d4800b040 comp rx=0 tx=0).stop 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 shutdown_connections 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:6800/326636880,v1:172.21.15.134:6801/326636880] conn(0x7f7d4406d2f0 0x7f7d4406f7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d58101c80 0x7f7d581123a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 --2- 172.21.15.134:0/2312511035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d581012e0 0x7f7d58111e60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.064+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 >> 172.21.15.134:0/2312511035 conn(0x7f7d580f6eb0 msgr2=0x7f7d580f7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.065+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 shutdown_connections 2024-03-22T07:40:08.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-22T07:40:08.065+0000 7f7d5f86e640 1 -- 172.21.15.134:0/2312511035 wait complete. 2024-03-22T07:40:08.075 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-22T07:40:08.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.075 DEBUG:teuthology.orchestra.run.smithi195:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-22T07:40:08.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:07 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2621059400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-22T07:40:08.105 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:07 smithi195 ceph-mon[82061]: pgmap v301: 65 pgs: 65 active+clean; 197 MiB data, 823 MiB used, 536 GiB / 536 GiB avail 2024-03-22T07:40:08.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:07 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2883273670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-22T07:40:08.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:07 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/272146373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-22T07:40:08.106 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:07 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/1073155477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-22T07:40:08.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-03-22T07:40:08.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.113 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-22T07:40:08.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.192 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-03-22T07:40:08.207 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-22T07:40:08.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-22T07:40:08.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-03-22T07:40:08.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.374 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-03-22T07:40:08.392 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-22T07:40:08.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.393 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-22T07:40:08.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-22T07:40:08.465 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-03-22T07:40:08.566 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-22T07:40:08.577 INFO:tasks.cephadm:Teardown begin 2024-03-22T07:40:08.578 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:40:08.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:40:08.636 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-22T07:40:08.636 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-22T07:40:08.662 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-22T07:40:08.692 INFO:tasks.cephadm:Stopping all daemons... 2024-03-22T07:40:08.692 INFO:tasks.cephadm.mon.smithi134:Stopping mon.smithi134... 2024-03-22T07:40:08.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134 2024-03-22T07:40:09.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:08 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:09.007 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:08 smithi134 ceph-mon[93947]: from='client.? 172.21.15.134:0/2312511035' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-22T07:40:09.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:08 smithi195 ceph-mon[82061]: from='client.? 172.21.15.134:0/2312511035' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-22T07:40:09.271 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:09 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[93942]: 2024-03-22T07:40:09.007+0000 7f27bcc39700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:09.271 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:09 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134[93942]: 2024-03-22T07:40:09.007+0000 7f27bcc39700 -1 mon.smithi134@0(leader) e3 *** Got Signal Terminated *** 2024-03-22T07:40:09.544 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:09 smithi134 podman[147513]: 2024-03-22 07:40:09.272133034 +0000 UTC m=+0.380275201 container died 6529604eecda8409350b4af6edbc33e8ff97090a3d7ec5b9b29ef67f5f11cb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-22T07:40:09.895 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:09 smithi134 podman[147513]: 2024-03-22 07:40:09.670528796 +0000 UTC m=+0.778670963 container cleanup 6529604eecda8409350b4af6edbc33e8ff97090a3d7ec5b9b29ef67f5f11cb36 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-22T07:40:09.896 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 22 07:40:09 smithi134 bash[147513]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi134 2024-03-22T07:40:10.033 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi134.service' 2024-03-22T07:40:10.085 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:10.086 INFO:tasks.cephadm.mon.smithi134:Stopped mon.smithi134 2024-03-22T07:40:10.086 INFO:tasks.cephadm.mon.smithi195:Stopping mon.smithi195... 2024-03-22T07:40:10.086 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195 2024-03-22T07:40:10.382 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:10 smithi195 systemd[1]: Stopping Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:10.704 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:10 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195[82057]: 2024-03-22T07:40:10.381+0000 7ff43d13c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi195 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:10.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:10 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195[82057]: 2024-03-22T07:40:10.381+0000 7ff43d13c700 -1 mon.smithi195@1(peon) e3 *** Got Signal Terminated *** 2024-03-22T07:40:10.705 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:10 smithi195 podman[118547]: 2024-03-22 07:40:10.576247617 +0000 UTC m=+0.291952214 container died 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307) 2024-03-22T07:40:11.204 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:11 smithi195 podman[118547]: 2024-03-22 07:40:11.007217018 +0000 UTC m=+0.722921680 container cleanup 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-22T07:40:11.205 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:11 smithi195 bash[118547]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195 2024-03-22T07:40:11.468 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195.service' 2024-03-22T07:40:11.492 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:11 smithi195 podman[118559]: 2024-03-22 07:40:11.230697373 +0000 UTC m=+0.652355699 container remove 0921563bc4dc77d5a9708c9bae976cb7475b21b6e48133d76b9bd9782408e313 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-mon-smithi195, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307) 2024-03-22T07:40:11.492 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:11 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195.service: Deactivated successfully. 2024-03-22T07:40:11.492 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:11 smithi195 systemd[1]: Stopped Ceph mon.smithi195 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:40:11.492 INFO:journalctl@ceph.mon.smithi195.smithi195.stdout:Mar 22 07:40:11 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@mon.smithi195.service: Consumed 4.600s CPU time. 2024-03-22T07:40:11.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:11.511 INFO:tasks.cephadm.mon.smithi195:Stopped mon.smithi195 2024-03-22T07:40:11.511 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-22T07:40:11.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.0 2024-03-22T07:40:11.795 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:11 smithi134 systemd[1]: Stopping Ceph osd.0 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:12.294 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:11 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:40:11.840+0000 7fc453550700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:12.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:11 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:40:11.840+0000 7fc453550700 -1 osd.0 84 *** Got signal Terminated *** 2024-03-22T07:40:12.295 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:11 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0[102660]: 2024-03-22T07:40:11.840+0000 7fc453550700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:40:17.509 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:17 smithi134 podman[147649]: 2024-03-22 07:40:17.24524716 +0000 UTC m=+5.538105496 container died 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True) 2024-03-22T07:40:17.795 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:17 smithi134 podman[147649]: 2024-03-22 07:40:17.617261339 +0000 UTC m=+5.910119711 container cleanup 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_BRANCH=HEAD) 2024-03-22T07:40:17.795 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:17 smithi134 bash[147649]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0 2024-03-22T07:40:18.278 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:17 smithi134 podman[147667]: 2024-03-22 07:40:17.941820098 +0000 UTC m=+0.699626858 container remove 94026c2c00cb362e2d50c69cefbcc59f602a5645dcdd54768f757316b1c01cef (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:40:18.544 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:18 smithi134 podman[147760]: 2024-03-22 07:40:18.182101175 +0000 UTC m=+0.017782492 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:40:18.545 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:18 smithi134 podman[147760]: 2024-03-22 07:40:18.286551916 +0000 UTC m=+0.122233244 container create 0029bdc6c93f71e6a4cdddb25ec882386a42206967209616b25479d6c32d7c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-22T07:40:18.842 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:18 smithi134 podman[147760]: 2024-03-22 07:40:18.547311705 +0000 UTC m=+0.382993010 container init 0029bdc6c93f71e6a4cdddb25ec882386a42206967209616b25479d6c32d7c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-db0330b) 2024-03-22T07:40:18.842 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:18 smithi134 podman[147760]: 2024-03-22 07:40:18.552916981 +0000 UTC m=+0.388598268 container start 0029bdc6c93f71e6a4cdddb25ec882386a42206967209616b25479d6c32d7c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-22T07:40:18.842 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:18 smithi134 podman[147760]: 2024-03-22 07:40:18.656275649 +0000 UTC m=+0.491956952 container attach 0029bdc6c93f71e6a4cdddb25ec882386a42206967209616b25479d6c32d7c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307) 2024-03-22T07:40:19.133 INFO:journalctl@ceph.osd.0.smithi134.stdout:Mar 22 07:40:18 smithi134 podman[147760]: 2024-03-22 07:40:18.843335652 +0000 UTC m=+0.679016930 container died 0029bdc6c93f71e6a4cdddb25ec882386a42206967209616b25479d6c32d7c70 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:40:19.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.0.service' 2024-03-22T07:40:19.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:19.485 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-22T07:40:19.486 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-22T07:40:19.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.1 2024-03-22T07:40:19.737 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:19 smithi134 systemd[1]: Stopping Ceph osd.1 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:20.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:19 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:40:19.878+0000 7ffb60b40700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:20.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:19 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:40:19.878+0000 7ffb60b40700 -1 osd.1 84 *** Got signal Terminated *** 2024-03-22T07:40:20.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:19 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1[108046]: 2024-03-22T07:40:19.878+0000 7ffb60b40700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:40:25.689 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:25 smithi134 podman[147866]: 2024-03-22 07:40:25.413639373 +0000 UTC m=+5.656678553 container died 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-22T07:40:26.044 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:25 smithi134 podman[147866]: 2024-03-22 07:40:25.805359023 +0000 UTC m=+6.048398194 container cleanup 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-db0330b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-22T07:40:26.044 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:25 smithi134 bash[147866]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1 2024-03-22T07:40:26.376 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147894]: 2024-03-22 07:40:26.048389376 +0000 UTC m=+0.632703529 container remove 3d51608e5d6d39833d6defa0470c8645e602b1533df42aef9424eef8c522d2aa (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-22T07:40:26.676 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147985]: 2024-03-22 07:40:26.280507365 +0000 UTC m=+0.018500254 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:40:26.676 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147985]: 2024-03-22 07:40:26.382608375 +0000 UTC m=+0.120601259 container create f50a883a4d1a9c21c14229042bc536be138fdc0c7f2c75a8cf10486bd2dcf0fd (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-22T07:40:26.676 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147985]: 2024-03-22 07:40:26.576828818 +0000 UTC m=+0.314821702 container init f50a883a4d1a9c21c14229042bc536be138fdc0c7f2c75a8cf10486bd2dcf0fd (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS) 2024-03-22T07:40:26.676 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147985]: 2024-03-22 07:40:26.580913147 +0000 UTC m=+0.318906033 container start f50a883a4d1a9c21c14229042bc536be138fdc0c7f2c75a8cf10486bd2dcf0fd (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-22T07:40:26.676 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147985]: 2024-03-22 07:40:26.67693605 +0000 UTC m=+0.414928969 container attach f50a883a4d1a9c21c14229042bc536be138fdc0c7f2c75a8cf10486bd2dcf0fd (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, org.label-schema.build-date=20240307) 2024-03-22T07:40:27.045 INFO:journalctl@ceph.osd.1.smithi134.stdout:Mar 22 07:40:26 smithi134 podman[147985]: 2024-03-22 07:40:26.870302518 +0000 UTC m=+0.608295403 container died f50a883a4d1a9c21c14229042bc536be138fdc0c7f2c75a8cf10486bd2dcf0fd (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-22T07:40:27.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.1.service' 2024-03-22T07:40:27.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:27.552 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-22T07:40:27.552 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-22T07:40:27.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.2 2024-03-22T07:40:27.794 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:27 smithi134 systemd[1]: Stopping Ceph osd.2 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:28.294 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:27 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:40:27.867+0000 7ff5acfea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:28.294 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:27 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:40:27.867+0000 7ff5acfea700 -1 osd.2 84 *** Got signal Terminated *** 2024-03-22T07:40:28.295 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:27 smithi134 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2[113433]: 2024-03-22T07:40:27.867+0000 7ff5acfea700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:40:33.708 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:33 smithi134 podman[148090]: 2024-03-22 07:40:33.38449581 +0000 UTC m=+5.642646325 container died 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:40:33.708 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:33 smithi134 podman[148090]: 2024-03-22 07:40:33.708884302 +0000 UTC m=+5.967034817 container cleanup 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-22T07:40:33.993 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:33 smithi134 bash[148090]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2 2024-03-22T07:40:34.294 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:33 smithi134 podman[148107]: 2024-03-22 07:40:33.993679704 +0000 UTC m=+0.611558621 container remove 505f8d57592d73958c2bea281d36364b46addcb03b4b3a76c40a77a8b36f2133 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-db0330b, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-22T07:40:34.663 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:34 smithi134 podman[148199]: 2024-03-22 07:40:34.229954823 +0000 UTC m=+0.018147304 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:40:34.663 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:34 smithi134 podman[148199]: 2024-03-22 07:40:34.344644862 +0000 UTC m=+0.132837343 container create d53df96cc22f07b01711c34fbe3865e6493d32645f1b7f2fca2e739172a10f07 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:40:34.663 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:34 smithi134 podman[148199]: 2024-03-22 07:40:34.561548713 +0000 UTC m=+0.349741194 container init d53df96cc22f07b01711c34fbe3865e6493d32645f1b7f2fca2e739172a10f07 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-22T07:40:34.663 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:34 smithi134 podman[148199]: 2024-03-22 07:40:34.564986939 +0000 UTC m=+0.353179429 container start d53df96cc22f07b01711c34fbe3865e6493d32645f1b7f2fca2e739172a10f07 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-22T07:40:34.663 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:34 smithi134 podman[148199]: 2024-03-22 07:40:34.664233794 +0000 UTC m=+0.452426291 container attach d53df96cc22f07b01711c34fbe3865e6493d32645f1b7f2fca2e739172a10f07 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-22T07:40:35.045 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:34 smithi134 podman[148199]: 2024-03-22 07:40:34.866899746 +0000 UTC m=+0.655092228 container died d53df96cc22f07b01711c34fbe3865e6493d32645f1b7f2fca2e739172a10f07 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b) 2024-03-22T07:40:35.393 INFO:journalctl@ceph.osd.2.smithi134.stdout:Mar 22 07:40:35 smithi134 podman[148225]: 2024-03-22 07:40:35.375806657 +0000 UTC m=+0.503861381 container remove d53df96cc22f07b01711c34fbe3865e6493d32645f1b7f2fca2e739172a10f07 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307) 2024-03-22T07:40:35.398 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.2.service' 2024-03-22T07:40:35.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:35.440 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-22T07:40:35.441 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-22T07:40:35.441 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.3 2024-03-22T07:40:35.751 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:35 smithi195 systemd[1]: Stopping Ceph osd.3 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:36.204 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:35 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:40:35.750+0000 7ffb613e8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:36.204 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:35 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:40:35.750+0000 7ffb613e8700 -1 osd.3 84 *** Got signal Terminated *** 2024-03-22T07:40:36.205 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:35 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3[91907]: 2024-03-22T07:40:35.750+0000 7ffb613e8700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:40:38.205 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:37 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:37.768+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:39.204 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:38 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:38.801+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:40.204 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:39 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:39.848+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:41.118 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:40 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:40.838+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:41.454 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:41 smithi195 podman[118668]: 2024-03-22 07:40:41.25411697 +0000 UTC m=+5.622141015 container died 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-22T07:40:41.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:41 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:41.119+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:41.850 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:41 smithi195 podman[118668]: 2024-03-22 07:40:41.693275671 +0000 UTC m=+6.061299712 container cleanup 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, RELEASE=squid-db0330b) 2024-03-22T07:40:41.851 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:41 smithi195 bash[118668]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3 2024-03-22T07:40:42.123 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:41 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:41.849+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:42.123 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:41 smithi195 podman[118696]: 2024-03-22 07:40:41.886670516 +0000 UTC m=+0.626019989 container remove 0c89d39751da5ef606123a552ba97f3519bcf9cb8ce53c7ab4a09354cbb1e0ea (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-22T07:40:42.426 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:42 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:42.123+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:42.427 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:42 smithi195 podman[118791]: 2024-03-22 07:40:42.210276064 +0000 UTC m=+0.017141945 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:40:42.427 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:42 smithi195 podman[118791]: 2024-03-22 07:40:42.312480517 +0000 UTC m=+0.119346427 container create 11dd7ebb6c58b786b1f1584bdab6409f2e453e9d365e7e6609de4495a165301e (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, RELEASE=squid-db0330b) 2024-03-22T07:40:42.704 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:42 smithi195 podman[118791]: 2024-03-22 07:40:42.556678997 +0000 UTC m=+0.363544873 container init 11dd7ebb6c58b786b1f1584bdab6409f2e453e9d365e7e6609de4495a165301e (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240307, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-22T07:40:42.705 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:42 smithi195 podman[118791]: 2024-03-22 07:40:42.55978838 +0000 UTC m=+0.366654256 container start 11dd7ebb6c58b786b1f1584bdab6409f2e453e9d365e7e6609de4495a165301e (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-db0330b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307) 2024-03-22T07:40:42.705 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:42 smithi195 podman[118791]: 2024-03-22 07:40:42.614908144 +0000 UTC m=+0.421774010 container attach 11dd7ebb6c58b786b1f1584bdab6409f2e453e9d365e7e6609de4495a165301e (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307) 2024-03-22T07:40:43.134 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:42 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:42.839+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:43.134 INFO:journalctl@ceph.osd.3.smithi195.stdout:Mar 22 07:40:42 smithi195 podman[118791]: 2024-03-22 07:40:42.858976227 +0000 UTC m=+0.665842102 container died 11dd7ebb6c58b786b1f1584bdab6409f2e453e9d365e7e6609de4495a165301e (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240307, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-22T07:40:43.426 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:43 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:43.139+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:43.449 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.3.service' 2024-03-22T07:40:43.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:43.495 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-22T07:40:43.495 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-22T07:40:43.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.4 2024-03-22T07:40:43.704 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:43 smithi195 systemd[1]: Stopping Ceph osd.4 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:44.094 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:43 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:43.829+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:44.095 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:43 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:43.830+0000 7f9d08b20700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:44.095 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:43 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:43.830+0000 7f9d08b20700 -1 osd.4 84 *** Got signal Terminated *** 2024-03-22T07:40:44.095 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:43 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:43.830+0000 7f9d08b20700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:40:44.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:44 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:44.095+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:45.204 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:44 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:44.817+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:45.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:45 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:45.057+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:46.081 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:45 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:45.786+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:46.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:46 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:46.081+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:47.073 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:46 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:46.807+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:47.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:47 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:47.073+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:48.096 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:47 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:47.825+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:48.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:48 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:48.096+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:48.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:48 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:48.096+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:49.205 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:48 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:48.820+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:11.650434+0000 front 2024-03-22T07:40:11.650338+0000 (oldest deadline 2024-03-22T07:40:37.550397+0000) 2024-03-22T07:40:49.205 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:48 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4[97238]: 2024-03-22T07:40:48.820+0000 7f9d0190d700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.452066+0000 front 2024-03-22T07:40:24.452001+0000 (oldest deadline 2024-03-22T07:40:48.551986+0000) 2024-03-22T07:40:49.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:49 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:49.047+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:49.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:49 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:49.047+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:49.546 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:49 smithi195 podman[118896]: 2024-03-22 07:40:49.250213684 +0000 UTC m=+5.567023620 container died b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-db0330b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-22T07:40:49.546 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:49 smithi195 podman[118896]: 2024-03-22 07:40:49.547024893 +0000 UTC m=+5.863834837 container cleanup b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240307, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-db0330b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-22T07:40:49.954 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:49 smithi195 bash[118896]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4 2024-03-22T07:40:49.954 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:49 smithi195 podman[118914]: 2024-03-22 07:40:49.773593149 +0000 UTC m=+0.517399711 container remove b36ec1b7a8f7517fdbf4db4683c748d4347dc57bc6908fa3301758b8df7c878d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4, RELEASE=squid-db0330b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-22T07:40:50.334 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:50 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:50.089+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:50.335 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:50 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:50.089+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:50.335 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:50 smithi195 podman[119006]: 2024-03-22 07:40:50.066034898 +0000 UTC m=+0.096666413 container create 20e035cfa9adee6f6f8645f1df9f94ffa1494eb77d4eda8284ea343c88d3fb00 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, GIT_CLEAN=True, org.label-schema.build-date=20240307, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-22T07:40:50.335 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:50 smithi195 podman[119006]: 2024-03-22 07:40:49.98683908 +0000 UTC m=+0.017470562 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:40:50.335 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:50 smithi195 podman[119006]: 2024-03-22 07:40:50.335738546 +0000 UTC m=+0.366370029 container init 20e035cfa9adee6f6f8645f1df9f94ffa1494eb77d4eda8284ea343c88d3fb00 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-db0330b) 2024-03-22T07:40:50.616 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:50 smithi195 podman[119006]: 2024-03-22 07:40:50.339308745 +0000 UTC m=+0.369940222 container start 20e035cfa9adee6f6f8645f1df9f94ffa1494eb77d4eda8284ea343c88d3fb00 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-22T07:40:50.616 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:50 smithi195 podman[119006]: 2024-03-22 07:40:50.427029853 +0000 UTC m=+0.457661336 container attach 20e035cfa9adee6f6f8645f1df9f94ffa1494eb77d4eda8284ea343c88d3fb00 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-db0330b, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-22T07:40:50.912 INFO:journalctl@ceph.osd.4.smithi195.stdout:Mar 22 07:40:50 smithi195 podman[119006]: 2024-03-22 07:40:50.617603501 +0000 UTC m=+0.648234974 container died 20e035cfa9adee6f6f8645f1df9f94ffa1494eb77d4eda8284ea343c88d3fb00 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-22T07:40:51.204 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:51.115+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:51.205 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:51.115+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:51.227 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.4.service' 2024-03-22T07:40:51.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:51.271 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-22T07:40:51.271 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-22T07:40:51.271 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5 2024-03-22T07:40:51.625 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:51 smithi195 systemd[1]: Stopping Ceph osd.5 for 5a05dc38-e81c-11ee-95cd-87774f69a715... 2024-03-22T07:40:51.625 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:51.625+0000 7fec495d0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-22T07:40:51.625 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:51.625+0000 7fec495d0700 -1 osd.5 84 *** Got signal Terminated *** 2024-03-22T07:40:51.625 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:51 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:51.625+0000 7fec495d0700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-22T07:40:52.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:52 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:52.080+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:52.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:52 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:52.080+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:53.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:53 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:53.067+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:53.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:53 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:53.067+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:54.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:54 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:54.073+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:54.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:54 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:54.073+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:55.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:55 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:55.072+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:55.455 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:55 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:55.072+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:56.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:56 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:56.108+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6806 osd.0 since back 2024-03-22T07:40:14.263909+0000 front 2024-03-22T07:40:14.263896+0000 (oldest deadline 2024-03-22T07:40:40.163825+0000) 2024-03-22T07:40:56.454 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:56 smithi195 ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5[102566]: 2024-03-22T07:40:56.108+0000 7fec463c5700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.134:6814 osd.1 since back 2024-03-22T07:40:24.264850+0000 front 2024-03-22T07:40:24.264874+0000 (oldest deadline 2024-03-22T07:40:47.164751+0000) 2024-03-22T07:40:57.298 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:56 smithi195 podman[119112]: 2024-03-22 07:40:56.978868263 +0000 UTC m=+5.491977923 container died 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240307, RELEASE=squid-db0330b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-22T07:40:57.299 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:57 smithi195 podman[119112]: 2024-03-22 07:40:57.299694407 +0000 UTC m=+5.812804057 container cleanup 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=squid-db0330b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-22T07:40:57.704 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:57 smithi195 bash[119112]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5 2024-03-22T07:40:57.704 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:57 smithi195 podman[119133]: 2024-03-22 07:40:57.459571642 +0000 UTC m=+0.480505200 container remove 81581d5a70dadce7ecd391f4fff5eaed2453072df361cfc6c16c1538993fc6e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5, org.label-schema.build-date=20240307, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-db0330b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-22T07:40:58.103 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:57 smithi195 podman[119225]: 2024-03-22 07:40:57.851899664 +0000 UTC m=+0.112094098 container create 00347de11114f4fc44cd51e47d15c67f52e73f0d2b36e13998cf7276fdc002b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240307, org.label-schema.license=GPLv2, RELEASE=squid-db0330b, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-22T07:40:58.104 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:57 smithi195 podman[119225]: 2024-03-22 07:40:57.758089853 +0000 UTC m=+0.018284305 image pull 4f325f8440e9c0f506d7739caefa90a7992ee8ebee3932602ec2cb63e901d08d quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10 2024-03-22T07:40:58.104 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 podman[119225]: 2024-03-22 07:40:58.104578596 +0000 UTC m=+0.364773044 container init 00347de11114f4fc44cd51e47d15c67f52e73f0d2b36e13998cf7276fdc002b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, RELEASE=squid-db0330b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240307) 2024-03-22T07:40:58.396 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 podman[119225]: 2024-03-22 07:40:58.107648661 +0000 UTC m=+0.367843096 container start 00347de11114f4fc44cd51e47d15c67f52e73f0d2b36e13998cf7276fdc002b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240307, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-22T07:40:58.396 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 podman[119225]: 2024-03-22 07:40:58.187702406 +0000 UTC m=+0.447896857 container attach 00347de11114f4fc44cd51e47d15c67f52e73f0d2b36e13998cf7276fdc002b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240307) 2024-03-22T07:40:58.698 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 podman[119225]: 2024-03-22 07:40:58.397531905 +0000 UTC m=+0.657726332 container died 00347de11114f4fc44cd51e47d15c67f52e73f0d2b36e13998cf7276fdc002b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-db0330b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240307, ceph=True) 2024-03-22T07:40:58.937 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5.service' 2024-03-22T07:40:58.954 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 podman[119252]: 2024-03-22 07:40:58.9159895 +0000 UTC m=+0.512754332 container remove 00347de11114f4fc44cd51e47d15c67f52e73f0d2b36e13998cf7276fdc002b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3031fd9fa3ec502ba783e14433a4d3ebf8f66e5c31d12a3a8cd7e489d3d4d10, name=ceph-5a05dc38-e81c-11ee-95cd-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-db0330b, org.label-schema.build-date=20240307, org.label-schema.vendor=CentOS) 2024-03-22T07:40:58.954 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5.service: Deactivated successfully. 2024-03-22T07:40:58.954 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 systemd[1]: Stopped Ceph osd.5 for 5a05dc38-e81c-11ee-95cd-87774f69a715. 2024-03-22T07:40:58.955 INFO:journalctl@ceph.osd.5.smithi195.stdout:Mar 22 07:40:58 smithi195 systemd[1]: ceph-5a05dc38-e81c-11ee-95cd-87774f69a715@osd.5.service: Consumed 5.278s CPU time. 2024-03-22T07:40:58.979 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-22T07:40:58.979 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-22T07:40:58.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-22T07:41:18.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-22T07:41:32.494 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:41:32.530 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-22T07:41:32.559 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-22T07:41:32.561 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/remote/smithi134/crash 2024-03-22T07:41:32.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/crash -- . 2024-03-22T07:41:32.599 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-22T07:41:32.599 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-03-22T07:41:32.601 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/remote/smithi195/crash 2024-03-22T07:41:32.602 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/crash -- . 2024-03-22T07:41:32.628 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-22T07:41:32.628 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2024-03-22T07:41:32.629 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-22T07:41:32.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-22T07:41:32.678 INFO:teuthology.orchestra.run.smithi134.stdout:1711092373.4359963 mon.smithi134 (mon.0) 713 : cluster [WRN] Replacing daemon mds.cephfs.smithi134.yxdtlb as rank 0 with standby daemon mds.cephfs.smithi134.dexlss 2024-03-22T07:41:32.678 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-22T07:41:32.678 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[SEC\]' /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-22T07:41:32.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]' /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-22T07:41:32.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[WRN\]' /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-22T07:41:32.893 INFO:teuthology.orchestra.run.smithi134.stdout:1711092373.4359963 mon.smithi134 (mon.0) 713 : cluster [WRN] Replacing daemon mds.cephfs.smithi134.yxdtlb as rank 0 with standby daemon mds.cephfs.smithi134.dexlss 2024-03-22T07:41:32.894 INFO:tasks.cephadm:Compressing logs... 2024-03-22T07:41:32.894 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-22T07:41:32.937 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-22T07:41:32.961 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-22T07:41:32.961 INFO:teuthology.orchestra.run.smithi134.stderr:: No such file or directory 2024-03-22T07:41:32.961 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mgr.smithi134.wtwqre.log 2024-03-22T07:41:32.961 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi134.dexlss.log 2024-03-22T07:41:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-22T07:41:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mgr.smithi134.wtwqre.log: /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi134.dexlss.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mon.smithi134.log 2024-03-22T07:41:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi134.yxdtlb.log 2024-03-22T07:41:32.962 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.audit.log: /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mon.smithi134.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.1.log 2024-03-22T07:41:32.964 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-03-22T07:41:32.964 INFO:teuthology.orchestra.run.smithi195.stderr: -- /var/log/ceph/cephadm.log 2024-03-22T07:41:32.964 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mon.smithi195.log 2024-03-22T07:41:32.964 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-22T07:41:32.968 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mon.smithi195.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.4.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi195.jursxo.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.5.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi195.jursxo.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.3.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr: 92.4%/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.3.log: -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log: /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.cephadm.log: 85.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mgr.smithi195.jxfsnc.log 2024-03-22T07:41:32.969 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-volume.log: 91.2% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-22T07:41:32.971 INFO:teuthology.orchestra.run.smithi195.stderr: 87.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-22T07:41:32.971 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi195.dayrmo.log 2024-03-22T07:41:32.974 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi134.yxdtlb.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.0.log 2024-03-22T07:41:32.974 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.1.log: /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-22T07:41:32.974 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-22T07:41:32.974 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log 2024-03-22T07:41:32.975 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.cephadm.log: 85.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-22T07:41:32.975 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.2.log 2024-03-22T07:41:32.975 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log: 87.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-22T07:41:32.975 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-22T07:41:32.975 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.2.log: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-22T07:41:32.990 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mgr.smithi195.jxfsnc.log: /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi195.dayrmo.log: 91.1% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-22T07:41:32.999 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-22T07:41:33.027 INFO:teuthology.orchestra.run.smithi195.stderr: 88.9% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mgr.smithi195.jxfsnc.log.gz 2024-03-22T07:41:33.220 INFO:teuthology.orchestra.run.smithi195.stderr: 92.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mon.smithi195.log.gz 2024-03-22T07:41:33.304 INFO:teuthology.orchestra.run.smithi134.stderr: 88.2% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mgr.smithi134.wtwqre.log.gz 2024-03-22T07:41:33.979 INFO:teuthology.orchestra.run.smithi134.stderr: 90.6% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mon.smithi134.log.gz 2024-03-22T07:41:37.577 INFO:teuthology.orchestra.run.smithi134.stderr: 93.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.2.log.gz 2024-03-22T07:41:38.140 INFO:teuthology.orchestra.run.smithi134.stderr: 94.8% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi134.yxdtlb.log.gz 2024-03-22T07:41:38.392 INFO:teuthology.orchestra.run.smithi195.stderr: 94.8% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi195.dayrmo.log.gz 2024-03-22T07:41:38.530 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.0.log.gz 2024-03-22T07:41:38.827 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.5.log.gz 2024-03-22T07:41:39.274 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.4.log.gz 2024-03-22T07:41:39.659 INFO:teuthology.orchestra.run.smithi195.stderr: 93.4% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.3.log.gz 2024-03-22T07:41:39.971 INFO:teuthology.orchestra.run.smithi195.stderr: 94.8% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi195.jursxo.log.gz 2024-03-22T07:41:39.973 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-03-22T07:41:39.973 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m7.022s 2024-03-22T07:41:39.973 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m30.515s 2024-03-22T07:41:39.973 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m1.092s 2024-03-22T07:41:40.165 INFO:teuthology.orchestra.run.smithi134.stderr: 93.5% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-osd.1.log.gz 2024-03-22T07:43:01.938 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/5a05dc38-e81c-11ee-95cd-87774f69a715/ceph-mds.cephfs.smithi134.dexlss.log.gz 2024-03-22T07:43:01.940 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-03-22T07:43:01.940 INFO:teuthology.orchestra.run.smithi134.stderr:real 1m28.991s 2024-03-22T07:43:01.940 INFO:teuthology.orchestra.run.smithi134.stderr:user 1m49.319s 2024-03-22T07:43:01.940 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m3.430s 2024-03-22T07:43:01.940 INFO:tasks.cephadm:Archiving logs... 2024-03-22T07:43:01.941 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/remote/smithi134/log 2024-03-22T07:43:01.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-22T07:43:19.069 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/remote/smithi195/log 2024-03-22T07:43:19.070 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-22T07:43:22.801 INFO:tasks.cephadm:Removing cluster... 2024-03-22T07:43:22.801 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 --force 2024-03-22T07:43:23.409 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a05dc38-e81c-11ee-95cd-87774f69a715 --force 2024-03-22T07:43:24.068 INFO:tasks.cephadm:Removing cephadm ... 2024-03-22T07:43:24.068 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-22T07:43:24.085 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-22T07:43:24.099 INFO:tasks.cephadm:Teardown complete 2024-03-22T07:43:24.100 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-22T07:43:24.112 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-22T07:43:24.112 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-22T07:43:24.128 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-22T07:43:24.215 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-22T07:43:24.229 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-22T07:43:24.229 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-22T07:43:24.232 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-22T07:43:24.243 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-03-22T07:43:24.245 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-03-22T07:43:24.248 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-22T07:43:24.248 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-03-22T07:43:24.248 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +1931us[+1931us] +/- 122ms 2024-03-22T07:43:24.248 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -1191us[-1186us] +/- 69ms 2024-03-22T07:43:24.248 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +125us[ +130us] +/- 62ms 2024-03-22T07:43:24.248 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:43:24.249 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-22T07:43:24.249 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-03-22T07:43:24.249 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 +1959us[+1959us] +/- 122ms 2024-03-22T07:43:24.249 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -1180us[-1179us] +/- 69ms 2024-03-22T07:43:24.250 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +140us[ +140us] +/- 62ms 2024-03-22T07:43:24.250 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-22T07:43:24.250 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-22T07:43:24.261 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-22T07:43:24.262 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-22T07:43:24.289 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-22T07:43:24.373 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-22T07:43:24.451 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-22T07:43:24.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:43:24.482 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-22T07:43:24.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:43:24.513 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-22T07:43:24.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-22T07:43:24.565 INFO:teuthology.task.internal:Duration was 1957.223559 seconds 2024-03-22T07:43:24.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-22T07:43:24.598 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-22T07:43:24.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-22T07:43:24.601 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-22T07:43:24.642 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-22T07:43:24.644 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-22T07:43:24.835 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-22T07:43:24.835 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-03-22T07:43:24.836 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-22T07:43:24.894 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-03-22T07:43:24.894 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-22T07:43:24.920 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-22T07:43:24.920 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-22T07:43:24.936 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-22T07:43:24.990 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-22T07:43:24.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-22T07:43:25.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-22T07:43:25.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-22T07:43:25.620 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-22T07:43:25.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-22T07:43:25.648 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-22T07:43:25.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-22T07:43:25.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-22T07:43:25.691 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-22T07:43:25.714 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-03-22T07:43:25.741 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-03-22T07:43:25.757 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-22T07:43:25.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:43:25.784 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-22T07:43:25.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-22T07:43:25.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-22T07:43:25.824 INFO:teuthology.task.internal:Transferring archived files... 2024-03-22T07:43:25.825 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/remote/smithi134 2024-03-22T07:43:25.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-22T07:43:25.875 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031/remote/smithi195 2024-03-22T07:43:25.875 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-22T07:43:25.915 INFO:teuthology.task.internal:Removing archive directory... 2024-03-22T07:43:25.915 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-22T07:43:25.917 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-22T07:43:25.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-22T07:43:25.976 INFO:teuthology.task.internal:Not uploading archives. 2024-03-22T07:43:25.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-22T07:43:26.042 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-22T07:43:26.043 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-22T07:43:26.045 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-22T07:43:26.057 INFO:teuthology.orchestra.run.smithi134.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 22 07:43 /home/ubuntu/cephtest 2024-03-22T07:43:26.059 INFO:teuthology.orchestra.run.smithi195.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 22 07:43 /home/ubuntu/cephtest 2024-03-22T07:43:26.060 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-22T07:43:26.075 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-22T07:43:26.141 INFO:teuthology.nuke:Checking targets against current locks 2024-03-22T07:43:26.167 DEBUG:teuthology.nuke:shortname: smithi134 2024-03-22T07:43:26.167 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-22T07:43:26.193 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-22 07:01:58.938183', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAcqXMhTls3FT7xL+yVpzauANSZZY/lcNSZAjz1U2bpDW8extONAzceZP03Ao8jn/35Hv62Aumdg4/tGMcdplMA='} 2024-03-22T07:43:26.196 DEBUG:teuthology.nuke:shortname: smithi195 2024-03-22T07:43:26.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-22T07:43:26.220 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-22_02:08:13-upgrade-squid-distro-default-smithi/7616031', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-22 07:01:58.939817', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDeaxG++idYksphzV1KC9E74pqZDFOxehKK7e1lTaMu1GMl2yeuSCKKISGejv5KZ1SbpXnP7HWhDxcnYUH791Yg='} 2024-03-22T07:43:26.250 INFO:teuthology.orchestra.console.smithi134:Power off 2024-03-22T07:43:26.250 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-22T07:43:26.273 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-03-22T07:43:26.274 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:26.287 INFO:teuthology.orchestra.console.smithi195:Power off 2024-03-22T07:43:26.287 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-22T07:43:26.297 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-22T07:43:26.309 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-03-22T07:43:26.309 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:26.333 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-03-22T07:43:30.297 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:30.334 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:30.408 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-22T07:43:30.442 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-03-22T07:43:34.410 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:34.443 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:34.522 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-22T07:43:34.554 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-22T07:43:34.655 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-03-22T07:43:38.527 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-22T07:43:38.637 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-03-22T07:43:38.738 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-03-22T07:43:38.842 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1957.223559141159 failure_reason: '"1711092373.4359963 mon.smithi134 (mon.0) 713 : cluster [WRN] Replacing daemon mds.cephfs.smithi134.yxdtlb as rank 0 with standby daemon mds.cephfs.smithi134.dexlss" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-03-22T07:43:38.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-22T07:43:38.925 INFO:teuthology.run:FAIL